Introduction to the Open Refine RDF tool. March 2014 PwC EU Services

Transcription

1 Introduction to the Open Refine RDF tool March 2014 PwC EU Services

2 Learning objectives By the end of this module, you will have an understanding of: How to easily describe your solutions using a pre-defined template compliant with ADMS-AP. How to automatically transform your solutions descriptions into machine readable language, i.e., RDF. How to get your interoperability solutions ready to be shared on Joinup. 2

3 How can this tutorial help you to use ADMS-AP? This tutorial shows how you can generate ADMS- AP-compliant descriptions of your interoperability solutions from a spreadsheet using the RDF extension in Open Refine. What is the ADMS-AP? The ADMS-AP (Asset Description Metadata Schema Application Profile for Joinup) allows publishers of interoperability solutions to easily share their description metadata on Joinup using a common vocabulary, and consequently enabling the reuse possibilities of their solutions by a wider audience. For more info about ADMS-AP: ngs/introduction_to_adms-ap.pptx More than 35 repositories from EU Member States, EU Institutions (such as the Publications Office and Eurostat), standardisation bodies (such as W3C, CEN and the DCMI), and EU cofunded initiatives (such as e- CODEX) have shared description metadata of their interoperability solutions on the catalogue on Joinup 3

4 Outline 1. The context ADMS-AP for describing your interoperability solutions Automatic or manual path to generate ADMS-AP compliant RDF 2. The manual path Using the spreadsheet Importing into Open Refine Adding the skeleton Exporting 3. A practical example 4

5 ADMS-AP for describing your interoperability solutions on Joinup Public administrations Repository Academic Explore Find Select Obtain Using the ADMS Application Profile ADMS-AP Your Repository Repository Standardisation bodies Repository Businesses 5

6 Automatic or manual path to generate ADMS-AP Transformation with Open Refine Your repository of interoperability solutions Cleansing with SPARQL See how to cleanse RDF with SPARQL: to_metadata_cleansing.pptx 6

7 Outline 1. The context ADMS-AP for describing your interoperability solutions Automatic or manual path to generate ADMS-AP compliant RDF 2. The manual path Using the spreadsheet Importing into Open Refine Adding the skeleton Exporting 3. A practical example 7

8 This tutorial will describe the 4 steps of the MANUAL path for transforming your interoperability solution s description into an ADMS-AP-compliant description: 1. Use the spreadsheet template to describe your solution project, releases, packages, etc. 2. Import your spreadsheet in Open Refine 3. Add the pre-defined mappings using the Open Refine RDF extension 4. Export to RDF using the Open Refine RDF extension 8

9 1. Use the spreadsheet template to describe your solution getting the template Click on the following link to get the Excel template 9

10 1. Use the spreadsheet template to describe your solution understanding the template The spreadsheet template contains all concepts and fields included in the ADMS Application Profile. To describe your solution you have to fill in the different fields of the spreadsheet according to the following colour codes: 10

11 1. Use the spreadsheet template to describe your solution some spreadsheets refer to controlled vocabulary The following sheets help you to select the right codes when completing the classes fields: Asset_Type Publisher_Type Status License_Type Theme_Taxonomy Theme File_Format Geographic_Coverage Example: the field theme in the Asset sheet has to be in the format based on the controlled vocabulary described in the Theme sheet. Representation_Technique Operating_System Interoperability_level Language User_Interface_Type Programming_Language 11

12 2. Import your spreadsheet into Open Refine getting Open Refine and the RDF extension Download Open Refine from this link Note that Open Refine does not work properly on Internet Explorer Download the RDF extension from this link Install RDF extension into Open Refine following the installation guide 12

13 2. Import your spreadsheet into Open Refine creating your project Import the Excel file you completed in step 1 Fill in the following parameters: Create your project 13

14 3. Add the pre-defined mapping using the Open Refine RDF extension understanding the RDF skeleton What Why How The Open Refine RDF extension allows you to map the current fields of your data to the required RDF structure by drawing a so-called RDF Skeleton. The RDF skeleton specifies how the RDF data will get generated from your own data. The cells in each record of your data will get placed into nodes within the skeleton that conforms to the ADMS-AP. Even though it is possible to build the RDF Skeleton manually, it is easier here to reapply the operation history that contains all operations required to build the RDF Skeleton from the template. 14

15 3. Add the pre-defined mapping using the Open Refine RDF extension applying the operations history 1. Click Undo/Redo > Apply 2. Paste the operation history 3. Click Perform Operations 4. Click RDF > Edit RDF Skeleton... and verify that the RDF Skeleton has been created 15

16 3. Add the pre-defined mapping using the Open Refine RDF extension aligning the RDF schema By clicking on RDF > Edit RDF Skeleton..., you can check/modify the current mapping between your data and the RDF skeleton. 16

17 4. Export to RDF using the Open Refine RDF extension the final step Now everything is in place to generate an ADMS RDF file, containing your solution s description. Click Export > RDF in Turtle to get an RDF description of your solution 17

18 Outline 1. The context ADMS-AP for describing your interoperability solutions Automatic and manual path to generate ADMS-AP compliant RDF 2. The manual path Using the spreadsheet Importing into Open Refine Adding the skeleton Exporting 3. A practical example 18

19 Practical example describe your asset CLASS PROPERTY EXAMPLE OF VALUE Asset (models an interoperability solution) Publisher AssetURI Theme (controlled voc.) Description Description of the asset Modified Publisher Name Type (controlled voc.) PublisherURI Name Publisher type label (controlled voc.) Publisher type (controlled voc.) The name of the asset nt The name of the publisher National authority thority Note that for simplifying the example, we only filled up the mandatory classes with their mandatory properties. 19

20 Practical example describe your asset Use the template to describe your asset: Asset Publisher 20

21 Practical example import your description Import the Asset and Publisher descriptions into Open Refine 21

22 Practical example map to the RDF Skeleton Copy/Paste the operation history for building the ADMS-AP RDF Skeleton 22

23 Practical example export your RDF description to Turtle or RDF/XML Turtle RDF/XML For more info about RDF: 23

24 Upload your metadata to Joinup The following tutorial helps you uploading your ADMS-AP RDF containing the descriptions of your solutions to Joinup How to import and export ADMS-AP conform metadata of interoperability solutions on Joinup 24

25 Related learning resources Introduction to ADMS-AP How to import and export ADMS-AP conform metadata of interoperability solutions on Joinup Introduction to metadata cleansing using SPARQL Using Joinup as catalogue for interoperability solutions Introduction to the advanced search functionality of EFIR 25

26 Disclaimers 1. The views expressed in this presentation are purely those of the authors and may not, in any circumstances, be interpreted as stating an official position of the European Commission. The European Commission does not guarantee the accuracy of the information included in this presentation, nor does it accept any responsibility for any use thereof. Reference herein to any specific products, specifications, process, or service by trade name, trademark, manufacturer, or otherwise, does not necessarily constitute or imply its endorsement, recommendation, or favouring by the European Commission. All care has been taken by the author to ensure that s/he has obtained, where necessary, permission to use any parts of manuscripts including illustrations, maps, and graphs, on which intellectual property rights already exist from the titular holder(s) of such rights or from her/his or their legal representative. 2. This presentation has been carefully compiled by PwC, but no representation is made or warranty given (either express or implied) as to the completeness or accuracy of the information it contains. PwC is not liable for the information in this presentation or any decision or consequence based on the use of it. PwC will not be liable for any damages arising from the use of the information contained in this presentation. The information contained in this presentation is of a general nature and is solely for guidance on matters of general interest. This presentation is not a substitute for professional advice on any particular matter. No reader should act on the basis of any matter contained in this publication without considering appropriate professional advice.

27 Project Officer Contractors Visit our initiatives Get involved ADMS. SW CISR COMMUNITY OF INTEROPERABILITY SOLUTION REPOSITORIES on Twitter Join the CISR community on Joinup Joinup and ADMS are funded by the ISA Programme 27