Linked Data Applications: There is no One-Size-Fits-All Formula

Transcription

1 Linked Data Applications: There is no One-Size-Fits-All Formula Asunción Gómez-Pérez Facultad de Informática, Universidad Politécnica de Madrid Campus de Montegancedo sn, Boadilla del Monte, Madrid Acknowledgements: O.Corcho, D. Garijo, D. Vila, L.Vilches, B. Villazón Work distributed under the license Creative Commons Attribution-Noncommercial-Share Alike 3.0

2 Table of content 1. Introduction and Motivation 2. The process 3. Examples Libraries: Geo: Metereology: Travelling: 2

3 Ontology Engineering Group Director: A. Gómez-Pérez Research Group (33 people) A. Gomez-Perez O. Corcho G. Aguado B. Villazon Participation in more than 15 EU projects, (3 as coordinator) Collaboration with many companies,,, 3

4 Ontology Engineering Group Research Areas Linked Data Semantic e-science (Data Integration, Ontological Engineering Semantic Grid) 1995 (Social) Semantic Web 2000 Natural Language Processing and Multilingualism 1997

5 Center for Open Middleware Technology center funded by the Santander Group Bank Associated Software companies 1M /year during the next five years Mission: Open innovation ecosystem based on open software component developments Managing open source software and products with LD 5

6 Linked data project at the Ontology Engineering Group Morph NOR 2 O Geometry2RDF Marimba SPARQL -Stream Sem4Tags geo REST service annotation shp2rdf RDF and Linking Visualization Map4RDF Linked Library Data Visualisation Sensor Data Visualisation 6

7 Geo: Linked data: applications Travelling: Libraries: Metereology: 7

8 Table of content 1. The concept 2. The process 3. Examples Specification Modelling RDF Links Publication Exploitation 8

9 Table of content 1. The concept 2. The process 3. Examples Libraries: Geo: Metereology: Travelling: 9

10 MARC21 Specification Modelling Different communication formats: MARC 21 format for Bibliographic Data MARC 21 format for Authority Data Others: Holdings, Classification, etc. RDF Links Publication Exploitation Three main elements: Record structure: ISO Fields, indicators, subfields Content designation: "Meaning" of codes and conventions Content: Defined outside the MARC standard (ISBD, AACR..) So, RDBtoRDF technologies were not appropriate for this task. 11

11 BNE Specification Modelling Records in the MARC 21 format 3.9 million bibliographical records 4.2 million authority records Version: November, 2011 RDF AUTHORITY BIBLIOGRAPHIC Links Publication Exploitation Persons Corporate bodies Conferences Titles Subject Maps Sound recordings Gravings, drawings, pictures Manuscripts Ancient books Modern books Scores 3021 Electronic resources Serials Videos 12

12 MARC21 record structure Specification Authority record: Camus, Albert* Field Subfield Subfield Control Field Content Content 001 XX nn aijnnaabn n aaa 016 $a BNE $a SpMaBN $b spa $c SpMaBN $e rdc $f embne $a Camus, Albert $d $a El mite de Sísif, 1987 $b port. (Albert Camus) 670 $a Dic. de filosofía, de J. Ferrater Mora, 1980$b(Camus., Albert ( ); n. Mondovi, Argel) 670 $a Aut. BN-OPALE, 1995 $b (Camus, Albert) * HEADING 1XX 13

13 MARC21 record content designation Authority record: Camus, Albert* Control Number Personal name Name 001 XX HEADING Personal $a Camus, Albert Name 100 Dates associated with name $d Source consulted Citation 670 $a El mite de Sísif, 1987 $b port. (Albert Camus) Human reading: An authority record that describes a Person, named Camus, Albert with associated dates * 14

14 Frecuency of codes in records Specification Modelling RDF Links Publication Exploitation 15

15 Specification Specification Source data: MARC 21 records, not RDB. Very flat structure difficult to map to richer models Modelling RDF Links Publication Exploitation Domain experts (catalogers) need to be part of the mapping process. Highly specialized library models: FRBR, ISBD. Data quality good but still many errors: data curation during the LD generation process Iterative and incremental transformation process: measure coverage and progress. Multilinguality, collaboration with IFLA

16 Modelling: Ontologies and Terminology Specification Modelling RDF Links Publication Shared Understanding Exploitation

17 Model: FRBR at a glance Specification Work 2 Works Modelling Work 1 Work 3 RDF Links Expression1 Expression 2 Expressions Publication Exploitation Manifestation1 Manifestation2 Manifestations 18

18 The Ontology: based on IFLA vocabularies Specification Modelling RDF Links Publication Exploitation

19 Who will be the mapping generator? Specification Modelling RDF Links 001 XX nn aijnnaabn n aaa 016 $a BNE $a SpMaBN $b spa $c SpMaBN $e rdc $f embne $a Camus, Albert $d $a El mite de Sísif, 1987 $b port. (Albert Camus) 670 $a Dic. de filosofía, de J. Ferrater Mora, 1980$b(Camus., Albert ( ); n. Mondovi, Argel) 670 $a Aut. BN-OPALE, 1995 $b (Camus, Albert) Publication Exploitation BNE

20 Similar to mapping ontologies 100a maps Person Content (100a) contained in Content (100at) maps is creator of 100at maps Work subfield property 100t maps title of work 21

21 Marimba software Marimba allows librarians to create mappings between MARC21 records and IFLA vocabularies using spreadsheets Annotation mapping Classification mapping Relationships mapping MARC21 info Basic structure Records count Content sample Mapping 100 $a $d Camus, Albert $a Cervantes, Miguel de foaf:person foaf:name 100 $a $m Cervantes, iguel ERROR 22

22 Classification mapping Librarians create mappings using excell Classification mapping Annotation mapping MARC21 info Basic structure Records count Content sample Mapping 100 $a $d Camus, Albert $a Cervantes, Miguel de foaf:person foaf:name 100 $a $m Cervantes, iguel ERROR Relationships mapping 23

23 Librarians create mappings using excell Annotation mapping place of publication has dimensions Is part of work Relationships mapping 24

24 Marimba interprets the Mappings and generate the RDF Specification Modelling RDF Links 001 XX $a Camus, Albert $d Classify: Exploiting the heading field and subfield codes. 100 $a $d Person (it has a personal name) 100 $a $d $t Work (it has a title) Annotate: Using subfield codes and the content. 100 $a "Camus, Albert" frbr:3001 "Camus, Albert" 100 $t "La Peste" frbr:p3039 "La Peste" Publication Exploitation BNE MARC 21 record (Input) Action RDF (Output) 100 $a $d Classify rdf:type frbr:c $a Camus, Albert Annotate frbr:p3039 "Camus, Albert" 100 $d Annotate frbr:p3040 " " 25

25 Mapping process more in detail RDF But, what about the relationships between the entities? Relationships between records are not explicit in MARC. Goal: The work "La Peste" was created by Albert Camus 001 XX XX $a Camus, Albert $d $a Camus, Albert$d $tla peste Common Common Diff Person Work We know the type of R1 and R2, and we look at the heading diff bne:xx frbr:2010 bne:xx (iscreatorof) * 26

26 Specification (MARC records) Marimba: Mapping process summary 001 XX XX Modelling RDF Links Publication Exploitation BNE $a Camus, Albert $d Classify bne:xx a frbr:person Annotate bne:xx a frbr:person frbr:name "Camus, Albert". frbr:hasdates Relate bne:xx a frbr:person frbr:name "Camus, Albert". frbr:hasdates frbr:iscreatorof bne:xx $a Camus, Albert$d $tla peste bne:xx a frbr:work bne:xx a frbr:work frbr:title "La Peste" bne:xx a frbr:work frbr:title "La Peste". frbr:iscreatedby bne:xx

27 Marimba uses the ontology to generate RDF Specification Modelling RDF Links Publication Exploitation BNE

28 Marimba links with other resources: VIAF, DNB, SUDOC, LIBRIS, DBpedia Specification DNB Modelling VIAF RDF Same As Same As Links Same As DBpedia Publication Same As BNE Exploitation Same As SUDOC LIBRIS

29 Publicación Specification Modelling RDF Links Publication Exploitation Data publication Metadata publicacion using VOID To facilitate the discovery Register in CKAN your dataset Use to sitemap4rdf to generate the site map Upload the site map to Google and Sindice

30 Especification Specification Modelling RDF generation Links Publication Exploitation Publication Exploitation 34

31 Modelling: based on IFLA Vocabularies Open Metadata Registry Neon Toolkit Technological Support Mapping and generation MARiMbA: Library-oriented, supports and facilitates the entire process od transformation from MARC21 to RDF Publication: Virtuoso Universal Server Pubby CKAN registry Sitemap4rdf Exploitation: Web Applications that visualize data using SPARQL

32 Table of content 1. The concept 2. Foundations 3. The process 4. Examples Libraries: Geo: Metereology: Travelling: 37

33 Specification Uniform access to the Spanish Geographical Institute Databases RDF from DB 7 geographical DB Granularity Scale Multilingual Geometry2RDF Geometry column shp2rdf NOR 2 O Model haslat/long W3C Vocabulary WGS84 4 haslat/long hasstatisticaldata O. Statistics SCOVO hydrontology haslocation/islocated FAO on UNESCO EGM / ERM GeoNames 4 hasgeometry GML hasgeometry FAO Geopolitical ontology O. Time W3C Time Legend 4 GML Specification Ontology Specification 4 Thesaurus

34 aemet.linkeddata.es

35 webenemasuno.linkeddata.es/

36 Phase/Domain Modeling Library (BNE) Goegraphic (IGN, Otalex) hydrontology Meteorology (AEMET) Travelling (PRISA) Wgs84 SSN ontology SIOC PROV DC time PROV PROV Statistic (INE) Scovo Data cube MARiMbA RDF generation geometry2rdf NOR2O CSV parser CSV parser NOR2O Links generation DNB VIAF LIBRIS DBPEDIA Silk Silk Silk DBPEDIA DBPEDIA Geolinkeddata.es Geonames Geolinkeddata.es NOR2O Geolinkeddata.es Publication Pubby sitemap4rdf Exploitation SPARQL map4rdf 43

37 Results Total number of authority records: Total number of bibliographic records: Total number of RDF triples: Links (15% authority): Linked sources: VIAF SUDOC (Sistema Universitario de Documentación) FR GND (Auth German National Library) GER LIBRIS Sweden DBPedia Total number of guides: Total number of posts: Total number of locations: Total number of RDF triples: Linked sources: DBPedia (6024 links) GeoLinkedData (6726 links) Number of geo type phenomenon: 95 (Rivers, mountains, etc.) Number of geo entities: Total number of RDF triples: Links: 1002 (outlinks) y 6782 (coming) Linked sources: DBpedia y GeoNames (outlinks) AEMET y El Viajero (entry) 44

38 Linked Data Applications: There is no One-Size-Fits-All Formula Asunción Gómez-Pérez Facultad de Informática, Universidad Politécnica de Madrid Campus de Montegancedo sn, Boadilla del Monte, Madrid Acknowledgements: O.Corcho, D. Garijo, D. Vila, L.Vilches, B. Villazón Work distributed under the license Creative Commons Attribution-Noncommercial-Share Alike 3.0