Lider Roadmapping Workshop

Transcription

1 Deutsche Nationalbibliothek Software-supported Bibliographic Recording and Linked Data Lider Roadmapping Workshop Mark Zöpfgen Leipzig,

2 Overview - DNB German National Library - Activities in Content Extraction and Semantic Web - MACS - PETRUS - Open Linked Data - Motivation/Challenges 2 Lider-Roadmapping-Workshop Leipzig

3 DNB the German National Library - central archival library and national bibliographic center for the Federal Republic of Germany - collect, permanently archive, comprehensively document and record bibliographically all German and German-language publications since 1913, foreign publications about Germany, translations of German works (German National Bibliography) - produces (in collaboration with other institutions the Integrated Authority File (GND, Gemeinsame Normdatei ) - makes them available to the public - develops and maintains bibliographic rules and standards for Germany - plays a significant role in the development of international library standards. Inventory: ~ 27,8 bibliographical units; ~ online - publications (mainly pdf and epub) 3 Lider-Roadmapping-Workshop Leipzig

4 Location in Leipzig Location in Frankfurt 4 Lider-Roadmapping-Workshop Leipzig

5 Activities in the Context of Content extraction and Semantic Web: Contentus CrissCross Culturegraph Linked Data Service MACS Unidissen VIAF PETRUS For more information see: 5 Lider-Roadmapping-Workshop Leipzig

6 MACS Multilingual Access to Subjects I/IV - Creation of a multilingual retrieval-vocabulary for research in bibliograpic databases. - Links between Subject Headings of LCSH (Library of Congress Subject Headings), RAMEAU (Répertoire d'autorité-matière encyclopédique et alphabétique unifié) and GND (Gemeinsame Normdatei) - In cooperation with SNB (Swiss National Library) - Currently ~ Links wich have been imported to the GND-records Use Cases Make data of DNB internationally available (search via LCSH/RAMEAU-subject headings) Search in the Library of Congress /Bibliothèque de France with GND-subject headings Possibility to overtake subject headings from bibliographical records (e.g. in case of translations) - Link: 6 Lider-Roadmapping-Workshop Leipzig

7 MACS Multilingual Access to Subjects II/IV Maintenance: The links are created/updated using the LMI (Link Management Interface). The LMI provides a web-interface, data is stored in a central database. Data Export / Import: The links are exported via OAI-Interface. The import to the CBS (Central Bibliographic Database) is currently done by script (manually initiated) Planned: Integration in the search-portal of TEL (The European Library) Provision via linked data service (actually not integrated) Regular update between LMI and CBS 7 Lider-Roadmapping-Workshop Leipzig

8 MACS Multilingual Access to Subjects III/IV 8 Lider-Roadmapping-Workshop Leipzig

9 MACS Multilingual Access to Subjects IV/IV 9 Lider-Roadmapping-Workshop Leipzig

10 Petrus Software-supported Bibliographical Recording I/V Why software supported? Growing number of online publications (see graphic below). The German National Library is looking to reduce its traditional indexing operations in areas which are no longer feasible due to the continually growing number of publications, or are no longer necessary because of technological developments Lider-Roadmapping-Workshop Leipzig

11 Petrus Software-supported Bibliographical Recording II/V Classification Based upon the DNB- Sachgruppen ~ first two layers of the DDC Statistical procedure, training corpus ~ objects with known classes (full text and tables of content). The objects are limited to characters. After stemming, the data model is generated. As classifier, SVM (scalable vector machine) is used. After the creation of the model, a 3-fold validation is executed, in order to verify the quality. The model can be transferred to an endpoint, which is a stand-alone application. The endpoint communicates via web service-interface. In use since January 2012; currently ~ 400 objects/day 11 Lider-Roadmapping-Workshop Leipzig

12 Petrus Software-supported Bibliographical Recording III/V Keywording Linguistic text analysis: language recognition, identification of sentences, words, phrases etc. Term matching with a dictionary which is based on the integrated authority file (72000 subject headings), Disambiguation Term ranking (dependant on position and frequency) The keywording process can eventually be transferred to an endpoint (according to the classification modell) ~ 80 objects/day 12 Lider-Roadmapping-Workshop Leipzig

13 Petrus Software-supported Bibliographical Recording IV/V (1) List of publications to be processed (2) Metadata to be imported out of the biblographic database (3) (Full-text) objects to be imported out of the repository (4) Transfer via a webservice interface (5) Return of results (6) Storage of the results in the bibliographic data base 13 Lider-Roadmapping-Workshop Leipzig

14 Petrus Software-supported Bibliographical Recording V/V Return of the classification software Appearance in the bibliographic record 14 Lider-Roadmapping-Workshop Leipzig

15 Open Linked Data I/III - DNB provides high quality, mainly intellectually created data. - Authority file (GND) and National Bibliography are available in rdf-format - Data is published under the Creative Commons Zero-License - Currently, the data can be accessed via the Portal (for single records) or downloaded - Target groups are research facilities and non-profit organisations as well as commercial service suppliers (e.g. search engines, knowledge management systems) 15 Lider-Roadmapping-Workshop Leipzig

16 Open Linked Data II/III Bibliographic data is highly reliable, but has a poor formal quality (free-text fields) - High efforts for conversion The data was converted using Metafacture, which had been developed by culturegraph.org. ( 16 Lider-Roadmapping-Workshop Leipzig

17 Open Linked Data III/III Bibliographic record of Winnetou leads to Karl May - detail leads to place of birth Coordinates 17 Lider-Roadmapping-Workshop Leipzig

18 Motivation of the DNB - Motivate external parties to work with rdf-data, e.g. linking it with other ontologies. - Improve search: Access by themes, browsing, unveiling relations between cultural entities. Technical Challenges - Improve the accessibilty (e.g. by services - MACS) - Search: Integrate Portal (knowledge representation, user interaction) with search engine and linked data 18 Lider-Roadmapping-Workshop Leipzig

19 Questions? Mark Zöpfgen Deutsche Nationalbibliothek Informationstechnik Adickesallee 1 D Frankfurt am Main Telefon: mailto: m.zoepfgen@d-nb.de 19 Lider-Roadmapping-Workshop Leipzig