Riding the Wave: Move Beyond Text TIB's strategy in the context of non-textual materials. Uwe Rosemann, Irina Sens IATUL Conference Singapur

Transcription

1 Riding the Wave: Move Beyond Text TIB's strategy in the context of non-textual materials Uwe Rosemann, Irina Sens IATUL Conference Singapur

2 Outline TIB Role and functions Requirements Politicians - Funders Users Examples for solutions DataCite AV-Portal chemocr Visual search Long-time preservation 2

3 TIB Hannover Some of the facts = German National Library of Science and Technology engineering, architecture, chemistry, information technology, mathematics and physics Founded in 1959 Financed by Federal Government and all Federal States 3

4 Main Building 4

5 Marstall Building 5

6 Marstall Building a former horse stable 6

7 Castle 7

8 Main Stacks 8

9 TIB Hannover Some of the facts 11 mio annual acquisition budget 18,500 journal subscriptions 7 mio items Staff: ca. 175 FTE 9

10 Global Network TechLib 10

11 Customers Europe 10% Germany 71% USA 14% World 5% 11

12 Main Services Provision of scientific content full texts, document delivery, interlibrary loan Scientific retrieval portal GetInfo Long-time preservation DOI Services for research data Research and development 12

13 Veränderungen im Wissenschaftsprozess Jim Gray, escience Group, Microsoft Research 13

14 A Gap A widening gap in the scientific record between published research in a text document and the data that underlies it As a result, datasets are Difficult to discover Difficult to access Scientific information gets lost 14

15 Requirements - Politics Knowledge is power; Europe must manage the digital assets its researchers generate. 15

16 Riding the wave How Europe can gain access from the rising tide of scientific data. Final report of the High Level Expert Group on Scientific Data. 16

17 Strategy Move beyond text Scientific Films 3D Objects Software Simulation Research Data Text 17

18 Move beyond text Consequences for TIB Research communities produce many types of scientific and technical information Each has its own unique characteristics and life cycle Must become capable of accepting and managing new media formats 18

19 GetInfo Portal for Science and Technology 45 Mio metadata index 150 Mio metadata in external sources 1,8 Mio documents AV-Media GetInfo mobile 19

20 Move beyond text Consequences for TIB We have to open our portal to this non-textual information 20

21 Joint Science Conference statement An increasingly important user needs addressed by TIB is the systematic collection, registration, archiving, indexing, and optimized provision of audio-visual materials using the latest technical possibilities. TIB is the appropriate institution to build up expertise in the area of non-textual materials. Systematic acquisition of scientific objects Object specific search and presentation Long-term archiving Development of standards (in collaboration) Applied research (visual search, search, automatic Content analysis etc) 21

22 How have we been preparing? Infrastructure for research data- DataCite Visual Search tools for AV-media 3D-Objects Architecture chemocr Visual access to research data 22

23 Collaboration Research Data In 2005, the TIB became a non-commercial DOI registration agency for research data In 2010, the TIB became co-founder of the international Datacite consortium to establish easier access to scientific research data on the Internet. Mission Citability of research data High visibility of the data Easy re-use and verification of the data sets Increasing quality of published papers 23

24 DataCite Members Australia Canada Denmark France Germany Italy The Netherland Sweden Switherland UK USA Korea (affiliated) 24

25 DataCite Structure International DOI Foundation Member DataCite Managing Agent (TIB) Member Institution Member Institution Associate Stakeholder Data Centre Data Centre Data Centre Data Centre Data Centre Data Centre Works with 25

26 Example: EHEC virus 26

27 Example: EHEC virus 27

28 How have we been preparing? Infrastructure for research data- DataCite Visual Search tools for AV-media 3D-Objects Architecture chemocr Visual access to research data 28

29 AV media A N A L Y S I S visual structural auditive source: Scorupka, Sascha, Experiment der Woche, 2011 Object detection & clustering Genre analysis Intelligent Character Recognition (ICR) Scene/ shot detection Speaker detection Automatic Speech Recognition (ASR) Semantic and content based indexing on extracted features on extracted text 29

30 Keyframes Annotation Machine learning using visual features I N D E X I N G Textual Metadata ICR derived text Audio Transkript Genre Classes Graphical : Animation Graphical : Drawing Graphical : Diagram Real : Outdoor Real : Indoor Real : Lecture / Conference Real : Interview Real : Buildings... e.g. person xy location xy subject xy domain xy... Named Entity Recognition Mapping Ontologies Taxonomies Thesauri e.g. bibliographic, geographical, encyclopedic data 30

31 AV media D I S P L A Y Faceted search Info ASR Explorative/ Semantic search Keyframe navigation Navigation on audio text Die Technik des Lasers ist aus dem heutigen Alltag kaum mehr wegzudenken.... Variable Strahl- Aufweitungssysteme in Berlin Adlershof - der Stadt für Wissenschaft, Wirtschaft und... 31

32 How have we been preparing? Infrastructure for research data- DataCite Visual Search tools for AV-media 3D-Objects Architecture chemocr Visual access to research data 32

33 3D objects an excursion to Architecture 33

34 Visual search tools visual search content based indexing 34

35 Content based indexing segmentation with form-primitives extraction of room connectivity graphs 35

36 Visual search attributed graph 3D sketch result visualization 36

37 How have we been preparing? Infrastructure for research data- DataCite Visual Search tools for AV-media 3D-Objects Architecture chemocr Visual access to research data 37

38 Information Retrieval in Chemistry Search for chemical structures how? Chemists are used to drawing? 38

39 Textual and non-textual chemical information Table with reaction scheme Chemical Names 2a-i: Derivates from the reaction Linked entities from the table Chemical structure Reaction scheme 39

40 Non-textual data processing chemocr image data chemical structure data CLiDE chemocr 40

41 Information retrieval in chemistry Text AND Formulas 41

42 How have we been preparing? Infrastructure for research data- DataCite Visual Search tools for AV-media 3D-Objects Architecture chemocr Visual access to research data 42

43 Numerical data Zeit [h] T [ C]

44 Visual access to research data 44

45 Last but not least. Long Term Preservation Digital texts AV media 3D objects etc. 45

46 Conclusion Dissemination of Scientific and Technical Information has been a foundational mission. The methods have completely changed, but the mission remains the same. 46

47 Conclusion Ultimate Goal: Interlinking and Search Across All Types of Digital Assets. 47

48 Questions? 48