SIMILE. Reframing Digital Information Management

Transcription

1 SIMILE Reframing Digital Information Management

2 The Situation Unprecedented Growth of Data Orders of magnitude shift in cost/item, scale of collection management

3 The Situation Bewildering Heterogeneity Thousands of schemas Billions of creators Everybody is a collector

4 The Situation Elusive Content Mandating deposit is a stick Where are the carrots? Where are the tools?

5 The Situation Emergent Social Structures New players Experts & Enthusiasts Professional Societies & Publishers (Nature, ACS) Commercial Players (Google, Flickr, Amazon) New labor for metadata collection/creation New supply chain for content & metadata

6 The Questions Dark Terabytes Missing Metadata How do we assure that collections have useful metadata for search and access? Need new tools, more metadata providers

7 The Questions Partnering with the Periphery How do we structure the relationship with new creators and collectors for mutual benefit? Need new behaviors, new incentives

8 The Questions Accept Heterogeneity How do we embrace/encourage/accelerate data heterogeneity? Need lazy standardization, supply chain for adding value

9 The Challenges Mixing Collections Aggregating, searching, sub-setting heterogeneous collections and metadata Need to take messy metadata, delegate alignment

10 The Challenges Enabling a Supply Chain Users/curators/collectors Need to empower more people, frame the dialog in new ways

11 The Challenges Scale is Scary Quantity, Growth rate, Social,

12 The Simile Approach Cast a wide net Be opportunistic Don t ignore hard problems Deliver working systems Get them adopted Learn from their use Build communities around them Leverage RDF, Semantic Web technology

13 The Simile Tool Chain! Babel! Exhibit! Fresnel! Gadget! Longwell! Piggy Bank! RDFizers! Referee! Seek! Semantic Bank! Solvent! Timeline! Timeplot! Welkin

14 Metadata Management Tools! Gadget! RDFizers! Solvent! Babel! Banach

15 Gadget Command Line Tool for Exploring XML

16 RDFizers XSLT Style Sheets for XML Conversion! JPEG (EXIF, IPCT)! MARC/MODS! DC (OAI-PMH)! OCW! VRA! ! BibTeX! Weather! Jira! Subversion Need to define RDF ontology for each new XML schema

17 Solvent Firefox Extension for Screen Scraping

18 Babel Data Conversion Web Service

19 Banach ( unferencing ) Pre-process Data to Create OWL Equivalences in the RDF Triplestore

20 Metadata Discovery Tools! Longwell! Piggybank! DWell

21 Longwell

22

23

24

25 Piggybank

26 Dwell Longwell in DSpace

27 Metadata Visualizers! Timeline! Timeplot! Exhibit! Seek

28 Timeline AJAX Widget

29

30

31 Have We Solved Ease of Use?

32 Timeline in Sakai

33 Timeline in Sakai

34 Timeplot - More AJAX

35 Exhibit AJAX on Steroids

36

37

38 Backstage (scale revisited)! Client and Server-side components! Server initiated/configured from the client! Sesame triplestore on server-side! JSONP to transfer data between! Handles interactive sessions

39 Seek

40 Bringing It All Back Home Personal Information Management Meets the Enterprise

41 Playground ( Flickr for data ) Accepts data in various formats and allows users to construct Exhibits on-the-fly Exhibit HTML RDF/XML Tab-Separated Values RDF/N3 Exhibit JSON Excel Spreadsheet BibTeX

42 The Citation Pipeline! Bibliographic data comes from authors EndNote, RefWorks, Zotero, BibTeX, PubMed, Web of Science, ProQuest, Compendex, Inspec,! Bibliographic data aggregates centrally For institutional reporting, group management! Bibliographic data goes to Libraries Institutional archives (e.g. DSpace)

43 Citation Commons

44 Zotero Integration

45 Simile Futures! Growth! Transition! Future Work

46 Community Growth

47 Transition the Old! Widget code, lists moved to Google! New committers added! MIT runs static.simile.mit.edu

48 Envision the New! Campus Personal Information Management Allow heterogeneity Work on scale! (Meta)data pipelines Leverage the periphery Increase open content!

49 Future Work! Longwell 3?! Roll out PIM tools! Integrate with Institutional Repositories! Support Linked Open Data

50 Acknowledgements The Andrew W. Mellon Foundation