RADAR A Repository for Long Tail Data

Size: px

Start display at page:

Download "RADAR A Repository for Long Tail Data"

Cuthbert Martin
5 years ago
Views:

1 RADAR A Repository for Long Tail Data Angelina Kraft, Janna Neumann German National Library of Science and Technology TIB 36th Annual IATUL Conference Hannover, July 6 th, 2015 funded by

2 IN A NUTSHELL = Research Data Repository Goal: Establish a interdisciplinary research data repository Online: What kind of data? DIGITAL! Including: Raw (primary, machine output) Secondary (working data) Negative Analyzed in scientific articles Duration: September (August 2016) Funded by Hannover, July 6 th,

SCIENCE NOW & THEN One thousand years ago, science was empirical:

theoretical branch developed: building on models, generalisations

Today, science is data based (escience): Combination of theory,

3 SCIENCE NOW & THEN One thousand years ago, science was empirical: described natural phenomena Over the last one hundred years, a theoretical branch developed: building on models, generalisations In recent decades, an IT branch: Simulation of complex phenomena Today, science is data based (escience): Combination of theory, experiment & simulation. a a 2 4 G c 3 a 2 2 Hannover, July 6 th,

RESEARCH DATA Long Tail The majority of datasets produced through research are part of the

4 RESEARCH DATA Long Tail The majority of datasets produced through research are part of the Long Tail of Research Data Source: Humphrey C (2014): OpenAIRE-COAR Conference, Athens Source: Ferguson et al. (2014): Big data from small data: data-sharing in the 'long tail' of neuroscience. DOI: /nn.3838 Science Survey 2011: 48 % of respondents were working with datasets that were <1GB in size 50 % stored data exclusively! in labs Source: Science (2011): 331(6018), p DOI: /science Hannover, July 6 th,

5 DATA LANDSCAPE The Reality! Current situation of data publishing: Potential for data dumping overburdened! Articles Supplements Data centres / repositories Few Lack of archives in many subject areas! ~ 75 % of RD is never published Data on private hard disks / institutional servers Modified based on STM / Smit, E: Avoiding a Digital Dark Age for Data: why data and publications belong together ICSTI workshop Delivering Data in Science PARIS, 5 March 2012 Hannover, July 6 th,

6 DATA LANDSCAPE The Future? Ideal case of data publishing: Journals request and check data deposition If no other data integration is possible RD in articles Supplements Research data in data centres and repositories Linking text & data enhanced publications Generic & discipline specific; interfaces for good connection! Support enhanced publications ; Persistent Identifiers Modified based on STM / Smit, E: Avoiding a Digital Dark Age for Data: why data and publications belong together ICSTI workshop Delivering Data in Science PARIS, 5 March 2012 Data on private hard disks / institutional servers Hannover, July 6 th,

7 RADAR The Domain Model 1. Private domain 2. Collaborative domain 3. Public domain Archive 4. Dissemination domain Researcher s workplace Institutional infrastructure RADAR 2 Services: 1. Archival 2. Publication Portals, researchers Data selection Data documentation Data types / Data formats Based on: Treloar, A., Harboe-Ree, C. (2008) Data management and the curation continuum. How the Monash experience is informing repository relationships. VALA th Biennial Conference, Melbourne and Klump, J. (2009) Managing the Data Continuum. Online: Business model Infrastructure Software Metadata standards Persistent Identifiers Contracts Interfaces DataCite, publishers Reuse Hannover, July 6 th,

8 TNERS oftware, framework & business model Scientific specification & evaluation Data management preservation services Data publication, metadata & contact to publishers

9 US OF RADAR rchival of research data as a generic service rustworthy preservation & traceable publication Long tail of research data ervices Basic service: interdisciplinary data preservation Extended service: data publication

GET AUDIENCE esearchers Archive and publish project

Integration with existing institutional portals ltural

access of digitized materials blishers Infrastructure

10 GET AUDIENCE esearchers Archive and publish project based research data braries and Research Institutions Integration with existing institutional portals ltural Heritage Organizations Long term preservation & web access of digitized materials blishers Infrastructure for providing access to research data Linked to publications

VICE: Archival Storage Aim: Trustworthy data preservation For

publically available (yet) Handle Properties: Minimum metadata

years + extension Bitstream Preservation for storage period

11 VICE: Archival Storage Aim: Trustworthy data preservation For whom? Completed research projects Internal resources, not to be publically available (yet) Handle Properties: Minimum metadata set (9 parameters) Handle Variable storage period: up to 15 years + extension Bitstream Preservation for storage period Regular reports on data integrity Access rights for selected groups/users

papers Independent data publications (e.

12 VICE: Data Publication Aim: Trustworthy preservation & traceable publication DOI For whom? Projects: Data basis for scientific papers Independent data publications (e.g. negative data) Digital representations DOI API Properties: Expanded metadata set for discipline specific data DOI Unlimited storage period Regular reports on downstream use to data provider Access management (embargo & publisher services)

13 Test System June 2015

DOI 0110100 0110100 1110101 0110101 0111100 0111100 Data citation: Creator

16 DOI Data citation: Creator (Publication Year): Title of the data set. Publisher. Resource Type. Identifier

17 WORKFLOW Hannover, July 6 th,

18 RESEARCH DATA MANAGEMENT Guidelines How To s, recommendations on formats, citations, licenses General & discipline specific glossary Step by step addition of examples Business model & quotes Indicative price, e.g. for funding applications Integration services for publishers/journals Data for peer review Hannover, July 6 th,

19 RADAR Reliable Storage Space Management of storage quotas Bitstream Preservation Regular fixity checks PID Service (DOI & Handle) on data set or file level Generic metadata schema Managing license metadata & access rights Access may be restricted to the institution providing the data (resp. another authorized party) and service operator But: No functional long term preservation! Hannover, July 6 th,

20 RADAR Roadmap Software further development of services 1. Middleware infrastructure realized 2. Archival service realized 3. Publication service in progress DSA certification in progress Roll out to further disciplines in progress Workflows & interfaces to data providers in progress Hannover, July 6 th,

21 CH DATA REPOSITORY w.radar projekt.org Thank you for your attention! Questions? RADAR Test Account Contact: hannover.de

RADAR Project. Data Archival and Publication as a Service. Matthias Razum FIZ Karlsruhe RESEARCH DATA REPOSITORIUM. Zurich, December 15, 2014

RADAR Project. Data Archival and Publication as a Service. Matthias Razum FIZ Karlsruhe RESEARCH DATA REPOSITORIUM. Zurich, December 15, 2014 RADAR Project Data Archival and Publication as a Service RESEARCH DATA REPOSITORIUM Matthias Razum FIZ Karlsruhe The RADAR Project in a Nutshell RADAR = Research Data Repository Goal: Establish a interdisciplinary