A Micro-Services-Based Approach for Curation and Preservation Solutions

Size: px
Start display at page:

Download "A Micro-Services-Based Approach for Curation and Preservation Solutions"

Transcription

1 Global Oracle PASIG User Group Meeting, Redwood Shores, May 10-12, 2011 A Micro-Services-Based Approach for Curation and Preservation Solutions Stephen Abrams Patricia Cruse John Kunze Perry Willett University of California Curation Center California Digital Library

2 Who are we?

3 What do we do? Innovative curation solutions (preservation and access) for the UC community and external partners EZID, Merritt repository, Web Archiving Service (WAS) Guidelines and best practices Integration with other CDL programs (e.g., OA publishing, special collections) and external initiatives (e.g., DataCite, DataONE, HathiTrust, etc.) Share Collect Create Research Teaching Learning Discover Publish Curation Preserve Gather Access Scholarly lifecycle Information lifecycle

4 That s simple, right? Ever increasing number, size, and diversity of content

5 That s simple, right? Ever increasing number, size, and diversity of content Expanded use by new constituencies Minnesota Digital Library Information Center for the Environment

6 That s simple, right? Ever increasing number, size, and diversity of content Expanded use by new constituencies Ongoing (potentially disruptive) changes in technology and user expectation Increasing obligations, shrinking budgets

7 Merritt repository I know my desktop content is at risk; what should I do? How can I ensure persistent availability? What s a good way to share the data underlying a recent publication? How can I meet the data management requirements of my grant?

8 Merritt repository Dark archive for preservation masters Bright archive for preservation and end-user access Preservation back-end for existing discovery services Integration with distributed data grids

9 Managerially friendly

10 Model free application/msword KB

11 Strongly versioned

12 Easy submission

13 Merritt micro-services Merritt is built from a micro-services toolkit IdM/Authn/Authz LDAP Persistent identifiers EZID Persistent storage CAN/Pairtree/Dflat/Checkm/ReDD Fixity Fixity Replication Replication Catalog Inventory/4store Ingest Ingest/Zookeeper Characterization JHOVE2 Discovery XTF Transformation Notification Annotation GhOST/Shibboleth Version 2

14 Micro-service choreography EZID Identifier Node User agent SIP AIP AIP Ingest Store Notification DIP Node Fixity DIP Node DIP Inventory

15 Micro-services The Unix philosophy Make each program do one thing well To do a new job, build afresh rather than complicate old programs by adding new features Expect the output of every program to become the input to another, as yet unknown, program Design and build software to be tried early Don't hesitate to throw away the clumsy parts and rebuild them L. McIlroy et al. Unix time-sharing system forward Bell System Technical Journal 57:6, part 2 (1978): 1902 Complex emergent behavior Low barrier, low maintenance, low commitment Policy neutral, protocol/platform independent The file system is the database

16 Questions? Curious Oysters,

17 For more information UC Curation Center Merritt repository Abrams, Cruse, Kunze, & Minor, Curation micro-services: A pipeline metaphor for repositories, Journal of Digital Information 12:2 (2011) Abrams, Kunze, & Loy, An emergent micro-services approach to digital curation infrastructure International Journal of Digital Curation 5:1 (2010): UC3 Stephen Abrams Lisa Colvin Patricia Cruse Scott Fisher Alex Genadinik Erik Hetzner Greg Janée John Kunze Margaret Low David Loy Mark Reyes Tracy Seneca Joan Starr Marisa Strong Perry Willett

CDL s Web Archiving System

CDL s Web Archiving System CDL s Web Archiving System Erik Hetzner UC3, California Digital Library 16 June 2011 Erik Hetzner (UC3, California Digital Library) CDL s Web Archiving System 16 June 2011 1 / 24 Introduction We don t

More information

PRESERVING DIGITAL OBJECTS

PRESERVING DIGITAL OBJECTS MODULE 12 PRESERVING DIGITAL OBJECTS Erin O Meara and Kate Stratton Preserving Digital Objects 51 Case Study 2: University of North Carolina Chapel Hill By Jill Sexton, former Head of Digital Research

More information

Digital Preservation DMFUG 2017

Digital Preservation DMFUG 2017 Digital Preservation DMFUG 2017 1 The need, the goal, a tutorial In 2000, the University of California, Berkeley estimated that 93% of the world's yearly intellectual output is produced in digital form

More information

Digital Preservation at NARA

Digital Preservation at NARA Digital Preservation at NARA Policy, Records, Technology Leslie Johnston Director of Digital Preservation US National Archives and Records Administration (NARA) ARMA, April 18, 2018 Policy Managing Government

More information

David Minor UC San Diego Library Chronopolis Preservation Network

David Minor UC San Diego Library Chronopolis Preservation Network David Minor UC San Diego Library Chronopolis Network What is DPN? DPN = Digital Network, pronounced Deepen. What is DPN? Data Owner Data Owner Data Owner Data Owner Data Owner One repository to rule

More information

Next-Generation Characterization An Update on the JHOVE2 Project

Next-Generation Characterization An Update on the JHOVE2 Project NDIIPP Partners Meeting Arlington, Virginia, July 20-22, 2010 Next-Generation Characterization An Update on the JHOVE2 Project JHOVE2 Project Team California Digital Library, Portico, Stanford University

More information

Digital Preservation Network (DPN)

Digital Preservation Network (DPN) Digital Preservation Network (DPN) Pamela Vizner Oyarce Digital Preservation Professor Kara van Malssen October 1, 2013 Introduction Institutions, as individual entities, have tried to establish systems

More information

continuous delivery sounds great

continuous delivery sounds great continuous delivery sounds great @jezhumble dev on summit march 30, 2017 2017 Jez Humble continuous delivery sounds great but it won t work here @jezhumble dev on summit march 30, 2017 2017 Jez Humble

More information

Protecting Future Access Now Models for Preserving Locally Created Content

Protecting Future Access Now Models for Preserving Locally Created Content Protecting Future Access Now Models for Preserving Locally Created Content By Amy Kirchhoff Archive Service Product Manager, Portico, ITHAKA Amigos Online Conference Digital Preservation: What s Now, What

More information

DRS Policy Guide. Management of DRS operations is the responsibility of staff in Library Technology Services (LTS).

DRS Policy Guide. Management of DRS operations is the responsibility of staff in Library Technology Services (LTS). Harvard University Library Office for Information Systems DRS Policy Guide This Guide defines the policies associated with the Harvard Library Digital Repository Service (DRS) and is intended for Harvard

More information

University of California Curation Center Merritt Data User Agreements Rev Introduction. 2 Data user agreements

University of California Curation Center Merritt Data User Agreements Rev Introduction. 2 Data user agreements University of California Curation Center Merritt Data User Agreements Rev. 0.7 2013-01-27 1 Introduction Information technology and resources have become integral and indispensable to the pedagogic mission

More information

Sessions 3/4: Member Node Breakouts. John Cobb Matt Jones Laura Moyers 7 July 2013 DataONE Users Group

Sessions 3/4: Member Node Breakouts. John Cobb Matt Jones Laura Moyers 7 July 2013 DataONE Users Group Sessions 3/4: Member Node Breakouts John Cobb Matt Jones Laura Moyers 7 July 2013 DataONE Users Group Schedule 1:00-2:20 and 2:40-4:00 Member Node Breakouts Member Node Overview and Process Overview Documentation

More information

University of British Columbia Library. Persistent Digital Collections Implementation Plan. Final project report Summary version

University of British Columbia Library. Persistent Digital Collections Implementation Plan. Final project report Summary version University of British Columbia Library Persistent Digital Collections Implementation Plan Final project report Summary version May 16, 2012 Prepared by 1. Introduction In 2011 Artefactual Systems Inc.

More information

The e-depot in practice. Barbara Sierman Digital Preservation Officer Madrid,

The e-depot in practice. Barbara Sierman Digital Preservation Officer Madrid, Barbara Sierman Digital Preservation Officer Madrid, 16-03-2006 e-depot in practice Short introduction of the e-depot 4 Cases with different aspects Characteristics of the supplier Specialities, problems

More information

Data Curation Handbook Steps

Data Curation Handbook Steps Data Curation Handbook Steps By Lisa R. Johnston Preliminary Step 0: Establish Your Data Curation Service: Repository data curation services should be sustained through appropriate staffing and business

More information

Trusted Digital Repositories. A systems approach to determining trustworthiness using DRAMBORA

Trusted Digital Repositories. A systems approach to determining trustworthiness using DRAMBORA Trusted Digital Repositories A systems approach to determining trustworthiness using DRAMBORA DRAMBORA Digital Repository Audit Method Based on Risk Assessment A self-audit toolkit developed by the Digital

More information

Lessons from the implementation

Lessons from the implementation Bibliothèque nationale de France (BnF) Distributed Archiving & Preservation System Système de Préservation et d Archivage Réparti (SPAR) Lessons from the implementation Sun-PASIG Malta 24/06/2009 Distributed

More information

Digital Preservation Standards Using ISO for assessment

Digital Preservation Standards Using ISO for assessment Digital Preservation Standards Using ISO 16363 for assessment Preservation Administrators Interest Group, American Library Association, June 25, 2016 Amy Rudersdorf Senior Consultant, AVPreserve amy@avpreserve.com

More information

Can a Consortium Build a Viable Preservation Repository?

Can a Consortium Build a Viable Preservation Repository? Can a Consortium Build a Viable Preservation Repository? Presentation at CNI March 31, 2014 Bradley Daigle (APTrust University of Virginia) Stephen Davis (Columbia University) Linda Newman (University

More information

DataONE Enabling Cyberinfrastructure for the Biological, Environmental and Earth Sciences

DataONE Enabling Cyberinfrastructure for the Biological, Environmental and Earth Sciences DataONE Enabling Cyberinfrastructure for the Biological, Environmental and Earth Sciences William K. Michener 1,2, Rebecca Koskela 1,2, Matthew B. Jones 2,3, Robert B. Cook 2,4, Mike Frame 2,5, Bruce Wilson

More information

The Web-at-Risk at Three: Overview of an NDIIPP Web Archiving Initiative

The Web-at-Risk at Three: Overview of an NDIIPP Web Archiving Initiative The Web-at-Risk at Three: Overview of an NDIIPP Web Archiving Initiative Tracy Seneca Abstract The Web-at-Risk project is a multi-year National Digital Information Infrastructure and Preservation Program

More information

The Data Curation Profiles Toolkit: Interview Worksheet

The Data Curation Profiles Toolkit: Interview Worksheet Purdue University Purdue e-pubs Data Curation Profiles Toolkit 11-29-2010 The Data Curation Profiles Toolkit: Interview Worksheet Jake Carlson Purdue University, jakecar@umich.edu Follow this and additional

More information

Susan Thomas, Project Manager. An overview of the project. Wellcome Library, 10 October

Susan Thomas, Project Manager. An overview of the project. Wellcome Library, 10 October Susan Thomas, Project Manager An overview of the project Wellcome Library, 10 October 2006 Outline What is Paradigm? Lessons so far Some future challenges Next steps What is Paradigm? Funded for 2 years

More information

What do you do when your file formats become obsolete? Lydia T. Motyka Florida Center for Library Automation USETDA 2011

What do you do when your file formats become obsolete? Lydia T. Motyka Florida Center for Library Automation USETDA 2011 What do you do when your file formats become obsolete? Lydia T. Motyka Florida Center for Library Automation USETDA 2011 The FCLA, the FDA, and DAITSS FDA: a service of the Florida Center for Library Automation

More information

Igitur Archive: Institutional Repository Utrecht University. May , Martin Slabbertje

Igitur Archive: Institutional Repository Utrecht University. May , Martin Slabbertje Igitur Archive: Institutional Repository Utrecht University May 18 2011, Martin Slabbertje 5/20/2011 5/20/2011 Utrecht University Library: some facts Main location open 87 hours a week, 1800 study places

More information

An overview of the OAIS and Representation Information

An overview of the OAIS and Representation Information An overview of the OAIS and Representation Information JORUM, DCC and JISC Forum Long-term Curation and Preservation of Learning Objects February 9 th 2006 University of Glasgow Manjula Patel UKOLN and

More information

Leveraging High Performance Computing Infrastructure for Trusted Digital Preservation

Leveraging High Performance Computing Infrastructure for Trusted Digital Preservation Leveraging High Performance Computing Infrastructure for Trusted Digital Preservation 12 December 2007 Digital Curation Conference Washington D.C. Richard Moore Director of Production Systems San Diego

More information

Service Guidelines. This document describes the key services and core policies underlying California Digital Library (CDL) s EZID Service.

Service Guidelines. This document describes the key services and core policies underlying California Digital Library (CDL) s EZID Service. http://ezid.cdlib.org Service Guidelines 1 Purpose This document describes the key services and core policies underlying (CDL) s EZID Service. 2 Introduction to EZID EZID (easy eye dee) is a service providing

More information

DRS Update. HL Digital Preservation Services & Library Technology Services Created 2/2017, Updated 4/2017

DRS Update. HL Digital Preservation Services & Library Technology Services Created 2/2017, Updated 4/2017 Update HL Digital Preservation Services & Library Technology Services Created 2/2017, Updated 4/2017 1 AGENDA DRS DRS DRS Architecture DRS DRS DRS Work 2 COLLABORATIVELY MANAGED DRS Business Owner Digital

More information

irods for Data Management and Archiving UGM 2018 Masilamani Subramanyam

irods for Data Management and Archiving UGM 2018 Masilamani Subramanyam irods for Data Management and Archiving UGM 2018 Masilamani Subramanyam Agenda Introduction Challenges Data Transfer Solution irods use in Data Transfer Solution irods Proof-of-Concept Q&A Introduction

More information

Geospatial Records and Your Archives

Geospatial Records and Your Archives The collections of scientific data acquired with government and private support are the foundation for our understanding of the physical world and for our capabilities to predict changes in that world.

More information

IRVLA The Irish Virtual Research Library and Archive project.

IRVLA The Irish Virtual Research Library and Archive project. IRVLA The Irish Virtual Research Library and Archive project. A presentation to the HII International Advisory Committee John Mc Donough IVRLA Project Manager Outline Background. Scope. The Vision Thing.

More information

Software + Services for Data Storage, Management, Discovery, and Re-Use

Software + Services for Data Storage, Management, Discovery, and Re-Use Software + Services for Data Storage, Management, Discovery, and Re-Use CODATA 22 Conference Stellenbosch, South Africa 25 October 2010 Alex D. Wade Director Scholarly Communication Microsoft External

More information

Copyright 2008, Paul Conway.

Copyright 2008, Paul Conway. Unless otherwise noted, the content of this course material is licensed under a Creative Commons Attribution - Non-Commercial - Share Alike 3.0 License.. http://creativecommons.org/licenses/by-nc-sa/3.0/

More information

Persistent Identifier the data publishing perspective. Sünje Dallmeier-Tiessen, CERN 1

Persistent Identifier the data publishing perspective. Sünje Dallmeier-Tiessen, CERN 1 Persistent Identifier the data publishing perspective Sünje Dallmeier-Tiessen, CERN 1 Agenda Data Publishing Specific Data Publishing Needs THOR Latest Examples/Solutions Publishing Centerpiece of research

More information

Preservation Planning in the OAIS Model

Preservation Planning in the OAIS Model Preservation Planning in the OAIS Model Stephan Strodl and Andreas Rauber Institute of Software Technology and Interactive Systems Vienna University of Technology {strodl, rauber}@ifs.tuwien.ac.at Abstract

More information

Oracle Intelligent Policy

Oracle Intelligent Policy NETBACKUP 7.6 FEATURE BRIEFING ORACLE INTELLIGENT POLICY NetBackup 7.6 Feature Briefing Oracle Intelligent Policy Version number: 1.0 Issue date: 28 th August 2013 This document describes a feature introduced

More information

Envisioning a New Distributed Organization and Cyberinfrastructure to Enable Science

Envisioning a New Distributed Organization and Cyberinfrastructure to Enable Science Envisioning a New Distributed Organization and Cyberinfrastructure to Enable Science Stephen Abrams Patricia Cruse John Kunze California Digital Library Outline of today s talk Complexities of global change

More information

Introduction to Digital Preservation. Danielle Mericle University of Oregon

Introduction to Digital Preservation. Danielle Mericle University of Oregon Introduction to Digital Preservation Danielle Mericle dmericle@uoregon.edu University of Oregon What is Digital Preservation? the series of management policies and activities necessary to ensure the enduring

More information

PASIG Directions & Issues

PASIG Directions & Issues PASIG Directions & Issues Richard Boulderstone Director estrategy & Programmes April 2011 PASIG June 2007: Concluding comments The British Library has a substantial long term vision for electronic resources

More information

Building for the Future

Building for the Future Building for the Future The National Digital Newspaper Program Deborah Thomas US Library of Congress DigCCurr 2007 Chapel Hill, NC April 19, 2007 1 What is NDNP? Provide access to historic newspapers Select

More information

Agenda. Bibliography

Agenda. Bibliography Humor 2 1 Agenda 3 Trusted Digital Repositories (TDR) definition Open Archival Information System (OAIS) its relevance to TDRs Requirements for a TDR Trustworthy Repositories Audit & Certification: Criteria

More information

DIGITAL ARCHIVES & PRESERVATION SYSTEMS

DIGITAL ARCHIVES & PRESERVATION SYSTEMS DIGITAL ARCHIVES & PRESERVATION SYSTEMS Part 4 Archivematica (presented July 14, 2015) Kari R. Smith, MIT Institute Archives Session Overview 2 Digital archives and digital preservation systems. These

More information

Contents: *** Draft ***

Contents: *** Draft *** Proposal to the National Digital Information Infrastructure and Preservation Program (NDIIPP) for Technical Development Support for the Unified Digital Format Registry (UDFR) Contents: I. Abstract... 2

More information

A Strategy for Network Disclosure using MARC21 Format for Holdings

A Strategy for Network Disclosure using MARC21 Format for Holdings 5 June 2012 #SharedPrintMgt Bibliographic Infrastructure for Shared Print Collections A Strategy for Network Disclosure using MARC21 Format for Holdings Constance Malpas Program Officer OCLC Research @ConstanceM

More information

NDSA Web Archiving Survey

NDSA Web Archiving Survey NDSA Web Archiving Survey Introduction In 2011 and 2013, the National Digital Stewardship Alliance (NDSA) conducted surveys of U.S. organizations currently or prospectively engaged in web archiving to

More information

User Stories : Digital Archiving of UNHCR EDRMS Content. Prepared for UNHCR Open Preservation Foundation, May 2017 Version 0.5

User Stories : Digital Archiving of UNHCR EDRMS Content. Prepared for UNHCR Open Preservation Foundation, May 2017 Version 0.5 User Stories : Digital Archiving of UNHCR EDRMS Content Prepared for UNHCR Open Preservation Foundation, May 2017 Version 0.5 Introduction This document presents the user stories that describe key interactions

More information

Conch Appendix: Discovery Questionnaire. Questionnaire Summary

Conch Appendix: Discovery Questionnaire. Questionnaire Summary Conch Appendix: Discovery Questionnaire Project Acronym: PREFORMA Grant Agreement number: 619568 Project Title: PREservation FORMAts for culture information/e-archives Prepared by: MediaArea.net SARL Erik

More information

Systems Interoperability and Collaborative Development for Web Archiving

Systems Interoperability and Collaborative Development for Web Archiving Systems Interoperability and Collaborative Development for Web Archiving Filling Gaps in the IMLS National Digital Platform Mark Phillips, University of North Texas Courtney Mumma, Internet Archive Talk

More information

1 There is no single, authorized definition of digital preservation. 2 Definition is from the Framework for Applying OAIS to

1 There is no single, authorized definition of digital preservation. 2 Definition is from the Framework for Applying OAIS to Supporting the Analysis and Audit of Collaborative OAIS s Using an Outer OAIS-Inner OAIS (OO-IO) Model Eld Zierau Department of Digital Preservation The Royal Library of Denmark Søren Kierkegaards Plads

More information

PREMIS in Archivematica

PREMIS in Archivematica PREMIS in Archivematica PETER VAN GARDEREN Artefactual Systems Inc. American Library Association New Orleans - June 24, 2011 Peter Van Garderen President / Systems Archivist MJ Suhonos Systems Librarian

More information

NEW YORK PUBLIC LIBRARY

NEW YORK PUBLIC LIBRARY NEW YORK PUBLIC LIBRARY S U S A N M A L S B U R Y A N D N I C K K R A B B E N H O E F T O V E R V I E W The New York Public Library includes three research libraries that collect archival material: the

More information

Petabytes of Preservation on Tape Jason Pierson Oct 2012

Petabytes of Preservation on Tape Jason Pierson Oct 2012 Petabytes of Preservation on Tape Jason Pierson Oct 2012 Today we will cover Preservation system overview Tape subsystem design considerations Tape subsystem architecture 2 What do we preserve and why?

More information

IBM Tivoli Netcool Service Quality Manager V4.1.1

IBM Tivoli Netcool Service Quality Manager V4.1.1 000-430 IBM Tivoli Netcool Service Quality Manager V4.1.1 Version: 3.0 QUESTION NO: 1 During the IBM Tivoli Netcool Service Quality Manager planning stages, which two standard options are available to

More information

Long Term Digital Preserva2on

Long Term Digital Preserva2on Long Term Digital Preserva2on Internet2 Tech Exchange Columbus, OH October 6, 2015 Dave Pcolar - Chief Technical Officer, DPN Evviva Weinraub - Chief Opera2ng Officer, DPN Sibyl Schaefer - Program Manager,

More information

Oracle Enterprise Manager Ops Center 12c Administration Ed 3

Oracle Enterprise Manager Ops Center 12c Administration Ed 3 Oracle University Contact Us: Landline: +91 80 67863899 Toll Free: 0008004401672 Oracle Enterprise Manager Ops Center 12c Administration Ed 3 Duration: 5 Days What you will learn No hands-on lab environment

More information

Making Data Count Promo0ng Open Data Through Usage and Impact Tracking #mdc

Making Data Count Promo0ng Open Data Through Usage and Impact Tracking #mdc CNI Spring 2017 Membership Mee;ng Albuquerque, May 3-4, 2017 Making Data Count Promo0ng Open Data Through Usage and Impact Tracking #mdc Stephen Abrams UC Cura0on Center California Digital Library @slabrams

More information

Governance, Risk, and Compliance: A Practical Guide to Points of Entry

Governance, Risk, and Compliance: A Practical Guide to Points of Entry An Oracle White Paper January 2010 Governance, Risk, and Compliance: A Practical Guide to Points of Entry Disclaimer The following is intended to outline our general product direction. It is intended for

More information

Woodson Research Center Digital Preservation Policy

Woodson Research Center Digital Preservation Policy Primary Policy Aims Risk Assessment Needs Statement Project/Purpose Statement Goals and Objectives Projects to Undertake in 2016 Organizational Commitments Financial Commitments Personnel Preservation

More information

UNT Libraries TRAC Audit Checklist

UNT Libraries TRAC Audit Checklist UNT Libraries TRAC Audit Checklist Date: October 2015 Version: 1.0 Contributors: Mark Phillips Assistant Dean for Digital Libraries Daniel Alemneh Supervisor, Digital Curation Unit Ana Krahmer Supervisor,

More information

The DOI Identifier. Drexel University. From the SelectedWorks of James Gross. James Gross, Drexel University. June 4, 2012

The DOI Identifier. Drexel University. From the SelectedWorks of James Gross. James Gross, Drexel University. June 4, 2012 Drexel University From the SelectedWorks of James Gross June 4, 2012 The DOI Identifier James Gross, Drexel University Available at: https://works.bepress.com/jamesgross/26/ The DOI Identifier James Gross

More information

Preserving Electronic Mailing Lists as Scholarly Resources: The H-Net Archives

Preserving Electronic Mailing Lists as Scholarly Resources: The H-Net Archives Preserving Electronic Mailing Lists as Scholarly Resources: The H-Net Archives Lisa M. Schmidt lisa.schmidt@matrix.msu.edu http://www.h-net.org/archive/ MATRIX: The Center for Humane Arts, Letters & Social

More information

FAIR-aligned Scientific Repositories: Essential Infrastructure for Open and FAIR Data

FAIR-aligned Scientific Repositories: Essential Infrastructure for Open and FAIR Data FAIR-aligned Scientific Repositories: Essential Infrastructure for Open and FAIR Data GeoDaRRs: What is the existing landscape and what gaps exist in that landscape for data producers and users? 7 August

More information

RADAR Introduction and Basic Concepts. Matthias Razum

RADAR Introduction and Basic Concepts. Matthias Razum RADAR Introduction and Basic Concepts Matthias Razum RADAR RESEARCH DATA REPOSITORY RADAR (Research Data Repository) is a cross-disciplinary research data repository for the archival and publication of

More information

Digital Projects/Public Viewer Digital Preservation Storage Update National Preservation Projects

Digital Projects/Public Viewer Digital Preservation Storage Update National Preservation Projects Digital Projects/Public Viewer Digital Preservation Storage Update National Preservation Projects Robert Cartolano, Stephen Davis, Jim Neal April 23, 2014 Theme: From Local to National Local Effort Digital

More information

Importance of cultural heritage:

Importance of cultural heritage: Cultural heritage: Consists of tangible and intangible, natural and cultural, movable and immovable assets inherited from the past. Extremely valuable for the present and the future of communities. Access,

More information

What is Islandora? Islandora is an open source digital repository that preserves, manages, and showcases your institution s unique material.

What is Islandora? Islandora is an open source digital repository that preserves, manages, and showcases your institution s unique material. What is Islandora? Islandora is an open source digital repository that preserves, manages, and showcases your institution s unique material. 1 P age What is Islandora? Islandora is an open source digital

More information

Digital Preservation Efforts at UNLV Libraries

Digital Preservation Efforts at UNLV Libraries Library Faculty Presentations Library Faculty/Staff Scholarship & Research 11-4-2016 Digital Preservation Efforts at UNLV Libraries Emily Lapworth University of Nevada, Las Vegas, emily.lapworth@unlv.edu

More information

Developing a Research Data Policy

Developing a Research Data Policy Developing a Research Data Policy Core Elements of the Content of a Research Data Management Policy This document may be useful for defining research data, explaining what RDM is, illustrating workflows,

More information

Directory Description with Namaste Tags

Directory Description with Namaste Tags Repository Working Group J. Kunze California Digital Library November 9, 2009 Directory Description with Namaste Tags Abstract Namaste (NAMe AS TExt) is a file naming convention to support primitive directory-level

More information

Different Aspects of Digital Preservation

Different Aspects of Digital Preservation Different Aspects of Digital Preservation DCH-RP and EUDAT Workshop in Stockholm 3rd of June 2014 Börje Justrell Table of Content Definitions Strategies The Digital Archive Lifecycle 2 Digital preservation

More information

The OAIS Reference Model: current implementations

The OAIS Reference Model: current implementations The OAIS Reference Model: current implementations Michael Day, UKOLN, University of Bath m.day@ukoln.ac.uk Chinese-European Workshop on Digital Preservation, Beijing, China, 14-16 July 2004 Presentation

More information

Lessons Learned. Implementing Rosetta in the Harold B. Lee Library

Lessons Learned. Implementing Rosetta in the Harold B. Lee Library Lessons Learned Implementing Rosetta in the Harold B. Lee Library Provide Long Term Digital Access 1. To preserve BYU digital items: Digitized images, audio, video, Electronic articles, university records,

More information

How to make your data open

How to make your data open How to make your data open Marialaura Vignocchi Alma Digital Library Muntimedia Center University of Bologna The bigger picture outside academia Thursday 29th October 2015 There is a strong societal demand

More information

Metadata Sharing Policy

Metadata Sharing Policy University of California Libraries Metadata Sharing Policy Lisa Rowlison de Ortiz UC Berkeley, June 2015 Why is the Policy important? Establishes a major area for collaboration Who would make use of shared

More information

AFS Vermont Folklife Center Digital Preservation Storage Planning Report

AFS Vermont Folklife Center Digital Preservation Storage Planning Report AFS Vermont Folklife Center Digital Preservation Storage Planning Report 2017-06-12 Prepared By: AVPreserve 253 36th Street, Suite C302 Brooklyn NY 11232 634 West Main Street. Suite 202 Madison WI 53703

More information

Oracle Enterprise Manager. 1 Introduction. System Monitoring Plug-in for Oracle Enterprise Manager Ops Center Guide 11g Release 1 (

Oracle Enterprise Manager. 1 Introduction. System Monitoring Plug-in for Oracle Enterprise Manager Ops Center Guide 11g Release 1 ( Oracle Enterprise Manager System Monitoring Plug-in for Oracle Enterprise Manager Ops Center Guide 11g Release 1 (11.1.3.0.0) E18950-03 November 2011 This document provides describes the System Monitoring

More information

Certification. F. Genova (thanks to I. Dillo and Hervé L Hours)

Certification. F. Genova (thanks to I. Dillo and Hervé L Hours) Certification F. Genova (thanks to I. Dillo and Hervé L Hours) Perhaps the biggest challenge in sharing data is trust: how do you create a system robust enough for scientists to trust that, if they share,

More information

Knowledge-based Grids

Knowledge-based Grids Knowledge-based Grids Reagan Moore San Diego Supercomputer Center (http://www.npaci.edu/dice/) Data Intensive Computing Environment Chaitan Baru Walter Crescenzi Amarnath Gupta Bertram Ludaescher Richard

More information

ebooks Preservation at Scholars Portal Kate Davis & Grant Hurley Scholars Portal, Ontario Council of University Libraries

ebooks Preservation at Scholars Portal Kate Davis & Grant Hurley Scholars Portal, Ontario Council of University Libraries ebooks Preservation at Scholars Portal Kate Davis & Grant Hurley Scholars Portal, Ontario Council of University Libraries The Charlotte Initiative Open Conference March 10, 2017 Outline OCUL and Scholars

More information

Globus Platform Services for Data Publication. Greg Nawrocki University of Chicago & Argonne National Lab GeoDaRRS August 7, 2018

Globus Platform Services for Data Publication. Greg Nawrocki University of Chicago & Argonne National Lab GeoDaRRS August 7, 2018 Globus Platform Services for Data Publication Greg Nawrocki greg@globus.org University of Chicago & Argonne National Lab GeoDaRRS August 7, 2018 Outline Globus Overview Globus Data Publication v1 Lessons

More information

Cyberinfrastructure!

Cyberinfrastructure! Cyberinfrastructure! David Minor! UC San Diego Libraries! San Diego Supercomputer Center! January 4, 2012! Cyberinfrastructure:! History! Definitions! Examples! History! mid-1990s:! High performance computing

More information

Promoting Open Standards for Digital Repository. case study examples and challenges

Promoting Open Standards for Digital Repository. case study examples and challenges Promoting Open Standards for Digital Repository Infrastructures: case study examples and challenges Flavia Donno CERN P. Fuhrmann, DESY, E. Ronchieri, INFN-CNAF OGF-Europe Community Outreach Seminar Digital

More information

Research Data Management: lessons learned - and still to learn

Research Data Management: lessons learned - and still to learn Research Data Management: lessons learned - and still to learn SWITCH Research Data Management (RDM) Workshop, 15. Dezember 2014 Dr., ETH-Bibliothek, ETH Zürich 15.12.2014 1 Overview Digital Curation Office

More information

University of Maryland Libraries: Digital Preservation Policy

University of Maryland Libraries: Digital Preservation Policy University of Maryland Libraries: Digital Preservation Policy July 28, 2013 Approved by the Library Management Group: January 7, 2014 Digital Preservation Policy Task Force: Joanne Archer Jennie Levine

More information

Big Data, exploiter de grands volumes de données

Big Data, exploiter de grands volumes de données Big Data, exploiter de grands volumes de données mardi 3 juillet 2012 Daniel Teruggi, Head of Research dteruggi@ina.fr Ina: Institut National de l Audiovisuel Institut national de l audiovisuel Missions:

More information

Web of Science. Platform Release 5.29 Release 2. Nina Chang Product Release Date: June 3, 2018 EXTERNAL RELEASE DOCUMENTATION

Web of Science. Platform Release 5.29 Release 2. Nina Chang Product Release Date: June 3, 2018 EXTERNAL RELEASE DOCUMENTATION Web of Science EXTERNAL RELEASE DOCUMENTATION Platform Release 5.29 Release 2 Nina Chang Product Release Date: June 3, 2018 Document Version: 1.0 Date of issue : May 30, 2018 RELEASE OVERVIEW The following

More information

GEOSS Data Management Principles: Importance and Implementation

GEOSS Data Management Principles: Importance and Implementation GEOSS Data Management Principles: Importance and Implementation Alex de Sherbinin / Associate Director / CIESIN, Columbia University Gregory Giuliani / Lecturer / University of Geneva Joan Maso / Researcher

More information

Preservation of the H-Net Lists: Suggested Improvements

Preservation of the H-Net  Lists: Suggested Improvements Preservation of the H-Net E-Mail Lists: Suggested Improvements Lisa M. Schmidt MATRIX: Center for Humane Arts, Letters and Social Sciences Online Michigan State University August 2008 Preservation of the

More information

SIP AIP AIP DIP. Preservation Planning. Data Management. Ingest. Access. Archival Storage. Administration MANAGEMENT P R O D U O N S U M E R E R 4-1.

SIP AIP AIP DIP. Preservation Planning. Data Management. Ingest. Access. Archival Storage. Administration MANAGEMENT P R O D U O N S U M E R E R 4-1. Performance Study of Digital Object Format Identification & Validation Tools Quyen Nguyen ERA Systems Engineering National Archives & Records Administration Agenda Background Format Identification Tools

More information

Informatica Enterprise Information Catalog

Informatica Enterprise Information Catalog Data Sheet Informatica Enterprise Information Catalog Benefits Automatically catalog and classify all types of data across the enterprise using an AI-powered catalog Identify domains and entities with

More information

Oracle Database Vault

Oracle Database Vault Oracle Database Vault DBA Administrative Best Practices ORACLE WHITE PAPER MAY 2015 Table of Contents Introduction 2 Database Administration Tasks Summary 3 General Database Administration Tasks 4 Managing

More information

Connecting your Microservices and Cloud Services with Oracle Integration CON7348

Connecting your Microservices and Cloud Services with Oracle Integration CON7348 Connecting your Microservices and Cloud Services with Oracle Integration CON7348 Robert Wunderlich Sr. Principal Product Manager September 19, 2016 Copyright 2016, Oracle and/or its affiliates. All rights

More information

Data Curation: Technical Challenges Facing Repositories. Brianna Marshall Jan. 9, 2014

Data Curation: Technical Challenges Facing Repositories. Brianna Marshall Jan. 9, 2014 Data Curation: Technical Challenges Facing Repositories Brianna Marshall Jan. 9, 2014 Defining digital curation Maintaining and adding value to a trusted body of digital information for current and future

More information

Applied Interoperability in Digital Preservation: Solutions from the E-ARK Project

Applied Interoperability in Digital Preservation: Solutions from the E-ARK Project Applied Interoperability in Digital Preservation: Solutions from the E-ARK Project Kuldar Aas National Archives of Estonia J. Liivi 4 Tartu, 50409, Estonia +372 7387 543 Kuldar.Aas@ra.ee Andrew Wilson

More information

Working with a Preservation Software Vendor - The Kentucky Experience Glen McAninch

Working with a Preservation Software Vendor - The Kentucky Experience Glen McAninch Working with a Preservation Software Vendor - The Kentucky Experience Glen McAninch Kentucky Department for Libraries and Archives November 2014 Best Practices Exchange Montgomery, Alabama Who We Are Kentucky

More information

ISO Self-Assessment at the British Library. Caylin Smith Repository

ISO Self-Assessment at the British Library. Caylin Smith Repository ISO 16363 Self-Assessment at the British Library Caylin Smith Repository Manager caylin.smith@bl.uk @caylinssmith Outline Digital Preservation at the British Library The Library s Digital Collections Achieving

More information

RDMG Research Data Management Group at Freiburg University

RDMG Research Data Management Group at Freiburg University RDMG Research Data Management Group at Freiburg University Round Table RDM, Academy of Sciences in Heidelberg 13/07/2018 Dirk von Suchodoletz, escience dept. of the Computer Center Institutional RDM Rising

More information

Richard Marciano Alexandra Chassanoff David Pcolar Bing Zhu Chien-Yi Hu. March 24, 2010

Richard Marciano Alexandra Chassanoff David Pcolar Bing Zhu Chien-Yi Hu. March 24, 2010 Richard Marciano Alexandra Chassanoff David Pcolar Bing Zhu Chien-Yi Hu March 24, 2010 What is the feasibility of repository interoperability at the policy level? Can a preservation environment be assembled

More information

Digital Curation and Preservation: Defining the Research Agenda for the Next Decade

Digital Curation and Preservation: Defining the Research Agenda for the Next Decade Storage Resource Broker Digital Curation and Preservation: Defining the Research Agenda for the Next Decade Reagan W. Moore moore@sdsc.edu http://www.sdsc.edu/srb Background NARA research prototype persistent

More information