Samen bouwen aan een netwerk van landelijke voorzieningen voor digitale, duurzame toegankelijkheid in Nederland

Transcription

1 Samen bouwen aan een netwerk van landelijke voorzieningen voor digitale, duurzame toegankelijkheid in Nederland Voor: LCRDM sub werkgroepen van Werkgroep Faciliteiten en Datainfrastructuur oktober 2016 Joost van der Nat (NCDD)

2 Agenda 1. NCDD and Netwerk Digitaal Erfgoed 3. Analytical framework 4. Matrix 5. Scenarios 6. Blokjes model 7. HORA

3 The NCDD exists since 2008 as a cross-domain national coalition covering the entire public sector MISSION: To establish an organisational and technical infrastructure for long term access to all digital objects which are of crucial importance for science, culture and society Platform Catalyst 5 Members: The National Archive (NA) The National Library of the Netherlands (KB) Data Archiving and Networked Services (DANS) Dutch Institute for Sound and Vision (Beeld & Geluid) The Netherlands Cultural Heritage Coalition for Digital Preservation (CCDD) 3

4 The Dutch Digital Heritage Network 4

5 NCDD: the Content layer 5

6 NCDD en het NDE: Houdbaar : Digitaal Erfgoed Houdbaar Schaalbare en bruikbare voorzieningen Transparante kostenstructuur Rollen en verantwoordelijkheden A.1 Gedistribueerde voorzieningen A.2 Persistent Identifiers A.3 Software Sustainability B.1 Inzicht in kosten C.1 Use cases collectievorming C.2 Duurzaamheidsbeleid C.3 Certificering C.4 Expertisenetwerk preservation C.5 Coördinatie webarchivering 6

7 Agenda 1. NCDD and Netwerk Digitaal Erfgoed 3. Analytical framework 4. Matrix 5. Scenarios 6. Blokjes model 7. HORA

8 Analytical framework, 3 layers model of the Ministry of OCW 8

9 Analytical framework, 3 columns model of NCDD Scope 9

10 Analytical framework, infrastructure 10

11 Most important sources used The Final Report of the Blue Ribbon Task Force APARSEN D21.1 Overview of Preservation Services 4C Investing in Curation, A Shared Path to Sustainability DANS Data Seal of Approval, Guidelines version 2 DCH-RP D3.1 Study on a Roadmap for Preservation (revision 3.1) Jack van Hoof IT Services Stack public domain v0.1

12 Analytical framework, APARSEN WP 21 (2012) High-level service 1 Characterisation of SIPs 2 Quality assurance of SIPs 3 Policy-based assessment of SIPs 4 Acquisition and maintenance of represent. info 4.1 Automated metadata creation/maint Metadata migration 5 Environment monitoring (preservation watch) 5.1 Knowledge model comparison 6 Preservation plan formulation 6.1 Obsolescence substitution 6.2 Dependency management 7 Authenticity evidence management 8 Appraisal of collections 9 DRM clearinghouse 10 Brokerage between repositories 11 Long-term archiving 11.1 Integrity checking 11.2 Cloud storage for preservation 12 Preservation policy construction 13 Analysis of authenticity management policies 14 Format transformation 15 Finding aids 15.1 Federated search 16 PID resolver 17 Emulation facilities 18 Full repository service 19 Audit and certification of repositories service is a key contributor to the corresponding OAIS functional entity indicates possible or marginal relevance Ingest Preservation Planning Data Management Archival Storage Administration Access 12

13 Analytical framework, overall 13

14 Agenda 1. NCDD and Netwerk Digitaal Erfgoed 3. Analytical framework 4. Matrix 5. Scenarios 6. Blokjes model 7. HORA

15 Organisations interviewed The Rijksmuseum (Amsterdam) The National Library (KB, The Hague) DANS (Data Archiving and Networked Services, The Hague) The Dutch Institute for Sound and Vision (Hilversum) Het Nieuwe Instituut (former Architecture Institute, Rotterdam) The Amsterdam City Archive The National Archives (The Hague) The International Institute for Social History (Amsterdam) LIMA (sustainable access to media art, Amsterdam) Nationaal Museum van Wereldculturen (National Museum of Ethnology + Tropical Institute + Africa Museum) 15

16 Matrix, preliminary results versie 5, OVERALL TO BE and AS IS separate per organisation separate per domain national level Elements Systems Enterprise Architecture ❸-❺ 8❼❾❶❻❽ ICT network ❶❹❺❻❾ ❸❼❽ ICT hardware ❺ 48❹❻❾ ❶❸❼❽ ICT storage ❺❾ 48❹❻ ❶❸❼❽ ICT technical operations ❺ 8❹❻❾ ❶❸❼❽ ICT software ❺ 8❹❻❽❾ ❶❸❼ ICT application management ❶❸check❹❺ 8❻❽❾ ❼ ICT functional management ❶❸check❹❺❻❼❾ 8❽ Pre Primary Meta data obtain ❶-❺❻❼❾ ❸❽ Process conversion ❶❸-❺❻❼❾ ❽ enrichment ❶-❺❻❼❾ ❸❽ Primary process Ingest 1❶ SIP-check ❶❸❹❺❻❼❾ ❽ meta data obtain / maintenance ❶❸❺❻❼❾ ❹❽ meta data automated ❸❺❻❾ ❹❼❽ format transformation ❶❺❻❼❾ 4❹❽ ❶❸ Archival Storage 1 ❶ appraisal ❻❼❾ 5❽ ❺❶❸ long term storage (Preservation as a service) ❾ 4❹❼❽ 5❶❸❺❻ integrity check ❾ ❹❼❽ 5❶❸❺❻ Access 1❶ DRM clearinghouse ❶❺❻❼❾ 4❸❹❽ finding aids ❶❻❼ ❸check❽❾ 4❺❹ federated search ❶ ❼❾ 5❺❸check❹❻❽ PID resolver ❶❸❹❺❻❼❽❾ emulation facilities ❻ ❸❹-❼❽❾ Support of Preservation Planning - ❶ Primair Proces preservation watch (Format Registry) ❶❻ 8❸❹❺❼❽❾ preservation plan formulation ❸❺ 7❾❶❹❼❽ ❻ dependency management ❺ ❾❶❹❼❽ ❻❸ authenticity evidence management ❸ ❾❶❹❼❽ ❻❺ exchange between repositories ❶❸❹❾ 75❺❻❼❽ Data Management ❶❸❺❻❼❾ 4❹❽ Administration 158❺ ❶❽ preservation policy construction ❹❺❾ 78❸❶❼❽ ❻ Preservation tools ❶ 4❸❹❺❻❼❽❾ Secondary Quality Assurance ❻ 7❺❼❾❶❸❹❽ support Training ❺❶❹❼❽ 5❸❻❾ Research and development ❻❺❶❹❽ 53❸❾❼ Audit & Certification 13check ❶❼ ❸check❹❺❻❽❾ LEGENDA 1 Rijksmuseum 4 DANS 7 Stadsarchief ASD 10 LI-MA 16 2 Rijksdienst voor het Cultureel Erfgoed (RCE) 5 Instituut voor Beeld & Geluid 8 Nationaal Archief 11 Rijksmuseum Volkenkunde 3 Koninklijke Bibliotheek 6 Het Nieuwe Instituut 9 IISG

17 Preliminary results, matrix ICT 17

18 Agenda 1. NCDD and Netwerk Digitaal Erfgoed 3. Analytical framework 4. Matrix 5. Scenarios 6. Blokjes model 7. HORA

19 Scenarios, goal The overall purpose why to foster cooperation is to increase both Effectiveness and Efficiency: the ultimate goal is to enable all digital archiving organisations in The Netherlands to make and keep their digital objects accessible (effectiveness ), and to do this at costs that are as low as possible. This can be achieved by cooperating; economies of scale (efficiency). The assumption is that the more is cooperated, the bigger the delta is in increased Effectiveness and Efficiency. It is important to make a distinction between administrative responsibilities and operational responsibilities (that can be outsourced). The starting point for NCDD is: share what is possible, keep separate what must be separate. 19

20 Scenarios SCENARIO 1 Doing nothing extra 2 Ad Hoc (extend present practice) 3 Shared Services 3 A Technical infrastructure 3 B Digital Preservation Services 3 C Distributed National Infrastructure Digital Preservation 4 One NL e-depot 20

21 Agenda 1. NCDD and Netwerk Digitaal Erfgoed 3. Analytical framework 4. Matrix 5. Scenarios 6. Blokjes model 7. HORA

22 Scenario 3, building blocks generic Organisation X GENERIC BUSINESS IT STACK (example Services) TASKS & Business PRODUCTS SERVICES TARGETS ASSETS RESPONSIBIL. Business Processes BUSINESS FUNCTIONS VALUE CHAINS BUSINESS ACTIVITIES DEPARTMENTS EMPLOYEES CUSTOMERS SUPPLIERS RULES Business Applications Landscape applications SPECIFIC SOFTWARE GENERIC SOFTWARE BUSINESS INTELLIGENCE Application Infrastructure WEB SERVER APPLICATION SERVER FILE XFER (ESB) B2B GATEWAY PRESENTATION (PORTAL) DBMS DATA WAREHOUSE Technical Infrastructure STORAGE (NAS/SAN) DIRECTORY SERVICES ACCESS MANAGEMENT VIRTUAL MACHINE OPERATING SYSTEM NETWORK SERVICES Hardware Hardware SERVERS ROUTERS WIRING SWITCHES PRINTERS Locations DATA CENTERS OFFICE HOME MOBILE 22

23 Scenario 3, LTDP building blocks (analytical framework taken into account) Business STANDARDS COST BENEFIT MODELS AUDIT & CERTIFICATION TASKS & RESPONSIBILITIES SERVICES TARGETS ASSETS PRODUCTS Processes SEMANTICS PRESERVATION POLICY TRAINING BUSINESS FUNCTIONS BUSINESS COMPONENTS VALUE CHAINS ACTIVITIES BUSINESS RULES COLLECTION SUPPLIERS QUALITY ASSURANCE R & D DEPARTMENTS EMPLOYEES BUSINESS PARTNERS CUSTOMERS SERVICE SUPPLIERS Business Applications Landscape PID PRESERVATION TOOLS EMULATION OAIS 1 - n REPOSITORY REFERENCE LAYER BUSINESS INTELLIGENCE MORE GENERIC APPLICATIONS ORG. SPECIFIC SOFTWARE Application Infrastructure GENERIC APPLICATION INFRASTRUCTURE SERVICES SPECIFIC SERVICE 1 SPECIFIC SERVICE 2 SPECIFIC SERVICE n Technical Infrastructure GENERIC TECHNICAL INFRASTRUCTURE SERVICES SPECIFIC SERVICE A SPECIFIC SERVICE n Hardware GENERIC HARDWARE SERVICES SPECIFIC SERVICE Locations 4 (GOVERNMENTAL) DATA CENTERS SPECIALIZED DATA CENTER DEDICATED DATA CENTER OFFICES HOME MOBILE 23

24 Organisation specific Domain specific Shared Service B Business STANDARDS COST BENEFIT MODELS AUDIT & CERTIFICATION LEGAL TASKS & RESPONSIBILITIES SERVICES TARGETS ASSETS PRODUCTS Processes SEMANTICS PRESERVATION POLICY TRAINING BUSINESS FUNCTIONS BUSINESS COMPONENTS VALUE CHAINS ACTIVITIES BUSINESS RULES COLLECTION SUPPLIERS QUALITY ASSURANCE R & D DEPARTMENTS EMPLOYEES BUSINESS PARTNERS CUSTOMERS SERVICE SUPPLIERS C Business Applications Landscape PID PRESERVATION TOOLS EMULATION OAIS 1 - n REPOSITORY REFERENCE LAYER BUSINESS INTELLIGENCE MORE GENERIC APPLICATIONS ORG. SPECIFIC SOFTWARE Application Infrastructure GENERIC APPLICATION INFRASTRUCTURE SERVICES SPECIFIC SERVICE 1 SPECIFIC SERVICE 2 SPECIFIC SERVICE n Technical Infrastructure GENERIC TECHNICAL INFRASTRUCTURE SERVICES SPECIFIC SERVICE A SPECIFIC SERVICE n Hardware GENERIC HARDWARE SERVICES SPECIFIC SERVICE A Locations 4 (GOVERNMENTAL) DATA CENTERS SPECIALIZED DATA CENTER DEDICATED DATA CENTER OFFICES HOME MOBILE

25 Preferred Scenario for Deployment Distributed National Infrastructure for Digital Preservation time C Distributed applications for DP A Technical infrastructure B Preservation Services Technical infrastructure (A) en Preservation Services (B) can run parallel Technical infrastructure (A) is conditional for Distributed applications for Digital Preservation (C) First steps for A are in progress: 4 Governmental Data Centres For Archives, the National Archive is deploying its e-depot NCDD is developing Services for B in its present projects 25

26 Agenda 1. NCDD and Netwerk Digitaal Erfgoed 3. Analytical framework 4. Matrix 5. Scenarios 6. Blokjes model 7. HORA

27 Ontwikkelingen Principes Digitaal leren & werken Studentmobiliteit Onderzoeksdata Cloud computing Integratie Business Informatievoorziening Technologie Businessmodel Informatie Bedrijfsfuncties Applicatieplatform Bedrijfsprocessen Applicaties Enterprise-architectuur Gebruik van HORA Competentieontwikkeling Hoger Onderwijs Referentie Architectuur

28 HORA: Beheer van de data life cycle met DDI (Data Documentation Initiative)

29 More information Report: (in Dutch) Program Manager: Marcel Ras Researcher: Joost van der Nat