Digital Preservation in the Cloud Benefits and Considerations for State Archives Tuesday 10 Feb 2015 Preservica & Amazon Web Services

Transcription

1 Webinar Program 2015 Digital Preservation in the Cloud Benefits and Considerations for State Archives Tuesday 10 Feb 2015 Preservica & Amazon Web Services

2 Acknowledgements This webinar is made possible by a grant from:

3 Introduction Welcome! Latest initiatives from SERI/CoSA Sarah Koonts President CoSA

4 Agenda: Digital Preservation in the Cloud Introduction Core requirements of a Digital Preservation System Checklist for selecting Cloud Storage for Digital Preservation Michael Hope Preservica Checklist for selecting a fully Cloud hosted Digital Preservation service Summary and Questions Paul Beda Senior Solutions Architect Amazon Web Services

5 Digital Content is Fragile Need to protect digital assets from loss and degradation Need to proactively manage file formats & metadata

6 Digital Preservation System : Requirements 6. Information Preservation 5: Information Processes 4: Information Organisation Usable information Findable information 3: Storage Validation 2: Storage Management Durable storage 1: Safe Storage

7 Digital Preservation System : Requirements Preservation 6. Information Preservation Usable information Administration Ingest Access OAIS ISO Data Man. Storage 5: Information Processes 4: Information Organisation 3: Storage Validation 2: Storage Management Findable information Durable storage 1: Safe Storage

8 State Archives using Preservica (partial list) Archives of Michigan Massachusetts State Archives Alabama Department of Archives & History Texas State Library and Archives Wisconsin State Archives State of Vermont Archives Useful Resources Case Study: KDLA Video: KDLA Government Computer News (GCN) article: Michigan Press Release: Texas White paper: Achieving a Step Change in Digital Preservation Capability (DPCMM) Webinar: Achieving a Step Change in Digital Preservation Capability (DPCMM)

9 Digital Preservation System : Requirements Preservation 6. Information Preservation Usable information Administration Ingest Access OAIS ISO Data Man. Storage 5: Information Processes 4: Information Organisation 3: Storage Validation 2: Storage Management Findable information Durable storage 1: Safe Storage

10 Cloud Storage is ideal for Digital Preservation Cloud Storage is ideal for Digital Preservation Affordable Pay-as-you-go Highly scalable Durable Flexible Secure

11 Cloud Storage is ideal for Digital Preservation Cloud Storage is ideal for Digital Preservation Affordable Pay-as-you-go Highly scalable Durable Flexible Secure

12 Cloud Storage Checklist Cloud Storage Check list Durability multiple copies, multiple locations No Single Point of failure multiple copies, multiple locations Self Healing Integrity Checking Example: Amazon S3 - designed to provide an average annual durability of % per archive

13 Cloud Storage Checklist Cloud Storage Check list Durability multiple copies, multiple locations Flexibility for different content manifestation types low latency option for frequently accessed content (e.g. low resolution, presentation/access content) lower cost option for content that is rarely retrieved (e.g. high resolution, dark archive / preservation content)

14 Cloud Storage Checklist Cloud Storage Check list Durability multiple copies, multiple locations Flexibility for different content manifestation types Security - robust enterprise-grade with certification, compliance and best practice

15 Cloud Storage Checklist Cloud Storage Check list Durability multiple copies, multiple locations Flexibility for different content manifestation types Security - robust enterprise-grade with certification, compliance and best practice Security - choice of content location and jurisdiction 10 Regions 25 Availability Zones 51 Edge Locations Regions are isolated from each other All data/content stays within the region Three Availability zones per region S3 & Glacier are built across two availability zones to achieve high availability and durability

16 Cloud Storage Checklist Cloud Storage Check list Durability multiple copies, multiple locations Flexibility for different content manifestation types Security - robust enterprise-grade with certification, compliance and best practice Security - choice of content location and jurisdiction Security - optional Encryption Service for highly confidential or sensitive content

17 Cloud Storage Checklist Cloud Storage Check list Durability multiple copies, multiple locations Flexibility for different content manifestation types Security - robust enterprise-grade with certification, compliance and best practice Security - choice of content location and jurisdiction Security - optional Encryption Service for highly confidential or sensitive content Security optional AWS GovCloud for additional security

18 Cloud Storage Checklist Cloud Storage Check list Durability multiple copies, multiple locations Flexibility for different content manifestation types Security - robust enterprise-grade with certification, compliance and best practice Security - choice of content location and jurisdiction Security - optional Encryption Service for highly confidential or sensitive content Security optional AWS GovCloud for additional security

19 Cloud Storage Deployment: Examples hybrid: on premise & cloud fully cloud hosted

20 Cloud Hosted Digital Preservation Service Considerations Architectural Checklist Feature Checklist Commercial Checklist

21 Architectural Checklist Technical/Service Checklist OAIS Digital Preservation not just bit level storage

22 Architectural Checklist Technical/Service Checklist OAIS Digital Preservation not just bit level storage Architected, tested and proven to run in the Cloud

23 Architectural Checklist Technical/Service Checklist OAIS Digital Preservation not just bit level storage Architected, tested and proven to run in the Cloud Users never need to know about the infrastructure

24 Architectural Checklist Technical/Service Checklist OAIS Digital Preservation not just bit level storage Architected, tested and proven to run in the Cloud Users never need to know about the infrastructure Highly Durable Storage Data Centers AWS S3 for fast access AWS Glacier for dark cheap storage

25 Architectural Checklist Technical/Service Checklist OAIS Digital Preservation not just bit level storage Architected, tested and proven to run in the Cloud Users never need to know about the infrastructure Highly Durable Storage Multi-layer Security Built In

26 Architectural Checklist Technical/Service Checklist OAIS Digital Preservation not just bit level storage Architected, tested and proven to run in the Cloud Users never need to know about the infrastructure Highly Durable Storage Multi-layer Security Built In

27 Feature Checklist Technical/Service Checklist Storage policy management with integrated storage connectors

28 Feature Checklist Technical/Service Checklist Storage policy management with integrated storage connectors Collection management, active preservation & public access - one system

29 Feature Checklist Technical/Service Checklist Storage policy management with integrated storage connectors Collection management, active preservation & public access - one system Server-side rendering for multi-device support and minimise downloads Server

30 Feature Checklist Technical/Service Checklist Storage policy management with integrated storage connectors Collection management, active preservation & public access - one system Server-side rendering for multi-device support and minimise downloads Efficient ingest tools and large file uploading options

31 Feature Checklist Technical/Service Checklist Storage policy management with integrated storage connectors Collection management, active preservation & public access - one system Server-side rendering for multi-device support and minimise downloads Efficient ingest tools and large file uploading options Easy content retrieval tools e.g. copy home secure FTP

32 Feature Checklist Technical/Service Checklist Storage policy management with integrated storage connectors Collection management, active preservation & public access - one system Server-side rendering for multi-device support and minimise downloads Efficient ingest tools and large file uploading options Easy content retrieval tools e.g. copy home secure FTP

33 Commercial Checklist Commercial Checklist Location can I specify where my content is stored?

34 Commercial Checklist Commercial Checklist Location can I specify where my content is stored? Confidentiality how should I treat confidential content?

35 Commercial Checklist Commercial Checklist Location can I specify where my content is stored? Confidentiality how should I treat confidential content? Compliance and Standards ISO OAIS ISO Trusted Digital Repository (TDR/TRAC self-audit) ISO 9001 Development ISO Information Security HIPPA, EU Data Protection etc.

36 Commercial Checklist Commercial Checklist Location can I specify where my content is stored? Confidentiality how should I treat confidential content? Compliance and Standards Exit is there a cost to get content out at end of contract?

37 Commercial Checklist Commercial Checklist Location can I specify where my content is stored? Confidentiality how should I treat confidential content? Compliance and Standards Exit is there a cost to get content out at end of contract? Service is there an overall contractual commitment? availability, support, operations, backup, maintenance, privacy, fair use etc.

38 Commercial Checklist Commercial Checklist Location can I specify where my content is stored? Confidentiality how should I treat confidential content? Compliance and Standards Exit is there a cost to get content out at end of contract? Service is there an overall contractual commitment? Affordable - combined service operation, support, maintenance, software, infrastructure and storage

39 Commercial Checklist Commercial Checklist Location can I specify where my content is stored? Confidentiality how should I treat confidential content? Compliance and Standards Exit is there a cost to get content out at end of contract? Service is there an overall contractual commitment? Affordable - combined service operation, support, maintenance, software, infrastructure and storage

40 Summary : Digital Preservation in Cloud Durable, affordable, scalable and secure nature of Cloud Storage is ideal for Digital Preservation Cloud Storage alone is not Digital Preservation Preservation with Access is vital for long term sustainability No one size fits all Make sure the service meets architectural, technical & commercial considerations/checklists Proven the Cloud and Cloud storage are already being used for Digital Preservation at a number of State Archives

41 Practical Next Steps Preservica LIVE Demo Digital Preservation in Cloud: Resources CoSA NAGARA Joint Annual Meeting Austin, Texas July 2015

42 Questions?

43 Thank you!

44 WRAP-UP Post-webinar evaluation will automatically open in your web browser when you exit the session. All webinar slides available from the SERI webinar page: Educational-Webinar-Series/SERI-Educational-Webinar-Recordings-Materials.aspx