The role of PIONIER network in long term preservation services for cultural heritage institutions in Poland

Transcription

1 The role of PIONIER network in long term preservation services for cultural heritage institutions in Poland Marcin Werla Poznań Supercomputing and Networking Center Poznań, POLAND

2 PIONIER Polish Optical Network The mission of the PIONIER Consortium is the construction of Polish Optical Network and the support of the statutory activities of the leading institutions and the development of the Information Society in general, using the network and IT infrastructure. In the period from 200 to December 20, 5433 kilometres of fibres cables were built Together with fibres leased from other telco operators 6494,26 kilometres of fibres in PIONIER network are used. Two independent transmission systems, using separate optical fibres Two 2x0 Gbit/s links which connect all 2 Metropolitan Area Academic Networks. The second DWDM transmission system enables to use 80 0 Gbit/s optical channels.

3 Popular Archiving Service in PIONIER Storage cloud backend includes 5 HSMs with disks and tapes 5 file servers installed 0 data centers distributed across the country Storage cloud offers the users 2+PBs of tape capacity and 2+ PBs of disk storage and total I/O throughput of 5GB/s Reliable and highly-available service automatic and transparent data and metadata replication fail-over among multiple redundant components The access to the system is easy and efficient standard protocols including SFTP and WebDAV for efficient transfers of large data volumes GridFTP protocol can be used Service provides high storage safety and security support for end-to-end data encryption data integrity control SSL-protected data transmission security procedures employed at storage sites.

4 Campus Computing Service in PIONIER Allows users from academic institutions to access applications and virtual machines on demand 744 nodes, including 248 nodes with NVidia Quadro accelerators 23 TB of RAM 784 TB of disk storage 60 Tflops of computing power 8 XL clusters 30 computational nodes, 6 graphical nodes 48 TB of disk space 2 L clusters 20 computational nodes, 0 graphical nodes 24 TB of disk space 0 Gbit Ethernet network inside the system

5 Digital Library Services in PIONIER Developed since 999 dlibra - first Polish software for building digital libraries Developed to stimulate the development of digital libraries in the PIONIER network At the moment: Around 80 deployments Around 300 institutions Around.5 mln objects available on-line

6 DInGO: Digitise and Go! Evolution of dlibra system to a complex software package dlibra: system for digital libraries dmuseion: system for digital museums dlab: system for management of digitisation process darceo: long term preservation services

7 DInGO components integrated Selection of objects for digitisation Preparation of digital object On-line publishing Archiving Master files Planned objects Digitisation, processing Presentation files Access

8 DInGO: darceo Overview Developed in PSNC since 20 as a part of national research project SYNAT, to be open-source soon Focused on long-term preservation of digital objects invarious formats, including images, text and audiovisual content Based on OAIS model Used in practice by several Polish institutions, including consortium of 6 institute libraries of Polish Academy of Sciences Supporting several storage systems, including PIONIER Popular Archiving Service

9 DInGO: darceo Features Data analysis Identification of file formats based on PRONOM database Extraction of technical metadata (TextMD, AES57, MIX standards) Data storage Disk arrays, tapes, external services Built-in data replication Archival package compliant with METS and PREMIS

10 DInGO: darceo Features Data monitoring and control Obsolete format detection based on UDFR (GDFR+PRONOM) Periodic verification of data based on checksums Automated generation of reports and summaries Data processing Support for migration between data formats Extendable mechanism of migration and conversions services Data migration and conversion plans composing of several services Support for PIONIER Campus Computing is now beeing developed in MAN-HA national project

11 The role of PIONIER network in long term preservation services for cultural heritage institutions in Poland Summary PIONIER Network connecting public data and computational centres with public cultural and scientific institutions PIONIER Popular Archival Service PIONIER Campus Computing Service DInGO DInGO DInGO DInGO DInGO DInGO DInGO DInGO

12 Thank you for your attention! Any questions? Marcin Werla

13 Poznań Supercomputing and Networking Center affiliated to the Institute of Bioorganic Chemistry of the Polish Academy of Sciences, ul. Noskowskiego 2/4, Poznań, POLAND, Office: phone center: (+48 6) , fax: (+48 6) ,