ARTYDOC, the digital archive of the Meteorological Service of Catalonia Marc Prohom Mònica Herrero Montse Cañas

Transcription

1 ARTYDOC, the digital archive of the Meteorological Service of Catalonia Marc Prohom Mònica Herrero Montse Cañas 11th EUMETNET Workshop on Data Management Zagreb, October 2017

2 OVERVIEW Background and motivation of the project Main features of the digital documents What is ARTYDOC and how it works

3 BACKGROUND AND MOTIVATION OF THE PROJECT The Meteorological Service of Catalonia (SMC) was established in 1921 and had a great activity in many aspects. Documented, recovered and concentrated within one single archive many previous official observation initiatives (since 1890s) 1939 SMC is closed by force as a result of Franco s Dictatorship ( ). Observational documents get lost or scattered around several archives, mostly in Madrid (Spanish Met Service) The Catalan regional law (approved by the Spanish Courts) gives again meteorological responsibilities to Catalonia The restored SMC is created as a service within the Environment Department (Autonomous government). Documentation saved is returned to SMC by the Spanish Met Service. Historical Meteorological Archive is created SMC becomes a public company after coming into force the Catalan Meteorological Law.

4 BACKGROUND AND MOTIVATION OF THE PROJECT Since 2001, many internal DARE projects have been undertaken at SMC trying to digitize and unify in a single repository as many climate documentation as possible. Official meteorological archives Historical Scientific Societies Corporative archives (Electric power companies) Religious archives (Jesuits and Pairists) Local, provincial and county archives Old Newspapers Historical observatories Private donations

5 BACKGROUND AND MOTIVATION OF THE PROJECT Flow-chart strategy 1 ( ) Identification of repositories Document consultation within the archive Digitalitzation Risk of document degradation No digital preservation Time consuming during QC process

6 BACKGROUND AND MOTIVATION OF THE PROJECT Flow-chart strategy 2 ( ) Identification of repositories Professional imaging/scanning Digital document Final extraction of data Professional imaging is very expensive The original documents demands restoration in many cases Wide range of digital storage platforms: DVDs, CDs, external hard disks

7 BACKGROUND AND MOTIVATION OF THE PROJECT Flow-chart strategy 3 (since 2013) Identification of repositories + donations from observers Restoration of more deteriorated docs HD Digital Camera and equipment + profesional imaging Digital document Digital copy of both data and documentation Original documents stored at the Catalan National Archive Final extraction of data

8 BACKGROUND AND MOTIVATION OF THE PROJECT HUGE AMOUNT OF DIGITAL INFORMATION!!!! 6.4 TB and growing! Need for a unique and save storing system: NAS (Network Attached Storage) with 14 TB of capacity Need for a usable and reliable cataloguing tool

9 MAIN FEATURES OF THE DIGITAL INFO: TYPOLOGY Manuscripts Meteorological sheets and loggbooks Publications Photos Historical Press Strip charts

10 MAIN FEATURES OF THE DIGITAL INFO: FILES 535,000 digital files in a varity of formats (png, tiff, bmp, jpg, pdf) and of different quality/resolution. Observers 1% Historical obsv. 2% Others 1% Old Newspapers 2% Religious archives 3% Local archives 2% SMC archives 22% AEMET archives 68% Where do digital files come from?

11 MAIN FEATURES OF THE DIGITAL INFO: VOLUME 86% of the volume comes from SMC archives (higher resolution) Volume of digital data (in GB)

12 WHAT IS ARTYDOC AND HOW IT WORKS ARTYDOC is the solution for storage, management, cataloguing, description and dissemination of the climate digital information at SMC. Web-based software Software developed by ARTYPLAN a leading Catalan company highly specialized in any print and copy service ( In 2003 started a new division: Document. This division linked to the world of the archives, biblioteconomics, documentation and TIC. ARTYDOC for climatic digital archives is being developed jointly with SMC.

13 WHAT IS ARTYDOC AND HOW IT WORKS DESIGN: the main point is how the information is internally classified according to the varity of info and digital formats. CATEGORIES: 1. Numerical data (sheets) 2. Publications and historical press 3. Photos 4. Strip charts 1. Numerical data: cataloguing info Key value: station code (name station, municipality, county, geographic info, observers) Parameter observed Temporal coverage (initial and final date) Temporal resolution (subdaily, daily, monthly, yearly) Format (sheets, logbooks, postal cards ) Producer (SMC, AEMET ) Source (which archive) Informer (technitian how entered the info) Creation date (when was created)

14 WHAT IS ARTYDOC AND HOW IT WORKS

15 WHAT IS ARTYDOC AND HOW IT WORKS Searcher of digital files Navigation menu Last entries

16 WHAT IS ARTYDOC AND HOW IT WORKS Searcher of digital files Several filters can be implemented Results in a list format

17 WHAT IS ARTYDOC AND HOW IT WORKS Searcher of digital files Several filters can be implemented Results on a visual navigator

18 WHAT IS ARTYDOC AND HOW IT WORKS Searcher of digital files

19 WHAT IS ARTYDOC AND HOW IT WORKS: SUMMARY GOOD NEWS ARTYDOC fits well SMC demands for digital storing and cataloguing Useful tool for preservation and consultation Is fully transparent: the administrator has full capacity for adding new requirements Very adequate for QC purposes In a year the platform will be publicly accessible BAD NEWS Only 25% of the images are already catalogued, and they are the simplest ones: T and PPT postal cards No extra funding for cataloguing personnel is available

20 puno hvala!