DigCCurr 2009 Digital Curation Practice, Promise and Prospects. IBM Demo Session

Size: px

Start display at page:

Download "DigCCurr 2009 Digital Curation Practice, Promise and Prospects. IBM Demo Session"

Dorcas Harvey
5 years ago
Views:

1 IBM Global Business Services Long-Term Preservation Center of Excellence The Netherlands DigCCurr 2009 Digital Curation Practice, Promise and Prospects IBM Demo Session April 1st 2009 Dr. Raymond J. van Diessen Tel:

2 Preservation Manager Demo 2

3 Objectives The Preservation Manager provides the services for monitoring the technical environments needed to ensure accessibility of the digital objects over time: Identification of digital objects endangered of becoming inaccessible due to technology changes (hardware and software) Guiding the preservation actions to be taken, i.e. implementation of specific migration and emulation strategies Supplying technical metadata to generate / validate the technical environments during delivery / rendering of a digital object 3

4 Preservation Manager Core Concepts On a abstract level the complete hardware and software stack needed to render a digital asset contains four layers Digital Asset Data Format Rendering Application Operating System Reference Platform The Data Format identifies the structure and some of the meaning of a bit-stream. The structure and meaning of the bit-stream are further defined within the application logic of a specific Rendering Application The Operating System contains shared functionalities that all rendering applications need like access to a printer, screen, file interaction, font rendering etc. The Reference Platform specifies how the bits and bytes are transformed to a physical representation like pages or images Requested Information Object 4

5 View Paths PDF version 7.0 Windows Acrobat Reader AIX Acrobat Reader Win 95 Win XP Vista AIX 4.3 AIX 5.2 Pentium 4 Intel Dual Core p4series p5series 5

6 View Paths PDF version 7.0 Windows Acrobat Reader AIX Acrobat Reader Win 95 Win XP Vista AIX 4.3 AIX 5.2 Pentium 4 Intel Dual Core p4series p5series So Windows 95 gets obsolete.. 6

7 View Paths PDF version 7.0 Windows Acrobat Reader AIX Acrobat Reader Win 95 Win XP Vista AIX 4.3 AIX 5.2 Pentium 4 Intel Dual Core p4series p5series So Windows 95 gets obsolete.. And Acrobat for AIX is no longer supported.. 7

Preservation Manager The Preservation Manager knows two modes of operation: model view and browser view Model View Defining file formats Building the structures to maintain the technical metadata

8 Preservation Manager The Preservation Manager knows two modes of operation: model view and browser view Model View Defining file formats Building the structures to maintain the technical metadata (PLMs) Specifying technical metadata (View Paths) Creating associations between objects/collections and View Paths Browser View Searching entry for all defined technical metadata Recursive closure of dependencies Entry point to conduct What-If scenarios 8

9 Model View The technical metadata is defined Lego Style through the reuse of more basic building block Attribute 9

10 Model View The technical metadata is defined Lego Style through the reuse of more basic building block Layer 10

11 Model View The technical metadata is defined Lego Style through the reuse of more basic building block PLM 11

12 Model View The technical metadata is defined Lego Style through the reuse of more basic building block File Type 12

13 Model View The technical metadata is defined Lego Style through the reuse of more basic building block View Path 13

14 Quality Control Quality control within the Preservation Manager is being managed by the status indicator of each building block (above is also applicable for other building block: layer, PLM, view path and file type) 14

15 Browser View The Browser view provides a structured navigation process through the technical metadata and their dependencies 15

16 Usage Scenarios Preservation Manager be used in different type of configurations: Usage Scenarios: Additional DIAS component File type management Technical metadata management File / Software Registry File type management Software configuration management IBM's Preservation Manager future value propositions: File / Software Registry implementation IBM controlled formats and software stacks Signaling and advisory services Combining with IBM s Preservation Data Store Technology Specifying migration actions RepInfo Manager 16

17 Universal Virtual Computer Demo 17

18 Technology Innovation The speed of technology change is only increasing and with it technology obsolescence ENIAC (1946) PDP-11 (1970) IBM AT (1981) OQO (2002) Macintosh (1984) IBM BLUE GENE/L (2005) 18

19 Universal Virtual Computer The UVC has a very elementary instruction set (25) and it is a bit addressable op (8 bits) segment (32 bits) flag (1 bit) register (31 bits) segment (32 bits) flag (1 bit) register (31 bits) Move information between registers and memory Comparison instructions Load Reg1 (dest), Reg2 (address), Reg3 (length) Grt Reg1 (arg1), Reg2 (arg2) Store Reg1 (src), Reg2 (address), Reg3 (length) Equ Reg1 (arg1), Reg2 (arg2) Lsign Reg1 (dest), Reg2 (address) Logical instructions Ssign Reg1 (src), Reg2 (address) Not Reg1 (dest), Operations on registers Or Reg1 (dest), Reg2 (arg1) Loadr Reg1 (dest), Reg2 (src) And Reg1 (dest), Reg2 (arg1) Psign Reg1 (positive) Instructions that alter the flow of execution Nsign Reg1 (negative) Br Reg1 (address) Loadc Reg1 (dest), Reg2 (length), bit string Brc Reg1 (address) Rlen Reg1 (length), Reg2 (src) Break Numeric instructions Call Reg1 (section), Reg2 (address), Reg3 (argument) Add Reg1 (dest), Reg2 (arg) Stop Subt Reg1 (dest), Reg2 (arg) Communication with the outside world (I/O) Mult Reg1 (dest), Reg2 (arg) In Reg1 (msg type), Reg2 (length), Reg3 (address) Div Reg1 (quotient), Reg2 (arg), Reg3 (remainder) Out Reg1 (msg type), Reg2 (length), Reg3 (address) 19

20 Virtualization UVC is a segment-based machine with almost unlimited resources Segment 3 Segment 2 Segment 1 Register 1 Register 1 Register 1 Register 2 Register 2 Register 2 Register 3* Register 3* Register 3* Low Address Low Address value value length sign value length sign length sign displacement displacement length displacement length length sign reference to register reference to register length reference to register length length sign sign sign sign sign sequential memory sequential memory Low Address sequential memory Segment N Register 1 Register 2 Register 3* value length sign displacement length sign reference to register length sign Low Address sequential memory High Address High Address High Address High Address 20

21 Communication Interaction with the outside world is established through the defined communication channel Valid Communication Patterns UVC Emulator IN Communication Channel Message Message Message Type Length Data OUT Program Using UVC Emulator UVC Emulator OUT Communication Channel Message Message Message Data Length Type IN Program Using UVC Emulator 21

22 UVC Data Preservation By migrating proprietary formats into machine-independent descriptions, the informational content can be long-term preserved Original Object Logical Data View (LDV) Rendered Image? UVC Program <PIXEL> <PIXEL> <COLOUR> <COLOUR> <RED> 148 <RED> 148 <GREEN> 136 <GREEN> 136 <BLUE> 138 <BLUE> 138 Restore Application Description Description of of the the elements elements + + explanation explanation data data format format 22 Logical Data Schema (LDS) Long-Term Archiving of Digital Information, Raymond Lorie, IBM Almaden Research Center, RJ (95059), March 28, 2000

UVC Data Preservation Overview of IBM s UVC long-term Data Preservation process based on a combination of emulation (UVC) and migration (LDV) Archive In the future

23 UVC Data Preservation Overview of IBM s UVC long-term Data Preservation process based on a combination of emulation (UVC) and migration (LDV) Archive In the future Digital Object UVC Program Logical Data Schema UVC Program UVC Digitaal Object Logical Data View Restore Application Logical Data Schema UVC Specification Future Platform 23

24 Migration Validation The UVC Data Preservation approach could also be used to automatically validate format migrations TIFF to JPEG2000 conversion 24 LDV <PIXEL> <PIXEL> <COLOUR> <COLOUR> <RED> 148 <RED> 148 <GREEN> 136 <GREEN> 136 <BLUE> 138 <BLUE> 138? LDV <PIXEL> <PIXEL> <COLOUR> <COLOUR> <RED> 148 <RED> 148 <GREEN> 136 <GREEN> 136 <BLUE> 138 <BLUE> 138

25 UVC Program Preservation The UVC vision intended to gradually also support the emulation of existing program, i.e. UVC Program Emulation Case 1 Case 2 Case 3 Case 4 Present Future Present Future Present Future Present Future Data Metadata Restore Application Data Process Metadata Restore Application UVC Program Data Process Metadata Restore Application UVC Program Data Process Metadata Restore Application UVC Program Example BMP Example JPEG Example Spreadsheet Example Chess Game Metadata Meaning 25 Process/Program

26 Planets UVC Spreadsheet Proof of Concept 26

27 Thank You 27

IBM s UVC Approach October 20th 2006

IBM s UVC Approach October 20th 2006 Business Consulting Services IBM s Approach October 20th 2006 Dr. Raymond van Diessen IBM GBS Netherlands +31.(0)6.51617487 Raymond_vanDiessen@nl.ibm.com 2002 IBM Corporation basic concepts Origineel object