Lessons Learned. Table of Contents. Data Migration, Our Frenemy. Data Migrations. data migration

Transcription

1 Data Migration, Our Frenemy Reto Kromer AV Preservation by reto.ch No Time to Wait! Open Media, Open Formats, Open Archives Österreichisches Filmmuseum, Vienna, Austria 9 November 27 The Reel Thing XLII New Orleans, Louisiana, USA 29 November 27 data migration Table of Contents handling of established and experimental file formats wishes for CELLAR 2 Data Migrations Lessons Learned 24 our internal archive from LTO-4 to LTO-6 (5.7 PB) [ ] 27 a client s archive from LTO-5 to LTO-7 (27 GB) 3 4

2 5 6 read script write script to modify container codec both container and codec Examples 7 8

3 Video AVI / 8-bit and -bit uncompressed MOV / 8-bit and -bit uncompressed MP4 / 8-bit and -bit uncompressed Matroska / FFV Container and Codec decode file Y CBCR, 4:2:2, 8 bit, «raw» [uyvy422] encode file 9 Container and Codec decode file Y CBCR, 4:2:2, bit, «raw» [yuv422ple] encode file TIFF DPX Film Matroska / FFV using RGB48 and additional metadata 2

4 Reading Reto Kromer: Matroska and FFV: One File Format for Film and Video Archiving?, in «Journal of Film Preservation», n. 96 (April 27), FIAF, Brussels, Belgium, p JFP_96.html Old Experimentations AVI / HuffYUV AVI / FFV version Matroska / FFV [version 3] 3 4 Midold Experimentations AVI / CineForm (VC-5) with Bayer MOV / CineForm (VC-5) with Bayer MOV / ProRes Matroska / FFV after de-mosaicking Matroska / ProRes Container, Codec and Data decode data 2 bit [bayer_bggr6le] encode data 5 6

5 Container, Codec and Data decode data R G B, 4:4:4, 6 bit, «raw» [rgb48le] encode data Container, Codec and Data decode data filter data (de-mosaic) encode data 7 8 Container ProRes 422, bit [yuv422ple] ProRes 4444, bit [yuv444ple or yuva444ple] or 2 bit [yuv444p2le] Midnew Experimentations AVI / CineForm (VC-5) with Bayer MOV / CineForm (VC-5) with Bayer MOV / ProRes Matroska / FFV version 4 [with Bayer] Matroska / ProRes with 2-bit support 9 2

6 New Experimentations MXF / OpenEXR flavour of NUT / multiple RGB48 flavour of NUT / RGB72 or Y CBCR 24-bit flavour of NUT / expanded OpenEXR Matroska / FFV version 4 using RGB48, RGB72, floats and additional metadata 2 22 Wishes additional support: Gray codes EBML 23 24

7 Matroska = = = 5 = 5 additional metadata additional integration: D LUT 3D LUT additional support: Gray codes FFV additional metadata additional encoding: RGB72, Y CBCR 24-bit and floats Bayer additional support: Gray codes Y COCG 27 28

8 29 3 additional support: Gray codes FLAC additional encoding: 24-bit sample format 3 32

9 Kate Murray: «More adoption means better sustainability.» [while proudly speaking about MXF/JPEG 2 at the Matroska/FFV symposium in Vienna] Matroska Reader full transparency with DPX [et similia] RAWcooked create, alter and inspect Matroska files MKVToolNix verify Matroska and WebM files mkvalidator Matroska Player apply D and 3D LUT to the video stream VLC mpv ffplay FFmpv AV Preservation by reto.ch chemin du Suchet 5 24 Écublens Switzerland Web: reto.ch info@reto.ch 35 36