MPEG-4 Audio Lossless Coding ALS

Transcription

1 MPEG-4 Audio Lossless Coding ALS 1,a) 1,b) 1,c) , OAIS MPEG-4 ALS WinZip Mac OS MacDMG WinZip WavPack Mac OS Windows MPEG-4 ALS MPEG-A PA-AF MPEG-4 Audio Lossless Coding (ALS) Applied to Archiving System of Recorded Audio Project Noboru Harada 1,a) Yutaka Kamamoto 1,b) Takehiro Moriya 1,c) Received: July 31, 2015, Accepted: February 8, 2016 Abstract: In music industry, it is recommended to preserve files of recorded audio projects with keeping its hierarchical folder structure. This paper proposes an information package to be applied for archiving system of recoded audio project. The devised information package format complies with the Open Archival Information System reference model and its implementation makes use of an optimized MPEG-4 Audio Lossless Coding (ALS) codec library for audio data compression. Performance test results for actual audio data, such as ProTools HD projects, show that the compression performance is better than those of conventional tools such as MacDMG, WinZip with WavPack, etc. while requiring comparable or even shorter processing time. In addition, the proposed format can solve some inter-operability issues caused by differences among Operating Systems where target data files are placed, such as multiple bytes character set in Japanese fine names and platform specific attributes of Mac OS and Windows (and others). The devised package format is utilized into commercial archive systems for music industry. Keywords: Information Package, Recorded audio project, preservation, MPEG-4 ALS, MPEG-A PA-AF 1. 1 NTT NTT Communication Science Laboratories, Nippon Telegraph and Telephone Corporation, Kanagawa , Japan a) harada.noboru@lab.ntt.co.jp b) kamamoto.yutaka@lab.ntt.co.jp c) moriya.takehiro@lab.ntt.co.jp [1] ProTools Digital Audio Workstation; DAW c 2016 Information Processing Society of Japan 1355

2 [2], [3], [4] IEC DVD/Blu-ray [5] Mac Windows Operating System OS OS DAW OS Mac OS MacDMG [6] UNIX Tar [7] Windows Zip [8] OS 1 METS *1 [9] METS base64 [10] 1 OS *1 Metadata Encoding & Transmission Standard 1 Fig. 1 OAIS Archival Information Package defined in OAIS reference model. OAIS *2 [11] OAIS AIP *3 1 OAIS [12], [13] MPEG-4 Audio Lossless Coding ALS [14], [15], [16] MPEG-4 ALS MPEG *4 ISO *5 /IEC * MPEG-A PA-AF *7 [17], [18], [19], [20] 2 MPEG MPEG-4 ALS Optimized-ALS *2 Open Archival Information System *3 Archival Information Package *4 The Moving Picture Experts Group *5 International Organization for Standardization *6 International Electrotechnical Commission *7 Professional Archival Application Format c 2016 Information Processing Society of Japan 1356

3 MPEG-4 ALS MPEG-4 ALS MPEG-4 ALS [14], [15], [16] MPEG-4 1 MPEG-4 ALS 1 MPEG-4 ALS [24] 1 MPEG-4 ALS [21], [22] Optimized-ALS 2 MPEG MB Optimized-ALS (1) 192 khz 24 bit 2ch 9 (2) 96 khz 24 bit 2ch 15 (3) 48 khz 24 bit 2ch 15 (4) 48 khz 16 bit 2ch (a) MPEG-4 ALS RM23 [23], [24] (b) Optimized-ALS (c) WavPack Win32 version [25] (d) FLAC version [26] Windows 7 Professional Service Pack 1 32 bit Intel(R) Core(TM) i7-3667u CPU 2.00 GHz 1.00 GB RAM timeit.exe Comp. ratio Comp. ratio = 100 (1) 2 Optimized-ALS RM23 1 Table 1 MPEG-4 ALS Input formats supported by MPEG-4 ALS. Sampling Currently tested up to 192 khz frequency (Higher frequency, such as 384 khz, can be handled with the current specification) Bit depth PCM (up to 32 bit), IEEE bit floating-point Channels Up to File Raw, WAVE, AIFF, BWF, BWF with formats RF64, Sony Wave64 2 Table 2 Compression ratio and processing time of lossless codecs. Comp. Time [sec] ratio Enc. Dec. (a) MPEG-4 ALS RM % (b) Optimized-ALS % (c) WavPack % (d) FLAC % % [27], [28], [29] 3. MPEG-4 ALS DAW DAW DAW [2], [3], [4] Linear Tape-Open LTO CD c 2016 Information Processing Society of Japan 1357

4 Fig. 2 2 Workflow and overview of the music content management system. Fig. 3 3 Overview of proposed packager and un-packager structure. JASRAC *8 MPEG-4 ALS PA-AF *8 Japanese Society for Rights of Authors, Composers and Publishers MPEG-21 DID *9 XML [30] *9 MPEG-21 Digital Item Discriptor c 2016 Information Processing Society of Japan 1358

5 3 /MIME type Table 3 Examples of MIME types related to file extensions and corresponding coding schemes applied to those file types. File extension name Corresponding file formats MIME type/mime sub type Compression scheme.bwf,.bwf64 BWF file audio/x-bwf x-mp4als.wav,.wave WAVE file audio/x-wav.wav64,.w64 Wave64 file audio/x-wave64.aif,.aifa,.aiff AIFF file audio/x-aiff.mp4,.m4a MPEG-4 file (AAC, ALS, etc.) audio/mp4 Identity (No compression).als,.mp4 MPEG-4 ALS encoded audio audio/x-mp4als.zip zip compressed application/zip.gz,.gzip gzip compressed application/gzip.txt Plain text text/plain x-gzip.exe Binary data application/binary Others Unknown type application/octet-stream / URL index.html MPEG ISO base media file format [31] MPEG-21 IPMP * 10 [32] MPEG-21 DID XML MD5 [33] SHA- 1 [34] 1 Open-source [19], [20] *10 MPEG-21 Intellectual Property Management and Protecthion Components 1 2 Optimized 2 MPEG-4 ALS Optimized-ALS Gzip [35] Zlib [36] MD5 SH-1 AES128 OpenSSL lib [37] MIME type Config Zip AAC PCM MPEG-4 ALS txt exe Gzip OS Mac OS 4 OSLocalMacAttributes.xsd element <paaf:userdefinedattributes> OS 1 Open-source XML Xerses [38] 2 Optimized c 2016 Information Processing Society of Japan 1359

6 Table 4 4 Input files used for the performance evaluation. (audio files) Song Int1 ProTools HD GB 97 (58) Song Int2 ProTools HD GB 1097 (858) Song Float Nuendo GB 1052 (517) 4 Mac OS Fig. 4 Schema definition for extended file attributes on Mac OS. 2 Optimized MPEG-4 ALS 2 Optimized 4. DAW ProTools HD Song Int 1 Int 2 Nuendo Song Float Windows Mac OS 1 2 Song Int1 Song Int2 48 khz 24 bit Song Float 48 khz 32 bit ProTools 4 OS MacDMG tar-gz WinZip WavPack [.zipx] WinZip WinZip[.zipx] [.zip] LZ deflate riff wav RAW 2 WavPack MPEG-4 ALS 5 Windows 4 (a W ) MPEG-4 ALS RM23 [24] 1 Open-source (b W ) Optimized-ALS 2 Optimized (c W ) WinZip 14.5 [39] zip [.zip] (d W ) WinZip 14.5 Wav- Pack [25] zip [.zipx] Microsoft Windows XP Professional x64 Edition Version 2003 Service Pack 2 Intel Xeon CPU 5130@2.00 GHz 3.99 GB RAM timeit.exe Mac OS X 4 (a M ) MPEG-4 ALS RM23 [24] 1 Open-source (b M ) Optimized-ALS 2 Optimized (c M ) MacDMG c 2016 Information Processing Society of Japan 1360

7 5 Table 5 Tools and option settings for the performance evaluation. Windows XP (a W ) 1 (Open-source) Pack paafrm003.exe -i -g -a outfile.paf infolder Unpack paafrm003.exe -x infile.paf -o outfolder (b W ) 2 (Optimized) Pack paaftest.exe -i -g -a outfile.paf infolder Unpack paaftest.exe -x infile.paf -o outfolder (c W ) WinZip [.zip] Pack winzip32.exe -min -a -r outfile.zip infolder Unpack winzip32.exe -min -e outfile.zip outfolder (d W ) WinZip+WavPack [.zipx] Pack winzip32.exe -min -a -r outfile.zipx infolder Unpack winzip32.exe -min -e outfile.zipx outfolder Mac OS X (a M ) 1 (Open-source) Pack paafrm003 -i -g -a outfile.paf infolder Unpack paafrm003 -x infile.paf -o outfolder (b M ) 2 (Optimized) Pack paaftest -i -g -a outfile.paf infolder Unpack paaftest -x infile.paf -o outfolder (c M ) MacDMG [.dmg] Pack hdiutil create -ov -srcfolder infolder -format UDZO outfile.dmg Unpack hdiutil attatch -mountpoint mountpath infile.dmg; cp -R mountpath outfolder; hdiutil detatch mountpath (d M ) Tar-gz [.tgz] Pack tar zcvf outfile.tgz infolder Unpack tar zxvf infile.tgz 6 Windows Table 6 Test results on Windows platform. Song Int1 Comp. size Time [h:mm:ss] (ratio) Enc. Dec. (a W ) GB 1:29:48 0:45:23 Open-source (47.31 %) (b W ) GB 0:14:48 0:13:57 Optimized (47.41 %) (c W ) WinZip [.zip] GB 0:35:37 0:22:36 (82.69 %) (d W )WinZip 8.13 GB 0:26:32 0:30:14 +WavPack [.zipx] (47.67 %) Song Int2 Comp. size Time [h:mm:ss] (ratio) Enc. Dec. (a W ) GB 8:26:33 3:32:26 Open-source (46.98 %) (b W ) GB 1:03:56 1:17:02 Optimized (47.03 %) (c W ) WinZip [.zip] GB 2:18:54 0:57:10 (86.71 %) (d W )WinZip GB 1:46:45 1:53:37 +WavPack [.zipx] (48.23 %) Song Float Comp. size Time [h:mm:ss] (ratio) Enc. Dec. (a W ) GB 0:25:42 0:08:44 Open-source (56.65 %) (b W ) GB 0:04:28 0:03:31 Optimized (52.25 %) (c W ) WinZip [.zip] 1.67 GB 0:06:32 0:01:21 (68.20 %) (d W )WinZip 1.30 GB 0:10:08 0:03:40 +WavPack [.zipx] (53.50 %) (d M ) Tar-gz Mac OS X Server version Power PC G5 (3.1) CPU 2.3 GHz two CPUs 8GB RAM /usr/bin/time -p (a W ) (b W ) (a M ) (b M ) / OpenSSL SHA-1 MPEG-4 ALS 10 Rice Comp. ratio (1) 2 Optimized WinZip [.zip] Tar-gz [.tgz] MacDMG [.dmg] WavPack WinZip [.zipx] 2 1% 2 Optimized-ALS WavPack 5% 40% 60% 68% 96% % 41% 27% 46% (1) Optimized-ALS MPEG-4 ALS / (2) SHA-1 MPEG-4 ALS / Gzip / (3) Xersis XML 1 2 Windows Mac c 2016 Information Processing Society of Japan 1361

8 7 Mac OS X Table 7 TestresultsonMacOSXplatform. Song Int1 Comp. size Time [h:mm:ss] (ratio) Enc. Dec. (a M ) GB 0:39:30 0:36:52 Open-source (47.95 %) (b M ) GB 0:15:46 0:14:46 Optimized (47.64 %) (c M ) MacDMG [.dmg] GB 0:58:05 0:19:33 (83.48 %) (d M ) Tar-gz [.tgz] GB 0:39:14 0:16:27 (82.70 %) Song Int2 Comp. size Time [h:mm:ss] (ratio) Enc. Dec. (a M ) GB 2:38:02 2:39:55 Open-source (48.28 %) (b M ) GB 1:13:36 1:07:50 Optimized (47.28 %) (c M ) MacDMG [.dmg] GB 4:10:02 1:32:34 (87.25 %) (d M ) Tar-gz [.tgz] GB 2:37:03 1:12:48 (86.72 %) OS X CPU HDD / 2 MPEG-4 ALS 6 Song Int2 Song Float (b W ) 2 (c W )WinZip 2 (1) WavPack (c W )WinZip WinZip MPEG-4 ALS (b W ) (2) XML XML WinZip 1000 LTO 5 Windows Mac OS X Fig. 5 Mac OS X file names extracted on Windows using proposed information package format. 6 Song Int Mbit/s 10 MByte/s Song Int GB GB khz 96 khz 192 khz 3.2 OS Song Int1 Mac OS X Windows 5 WinZip 6 WinZip Tar-gz Mac OS X UTF-8-Mac Windows Shift JIS c 2016 Information Processing Society of Japan 1362

9 PA-AF Hendry Houari Sabirin Munchrl Kim 6 WinZip Windows Mac OS X Fig. 6 Mac OS X file names extracted on Windows using WinZip (Corrupted). OS 5. OAIS MPEG-4 ALS MPEG-A PA-AF MPEG 1 2 WinZip MacDMG WinZip WavPack Mac OS Windows CD / DAW 2 MPEG 4 [1] Lee, K., Slattery, O., Lu, R., Tang, X. and McCrary, V.: The State of the Art and Practice in Digital Preservation, J. Res. Nati. Inst. Stand. Technol., 107, pp (2002). [2] Pro Tools unyoukijun300.pdf [3] JVC or.jp/protools/pdf/victor&jvc.pdf [4] EMI [5] IEC CDV , IEC TC100/TA4. [6] Mac DMG, available from wiki/apple Disk Image/ [7] Tar, available from [8] Zip, available from Zip (file format) [9] Metadata Encoding & Transmission Standard (online), available from [10] Base64, available from Base64 [11] ISO 14721:2003: Space data and information transfer systems Open Archival Information System Reference Model, ISO (2003). [12] Harada, N., Kamamoto, Y. and Moriya, T.: MPEG- A Professional Archival Multimedia Application Format (MAF) Under Development, AES 31st International Conference, London, UK, June (2007). [13] Harada, N., Kamamoto, Y., Moriya, T. and Otsuka, M.: MPEG-A Professional Archival Application Format and its application for audio data archiving, AES 129th Convention No.8207, San Francisco, CA, USA, November 4-7 (2010). [14] ISO/IEC :2005/Amd.2:2006: Information technology Coding of audio-visual objects Part 3: Audio, 3rd Ed. AMENDMENT2: Audio Lossless Coding (ALS), new audio profiles and BSAC extensions, ISO/IEC, March (2006). [15] ISO/IEC :2009/Amd.2:2010: Information technology Coding of audio-visual objects Part 3: Audio, 4th Ed. AMENDMENT2: ALS Simple Profile and Transport of SAOC, ISO/IEC (2010). [16] Liebchen, T., Moriya, T., Harada, N., Kamamoto, Y. and Reznik, Y.A.: The MPEG-4 audio lossless coding (ALS) standard technology and applications, Preprint AES 119th Convention, No.6589, New York, NY, USA (2005). [17] ISO/IEC :2012: Information technology Multimedia application format (MPEG-A) Part 6: Professional archival application format, ISO/IEC, April (2009). [18] Harada, N., Hendry, Sabirin, H., Kim, M., Kamamoto, Y. and Moriya, T.: Archive and Preservation of Media Contents using MPEG-A, IEEE Multimedia, Vol.17, No.4, pp (2010). [19] ISO/IEC ITTF web site (online), available from c 2016 Information Processing Society of Japan 1363

10 standards.iso.org/ittf/publiclyavailablestandards/ index.html [20] Links to PA-AF development website (online), available from research.html [21] Moriya, T., Harada, N. and Kamamoto, T.: An enhanced encoder for the MPEG-4 ALS lossless coding standard, Preprint AES 121st Convention, No.6869, San Francisco, CA, USA (2005). [22] Harada, N., Moriya, T. and Kamamoto, T.: An implementation of MPEG-4 ALS standard compliant decoder on ARM core CPUs, Preprint AES 125th Convention, No.7625, San Francisco, CA, USA (2008). [23] ISO/IEC :2001/Amd.10:2007: Information technology Coding of audio-visual objects Part 5: Reference software, AMENDMENT10: SSC, DST, ALS and SLS reference software, ISO/IEC (2007). [24] MPEG-4 ALS RM23, available from tu-berlin.de/menue/forschung/projekte/beendete projekte/mpeg-4 audio lossless coding als/ [25] WavPack Hybrid Lossless Audio Compressor Win32 Version , available from [26] FLAC 1.3.1, available from [27] Huang, H., Shu, H. and Yu, R.: Lossless Audio Compression in the New IEEE Standard for Advanced Audio Coding, ICASSP2014, pp (2014). [28] Ghido, F. and Tabus, I.: Sparse Modeling for Lossless Audio Compression, IEEE Trans. ASLP, Vol.21, No.1, pp (2013). [29] Sgouros, N.P., Constantinou, I.P., Loudos, G.K. and Kossida, S.A.: Use of the MPEG-4 ALS Architecture and Inter-channel Prediction for Multi-channel ECG Coding, 2007 IEEE International Symposium on Signal Processing and Information Technology, pp (2007). [30] ISO/IEC :2005: Information technology Multimedia framework (MPEG-21) Part 2: Digital Item Declaration, ISO/IEC (2005). [31] ISO/IEC :2005: Information technology Multimedia framework (MPEG-21) Part 9: File Format, ISO/IEC (2005). [32] ISO/IEC :2006: Information technology Multimedia framework (MPEG-21) Part 4: Intellectual Property Management and Protection Components, ISO/IEC (2006). [33] Rivest, R.: The MD5 Message-Digest Algorithm, RFC 1321 (Apr. 1992). [34] Eastlake 3rd, D. and Jones, P.: US Secure Hash Algorithm 1 (SHA1), RFC 3174 (Sep. 2001). [35] Gzip version 1.3.5, available from org/ [36] Zlib 1.2.5, available from [37] OpenSSL, available from [38] Xerces, available from [39] WinZip 14.5, available from VoIP NTT AES IEEE NTT 2005 IEEE 1980 NTT 1989 AT&T NTT NTT IEEE c 2016 Information Processing Society of Japan 1364