Overview of H.264 and Audio Video coding Standards (AVS) of China

Transcription

1 Overview of H.264 and Audio Video coding Standards (AVS) of China Prediction is difficult - especially of the future. Bohr ( ) Submitted by: Kaustubh Vilas Dhonsale 5359 Multimedia Processing Spring 2012

2 Outline Introduction MPEG -4 AVC/ H.264 AVS of China Video evaluation parameters Experimental results

3 Introduction Fig. 1 Example of multimedia ecosystem. [1]

4 Audio/Video History Fig. 2 History of audio and video standards [2]

5 MPEG - 4 part 2 AVC/ H.264 Moving Picture Experts Group (MPEG) formed in 1988 Focused on creating a simple and clean solution, limiting options and features to a minimum for video and audio data Has seven profiles each targeted to a specific class of applications

6 Main Profiles of H.264 [3] Baseline profile Main profile Extended profile High profile

7 Advantages of H.264 Up to 50% in bit rate savings[2] High quality video Error resilience More efficient entropy coding Network friendliness Wide areas of applications

8 AVS of China Developed by a working group of China named as Audio video coding Standard [3] Originally was developed to replace MPEG 2 format Important two different parts AVS Part 2 High-definition digital video broadcasting and high-density storage media AVS Part 7 for low complexity, low resolution mobility applications

9 Parts of AVS of China Parts of AVS Contents Stage Part 1 System for broadcasting Final committee draft Part 2 SD/HD Video National Standard Part 3 Audio Final draft Part4 Conformance test Final committee draft Part5 Reference software Final committee draft Part 6 Digital right management Final committee draft Part 7 Mobility video Final draft Part 8 System over IP Final draft Part 9 File format Final draft Table 1 AVS China parts [3]

10 Basic Profiles Profiles Jizhun (baseline) profile Jiben (basic) profile Shenzhan (extended) profile Jiaqiang (enhanced) profile Key Applications Television broadcasting, HDTV, etc. Mobility applications, etc. Video surveillance, etc. Multimedia entertainment, etc. Table 2 Application based profiles of AVS of China [4]

11 Layered structure of AVS of China Fig. 3 Layered structure of AVS of China

12 Video evaluation parameters Peak Signal to Noise Ratio (PSNR) Mean Square Error (MSE) Structural Similarity (SSIM)

13 Performance comparison parameters Simulation with different test sequences Bit rate Quality PSNR MSE SSIM Compression ratio

14 Experimental results for AVS of china Software used : BM1.0v3 [13] Microsoft visual C express edition [14] MSU video quality measurement tool [15]

15 File description Original sequence: foreman_cif.yuv Resolution: 358 X 288 Frame rate: 25 frames / sec Original file size: Kilobytes Number of frames used: 300

16 Results of foreman_cif.yuv sequence QP Compressed File size(kb) Bit rate (Kbits/s) Bits/pixel Y-PSNR (db) Y-MSE Y-SSIM Compression ratio : : : : :1 Table 3 MSE, PSNR and SSIM for AVS China for the sequence foreman_cif.yuv

17 Results continued.. Bitrate=17100 Kbits/s Bitrate= Kbits/s Bitrate = 23.67Kbits/s PSNR= db PSNR = db PSNR= db MSE= MSE= MSE= SSIM= SSIM= SSIM = Fig. 4 Obtained compressed AVS china frames for different Bitrates

18 PSNR in db Comparison at different bitrates for AVS of China for foreman_cif.yuv sequence 65 PSNR Vs. Bitrate Fig. 5 PSNR Vs. Bitrate for foreman_cif.yuv sequence Bitrate in Kbps

19 MSE 300 MSE Vs. Bitrate Fig. 6 MSE Vs. Bitrate for foreman_cif.yuv sequence Bitrate in Kbps

20 SSIM 1 SSIM Vs. Bitrate Fig. 7 SSIM Vs. Bitrate for foreman_cif.yuv sequence Bitrate in Kbps

21 File description Original sequence: foreman_qcif.yuv Resolution: 176 X 144 Frame rate: 25 frames / sec Original file size: Kilobytes Number of frames used: 300

22 Results of foreman_qcif.yuv sequence QP Compressed File size(kb) Bit rate (Kbits/s) Bits/pixel Y-PSNR (db) Y-MSE Y-SSIM Compression ratio : : : : : 1 Table 4 MSE, PSNR and SSIM for AVS China for the sequence foreman_qcif.yuv

23 Results continued.. Bitrate= Kbits/s Bitrate= Kbits/s PSNR= db PSNR = db MSE= MSE = SSIM= SSIM = Fig. 8 Obtained compressed AVS china frames for different Bitrates Bitrate = Kbits/s PSNR = db MSE = SSIM =

24 PSNR in db Comparison at different bitrates for AVS of China for foreman_cif.yuv sequence 55 PSNR Vs. Bitrate Fig. 9 PSNR Vs. Bitrate for foreman_qcif.yuv sequence Bitrate in Kbps

25 MSE 700 MSE Vs. Bitrate Fig. 10 MSE Vs. Bitrate for foreman_qcif.yuv sequence Bitrate in Kbps

26 SSIM 1 SSIM Vs. Bitrate Fig. 11 SSIM Vs. Bitrate for foreman_qcif.yuv sequence Bitrate in Kbps

27 File description Original sequence: akiyo_qcif.yuv Resolution: 176 X 144 Frame rate: 25 frames / sec Original file size: Kilobytes Number of frames used: 300

28 Results of akiyo_cif.yuv sequence QP Compressed File size(kb) Bit rate (Kbits/s) Bits/pixel Y-PSNR (db) Y-MSE Y-SSIM Compression ratio : : : : : 1 Table 5 MSE, PSNR and SSIM for AVS China for the sequence akiyo_qcif.yuv

29 Results continued.. Bitrate = Kbits/s Bitrate = Kbits/s PSNR = db PSNR = db MSE= MSE = SSIM = SSIM = Fig. 12 Obtained compressed AVS china frames for different Bitrates Bitrate = 7.84 Kbits/s PSNR = db MSE = SSIM =

30 PSNR in db Comparison at different bitrates for AVS of China for akiyo_qcif.yuv sequence 60 PSNR Vs. Bitrate Fig. 13 PSNR Vs. Bitrate for akiyo_qcif.yuv sequence Bitrate in Kbps

31 MSE 140 MSE Vs. Bitrate Fig. 14 MSE Vs. Bitrate for akiyo_qcif.yuv sequence Bitrate in Kbps

32 SSIM 1 SSIM Vs. Bitrate Fig. 15 SSIM Vs. Bitrate for akiyo_qcif.yuv sequence Bitrate in Kbps

33 MSU video quality measurement tools[13] Fig. 16 Snapshot of MSU video quality measurement tool

34 References 1. AVS Video Expert Group, Information technology Advanced coding of audio and video Part 2: Video (AVS1-P2 JQP FCD 1.0), Audio Video Coding Standard Group of China (AVS), Doc. AVS-N1538, Sep ITU H.263 Video Compression : 3. K. R. Rao and D. N. Kim, Current Video Coding Standards: H.264/AVC, Dirac, AVS China and VC-1, IEEE 42 nd Southeastern symposium on system theory (SSST), March , pp. 1-8, March J. Watkinson, The MPEG Handbook, Second Edition, Elsevier/Focal Press, pp. 1, Advanced Audio Video Coding Standard Part 2: Video, Audio Video Coding Standard Group of China (AVS), Doc. AVS-N1063, Dec, L. Yu, et al, Overview of AVS-video coding standards, Elsevier Press, Signal Processing: Image Communication, vol. 24, pp , April 2009

35 References continued. 7. T. Wiegand, G. J. Sullivan, G. Bjøntegaard, and A. Luthra, Overview of the H.264/AVC Video Coding Standard, IEEE Trans. on circuits and systems for video technology, Vol. 13, pp , JULY L. Fan, S. Ma and F. Wu, Overview of AVS Video Standards, IEEE International Conference on Multimedia and Expo (ICME), pp , Audio Video Coding Standard Workgroup of China (AVS), Video Coding Standard FCD1.0, NOV AVS Video Expert Group, Information Technology Advanced Audio Video Coding Standard Part 7: Mobility Video, Audio Video Coding Standard Group of China (AVS), Doc. AVS-N1151,Dec Z. Wang, et al Image quality assessment: From error visibility to structural similarity, IEEE Trans. on Image Processing, vol. 13, pp , Apr I.E. Richardson, The H.264 Advanced Video compression standard, second edition, Wiley,2010

36 References continued. 13. AVS software: : ftp:// (password required) 14. Microsoft Visual C express edition: MSU video quality measurement tool: