Overview of H.264 and Audio Video coding Standards (AVS) of China Prediction is difficult - especially of the future. Bohr (1885-1962) Submitted by: Kaustubh Vilas Dhonsale 5359 Multimedia Processing Spring 2012
Outline Introduction MPEG -4 AVC/ H.264 AVS of China Video evaluation parameters Experimental results
Introduction Fig. 1 Example of multimedia ecosystem. [1]
Audio/Video History Fig. 2 History of audio and video standards [2]
MPEG - 4 part 2 AVC/ H.264 Moving Picture Experts Group (MPEG) formed in 1988 Focused on creating a simple and clean solution, limiting options and features to a minimum for video and audio data Has seven profiles each targeted to a specific class of applications
Main Profiles of H.264 [3] Baseline profile Main profile Extended profile High profile
Advantages of H.264 Up to 50% in bit rate savings[2] High quality video Error resilience More efficient entropy coding Network friendliness Wide areas of applications
AVS of China Developed by a working group of China named as Audio video coding Standard [3] Originally was developed to replace MPEG 2 format Important two different parts AVS Part 2 High-definition digital video broadcasting and high-density storage media AVS Part 7 for low complexity, low resolution mobility applications
Parts of AVS of China Parts of AVS Contents Stage Part 1 System for broadcasting Final committee draft Part 2 SD/HD Video National Standard Part 3 Audio Final draft Part4 Conformance test Final committee draft Part5 Reference software Final committee draft Part 6 Digital right management Final committee draft Part 7 Mobility video Final draft Part 8 System over IP Final draft Part 9 File format Final draft Table 1 AVS China parts [3]
Basic Profiles Profiles Jizhun (baseline) profile Jiben (basic) profile Shenzhan (extended) profile Jiaqiang (enhanced) profile Key Applications Television broadcasting, HDTV, etc. Mobility applications, etc. Video surveillance, etc. Multimedia entertainment, etc. Table 2 Application based profiles of AVS of China [4]
Layered structure of AVS of China Fig. 3 Layered structure of AVS of China
Video evaluation parameters Peak Signal to Noise Ratio (PSNR) Mean Square Error (MSE) Structural Similarity (SSIM)
Performance comparison parameters Simulation with different test sequences Bit rate Quality PSNR MSE SSIM Compression ratio
Experimental results for AVS of china Software used : BM1.0v3 [13] Microsoft visual C++ 2008 express edition [14] MSU video quality measurement tool [15]
File description Original sequence: foreman_cif.yuv Resolution: 358 X 288 Frame rate: 25 frames / sec Original file size: 44550 Kilobytes Number of frames used: 300
Results of foreman_cif.yuv sequence QP Compressed File size(kb) Bit rate (Kbits/s) Bits/pixel Y-PSNR (db) Y-MSE Y-SSIM Compression ratio 0 20734 17100 6.63 60.54 0.0573 0.9997 2.14 : 1 15 6213 5123.57 1.9877 45.8679 1.6837 0.9942 7.1 : 1 31 1045 860.94 0.3340 37.6255 11.2340 0.9737 42.63:1 45 206 169.21 0.0656 31.2507 48.7547 0.9186 216.3:1 63 34 27.67 0.0107 23.8649 267.0482 0.7114 1317.3:1 Table 3 MSE, PSNR and SSIM for AVS China for the sequence foreman_cif.yuv
Results continued.. Bitrate=17100 Kbits/s Bitrate= 860.94 Kbits/s Bitrate = 23.67Kbits/s PSNR= 60.54 db PSNR = 37.6255 db PSNR= 26.8649 db MSE= 0.0573 MSE= 11.2340 MSE= 267.0482 SSIM= 0.9997 SSIM= 0.9737 SSIM = 0.7114 Fig. 4 Obtained compressed AVS china frames for different Bitrates
PSNR in db Comparison at different bitrates for AVS of China for foreman_cif.yuv sequence 65 PSNR Vs. Bitrate 60 55 50 Fig. 5 PSNR Vs. Bitrate for foreman_cif.yuv sequence 45 40 35 30 0 2000 4000 6000 8000 10000 12000 14000 16000 18000 Bitrate in Kbps
MSE 300 MSE Vs. Bitrate 250 200 Fig. 6 MSE Vs. Bitrate for foreman_cif.yuv sequence 150 100 50 0 0 2000 4000 6000 8000 10000 12000 14000 16000 18000 Bitrate in Kbps
SSIM 1 SSIM Vs. Bitrate 0.95 0.9 Fig. 7 SSIM Vs. Bitrate for foreman_cif.yuv sequence 0.85 0.8 0.75 0 2000 4000 6000 8000 10000 12000 14000 16000 18000 Bitrate in Kbps
File description Original sequence: foreman_qcif.yuv Resolution: 176 X 144 Frame rate: 25 frames / sec Original file size: 11138 Kilobytes Number of frames used: 300
Results of foreman_qcif.yuv sequence QP Compressed File size(kb) Bit rate (Kbits/s) Bits/pixel Y-PSNR (db) Y-MSE Y-SSIM Compression ratio 0 5762 4751.41 7.49 53.658 0.2823 0.9985 1.93 : 1 15 1843 1519.72 2.3985 44.894 2.214 0.9905 6.04 : 1 31 436 350.44 0.5531 36.038 16.319 0.9493 25.56 : 1 45 118 96.68 0.1526 29.161 79.499 0.855 94.39 : 1 63 14 11.12 0.0176 20.357 603.59 0.5186 795.57 : 1 Table 4 MSE, PSNR and SSIM for AVS China for the sequence foreman_qcif.yuv
Results continued.. Bitrate=4751.41 Kbits/s Bitrate= 350.44 Kbits/s PSNR= 53.65 db PSNR = 36.038 db MSE= 0.2823 MSE = 16.139 SSIM= 0.9985 SSIM = 0.9493 Fig. 8 Obtained compressed AVS china frames for different Bitrates Bitrate = 11.12 Kbits/s PSNR = 20.357 db MSE = 603.59 SSIM = 0.5186
PSNR in db Comparison at different bitrates for AVS of China for foreman_cif.yuv sequence 55 PSNR Vs. Bitrate 50 45 40 Fig. 9 PSNR Vs. Bitrate for foreman_qcif.yuv sequence 35 30 25 20 0 500 1000 1500 2000 2500 3000 3500 4000 4500 5000 Bitrate in Kbps
MSE 700 MSE Vs. Bitrate 600 500 400 Fig. 10 MSE Vs. Bitrate for foreman_qcif.yuv sequence 300 200 100 0 0 500 1000 1500 2000 2500 3000 3500 4000 4500 5000 Bitrate in Kbps
SSIM 1 SSIM Vs. Bitrate 0.95 0.9 0.85 0.8 Fig. 11 SSIM Vs. Bitrate for foreman_qcif.yuv sequence 0.75 0.7 0.65 0.6 0.55 0.5 0 500 1000 1500 2000 2500 3000 3500 4000 4500 5000 Bitrate in Kbps
File description Original sequence: akiyo_qcif.yuv Resolution: 176 X 144 Frame rate: 25 frames / sec Original file size: 11138 Kilobytes Number of frames used: 300
Results of akiyo_cif.yuv sequence QP Compressed File size(kb) Bit rate (Kbits/s) Bits/pixel Y-PSNR (db) Y-MSE Y-SSIM Compression ratio 0 2059 1697.68 2.6794 58.8256 0.0852 0.9993 5.41 : 1 15 391 322.26 0.5086 47.3606 1.1940 0.9902 28.49 : 1 31 99 80.79 0.1275 41.5042 4.5989 0.9747 112.51 : 1 45 37 29.64 0.0468 34.3129 24.087 0.9231 301.03 : 1 63 10 7.84 0.0124 26.8455 134.43 0.8022 1113.8 : 1 Table 5 MSE, PSNR and SSIM for AVS China for the sequence akiyo_qcif.yuv
Results continued.. Bitrate = 1697.68 Kbits/s Bitrate = 80.79 Kbits/s PSNR = 58.82 db PSNR = 41.5042 db MSE= 0.0852 MSE = 4.5989 SSIM = 0.9993 SSIM = 0.9747 Fig. 12 Obtained compressed AVS china frames for different Bitrates Bitrate = 7.84 Kbits/s PSNR = 26.8455 db MSE = 134.43 SSIM = 0.8022
PSNR in db Comparison at different bitrates for AVS of China for akiyo_qcif.yuv sequence 60 PSNR Vs. Bitrate 55 50 45 Fig. 13 PSNR Vs. Bitrate for akiyo_qcif.yuv sequence 40 35 30 25 0 200 400 600 800 1000 1200 1400 1600 1800 Bitrate in Kbps
MSE 140 MSE Vs. Bitrate 120 100 80 Fig. 14 MSE Vs. Bitrate for akiyo_qcif.yuv sequence 60 40 20 0 0 200 400 600 800 1000 1200 1400 1600 1800 Bitrate in Kbps
SSIM 1 SSIM Vs. Bitrate 0.98 0.96 0.94 0.92 Fig. 15 SSIM Vs. Bitrate for akiyo_qcif.yuv sequence 0.9 0.88 0.86 0.84 0.82 0.8 0 200 400 600 800 1000 1200 1400 1600 1800 Bitrate in Kbps
MSU video quality measurement tools[13] Fig. 16 Snapshot of MSU video quality measurement tool
References 1. AVS Video Expert Group, Information technology Advanced coding of audio and video Part 2: Video (AVS1-P2 JQP FCD 1.0), Audio Video Coding Standard Group of China (AVS), Doc. AVS-N1538, Sep. 2008 2. ITU H.263 Video Compression : http://www.h263l.com/ 3. K. R. Rao and D. N. Kim, Current Video Coding Standards: H.264/AVC, Dirac, AVS China and VC-1, IEEE 42 nd Southeastern symposium on system theory (SSST), March 7-9 2010, pp. 1-8, March 2010. 4. J. Watkinson, The MPEG Handbook, Second Edition, Elsevier/Focal Press, pp. 1, 2004. 5. Advanced Audio Video Coding Standard Part 2: Video, Audio Video Coding Standard Group of China (AVS), Doc. AVS-N1063, Dec, 2003. 6. L. Yu, et al, Overview of AVS-video coding standards, Elsevier Press, Signal Processing: Image Communication, vol. 24, pp. 247-262, April 2009
References continued. 7. T. Wiegand, G. J. Sullivan, G. Bjøntegaard, and A. Luthra, Overview of the H.264/AVC Video Coding Standard, IEEE Trans. on circuits and systems for video technology, Vol. 13, pp. 560-576, JULY 2003. 8. L. Fan, S. Ma and F. Wu, Overview of AVS Video Standards, IEEE International Conference on Multimedia and Expo (ICME), pp. 423-426, 2004. 9. Audio Video Coding Standard Workgroup of China (AVS), Video Coding Standard FCD1.0, NOV.2003. 10. AVS Video Expert Group, Information Technology Advanced Audio Video Coding Standard Part 7: Mobility Video, Audio Video Coding Standard Group of China (AVS), Doc. AVS-N1151,Dec.2004 11. Z. Wang, et al Image quality assessment: From error visibility to structural similarity, IEEE Trans. on Image Processing, vol. 13, pp. 600-612, Apr. 2004. 12. I.E. Richardson, The H.264 Advanced Video compression standard, second edition, Wiley,2010
References continued. 13. AVS software: : ftp://124.207.250.92 (password required) 14. Microsoft Visual C++ 2008 express edition: http://msdn.microsoft.com/enus/express/future/bb421473 15. MSU video quality measurement tool: http://compression.ru/video/quality_measure/vqmt_download_en.html#start