STUDY AND IMPLEMENTATION OF VIDEO COMPRESSION STANDARDS (H.264/AVC, DIRAC)

Transcription

1 STUDY AND IMPLEMENTATION OF VIDEO COMPRESSION STANDARDS (H.264/AVC, DIRAC) EE 5359-Multimedia Processing Spring 2012 Dr. K.R Rao By: Sumedha Phatak( )

2 OBJECTIVE A study, implementation and comparison of the baseline profiles of H.264/AVC [6] and Dirac [21] For factors like video quality, bit rates, compression ratio, complexity and performance analysis A comparison of these two standards Based on quality parameters like SSIM [13], MSE [13] and PSNR [13] at various bit rates will be done

3 INTRODUCTION Data compression means bit-rate reduction Compression can be either lossy or lossless [9] Majority of video compression algorithms uselossy compression [1] Video compression uses modern coding techniques to reduce redundancy in video data and combines spatial image compression and temporal motion compensation. [3]

4 NEED FOR VIDEO COMPRESSION? Mainly because bandwidth is still a valuable commodity Consider a TV picture resolution of and a frame rate of 30 fps If represented by 3 bytes per pixel 1 sec of video=31.1 MB and 1 hr of video=112gb BW required to deliver wirelessly will be MHz

5 HISTORY Table 1: History of video compression standards [1]

6 HISTORY( ( CONTD.) Figure 1: Evolution of video compression standards [2]

7 H.264 [4] H.264/MPEG-4 Part 10orAVC(Advanced Video Coding) is a standard for video compression [3] Currently one of the most commonly used formats for the recording, compression, and distribution ofhigh definition video [4] Good video quality at substantially lower bit rates than previous standards

8 H.264 PROFILES AND LEVELS Figure 2: H.264 profiles [3]

9 H.264 ARCHITECTURE Figure 3: H.264 architecture [2]

10 H.264 ENCODER Figure 4: H.264 encoder block diagram [4]

11 H.264 DECODER Figure 5: H.264 decoder block diagram [4]

12 H.264 IMPLEMENTATION JM 17.2 software [22] Build the solution and run it using Microsoft Visual Studio Generate lencod and ldecod and executable files lencod/ldecod file should then be run from the command prompt Since, baseline profile is being implemented, the encoder_baseline.cfg file should be used. Necessary parameters should be changed along with the required input file and destination to get the output at desired parameters.

13 COMMAND LINE INTERFACE Figure 6: Command line interface snapshot

14 ORIGINAL FILE : grandma_qcif.yuv [23] Figure 7: Original video file grandma_qcif.yuv

15 AT QP=2: Figure 8: At QP=2

16 AT QP=25: Figure 9: At QP=25

17 AT QP=50; Figure 10: At QP=50

18 RESULTS QCIF sequence: grandma_qcif.yuv Height: 176, Width: 144 Total no. of frames: 870 Frames used: 3 Original File size: KB Frame Rate = 30 fps

19 BIT RATE, MSE, PSNR, SSIM AT VARIOUS QP QP Bitrate (kbps) MSE (Y-component) PSNR (Y-component) in db SSIM (Y-component) Table 2: Various metrics at different QP values

20 PLOTS FOR grandma_qcif.yuv: Figure 11: PSNR vs. bit rate

21 Figure 12:MSE vs. bit rate

22 Figure 13: SSIM vs. bit rate

23 ORIGINAL FILE : suzie_qcif.yuv [23] Figure 14: Original video file suzie_qcif.yuv

24 AT QP=2: Figure 15: At QP=2

25 AT QP=25: Figure 16: At QP=25

26 AT QP=50: Figure 17: At QP=50

27 RESULTS QCIF sequence: suzie_qcif.yuv Height: 176, Width: 144 Total no. of frames: 150 Frames used: 3 Original File size: 5569 KB Frame Rate = 30 fps

28 BIT RATE, MSE, PSNR, SSIM AT VARIOUS QP QP Bitrate (kbps) MSE (Y-component) PSNR (Y-component) in db SSIM (Y-component) Table 3: Various metrics at different QP values

29 PLOTS FOR suzie_qcif.yuv: MSE vs Bitrate MSE (Y-component) Bitrate (Kbps) Figure 18: MSE vs. bit rate

30 PSNR vs Bitrate PSNR (Y-component) in db Bitrate (Kbps) Figure 19: PSNR vs. bit rate

31 SSIM v/s Bitrate SSIM (Y-component) Bitrate (Kbps) Figure 20: SSIM vs. bit rate

32 DIRAC [21] Open and free video compression format developed by BBC research [6] Intended to provide high quality video compression for applications like Ultra HDTV Mainly competes with existing standards like H.264 [5] and VC1 [12] Hybrid video codec because it involves both transform and motion compensation

33 DIRAC ENCODER BLOCK DIAGRAM Figure 5: Dirac encoder block diagram [5]

34 DIRAC DECODER BLOCK DIAGRAM Figure 6: Dirac decoder block diagram [5]

35 THANK YOU.

36 ABBREVIATIONS AND ACRONYMS AVC: Advanced Video Coding AVS: Audio Video Standard BBC: British Broadcasting Corporation CIF: Common Intermediate Format CABAC: Context Adaptive Binary Arithmetic Coding CODEC: Coder and Decoder DCT: Discrete Cosine Transform HDTV: High-Definition Television IEC: International Electrotechnical Commission ISO: International Organization for Standardization ITU-T: International Telecommunication Union -Telecommunication Standardization sector JPEG: Joint Photographic Experts Group MPEG: Moving Picture Experts Group MSE: Mean Square Error PSNR: Peak Signal to Noise ratio QCIF: Quarter Common Intermediate Format SMPTE: Society of Motion Picture and Television Engineers SSIM: Structural Similarity Metric VQMT: Video Quality Measurement Tool

37 REFERENCES [1]Video compression standards history: [2] Video conferencing standards and technology. [3] K. R. Rao and D. N. Kim, Current Video Coding Standards: H.264/AVC, Dirac, AVS China and VC-1, IEEE 42nd Southeastern symposium on system theory (SSST), March , pp. 1-8, March [4] S. Kwon, A. Tamhankar and K.R. Rao, Overview of H.264 / MPEG-4 Part 10, J. Visual Communication and Image Representation, vol. 17, pp , April [5]T. Borer and T. Davies, Dirac video compression using open technology, BBC EBU Technical Review, July [6] A. Ravi, and K.R. Rao, Performance analysis and comparison of the dirac video codec with H.264/MPEG-4 Part 10 AVC, International Journal of Wavelets, Multiresolution and Information Processing, vol.4, pp , January [7] T. Wiegand, and G. Sullivan, Overview of H.264/AVC video coding standards, IEEE Transactions on circuits and systems for video technology, vol. 13, no. 7,pp , July [8]DiracSpecification,Version2.2.3,Available: [9] General information on Data/ Video compression [10] The Dirac web page: [11] S.-T. Hsiang, A new sub band/wavelet framework for AVC/H.264 intra frame coding and performance comparison with motion-jpeg 2000", SPIE/VCIP, vol.6822, pp P-1 through 12, Jan [12] VC-1 Compressed video bit stream format and decoding process(smpte 421M-2006), SMPTE standard, pp. 2-9, [13] Z. Wang, et al, Image quality assessment: From error visibility to structural similarity, IEEE Transactions on Image Processing, vol.13, no.4, pp , April [14] MSU Video quality measurement tool: [15] G. J. Sullivan and J. Ohm, Recent developments in standardization of high efficiency video coding (HEVC), Proc. SPIE 7798, 77980V (2010)

38 REFERENCES [16] Dirac developer support documentation: [17] I. Richardson, The H.264 advanced video compression standard, Wiley, 2nd edition, [18] C. Christopoulos, A. Skodras, T.Ebrahimi, The JPEG2000 still image coding system: An Overview, IEEE Trans. on Consumer Electronics, vol.46, pp , Nov [19] B. Zeng and J. Fu, Directional discrete cosine transforms -A new framework for image coding, IEEE Trans. on Circuits and Systems for Video Technology, vol. 18, no. 3, pp , Mar [20] K. R. Rao and P. Yip, Discrete Cosine Transform: Algorithms, Advantages, Applications(Academic Press, Boston, 1990). [21] A. Ravi, Performance analysis and comparison of the dirac video codec with H.264/ MPEG 4 Part 10 AVC, M.S thesis, EE dept., UT Arlington, Aug 2009 [22] JM software source code: [23]Sample videos in yuv format: