THE H.264 ADVANCED VIDEO COMPRESSION STANDARD

Size: px

Start display at page:

Download "THE H.264 ADVANCED VIDEO COMPRESSION STANDARD"

Gregory Carter
5 years ago
Views:

1 THE H.264 ADVANCED VIDEO COMPRESSION STANDARD Second Edition Iain E. Richardson Vcodex Limited, UK WILEY A John Wiley and Sons, Ltd., Publication

About the Author Preface Glossary List of Figures List of Tables xiii xv xvii xxi xxix 1 Introduction 1 1.1 A change of scene 1 1.2 Driving the change 4 1.3 The role of standards 4 1.4 Why H.

2 About the Author Preface Glossary List of Figures List of Tables xiii xv xvii xxi xxix 1 Introduction A change of scene Driving the change The role of standards Why H.264 Advanced Video Coding is important About this book Reference 6 2 Video formats and quality Introduction Natural video scenes Capture Spatial sampling Temporal sampling Frames and fields Colour spaces RGB YCrCb YCrCb sampling formats Video formats Intermediate formats Standard Definition High Definition Quality Subjective quality measurement Objective quality measurement 21

2.7 2.8 3 3.1 3.2 3.3 3.4 3.5 3.6 3.7 3.8 Video coding concepts Introduction Video CODEC Prediction model 3.3.1 Temporal prediction 3.3.2 Spatial model: intra prediction Image model 3.4.1 Predictive image coding 3.

3 Video coding concepts Introduction Video CODEC Prediction model Temporal prediction Spatial model: intra prediction Image model Predictive image coding Transform coding Quantization Reordering and zero encoding Entropy coder Predictive coding Variable-length coding Arithmetic coding The hybrid DPCM/DCT video CODEC model What is H.264? Introduction What is H.264? A video compression format An industry standard A toolkit for video compression Better video compression How does an H.264 codec work? Encoder processes Decoder processes The H.264/AVC Standard H.264 Profiles and Levels The H.264 Syntax H.264 in practice Performance Applications H.264 syntax Introduction A note about syntax examples H.264 syntax Frames, fields and pictures 101

ix 5.4 5.5 5.6 5.7 5.8 5.9 6 6.1 6.2 6.3 6.4 6.5 6.6 6.7 7 7.1 5.3.1 5.3.2 5.3.3 5.3.4 NAL unit Parameter Sets Slice layer 5.6.1 5.6.2 5.6.3 Decoding order Display order Reference picture lists Frame and field coding Slice types Slice header Slice data Macroblock layer 5.

4 ix NAL unit Parameter Sets Slice layer Decoding order Display order Reference picture lists Frame and field coding Slice types Slice header Slice data Macroblock layer Overview The Intra PCM mode Macroblock prediction Residual data Macroblock syntax examples H.264 Prediction Introduction Macroblock prediction Intra prediction Inter prediction Loop x4 luma prediction modes 16x16 luma prediction modes Chroma prediction modes 8x8 luma prediction, High profiles Signalling intra prediction modes Reference pictures Interpolating reference pictures Macroblock partitions Motion vector prediction Motion compensated prediction Inter prediction examples Prediction structures filter Boundary strength Filter decision Filter implementation Loop filter example H.264 transform and coding Introduction

i Contents 7.2 Transform and quantization 179 7.2.1 The H.264 transforms 179 7.2.2 Transform processes 180 7.2.3 Integer transform and quantization: 4x4 blocks 185 7.2.4 Integer transform and quantization: 8x8 blocks 198 7.

5 i Contents 7.2 Transform and quantization The H.264 transforms Transform processes Integer transform and quantization: 4x4 blocks Integer transform and quantization: 8x8 blocks DC transforms Transform and quantization extensions in the High profiles Block scan orders Coding Exp-Golomb Coding Context Adaptive Variable Length Coding, CAVLC Context Adaptive Binary Arithmetic Coding, CABAC H.264 conformance, transport and licensing Introduction Conforming to the Standard Profiles Levels Hypothetical Reference Decoder Conformance testing H.264 coding tools for transport support Redundant slices Arbitrary Slice Order (ASO) Slice Groups/Flexible Macroblock Order (FMO) SP and SI slices Data partitioned slices Transport of H.264 data Encapsulation in RBSPs, NALUs and packets Transport protocols File formats Coding and transport issues Supplemental Information Supplemental Enhancement Information (SEI) Video Usability Information (VUI) Licensing H.264/AVC Video coding patents Video coding standards and patents Licensing H.264/AVC patents H.264 performance Introduction Experimenting with H

XI 9.2.1 The JM Reference Software 256 9.2.2 Other software encoders/decoders 261 9.2.3 H.264 stream analysis 263 9.3 Performance comparisons 265 9.3.1 Performance criteria 265 9.3.2 Performance examples: Foreman sequence, QCIF resolution 265 9.

6 XI The JM Reference Software Other software encoders/decoders H.264 stream analysis Performance comparisons Performance criteria Performance examples: Foreman sequence, QCIF resolution Performance examples: Foreman and Container sequences Performance examples: Inter prediction structures Performance example: H.264 vs. MPEG-4 Visual Rate control Rate control in the JM reference encoder Mode selection Rate Distortion Optimized mode selection Low complexity coding Approximating the cost function Reducing the set of tested modes Early termination Extensions and directions Introduction Scalable Video Coding Simulcast transmission Scalable transmission Applications of Scalable Video Coding Scalable Video Coding in H Temporal scalability Quality scalability: overview Spatial scalability: overview Spatial scalability in detail Quality scalability in detail Combined scalability SVC performance " Multiview Video Coding H.264 Multiview Video Coding Configurable Video Coding MPEG Reconfigurable Video Coding Fully Configurable Video Coding Beyond H.264/AVC Index 313

4G WIRELESS VIDEO COMMUNICATIONS

4G WIRELESS VIDEO COMMUNICATIONS Haohong Wang Marvell Semiconductors, USA Lisimachos P. Kondi University of Ioannina, Greece Ajay Luthra Motorola, USA Song Ci University of Nebraska-Lincoln, USA WILEY