4G WIRELESS VIDEO COMMUNICATIONS

Transcription

1 4G WIRELESS VIDEO COMMUNICATIONS Haohong Wang Marvell Semiconductors, USA Lisimachos P. Kondi University of Ioannina, Greece Ajay Luthra Motorola, USA Song Ci University of Nebraska-Lincoln, USA WILEY A John Wiley and Sons, Ltd., Publication

2 Foreword Preface About the Authors About the Series Editors xiii xv xxi xxv 1 Introduction Why 4G? G Status and Key Technologies GPP LTE Mobile WiMAX Video Over Wireless Video Compression Basics Video Coding Standards Error Resilience Network Integration Cross-Layer Design for Wireless Video Delivery Challenges and Opportunities for 4G Wireless Video 15 References 17 2 Wireless Communications and Networking Characteristics and Modeling of Wireless Channels Degradation in Radio Propagation Rayleigh Fading Channel Adaptive Modulation and Coding Basics of Modulation Schemes System Model of AMC Channel Quality Estimation and Prediction Modulation and Coding Parameter Adaptation 28

3 2.2.5 Estimation Error and Delay in AMC Selection of Adaptation Interval Orthogonal Frequency Division Multiplexing Background System Model and Implementation Pros and Cons Multiple-Input Multiple-Output Systems MIMO System Model MIMO Capacity Gain: Multiplexing MIMO Diversity Gain: Beamforming Diversity-Multiplexing Trade-offs Space-Time Coding Cross-Layer Design of AMC and HARQ Background System Modeling Cross-Layer Design Performance Analysis Performance Wireless Networking Layering Network Architectures Network Service Models Multiplexing Methods Connection Management in IP-Based Data Networks öos Handoff Summary 55 References 56 3 Video Coding and Communications Digital Video Compression - Why and How Much? Basics Video Formats Scanning Color Luminance, Luma, Chrominance, Chroma Information Theory Entropy and Mutual Information Encoding of an Information Source Variable Length Coding Quantization Encoder Architectures DPCM Hybrid Transform-DPCM Architecture A Typical Hybrid Transform DPCM-based Video Codec Motion Compensation DCT and Quantization Procedures Performed at the Decoder 84

4 vii 3.5 Wavelet-Based Video Compression Motion-Compensated Temporal Wavelet Transform Using Lifting 90 References G Wireless Communications and Networking IMT-Advanced and 4G LTE Introduction Protocol Architecture E- UTRAN Overview Architecture User Plane and Control Plane LTE Physical Layer LTE Layer 2 The Evolution of Architecture LTE Standardization WIMAX-IEEE m GPP2 UMB Acknowledg References Network Architecture System Reference Model Protocol Structure MAC Layer PHY Layer Other Functions Supported by IEEE m for Architecture Reference Model Layering Architecture and Protocols ements Further Study Advanced Video Coding (AVC)/H.264 Standard Digital Video Compression Standards AVC/H.264 Coding Algorithm Temporal Prediction Spatial Prediction The Transform Motion Estimation P and В MBs Multiple References Motion Estimation Accuracy Weighted Prediction Frame and Field MV MV Compression 4x4 Integer DCT and Inverse Integer DCT Transform 8x8 Transform Hadamard Transform for DC

5 viii Quantization and Scaling Scanning Variable Length Lossless Codecs Exp-Golomb Code CAVLC (Context Adaptive VLC) CABAC Deblocking Filter Hierarchy in the Coded Video Basic Picture Types (I, P, B, B R ) SP and SI Pictures Buffers 1 Encapsulation/Packetization Profiles Baseline Profile Extended Profile Main Profile High Profile HighlO Profile High 4:2:2 Profile High 4:4:4 Predictive Profile Intra Only Profiles Levels Maximum Bit Rates, Picture Sizes and Frame Rates Maximum СРВ, DPB and Reference Frames Parameter Sets References Sequence Parameter Sets (SPS) Picture Parameter Sets (PPS) Supplemental Enhancement Information (SEI) Subjective Tests 6 Content Analysis for Communications 6.1 Introduction 6.2 Content Analysis Low-Level Feature Extraction Edge Shape Color Texture Motion Mathematical Morphology Image Segmentation Threshold and Boundary Based Segmentation Clustering Based Segmentation Region Based Approach Adaptive Perceptual Color-Texture Segmentation

6 ix Video Object Segmentation COST211 Analysis Model Spatial-Temporal Segmentation Moving Object Tracking Head-and-Shoulder Object Segmentation Video Structure Understanding Video Abstraction Video Summary Extraction Analysis Methods in Compressed Domain Content-Based Video Representation Content-Based Video Coding and Communications Object-Based Video Coding Error Resilience for Object-Based Video Content Description and Management MPEG MPEG References Video Error Resilience and Error Concealment Introduction Error Resilience Re synchronization Markers Reversible Variable Length Coding (RVLC) Error-Resilient Entropy Coding (EREC) Independent Segment Decoding Insertion of Intra Blocks or Frames Scalable Coding Multiple Description Coding Channel Coding Error Concealment Intra Error Concealment Techniques Inter Error Concealment Techniques Error Resilience Features of H.264/AVC Picture Segmentation Intra Placement Reference Picture Selection Data Partitioning Parameter Sets Flexible Macroblock Ordering Redundant Slices (RSs) 239 References Cross-Layer Optimized Video Delivery over 4G Wireless Networks Why Cross-Layer Design? Quality-Driven Cross-Layer Framework 242

7 X References Application Layer Rate Control at the Transport Layer Background System Model Network Setting Problem Formulation Problem Solution Performance Evaluation Routing at the Network Layer Background System Model Routing Metric Problem Formulation Problem Solution Implementation Considerations Performance Evaluation Content-Aware Real-Time Video Streaming Background Background Problem Formulation Routing Based on Priority Queuing Problem Solution Performance Evaluation Cross-Layer Optimization for Video Summary Transmission Background Problem Formulation System Model Link Adaptation for Good Content Coverage Problem Solution Performance Evaluation Conclusions Content-based Video Communications Network-Adaptive Video Object Encoding Joint Source Coding and Unequal Error Protection Problem Formulation System Model Channel Model Expected Distortion Optimization Formulation Solution and Implementation Details Packetization and Error Concealment Expected Distortion Optimal Solution Application on Energy-Efficient Wireless Network

8 XI Channel Model Experimental Results Application on Differentiated Services Networks Joint Source-Channel Coding with Utilization of Data Hiding Hiding Shape in Texture Joint Source-Channel Coding Joint Source-Channel Coding and Data Hiding System Model Channel Model Expected Distortion Implementation Details Experimental Results 315 References AVC/H.264 Application - Digital TV Introduction Encoder Flexibility Random Access GOP Bazaar MPEG-2 Like, 2B, GOP Structure Reference В and Hierarchical GOP structures Low Delay Structure Editable Structure Others Buffers, Before and After Coded Picture Buffer Decoded Picture Buffer (DPB) Bitstream Splicing Trick Modes Fast Forward Reverse Pause Carriage of AVC/H.264 Over MPEG-2 Systems Packetization Packetized Elementary Stream (PES) Transport Stream (TS) Program Stream Audio Video Synchronization Transmitter and Receiver Clock Synchronization System Target Decoder and Timing Model 344 References Interactive Video Communications Video Conferencing and Telephony IP and Broadband Video Telephony

9 XU Wireless Video Telephony G-324M Protocol Multiplexing and Error Handling Adaptation Layers The Control Channel Audio and Video Channels Call Setup Region-of-Interest Video Communications ROI based Bit Allocation Quality Metric for ROI Video Bit Allocation Scheme for ROI Video Bit Allocation Models Content Adaptive Background Skipping Content-based Skip Mode Decision p Budget Adjustment 360 References Wireless Video Streaming Introduction Streaming System Architecture Video Compression Application Layer QoS Control Rate Control Rate Shaping Error Control Protocols Transport Protocols Video/Audio Synchronization Delay-Constrained Retransmission Receiver-Based Control Sender-Based Control Hybrid Control Rate-Distortion Optimal Retransmission Considerations for Wireless Video Streaming Cross-Layer Optimization and Physical Layer Consideration P2P Video Streaming 384 References 385 Index 389