Video Compression and Communications

Size: px

Start display at page:

Download "Video Compression and Communications"

Roxanne Stanley
6 years ago
Views:

3 Video Compression and Communications

5 Video Compression and Communications From Basics to H.261, H.263, H.264, MPEG4 for DVB and HSDPA-Style Adaptive Turbo-Transceivers Second Edition L. Hanzo, P. J. Cherriman and J. Streit All of University of Southampton, UK IEEE Communications Society, Sponsor John Wiley & Sons, Ltd

6 Copyright c 2007 John Wiley & Sons Ltd, The Atrium, Southern Gate, Chichester, West Sussex PO19 8SQ, England Telephone (+44) (for orders and customer service enquiries): cs-books@wiley.co.uk Visit our Home Page on All Rights Reserved. No part of this publication may be reproduced, stored in a retrieval system or transmitted in any form or by any means, electronic, mechanical, photocopying, recording, scanning or otherwise, except under the terms of the Copyright, Designs and Patents Act 1988 or under the terms of a licence issued by the Copyright Licensing Agency Ltd, 90 Tottenham Court Road, London W1T 4LP, UK, without the permission in writing of the Publisher. Requests to the Publisher should be addressed to the Permissions Department, John Wiley & Sons Ltd, The Atrium, Southern Gate, Chichester, West Sussex PO19 8SQ, England, or ed to permreq@wiley.co.uk, or faxed to (+44) Designations used by companies to distinguish their products are often claimed as trademarks. All brand names and product names used in this book are trade names, service marks, trademarks or registered trademarks of their respective owners. The Publisher is not associated with any product or vendor mentioned in this book. All trademarks referred to in the text of this publication are the property of their respective owners. This publication is designed to provide accurate and authoritative information in regard to the subject matter covered. It is sold on the understanding that the Publisher is not engaged in rendering professional services. If professional advice or other expert assistance is required, the services of a competent professional should be sought. Other Wiley Editorial Offices John Wiley & Sons Inc., 111 River Street, Hoboken, NJ 07030, USA Jossey-Bass, 989 Market Street, San Francisco, CA , USA Wiley-VCH Verlag GmbH, Boschstr. 12, D Weinheim, Germany John Wiley & Sons Australia Ltd, 42 McDougall Street, Milton, Queensland 4064, Australia John Wiley & Sons (Asia) Pte Ltd, 2 Clementi Loop #02-01, Jin Xing Distripark, Singapore John Wiley & Sons Canada Ltd, 22 Worcester Road, Etobicoke, Ontario, Canada M9W 1L1 Wiley also publishes its books in a variety of electronic formats. Some content that appears in print may not be available in electronic books. IEEE Communications Society, Sponsor COMMS-S Liaison to IEEE Press, Mostafa Hashem Sherif Library of Congress Cataloging-in-Publication Data Hanzo, Lajos, Video Compression and Communications : from basics to H.261, H.263, H.264, MPEG4 for DVB and HSDPA-style adaptive turbo-transceivers / L. Hanzo, P. J. Cherriman and J. Streit 2nd ed. p. cm. Includes bibliographical references and index. ISBN (cloth) 1. Video compression. 2. Digital video. 3. Mobile communication systems. I. Cherriman, Peter J., II. Streit, Jürgen, III. Title. TK H dc22 British Library Cataloguing in Publication Data A catalogue record for this book is available from the British Library ISBN (HB) Typeset by the authors using LATEX software. Printed and bound in Great Britain by Antony Rowe Ltd, Chippenham, England. This book is printed on acid-free paper responsibly manufactured from sustainable forestry in which at least two trees are planted for each one used for paper production.

7 Contents About the Authors Other Wiley and IEEE Press Books on Related Topics Preface Acknowledgments xvii xix xxi xxiii 1 Introduction A Brief Introduction to Compression Theory Introduction to Video Formats EvolutionofVideoCompressionStandards The International Telecommunications Union s H.120 Standard JointPhotographicExpertsGroup TheITUH.261Standard TheMotionPicturesExpertGroup TheMPEG-2Standard TheITUH.263Standard The ITU H.263+/H Standards TheMPEG-4Standard TheH.26L/H.264Standard VideoCommunications Organization of the Monograph I Video Codecs for HSDPA-style Adaptive Videophones 19 2 Fractal Image Codecs FractalPrinciples One-dimensionalFractalCoding FractalCodecDesign FractalCodecPerformance... 28

8 vi CONTENTS 2.3 ErrorSensitivityandComplexity SummaryandConclusions Low Bitrate DCT Codecs and HSDPA-style Videophone Transceivers Video Codec Outline ThePrincipleofMotionCompensation Distance Measures MotionSearchAlgorithms FullorExhaustiveMotionSearch Gradient-basedMotionEstimation HierarchicalorTreeSearch SubsamplingSearch Post-processingofMotionVectors Gain-cost-controlledMotionCompensation OtherMotionEstimationTechniques Pel-recursive Displacement Estimation GridInterpolationTechniques MCUsingHigherOrderTransformations MCintheTransformDomain Conclusion TransformCoding One-dimensionalTransformCoding Two-dimensionalTransformCoding QuantizerTrainingforSingle-classDCT Quantizer Training for Multiclass DCT The Codec Outline Initial Intra-frame Coding Gain-controlledMotionCompensation TheMCERActive/PassiveConcept PartialForcedUpdateoftheReconstructedFrameBuffers The Gain/Cost-controlled Inter-frame Codec ComplexityConsiderationsandReductionTechniques TheBit-allocationStrategy Results DCT Codec Performance under Erroneous Conditions BitSensitivity BitSensitivityofCodecIandII DCT-basedLow-rateVideoTransceivers ChoiceofModem Source-matchedTransceiver System SystemConcept Sensitivity-matched Modulation SourceSensitivity ForwardErrorCorrection TransmissionFormat... 75

9 CONTENTS vii System AutomaticRepeatRequest Systems SystemPerformance PerformanceofSystem PerformanceofSystem FERPerformance SlotOccupancyPerformance PSNRPerformance PerformanceofSystems SummaryandConclusions Very Low Bitrate VQ Codecs and HSDPA-style Videophone Transceivers Introduction The Codebook Design TheVectorQuantizerDesign Mean and Shape Gain Vector Quantization AdaptiveVectorQuantization ClassifiedVectorQuantization AlgorithmicComplexity Performance under Erroneous Conditions Bit-allocationStrategy BitSensitivity VQ-basedLow-rateVideoTransceivers Choice of Modulation ForwardErrorCorrection ArchitectureofSystem ArchitectureofSystem ArchitectureofSystems SystemPerformance SimulationEnvironment PerformanceofSystems1and PerformanceofSystems4and PerformanceofSystems2and Joint Iterative Decoding of Trellis-based Vector-quantized Video and TCM Introduction SystemOverview Compression Vector Quantization Decomposition SerialConcatenationandIterativeDecoding TransmissionFrameStructure Frame Difference Decomposition VQ Codebook VQ-inducedCodeConstraints VQ Trellis Structure VQEncoding...129

10 viii CONTENTS VQDecoding Results SummaryandConclusions Low Bitrate Quad-tree-based Codecs and HSDPA-style Videophone Transceivers Introduction Quad-tree Decomposition Quad-treeIntensityMatch Zero-orderIntensityMatch First-orderIntensityMatch Decomposition Algorithmic Issues Model-basedParametricEnhancement EyeandMouthDetection Parametric Codebook Training ParametricEncoding TheEnhancedQTCodec Performance and Considerations under Erroneous Conditions BitAllocation BitSensitivity QT-codec-basedVideoTransceivers Channel Coding and Modulation QT-basedTransceiverArchitectures QT-basedVideo-transceiverPerformance SummaryofQT-basedVideoTransceivers SummaryofLow-rateVideoCodecsandTransceivers II High-resolution Video Coding Low-complexity Techniques Differential Pulse Code Modulation Basic Differential Pulse Code Modulation Intra/Inter-frame Differential Pulse Code Modulation Adaptive Differential Pulse Code Modulation BlockTruncationCoding TheBlockTruncationAlgorithm BlockTruncationCodecImplementations Intra-frame Block Truncation Coding Inter-frame Block Truncation Coding Subband Coding Perfect Reconstruction Quadrature Mirror Filtering Analysis Filtering Synthesis Filtering PracticalQMFDesignConstraints Practical Quadrature Mirror Filters

11 CONTENTS ix Run-length-based Intra-frame Subband Coding Max-Lloyd-based Subband Coding SummaryandConclusions High-resolution DCT Coding Introduction Intra-frame Quantizer Training Motion Compensation for High-quality Images Inter-frame DCT Coding PropertiesoftheDCTTransformedMCER JointMotionCompensationandResidualEncoding The Proposed Codec MotionCompensation TheInter/Intra-DCTCodec FrameAlignment Bit-allocation TheCodecPerformance ErrorSensitivityandComplexity SummaryandConclusions III H.261, H.263, H.264, MPEG2 and MPEG4 for HSDPA-style Wireless Video Telephony and DVB H.261 for HSDPA-style Wireless Video Telephony Introduction TheH.261VideoCodingStandard Overview SourceEncoder CodingControl Video Multiplex Coder PictureLayer GroupofBlocksLayer Macroblock Layer BlockLayer SimulatedCodingStatistics Fixed-quantizerCoding VariableQuantizerCoding EffectofTransmissionErrorsontheH.261Codec Error Mechanisms Error Control Mechanisms Background Intra-frame Coding AutomaticRepeatRequest Reconfigurable Modulations Schemes CombinedSource/ChannelCoding...257

12 x CONTENTS ErrorRecovery EffectsofErrors Qualitative Effect of Errors on H.261 Parameters Quantitative Effect of Errors on a H.261 Data Stream ErrorsinanIntra-codedFrame ErrorsinanInter-codedFrame ErrorsinQuantizerIndices Errors in an Inter-coded Frame with MotionVectors Errors in an Inter-coded Frame at Low Rate A Reconfigurable Wireless Videophone System Introduction Objectives BitrateReductionoftheH.261Codec Investigation of Macroblock Size ErrorCorrectionCoding PacketizationAlgorithm EncodingHistoryList Macroblock Compounding EndofFrameEffect PacketTransmissionFeedback Packet Truncation and Compounding Algorithms H.261-based Wireless Videophone System Performance SystemArchitecture SystemPerformance SummaryandConclusions Comparative Study of the H.261 and H.263 Codecs Introduction TheH.263CodingAlgorithms SourceEncoder Prediction MotionCompensationandTransformCoding Quantization Video Multiplex Coder PictureLayer GroupofBlocksLayer H.261 Macroblock Layer H.263 Macroblock Layer BlockLayer MotionCompensation H.263MotionVectorPredictor H.263 Subpixel Interpolation H.263NegotiableOptions UnrestrictedMotionVectorMode Syntax-basedArithmeticCodingMode...310

13 CONTENTS xi Arithmeticcoding AdvancedPredictionMode Four Motion Vectors per Macroblock Overlapped Motion Compensation for Luminance P-BFramesMode PerformanceResults Introduction H.261Performance H.261/H.263 Performance Comparison H.263CodecPerformance Gray-ScaleversusColorComparison ComparisonofQCIFResolutionColorVideo CodingPerformanceatVariousResolutions SummaryandConclusions H.263 for HSDPA-style Wireless Video Telephony Introduction H.263inaMobileEnvironment ProblemsofUsingH.263inaMobileEnvironment PossibleSolutionsforUsingH.263inaMobileEnvironment Coding Video Sequences Using Exclusively Intra-coded Frames AutomaticRepeatRequests Multimode Modulation Schemes CombinedSource/ChannelCoding Design of an Error-resilient Reconfigurable Videophone System Introduction Controlling the Bitrate Employing FEC Codes in the Videophone System TransmissionPacketStructure CodingParameterHistoryList ThePacketizationAlgorithm OperationalScenariosofthePacketizingAlgorithm H.263-based Video System Performance SystemEnvironment PerformanceResults Error-free Transmission Results Effect of Packet Dropping on Image Quality Image Quality versus Channel Quality without ARQ Image Quality versus Channel Quality with ARQ Comparison of H.263 and H.261-based Systems PerformancewithAntennaDiversity PerformanceoverDECTChannels TransmissionFeedback ARQIssues...371

14 xii CONTENTS ImplementationofTransmissionFeedback MajorityLogicCoding SummaryandConclusions MPEG-4 Video Compression Introduction OverviewofMPEG MPEG-4Profiles MPEG-4Features MPEG-4Object-basedOrientation MPEG-4:Content-basedInteractivity VOP-basedEncoding MotionandTextureEncoding ShapeCoding VOPShapeEncoding Gray-scaleShapeCoding Scalability of Video Objects Video Quality Measures Subjective Video Quality Evaluation Objective Video Quality EffectofCodingParameters SummaryandConclusion Comparative Study of the MPEG-4 and H.264 Codecs Introduction TheITU-TH.264Project H.264VideoCodingTechniques H.264Encoder H.264Decoder H.264SpecificCodingAlgorithm Intra-frame Prediction Inter-frame Prediction BlockSizes MotionEstimationAccuracy Multiple Reference Frame Selection for Motion Compensation De-blocking Filter IntegerTransform Development of the 4 4-pixelIntegerDCT Quantization The Combined Transform, Quantization, Rescaling, and InverseTransformProcess IntegerTransformExample EntropyCoding UniversalVariableLengthCoding...424

15 CONTENTS xiii Context-basedAdaptiveBinaryArithmeticCoding H.264Conclusion ComparativeStudyoftheMPEG-4andH.264Codecs Introduction Intra-frame Coding and Prediction Inter-frame Prediction and Motion Compensation TransformCodingandQuantization EntropyCoding De-blocking Filter PerformanceResults Introduction MPEG-4Performance H.264Performance ComparativeStudy SummaryandConclusions MPEG-4 Bitstream and Bit-sensitivity Study Motivation StructureofCodedVisualData VideoData Still Texture Data MeshData FaceAnimationParameterData VisualBitstreamSyntax StartCodes Introduction to Error-resilient Video Encoding Error-resilient Video Coding in MPEG Error-resilience Tools in MPEG Resynchronization Data Partitioning ReversibleVariable-lengthCodes HeaderExtensionCode MPEG-4Bit-sensitivityStudy Objectives Introduction SimulatedCodingStatistics EffectsofErrors ChapterConclusions HSDPA-like and Turbo-style Adaptive Single- and Multi-carrier Video Systems Turbo-equalized H.263-based Videophony for GSM/GPRS Motivation and Background SystemParameters TurboEqualization Turbo-equalizationPerformance...465

SDH/SONET Explained in Functional Models

SDH/SONET Explained in Functional Models Modeling the Optical Transport Network Huub van Helvoort Networking Consultant, the Netherlands SDH/SONET Explained in Functional Models SDH/SONET Explained in