ADAPTIVE JOINT H.263-CHANNEL CODING FOR MEMORYLESS BINARY CHANNELS
|
|
- Alyson Atkinson
- 6 years ago
- Views:
Transcription
1 ADAPTIVE JOINT H.263-CHANNEL ING FOR MEMORYLESS BINARY CHANNELS A. Navarro, J. Tavares Aveiro University - Telecommunications Institute, 38 Aveiro, Portugal, navarro@av.it.pt Abstract - The main purpose of this paper is to show that once the video source coding is dependent on the channel characteristics, better performance can be achieved in terms of reconstructed video quality. Our study considers a fixed overall bit rate transmission of 64 kbit/s over error prone memoryless binary channels and the source coder is the ITU-T H.263 video standard. The variable H.263 source coding rate adapts to a particular channel Bit Error Rate () at any instant of time. Firstly, we investigated the error sensitivities of H.263 syntactical elements and grouped them into several classes of different significance. By identifying the most sensitive elements, we developed a data grouping (DG) technique which by itself, exhibits improved error resilience. Secondly, we design an Unequal Error Protection (UEP) scheme and compare its performance with an equivalent (same source coding bit rate) Equal Error Protection (EEP) scheme, using Rate Compatible Punctured Convolutional (RCPC) codes of different rates for forward error protection. Both forward error correction schemes adopted have resulted in PSNR improvements over db for s higher than of 4x 3. Finally, if during the real time encoding process, the encoder is aware of the channel and there is an unlimited number of code rates, this paper shows that UEP and EEP strategies provide quite similar performances. Keywords - adaptive wireless video communications, forward error protection, joint source-channel coding. I. INTRODUCTION Nowadays, commercially available multimedia terminals are not able to provide video based multimedia applications with accepted image resolution and quality. In future mobile multimedia terminals, motion video is the most demanding in terms of bit rate. Therefore, the wideband 3 rd generation mobile networks (UMTS - Universal Mobile Telecommunication Services) as well as the future broadband 4 th generation networks may be able to transmit motion digital video to the subscriber terminals. Although, the 3 rd and 4 th generations overcome the bit rate limitation, wireless video transmission offer other important negative aspects namely caused by the deep fast fading effects. Compressed video is extremely vulnerable to transmission errors since a single erroneous bit may lead to a considerable number of frames to be incorrectly decoded. Video coding standards were developed for error free transmission since prediction and statistical coding techniques have been adopted. Some papers published in the recent years have investigated both compatible standard and non-standard schemes to improve robustness of video coding. Several techniques have been investigated to increase the error resilience of video coding schemes and some examples are, Forward Error Correction (FEC), Error Concealment (EC), Automatic Request (ARQ), Synchronization Markers (SM) or a combination of them. Support for the last three mentioned techniques have recently been included in the H.263 standard as optional annexes [1,2]. FEC schemes are part of the multiplexing standards, H.223 [3] and H.323 [4]. Unlike these standards recommend, this paper results show that FEC codes should be applied dynamically according to instantaneous channel characteristics and different codes should be used to protect bit stream classes according to their significance. In the context of forward error protection of classified bit stream, Yap et al [] have presented an H.263 channel coding scheme based on RCPC codes and on source bit significance which shows the advantage of UEP over EEP. Bystrom and Modestino [6] formulated the problem of optimally allocating bit rate between source and channel coding for a particular value of overall bit budget. However, a mathematical solution for that optimization problem has not been proposed. Therefore, the solution was graphical. This paper obtained a different syntactical element significance order as reported by Yap et al, mainly due to the use of different binary channel modeling. More recently, Pei and Modestino [7] have shown the advantages of combining adaptive coding and modulation techniques. This paper is organized as follows: In Section 2, we investigate the H.263 syntactical element sensitivities subjected to memoryless binary channel errors. Section 3 classifies the H.263 syntactical elements into classes of significance and groups them. In Section 4, we present some forward error protection schemes and discuss the advantages and disadvantages of them in real time video coding applications, mainly in terms of source adaptability to the instantaneous wireless channel characteristics. Finally, Section concludes this paper. II. H.263 SYNTACTICAL ELEMENT SENSITIVITIES The H.263 baseline bit stream is divided into several layers, Picture Layer, Group of Blocks (GOB) Layer, Macroblock (MB) Layer and Block Layer, forming 21 syntactical elements supposing no optional modes. As subjecting to errors, each element has a different negative contribution to /02/$ IEEE PIMRC 02
2 the reconstructed luminance PSNR. A binary error generator with a constant Bit Error Rate () is used to corrupt the entire syntactical element under evaluation. All other elements are left error free. The mean luminance (Y) PSNR of the reconstructed sequence is used as a measure of sensitivity. By varying the from -1 to - we obtain a plot for each element. The simulation parameters are the following: test sequences- Miss America and Carphone, at Hz; image resolution- QCIF (176x144); target picture frame rate- Hz; target bit rates- 64 kbit/s and 32 kbit/s; GB distance - 1 slice (11 MB); INTRA picture rate - 0. frame/s (every 2 seconds); quantization parameter for INTRA pictures ; rate control used- TMN-8; annexes- all off; elements TR, E and EOS are left error free. As in H.263 bit stream there exist several syntactical elements and to reduce complexity and granularity, different elements with similar functions were grouped together. Those groups are presented in Table 1. Deep explanation of these elements and their meanings can be found in the H.263 video standard [1]. Table 1 Element grouping. Group name Elements P(first 17 bits) and GB P(last bits) and P, G and D P and G Two simulations were accomplished where the first one evaluated the H.263 syntactical element sensitivities of Miss America video sequence at 64 kbit/s and 32 kbit/s, as shown in Fig. 1. For the second one, the video sequence was Carphone and the results are presented in Fig. 2. From the simulation results, we conclude that the transform coefficients of INTRA frames,, are the most sensitive elements, whereas other types like or are nearly insensitive. Nevertheless, the results show element sensitivity dependence on its relative bit rate, whereby the sensitivity depends on the number of erroneous bits and therefore in the number of bits used to encode each element. For example, decreasing the bit rate obviously leads to less bits representing the transform coefficients of INTER frames () and therefore its significance decreases. Since different simulation parameters (concealment, INTRA refreshment, frame rate, bit rate, quantizer, etc.) lead to different element bit rate distribution, it is straightforward to conclude that the sensitivity also depends on those parameters. Any accurate attempt to classify the syntactical elements in a finite number of classes should depend on the channel as well as the source bit rate as mentioned above. Looking at higher s, the following section orders the elements according to their error sensitivities Fig. 1.Miss America sensitivities-a) 64 kbit/s, b)32 kbit/s Fig. 2.Carphone sensitivities-a) 64 kbit/s, b)32 kbit/s.
3 III. DATA GROUPING TECHNIQUE In order to improve H.263 error resilience we propose a data grouping (DG) technique which places together the same syntactical elements of each MB in the GOB. However, this technique does not use partitioning markers to separate each partition as in MPEG-4 [8,9]. Thus, unlike MPEG-4, DG does not introduces any additional bit rate overhead due to partitioning markers but nevertheless, it cannot take advantage of Reversible VLC codes (RVLC). As expected in the conventional H.263 decoding method, if errors are detected within a GOB, the decoder starts searching the synchronization marker of the next GOB. However, due to the DG, more valuable data can be recovered because errors in elements occurring close to the end of the GOB cannot corrupt the elements syntactically placed before. Therefore, placing the most important syntactical elements at the beginning of the GOB can increase error resilience. For example, in INTRA pictures placing all the elements at the beginning of GOB prevent any error occurring in, and TCOEF- I to corrupt. Thus, it is possible to reconstruct a low quality picture even if all other elements in the GOB were corrupted. For INTER pictures, placing and elements at the end of GOB allow minimizing crucial data errors for motion compensation such as elements. Our element sensitivity study of the H.263 syntax also led us to place the most sensitive ones at the end of the GOB. The adopted DG technique is presented in Fig. 3. As D elements are fixed length coded, any error occurring on them will not affect decoding. This technique is quite different from another proposed by Navarro and Tavares [] which separates the H.263 bit stream into INTRA and INTER GOBs. Although that separation does not lead to any error resilience improvements by itself, it is suitable for designing UEP schemes. Furthermore, a conventional H.263 compatible decoder can be used. INTRA Blocks a) H.263 syntax of an INTRA MB D INTER Blocks b) H.263 syntax of an INTER MB c) Data grouping element organization of an INTRA GOB D d) Data grouping element organization of an INTER GOB Fig. 3. Comparison of bit stream syntax (groups are indicated by bold type) We repeat the sensitivity experiments for this particular DG scheme for Miss America and Carphone sequences. The Miss America results are presented in Fig. 4 for 64 kbit/s and in Fig. for 32 kbit/s. As can be observed, is no longer the most sensitive syntactical element. Due to the DG, the sensitivity of, and are greatly reduced. There is also a considerable reduction in sensitivities of,, and. Elements such as,,,,,, and are nearly unaffected. Similar results were obtained for Carphone Fig. 4. Miss America-H.263+DG syntactical element sensitivities at 64 kbit/s Fig.. Miss America-H.263+DG syntactical element sensitivities at 32 kbit/s. Miss America: H.263 H.263-DG Carphone: H.263 H.263-DG Fig. 6. Miss America and Carphone- Error resilience comparison of H.263 and H.263+DG. Due to the sensitivity decrease of most of the elements, the H.263+DG technique is more error resilient than H.263 standard. Figure 6 presents the reconstructed mean luminance PSNR versus for H.263 and H.263+DG bit streams. The performance is almost equal for less than
4 - and greater than -2. The proposed technique shows its best performance for the middle range. For instance, at of -3, 6.42 db and 4.62 db PSNR gains are achieved for Miss America and Carphone video sequences respectively. The maximum PSNR gain is 7.43 db for Miss America video sequence at 4x -4. Subjective results are presented in Fig. 7. depends on the of the channel. The source coding is modified accordingly to maintain a constant 64 kbit/s transmission bit rate. Table 3 presents several protection schemes evaluated. Table 2 Definition of classes. 1,,,,, 2,, 3, 4,,, Table 3 Schemes used for H.263+DG bit stream protection. Fig. 7. Frame 0, H.263 (left), H.263+DG (right). Miss America, =4x -4. Carphone, =1x -3. IV. FORWARD ERROR PROTECTION In the last section, a video data grouping was devised in order to design UEP schemes. The channel codes used in our simulations are Rate Compatible Punctured Convolutional (RCPC) codes introduced by Hagenauer [11] which are based on a convolutional code of rate 1/4 punctured to produce higher rate codes. Those codes fit our needs in allowing several UEP and EEP schemes. In the simulations performed, it was used a maximum likelihood Viterbi decoder with hard decision. We present two approaches for forward error protection of the H.263+DG bit stream. They are based on Equal Error Protection (EEP) and Unequal Error Protection (UEP) schemes. In UEP, the channel protection is applied judiciously depending on the significance of the source bits. From the results discussed in the previous section, we came up with 4 classes of sensitivity. The classes are presented in Table 2. 1 is the most sensitive and class 4 is the least sensitive. It is assumed that different classes might be transmitted separately and unequal error protection can be applied without any further signaling. Multiplexing and demultiplexing are assumed perfect. For 64 kbit/s overall transmission bit rate, we propose a joint source-channel coding scheme. The level of protection Channel code rate Scheme Source bit rate (kbit/s) NP EEP /12 8/12 8/12 8/12 EEP /16 8/16 8/16 8/16 EEP /24 8/24 8/24 8/24 EEP /32 8/32 8/32 8/32 UEP /14 8/14 8/11 8/ UEP /19 8/16 8/ 8/12 UEP /26 8/24 8/23 8/ The results are presented in Fig. 8. As can be observed, the best protection scheme depends on the channel. The unprotected H.263+DG bit stream achieves the best PSNR until 3.x -. For higher s, another protection scheme is more adequate. For channel higher than 4x 3 the PSNR gains achieve more than db over the unprotected scheme (NP). At -2, a PSNR gain of approximately db is obtained by using EEP 2 scheme instead of NP. Figure 9 presents subjective results. By adopting a joint sourcechannel coding scheme, the video quality can be always maintained beyond 31 db over the whole tested range. The PSNR UEP scheme curves have smoother slope as the most sensitive classes are better protected. The PSNR UEP curve is always better than the corresponding EEP curve. However, the PSNR improvements with UEP are not very promising, especially if source bit rate is allowed adaptively changing in real time according to the channel characteristics (). For instance, at.4x -2 where the intersection between EEP 3 and EEP 4 occurs, the UEP 3 scheme gives only a PSNR improvement of 0.77 db. However, this small PSNR improvement will tend to zero as the number of available code rates increases. From Fig. 8, the optimal bit allocation between source and channel encoders can be obtained for both EEP and UEP schemes. However, the source and channel encoders must know the channel conditions. We point out that smoother PSNR transitions can be obtained if more combinations of source and channel coding rates were used. Then, considering a
5 curve flying over all curves dispatched in Fig. 8 and touching them in the curvature starting points, x -6,1x -3, 1x -2, 4x -2 and 7x -2, we derive an approximate expression of the channel code rate in function of the, given by, R c = -0,0219 (Log()) 2-0,3184 Log() - 0,0738. (1) From a particular, the selected channel code should correspond to one of the available codes, 8/9;8/;8/12;8/14;8/16;8/18;8/;8/22;8/24;8/26;8/28;8/; 8/32, with the closest rate but greater than R c calculated from (1). For example, for =4x -3, R c =0.328 corresponding to an 8/14 code. The H.263 video source bit rate, R s is given by, R s = 64 R c kbit/s, (2) and for this particular example, R s = 36.7 kbit/s. NP EEP 1 UEP 1 EEP 2 UEP 2 EEP 3 UEP 3 EEP Fig. 8. Miss America-Forward error protection of H.263+DG bit stream. Fig. 9. H.263+DG technique. Frame 0, = -2. NP(left), EEP 2 (right). V. CONCLUSIONS The H.263 baseline syntax is very vulnerable to channel errors. We have been able to identify the sensitivities of all H.263 syntactical elements at the transmission rates of 32 and 64 kbit/s. The significance ordering is almost independent of the H.263 source bit rate. The most sensitive elements are the AC coefficients of INTRA blocks (). By using a DG technique we improved error resilience, due especially to decreasing, and sensitivities. The DG technique proposed imposes no overhead. We show that it is very important to adapt the bit rate in an optimal way, i.e. allocating channel coding and source coding rates according to the channel conditions. It was also shown that UEP does not yield any noticeable improvement compared to EEP, especially if we operate on the optimal EEP curve. This paper also presents an expression to calculate the optimal channel and source code rates as a function of the channel for an overall transmission rate of 64 kbit/s. AKNOWLEDGEMENTS J. Tavares is sponsored by the Portuguese Science and Technology Foundation, Portugal. The authors gratefully acknowledge this support. REFERENCES [1] Telecommunication Standardization Sector of ITU, Video coding for low bitrate communication, ITU-T Recommendation H.263, February [2] S. Wenger, et al, Error Resilience Support in H.263+,IEEE Trans on Circuits and Systems for Video Technology, pp , Nov [3] Telecommunication Standardization Sector of ITU, Multiplexing protocol for low bit rate multimedia communication, ITU-T Recommendation H.223, [4] Telecommunication Standardization Sector of ITU, Packet based multimedia communications systems, ITU-T Recommendation H.323, February [] C.W. Yap, et al, Error Protection Scheme for the Transmission of H.263 Coded Video over Mobile Radio Channels, Proc. SPIE Conf. on Visual Communication and Image Processing, pp , [6] M. Bystrom and J. W. Modestino, Combined Source- Channel Coding for Transmission of Video Over a Slow- Fading Rician Channel, Int. Conference on Image Processing, [7] Y. Pei and J. W. Modestino, Multi-layered Video Transmission over Wiereless Channels Using an Adaptive Modulation and Coding Scheme, Int. Conference on Image Processing, pp , 01. [8] Raj Talluri, Error-Resilient Video Coding in the ISO MPEG-4 Standard, IEEE Communications Magazine, pp , June [9] L. Ducla-Soares and F. Pereira, Error Resilience and Concealment Performance for MPEG-4 Frame-based Video Coding, Image Comm., pp , [] A. Navarro and J. Tavares, Statistical Analysis of H.263 Video Coding and Forward Protection in Error Prone Channels, Int. Conference on Signal Processing Applications and Technology, 00. [11] J. Hagenauer, Rate-Compatible Punctured Convolutional Codes (RCPC Codes) and their Applications, IEEE Transactions on Communications, vol. 36, no. 4, pp , April 1988.
Module 6 STILL IMAGE COMPRESSION STANDARDS
Module 6 STILL IMAGE COMPRESSION STANDARDS Lesson 19 JPEG-2000 Error Resiliency Instructional Objectives At the end of this lesson, the students should be able to: 1. Name two different types of lossy
More informationOptimal Estimation for Error Concealment in Scalable Video Coding
Optimal Estimation for Error Concealment in Scalable Video Coding Rui Zhang, Shankar L. Regunathan and Kenneth Rose Department of Electrical and Computer Engineering University of California Santa Barbara,
More informationMPEG-4: Simple Profile (SP)
MPEG-4: Simple Profile (SP) I-VOP (Intra-coded rectangular VOP, progressive video format) P-VOP (Inter-coded rectangular VOP, progressive video format) Short Header mode (compatibility with H.263 codec)
More informationMotion Estimation. Original. enhancement layers. Motion Compensation. Baselayer. Scan-Specific Entropy Coding. Prediction Error.
ON VIDEO SNR SCALABILITY Lisimachos P. Kondi, Faisal Ishtiaq and Aggelos K. Katsaggelos Northwestern University Dept. of Electrical and Computer Engineering 2145 Sheridan Road Evanston, IL 60208 E-Mail:
More informationERROR-ROBUST INTER/INTRA MACROBLOCK MODE SELECTION USING ISOLATED REGIONS
ERROR-ROBUST INTER/INTRA MACROBLOCK MODE SELECTION USING ISOLATED REGIONS Ye-Kui Wang 1, Miska M. Hannuksela 2 and Moncef Gabbouj 3 1 Tampere International Center for Signal Processing (TICSP), Tampere,
More informationAdvanced Video Coding: The new H.264 video compression standard
Advanced Video Coding: The new H.264 video compression standard August 2003 1. Introduction Video compression ( video coding ), the process of compressing moving images to save storage space and transmission
More informationSNR Scalable Transcoding for Video over Wireless Channels
SNR Scalable Transcoding for Video over Wireless Channels Yue Yu Chang Wen Chen Department of Electrical Engineering University of Missouri-Columbia Columbia, MO 65211 Email: { yyu,cchen} @ee.missouri.edu
More informationDigital Video Processing
Video signal is basically any sequence of time varying images. In a digital video, the picture information is digitized both spatially and temporally and the resultant pixel intensities are quantized.
More informationRate-Distortion Optimized Layered Coding with Unequal Error Protection for Robust Internet Video
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 11, NO. 3, MARCH 2001 357 Rate-Distortion Optimized Layered Coding with Unequal Error Protection for Robust Internet Video Michael Gallant,
More informationCombined Copyright Protection and Error Detection Scheme for H.264/AVC
Combined Copyright Protection and Error Detection Scheme for H.264/AVC XIAOMING CHEN, YUK YING CHUNG, FANGFEI XU, AHMED FAWZI OTOOM, *CHANGSEOK BAE School of Information Technologies, The University of
More information4G WIRELESS VIDEO COMMUNICATIONS
4G WIRELESS VIDEO COMMUNICATIONS Haohong Wang Marvell Semiconductors, USA Lisimachos P. Kondi University of Ioannina, Greece Ajay Luthra Motorola, USA Song Ci University of Nebraska-Lincoln, USA WILEY
More informationPrioritisation of Data Partitioned MPEG-4 Video over Mobile Networks Λ
Communication Networks Prioritisation of Data Partitioned MPEG-4 Video over Mobile Networks Λ STEWART T. WORRALL, SIMON N. FABRI, ABDUL H. SADKA, AHMET M. KONDOZ Centre for Communication Systems Research
More information10.2 Video Compression with Motion Compensation 10.4 H H.263
Chapter 10 Basic Video Compression Techniques 10.11 Introduction to Video Compression 10.2 Video Compression with Motion Compensation 10.3 Search for Motion Vectors 10.4 H.261 10.5 H.263 10.6 Further Exploration
More informationA Hybrid Temporal-SNR Fine-Granular Scalability for Internet Video
318 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 11, NO. 3, MARCH 2001 A Hybrid Temporal-SNR Fine-Granular Scalability for Internet Video Mihaela van der Schaar, Member, IEEE, and
More informationFerre, PL., Doufexi, A., Chung How, J. T. H., Nix, AR., & Bull, D. (2003). Link adaptation for video transmission over COFDM based WLANs.
Ferre, PL., Doufexi, A., Chung How, J. T. H., Nix, AR., & Bull, D. (2003). Link adaptation for video transmission over COFDM based WLANs. Peer reviewed version Link to publication record in Explore Bristol
More informationLecture 5: Error Resilience & Scalability
Lecture 5: Error Resilience & Scalability Dr Reji Mathew A/Prof. Jian Zhang NICTA & CSE UNSW COMP9519 Multimedia Systems S 010 jzhang@cse.unsw.edu.au Outline Error Resilience Scalability Including slides
More informationAudio and video compression
Audio and video compression 4.1 introduction Unlike text and images, both audio and most video signals are continuously varying analog signals. Compression algorithms associated with digitized audio and
More informationCross Layer Protocol Design
Cross Layer Protocol Design Radio Communication III The layered world of protocols Video Compression for Mobile Communication » Image formats» Pixel representation Overview» Still image compression Introduction»
More informationPacket video transmission over wireless channels with adaptive channel rate allocation q
J. Vis. Commun. Image R. 16 (2005) 475 498 www.elsevier.com/locate/jvci Packet video transmission over wireless channels with adaptive channel rate allocation q Wei-Ying Kung a, Chang-Su Kim b, C.-C. Jay
More informationOne-pass bitrate control for MPEG-4 Scalable Video Coding using ρ-domain
Author manuscript, published in "International Symposium on Broadband Multimedia Systems and Broadcasting, Bilbao : Spain (2009)" One-pass bitrate control for MPEG-4 Scalable Video Coding using ρ-domain
More informationSystem Modeling and Implementation of MPEG-4. Encoder under Fine-Granular-Scalability Framework
System Modeling and Implementation of MPEG-4 Encoder under Fine-Granular-Scalability Framework Literature Survey Embedded Software Systems Prof. B. L. Evans by Wei Li and Zhenxun Xiao March 25, 2002 Abstract
More informationADAPTIVE PICTURE SLICING FOR DISTORTION-BASED CLASSIFICATION OF VIDEO PACKETS
ADAPTIVE PICTURE SLICING FOR DISTORTION-BASED CLASSIFICATION OF VIDEO PACKETS E. Masala, D. Quaglia, J.C. De Martin Λ Dipartimento di Automatica e Informatica/ Λ IRITI-CNR Politecnico di Torino, Italy
More informationObjective: Introduction: To: Dr. K. R. Rao. From: Kaustubh V. Dhonsale (UTA id: ) Date: 04/24/2012
To: Dr. K. R. Rao From: Kaustubh V. Dhonsale (UTA id: - 1000699333) Date: 04/24/2012 Subject: EE-5359: Class project interim report Proposed project topic: Overview, implementation and comparison of Audio
More informationMultimedia Standards
Multimedia Standards SS 2017 Lecture 5 Prof. Dr.-Ing. Karlheinz Brandenburg Karlheinz.Brandenburg@tu-ilmenau.de Contact: Dipl.-Inf. Thomas Köllmer thomas.koellmer@tu-ilmenau.de 1 Organisational issues
More informationEE 5359 Low Complexity H.264 encoder for mobile applications. Thejaswini Purushotham Student I.D.: Date: February 18,2010
EE 5359 Low Complexity H.264 encoder for mobile applications Thejaswini Purushotham Student I.D.: 1000-616 811 Date: February 18,2010 Fig 1: Basic coding structure for H.264 /AVC for a macroblock [1] .The
More informationJPEG 2000 vs. JPEG in MPEG Encoding
JPEG 2000 vs. JPEG in MPEG Encoding V.G. Ruiz, M.F. López, I. García and E.M.T. Hendrix Dept. Computer Architecture and Electronics University of Almería. 04120 Almería. Spain. E-mail: vruiz@ual.es, mflopez@ace.ual.es,
More informationCODING METHOD FOR EMBEDDING AUDIO IN VIDEO STREAM. Harri Sorokin, Jari Koivusaari, Moncef Gabbouj, and Jarmo Takala
CODING METHOD FOR EMBEDDING AUDIO IN VIDEO STREAM Harri Sorokin, Jari Koivusaari, Moncef Gabbouj, and Jarmo Takala Tampere University of Technology Korkeakoulunkatu 1, 720 Tampere, Finland ABSTRACT In
More informationError Concealment Used for P-Frame on Video Stream over the Internet
Error Concealment Used for P-Frame on Video Stream over the Internet MA RAN, ZHANG ZHAO-YANG, AN PING Key Laboratory of Advanced Displays and System Application, Ministry of Education School of Communication
More informationTitle Adaptive Lagrange Multiplier for Low Bit Rates in H.264.
Provided by the author(s) and University College Dublin Library in accordance with publisher policies. Please cite the published version when available. Title Adaptive Lagrange Multiplier for Low Bit Rates
More informationChannel-Adaptive Error Protection for Scalable Audio Streaming over Wireless Internet
Channel-Adaptive Error Protection for Scalable Audio Streaming over Wireless Internet GuiJin Wang Qian Zhang Wenwu Zhu Jianping Zhou Department of Electronic Engineering, Tsinghua University, Beijing,
More informationFast Decision of Block size, Prediction Mode and Intra Block for H.264 Intra Prediction EE Gaurav Hansda
Fast Decision of Block size, Prediction Mode and Intra Block for H.264 Intra Prediction EE 5359 Gaurav Hansda 1000721849 gaurav.hansda@mavs.uta.edu Outline Introduction to H.264 Current algorithms for
More informationIEEE TRANSACTIONS ON MULTIMEDIA, VOL. 7, NO. 2, APRIL
IEEE TRANSACTIONS ON MULTIMEDIA, VOL. 7, NO. 2, APRIL 2005 201 A Fragile Watermark Error Detection Scheme for Wireless Video Communications Minghua Chen, Yun He, Senior Member, IEEE, and Reginald L. Lagendijk,
More informationAn Efficient Table Prediction Scheme for CAVLC
An Efficient Table Prediction Scheme for CAVLC 1. Introduction Jin Heo 1 Oryong-Dong, Buk-Gu, Gwangju, 0-712, Korea jinheo@gist.ac.kr Kwan-Jung Oh 1 Oryong-Dong, Buk-Gu, Gwangju, 0-712, Korea kjoh81@gist.ac.kr
More informationVideo Redundancy Coding in H.263+ Stephan Wenger Technische Universität Berlin
Video Redundancy Coding in H.263+ Stephan Wenger Technische Universität Berlin stewe@cs.tu-berlin.de ABSTRACT: The forthcoming new version of ITU- T s advanced video compression recommendation H.263 [1]
More informationA New Configuration of Adaptive Arithmetic Model for Video Coding with 3D SPIHT
A New Configuration of Adaptive Arithmetic Model for Video Coding with 3D SPIHT Wai Chong Chia, Li-Minn Ang, and Kah Phooi Seng Abstract The 3D Set Partitioning In Hierarchical Trees (SPIHT) is a video
More informationWelcome Back to Fundamentals of Multimedia (MR412) Fall, 2012 Chapter 10 ZHU Yongxin, Winson
Welcome Back to Fundamentals of Multimedia (MR412) Fall, 2012 Chapter 10 ZHU Yongxin, Winson zhuyongxin@sjtu.edu.cn Basic Video Compression Techniques Chapter 10 10.1 Introduction to Video Compression
More informationVideo Coding Standards: H.261, H.263 and H.26L
5 Video Coding Standards: H.261, H.263 and H.26L Video Codec Design Iain E. G. Richardson Copyright q 2002 John Wiley & Sons, Ltd ISBNs: 0-471-48553-5 (Hardback); 0-470-84783-2 (Electronic) 5.1 INTRODUCTION
More informationEE Low Complexity H.264 encoder for mobile applications
EE 5359 Low Complexity H.264 encoder for mobile applications Thejaswini Purushotham Student I.D.: 1000-616 811 Date: February 18,2010 Objective The objective of the project is to implement a low-complexity
More informationIBM Research Report. Inter Mode Selection for H.264/AVC Using Time-Efficient Learning-Theoretic Algorithms
RC24748 (W0902-063) February 12, 2009 Electrical Engineering IBM Research Report Inter Mode Selection for H.264/AVC Using Time-Efficient Learning-Theoretic Algorithms Yuri Vatis Institut für Informationsverarbeitung
More informationIEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 19, NO. 9, SEPTEMBER
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 19, NO. 9, SEPTEER 2009 1389 Transactions Letters Robust Video Region-of-Interest Coding Based on Leaky Prediction Qian Chen, Xiaokang
More informationESTIMATION OF THE UTILITIES OF THE NAL UNITS IN H.264/AVC SCALABLE VIDEO BITSTREAMS. Bin Zhang, Mathias Wien and Jens-Rainer Ohm
19th European Signal Processing Conference (EUSIPCO 2011) Barcelona, Spain, August 29 - September 2, 2011 ESTIMATION OF THE UTILITIES OF THE NAL UNITS IN H.264/AVC SCALABLE VIDEO BITSTREAMS Bin Zhang,
More informationThe Scope of Picture and Video Coding Standardization
H.120 H.261 Video Coding Standards MPEG-1 and MPEG-2/H.262 H.263 MPEG-4 H.264 / MPEG-4 AVC Thomas Wiegand: Digital Image Communication Video Coding Standards 1 The Scope of Picture and Video Coding Standardization
More informationZonal MPEG-2. Cheng-Hsiung Hsieh *, Chen-Wei Fu and Wei-Lung Hung
International Journal of Applied Science and Engineering 2007. 5, 2: 151-158 Zonal MPEG-2 Cheng-Hsiung Hsieh *, Chen-Wei Fu and Wei-Lung Hung Department of Computer Science and Information Engineering
More informationContext based optimal shape coding
IEEE Signal Processing Society 1999 Workshop on Multimedia Signal Processing September 13-15, 1999, Copenhagen, Denmark Electronic Proceedings 1999 IEEE Context based optimal shape coding Gerry Melnikov,
More informationAn Unequal Packet Loss Protection Scheme for H.264/AVC Video Transmission
An Unequal Packet Loss Protection Scheme for H.4/AVC Video Transmission Xingjun Zhang, Xiaohong Peng School of Engineering and Applied Science, Aston University Aston Triangle, Birmingham, B4 7ET, UK {x.zhang,
More informationReduced Frame Quantization in Video Coding
Reduced Frame Quantization in Video Coding Tuukka Toivonen and Janne Heikkilä Machine Vision Group Infotech Oulu and Department of Electrical and Information Engineering P. O. Box 500, FIN-900 University
More informationIEEE TRANSACTIONS ON BROADCASTING, VOL. 51, NO. 4, DECEMBER
IEEE TRANSACTIONS ON BROADCASTING, VOL. 51, NO. 4, DECEMBER 2005 473 The Rate Variability-Distortion (VD) Curve of Encoded Video and Its Impact on Statistical Multiplexing Patrick Seeling and Martin Reisslein
More informationPattern based Residual Coding for H.264 Encoder *
Pattern based Residual Coding for H.264 Encoder * Manoranjan Paul and Manzur Murshed Gippsland School of Information Technology, Monash University, Churchill, Vic-3842, Australia E-mail: {Manoranjan.paul,
More informationVideo Transcoding Architectures and Techniques: An Overview. IEEE Signal Processing Magazine March 2003 Present by Chen-hsiu Huang
Video Transcoding Architectures and Techniques: An Overview IEEE Signal Processing Magazine March 2003 Present by Chen-hsiu Huang Outline Background & Introduction Bit-rate Reduction Spatial Resolution
More informationWeek 14. Video Compression. Ref: Fundamentals of Multimedia
Week 14 Video Compression Ref: Fundamentals of Multimedia Last lecture review Prediction from the previous frame is called forward prediction Prediction from the next frame is called forward prediction
More informationH.264/AVC und MPEG-4 SVC - die nächsten Generationen der Videokompression
Fraunhofer Institut für Nachrichtentechnik Heinrich-Hertz-Institut Ralf Schäfer schaefer@hhi.de http://bs.hhi.de H.264/AVC und MPEG-4 SVC - die nächsten Generationen der Videokompression Introduction H.264/AVC:
More informationEE Multimedia Signal Processing. Scope & Features. Scope & Features. Multimedia Signal Compression VI (MPEG-4, 7)
EE799 -- Multimedia Signal Processing Multimedia Signal Compression VI (MPEG-4, 7) References: 1. http://www.mpeg.org 2. http://drogo.cselt.stet.it/mpeg/ 3. T. Berahimi and M.Kunt, Visual data compression
More informationFast frame memory access method for H.264/AVC
Fast frame memory access method for H.264/AVC Tian Song 1a), Tomoyuki Kishida 2, and Takashi Shimamoto 1 1 Computer Systems Engineering, Department of Institute of Technology and Science, Graduate School
More informationAn Efficient Mode Selection Algorithm for H.264
An Efficient Mode Selection Algorithm for H.64 Lu Lu 1, Wenhan Wu, and Zhou Wei 3 1 South China University of Technology, Institute of Computer Science, Guangzhou 510640, China lul@scut.edu.cn South China
More informationError Protection of Wavelet Coded Images Using Residual Source Redundancy
Error Protection of Wavelet Coded Images Using Residual Source Redundancy P. Greg Sherwood and Kenneth Zeger University of California San Diego 95 Gilman Dr MC 47 La Jolla, CA 9293 sherwood,zeger @code.ucsd.edu
More informationMesh Based Interpolative Coding (MBIC)
Mesh Based Interpolative Coding (MBIC) Eckhart Baum, Joachim Speidel Institut für Nachrichtenübertragung, University of Stuttgart An alternative method to H.6 encoding of moving images at bit rates below
More informationSCALABLE HYBRID VIDEO CODERS WITH DOUBLE MOTION COMPENSATION
SCALABLE HYBRID VIDEO CODERS WITH DOUBLE MOTION COMPENSATION Marek Domański, Łukasz Błaszak, Sławomir Maćkowiak, Adam Łuczak Poznań University of Technology, Institute of Electronics and Telecommunications,
More informationInvestigation of the GoP Structure for H.26L Video Streams
Investigation of the GoP Structure for H.26L Video Streams F. Fitzek P. Seeling M. Reisslein M. Rossi M. Zorzi acticom GmbH mobile networks R & D Group Germany [fitzek seeling]@acticom.de Arizona State
More informationVideo Coding in H.26L
Royal Institute of Technology MASTER OF SCIENCE THESIS Video Coding in H.26L by Kristofer Dovstam April 2000 Work done at Ericsson Radio Systems AB, Kista, Sweden, Ericsson Research, Department of Audio
More informationInterframe coding A video scene captured as a sequence of frames can be efficiently coded by estimating and compensating for motion between frames pri
MPEG MPEG video is broken up into a hierarchy of layer From the top level, the first layer is known as the video sequence layer, and is any self contained bitstream, for example a coded movie. The second
More informationLow complexity H.264 list decoder for enhanced quality real-time video over IP
Low complexity H.264 list decoder for enhanced quality real-time video over IP F. Golaghazadeh1, S. Coulombe1, F-X Coudoux2, P. Corlay2 1 École de technologie supérieure 2 Université de Valenciennes CCECE
More informationVideo Compression Standards (II) A/Prof. Jian Zhang
Video Compression Standards (II) A/Prof. Jian Zhang NICTA & CSE UNSW COMP9519 Multimedia Systems S2 2009 jzhang@cse.unsw.edu.au Tutorial 2 : Image/video Coding Techniques Basic Transform coding Tutorial
More informationCOMPRESSION techniques for digital video have given
IEEE TRANSACTIONS ON BROADCASTING, VOL. 53, NO. 3, SEPTEMBER 2007 649 Error-Resilient Performance of Dirac Video Codec Over Packet-Erasure Channel M. Tun, K. K. Loo, Member, IEEE, and J. Cosmas, Member,
More informationVideo Compression An Introduction
Video Compression An Introduction The increasing demand to incorporate video data into telecommunications services, the corporate environment, the entertainment industry, and even at home has made digital
More informationLecture 13 Video Coding H.264 / MPEG4 AVC
Lecture 13 Video Coding H.264 / MPEG4 AVC Last time we saw the macro block partition of H.264, the integer DCT transform, and the cascade using the DC coefficients with the WHT. H.264 has more interesting
More informationScalable video coding with robust mode selection
Signal Processing: Image Communication 16(2001) 725}732 Scalable video coding with robust mode selection Shankar Regunathan, Rui Zhang, Kenneth Rose* Department of Electrical and Computer Engineering,
More informationAn Improved H.26L Coder Using Lagrangian Coder Control. Summary
UIT - Secteur de la normalisation des télécommunications ITU - Telecommunication Standardization Sector UIT - Sector de Normalización de las Telecomunicaciones Study Period 2001-2004 Commission d' études
More informationIn the name of Allah. the compassionate, the merciful
In the name of Allah the compassionate, the merciful Digital Video Systems S. Kasaei Room: CE 315 Department of Computer Engineering Sharif University of Technology E-Mail: skasaei@sharif.edu Webpage:
More informationVideo Communication with QoS Guarantees over HIPERLAN/2
Video Communication with QoS Guarantees over HIPERLAN/2 Ji Wang, Ashfaq Khokhar, and Vijay Garg Department of Electrical and Computer Engineering University of Illinois at Chicago, 60607 ABSTRACT This
More informationSTUDY AND IMPLEMENTATION OF VIDEO COMPRESSION STANDARDS (H.264/AVC, DIRAC)
STUDY AND IMPLEMENTATION OF VIDEO COMPRESSION STANDARDS (H.264/AVC, DIRAC) EE 5359-Multimedia Processing Spring 2012 Dr. K.R Rao By: Sumedha Phatak(1000731131) OBJECTIVE A study, implementation and comparison
More information1698 IEEE TRANSACTIONS ON MULTIMEDIA, VOL. 10, NO. 8, DECEMBER 2008
1698 IEEE TRANSACTIONS ON MULTIMEDIA, VOL. 10, NO. 8, DECEMBER 2008 Low-Delay Low-Complexity Bandwidth-Constrained Wireless Video Transmission Using SVC Over MIMO Systems Mohammad K. Jubran, Manu Bansal,
More informationREGION-BASED SPIHT CODING AND MULTIRESOLUTION DECODING OF IMAGE SEQUENCES
REGION-BASED SPIHT CODING AND MULTIRESOLUTION DECODING OF IMAGE SEQUENCES Sungdae Cho and William A. Pearlman Center for Next Generation Video Department of Electrical, Computer, and Systems Engineering
More informationThe new Hybrid approach to protect MPEG-2 video header
The new Hybrid approach to protect MPEG-2 video header *YUK YING CHUNG, *XIANG ZHANG, *XIAOMING CHEN, *MOHD AFIZI MOHD SHUKRAN, **CHANGSEOK BAE *School of Information Technologies, University of Sydney,
More information3GPP TS V6.1.0 ( )
TS 26.111 V6.1.0 (2004-12) Technical Specification 3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; Codec for circuit switched multimedia telephony service;
More informationIN the early 1980 s, video compression made the leap from
70 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 9, NO. 1, FEBRUARY 1999 Long-Term Memory Motion-Compensated Prediction Thomas Wiegand, Xiaozheng Zhang, and Bernd Girod, Fellow,
More informationVIDEO streaming applications over the Internet are gaining. Brief Papers
412 IEEE TRANSACTIONS ON BROADCASTING, VOL. 54, NO. 3, SEPTEMBER 2008 Brief Papers Redundancy Reduction Technique for Dual-Bitstream MPEG Video Streaming With VCR Functionalities Tak-Piu Ip, Yui-Lam Chan,
More informationThe Impact of Link Error Modeling on the Quality of Streamed Video in Wireless Networks
The Impact of Link Error Modeling on the Quality of Streamed Video in Wireless Networks Wolfgang Karner, Olivia Nemethova, Markus Rupp Institute of Communications and Radio-Frequency Engineering Vienna
More informationRecommended Readings
Lecture 11: Media Adaptation Scalable Coding, Dealing with Errors Some slides, images were from http://ip.hhi.de/imagecom_g1/savce/index.htm and John G. Apostolopoulos http://www.mit.edu/~6.344/spring2004
More informationLecture 5: Video Compression Standards (Part2) Tutorial 3 : Introduction to Histogram
Lecture 5: Video Compression Standards (Part) Tutorial 3 : Dr. Jian Zhang Conjoint Associate Professor NICTA & CSE UNSW COMP9519 Multimedia Systems S 006 jzhang@cse.unsw.edu.au Introduction to Histogram
More informationstreams cannot be decoded properly, which would severely affect the quality of reconstructed video. Therefore, error resilience is utilized to solve
3rd International Conference on Multimedia Technology(ICMT 2013) Video Error Resilience Scheme using Reversible Data Hiding Technique for Intra- Frame in H.264/AVC Ranran Li, Rangding Wang 1 Abstract.
More informationStereo Image Compression
Stereo Image Compression Deepa P. Sundar, Debabrata Sengupta, Divya Elayakumar {deepaps, dsgupta, divyae}@stanford.edu Electrical Engineering, Stanford University, CA. Abstract In this report we describe
More informationA LOW-COMPLEXITY MULTIPLE DESCRIPTION VIDEO CODER BASED ON 3D-TRANSFORMS
A LOW-COMPLEXITY MULTIPLE DESCRIPTION VIDEO CODER BASED ON 3D-TRANSFORMS Andrey Norkin, Atanas Gotchev, Karen Egiazarian, Jaakko Astola Institute of Signal Processing, Tampere University of Technology
More informationOptimizing Joint Erasure- and Error-Correction Coding for Wireless Packet Transmissions
Optimizing Joint Erasure- and Error-Correction Coding for Wireless Packet Transmissions 2007 IEEE Communication Theory Workshop Christian R. Berger 1, Shengli Zhou 1, Yonggang Wen 2, Peter Willett 1 and
More informationImproving the quality of H.264 video transmission using the Intra-Frame FEC over IEEE e networks
Improving the quality of H.264 video transmission using the Intra-Frame FEC over IEEE 802.11e networks Seung-Seok Kang 1,1, Yejin Sohn 1, and Eunji Moon 1 1Department of Computer Science, Seoul Women s
More informationError Resilient Image Transmission over Wireless Fading Channels
Error Resilient Image Transmission over Wireless Fading Channels M Padmaja [1] M Kondaiah [2] K Sri Rama Krishna [3] [1] Assistant Professor, Dept of ECE, V R Siddhartha Engineering College, Vijayawada
More informationUnbalanced Multiple Description Video Communication Using Path Diversity
Unbalanced Multiple Description Video Communication Using Path Diversity John G. Apostolopoulos, Susie J. Wee Client and Media Systems Laboratory HP Laboratories Palo Alto HPL-01-3 November th, 01* video
More informationFast Mode Decision for H.264/AVC Using Mode Prediction
Fast Mode Decision for H.264/AVC Using Mode Prediction Song-Hak Ri and Joern Ostermann Institut fuer Informationsverarbeitung, Appelstr 9A, D-30167 Hannover, Germany ri@tnt.uni-hannover.de ostermann@tnt.uni-hannover.de
More informationLIVE VIDEO STREAMING OVER PACKET NETWORKS AND WIRELESS CHANNELS
LIVE VIDEO STREAMING OVER PACKET NETWORKS AND WIRELESS CHANNELS Vladimir Stanković, Raouf Hamzaoui University of Konstanz Department of Computer and Information Science stankovi,hamzaoui@inf.uni-konstanz.de
More informationMulti-View Image Coding in 3-D Space Based on 3-D Reconstruction
Multi-View Image Coding in 3-D Space Based on 3-D Reconstruction Yongying Gao and Hayder Radha Department of Electrical and Computer Engineering, Michigan State University, East Lansing, MI 48823 email:
More informationIST MPEG-4 Video Compliant Framework
IST MPEG-4 Video Compliant Framework João Valentim, Paulo Nunes, Fernando Pereira Instituto de Telecomunicações, Instituto Superior Técnico, Av. Rovisco Pais, 1049-001 Lisboa, Portugal Abstract This paper
More informationChapter 11.3 MPEG-2. MPEG-2: For higher quality video at a bit-rate of more than 4 Mbps Defined seven profiles aimed at different applications:
Chapter 11.3 MPEG-2 MPEG-2: For higher quality video at a bit-rate of more than 4 Mbps Defined seven profiles aimed at different applications: Simple, Main, SNR scalable, Spatially scalable, High, 4:2:2,
More informationRobust MPEG-2 SNR Scalable Coding Using Variable End-of-Block
Robust MPEG-2 SNR Scalable Coding Using Variable End-of-Block Rogelio Hasimoto-Beltrán Ashfaq A. Khokhar Center for Research in Mathematics (CIMAT) University of Illinois at Chicago Guanajuato, Gto. México
More informationLaboratoire d'informatique, de Robotique et de Microélectronique de Montpellier Montpellier Cedex 5 France
Video Compression Zafar Javed SHAHID, Marc CHAUMONT and William PUECH Laboratoire LIRMM VOODDO project Laboratoire d'informatique, de Robotique et de Microélectronique de Montpellier LIRMM UMR 5506 Université
More informationRate Distortion Optimization in Video Compression
Rate Distortion Optimization in Video Compression Xue Tu Dept. of Electrical and Computer Engineering State University of New York at Stony Brook 1. Introduction From Shannon s classic rate distortion
More informationVIDEO COMPRESSION STANDARDS
VIDEO COMPRESSION STANDARDS Family of standards: the evolution of the coding model state of the art (and implementation technology support): H.261: videoconference x64 (1988) MPEG-1: CD storage (up to
More informationDr. Bhumin H. Pathak 1, Dr. Geoff Childs 2 and Dr. Maaruf Ali 3 1 Airvana Inc., Chelmsford, USA bhumin.pathak@gmail.com 2 School of Technology at Oxford Brooks University, Oxford, UK gnchilds@brookes.ac.uk
More informationSINGLE PASS DEPENDENT BIT ALLOCATION FOR SPATIAL SCALABILITY CODING OF H.264/SVC
SINGLE PASS DEPENDENT BIT ALLOCATION FOR SPATIAL SCALABILITY CODING OF H.264/SVC Randa Atta, Rehab F. Abdel-Kader, and Amera Abd-AlRahem Electrical Engineering Department, Faculty of Engineering, Port
More informationVideo Coding Using Spatially Varying Transform
Video Coding Using Spatially Varying Transform Cixun Zhang 1, Kemal Ugur 2, Jani Lainema 2, and Moncef Gabbouj 1 1 Tampere University of Technology, Tampere, Finland {cixun.zhang,moncef.gabbouj}@tut.fi
More information40 IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 15, NO. 1, JANUARY 2006
40 IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 15, NO. 1, JANUARY 2006 Rate-Distortion Optimized Hybrid Error Control for Real-Time Packetized Video Transmission Fan Zhai, Member, IEEE, Yiftach Eisenberg,
More informationARIB STD-T53-C.S Circuit-Switched Video Conferencing Services
ARIB STD-T-C.S00-0 Circuit-Switched Video Conferencing Services Refer to "Industrial Property Rights (IPR)" in the preface of ARIB STD-T for Related Industrial Property Rights. Refer to "Notice" in the
More information