An Independent Motion and Disparity Vector Prediction Method for Multiview Video Coding
|
|
- Branden Newton
- 6 years ago
- Views:
Transcription
1 Preprint Version (2011) An Independent Motion and Disparity Vector Prediction Method for Multiview Video Coding Seungchul Ryu a, Jungdong Seo a, Dong Hyun Kim a, Jin Young Lee b, Ho-Cheon Wey b, and Kwanghoon Sohn a a Department of Electrical and Electronic Engineering, Yonsei University, 50 Yonsei-ro, Seodaemun-gu, Seoul, , South Korea; b Samsung Advanced Institute of echnology, Samsung Electronics Co., Ltd., San 14-1, Nongseo-dong, Kiheung-gu, Yongin-si, Gyeonggi-do, , South Korea. ABSRAC he inter-view prediction is used as well as the temporal prediction in order to exploit both the temporal and inter-view redundancies in multiview video coding. Accordingly, the multiview video coding has two types of motion vectors that are the temporal motion vector and the disparity vector, respectively. he disparity vector is generally uncorrelated with the temporal motion vector. However, they are used together to predict the motion vector regardless of their types, therefore an efficiency of the conventional predictive coding of multiview video coding is decreased. In order to increase the accuracy of the predicted motion vector, a new motion vector prediction method including virtual temporal motion vector and virtual disparity vector is proposed for both the multiview video and multiview video plus depth formats. he experimental results show that the proposed method can reduce the coding bitrates by 6.5% in average and 14.6% at maximum in terms of Bjontegaard metric compared to the conventional method. Keywords: motion vector prediction, multiview video coding, virtual vector, temporal motion vector, disparity vector 1. INRODUCION he multiview video (MVV) format is widely used in challenging applications, such as 3DV, free viewpoint video, and entertainment applications. However, the amount of data needed for the multiview video is extremely increased in proportion to the number of viewpoints, and consequently an effective compression is very important for a successful multiview video system. Accordingly, a widely used 2D video coding standard H.264/AVC has been extended into the multiview video, which is known as multiview video coding (MVC) 1. he key technology of MVC is to reduce redundancies among the sequences of different views. For this purpose, the interview and temporal combined prediction structure (Fig. 1) is employed in MVC. his structure also adopts hierarchical B-picture structure 2 due to its effectiveness. In this structure, the type of view is classified into three groups (I-, P-, and B-views) according to the types of the employed inter-view prediction. In the I-view, temporal prediction (intra-view prediction) is only performed. In addition, anchor pictures of I-view have employed only intra prediction without any reference picture. On the other hand, P- and B-views employ both temporal and inter-view predictions. A bidirectional inter-view prediction is performed in B-view while a unidirectional inter-view prediction is adopted for P- view. In cases of inter-view and temporal combined structures (P-view and B-view), MVC has two different motion vectors such as the temporal motion vector (MV) and the disparity vector (DV). he characteristics of these motion vectors are absolutely different from each other, e.g. the magnitude of DV is relatively larger than that of MV. However, they are used together to predict the motion vector regardless of their types. Specifically, the motion vector is predicted using motion information of neighboring macroblocks (MB) based on the assumption that the adjacent MBs have motion consistency. However, this assumption is obviously invalid in MVC due to adaptation of inter-view and temporal combined prediction technique as mentioned above. herefore, the efficiency of the conventional motion vector prediction method employed in MVC is decreased.
2 Figure 1. Hierarchical B-picture structure in MVC In recent decades, several methods have been proposed in order to improve the performance of the motion vector prediction for MVC 3-8. An efficient representation method of motion data, which is called inter-view direct mode, was proposed 3-4. Even though the method is effective as an additional mode, it cannot solve the inherent problem caused by inter-view and temporal combined prediction structure. Competition-based motion vector coding methods were proposed in order to increase an accuracy of the predicted motion vector 5-6. he conventional skip mode is extended into an interview direction, but the method did not consider other modes 7. Lee et al. 8 proposed the virtual inter-view motion vector to increase the probability of inter-view motion vector selection. However, gain obtained by Lee s method is insufficient due to the rough derivation of virtual disparity. In this paper, a new motion vector prediction is proposed to resolve the inconsistency problem of MV and DV. his paper is organized as follows. Section 2 describes the conventional and the proposed motion vector prediction methods. In Section 3, the performance evaluation of the proposed method is presented. Section 4 concludes the paper. 2. PROPOSED MEHODS 2.1 Proposed motion vector prediction method In MVC, a motion vector is predicted using motion vectors of neighboring MBs and its residual is encoded. A residue of the motion vector mv r is computed as follows: mv = mv, (1) r mv p where mv is an actual motion vector of the current MB, and mv p is a predicted motion vector that is median for each component (horizontal and vertical) of the neighboring motion vectors based on the assumption of a motion consistency. he assumption is, however, invalid for most cases in MVC due to two different types of motion vectors. In order to solve this problem, a new motion vector prediction method is proposed in this paper. In the proposed method, only same types of motion vectors of neighboring MBs are used to predict mv p unlike the conventional prediction scheme in which motion vectors of neighboring MBs are all used regardless of their types. For example, only MVs of neighboring MBs are used for the temporal prediction, and only DVs are used for the inter-view prediction.
3 Figure 2. Overall algorithm of the proposed motion vector prediction However, for some cases, all the types of neighboring motion vectors are same. In these cases, virtual MV or virtual DV is required since there is no available motion vector used to predict mv p. For instance, when all the neighboring motion vectors are MV during the inter-view prediction, there is no available DV for predicting the corresponding DV. Accordingly, a virtual DV and virtual MV should be generated to solve the problem. A virtual DV is generated using disparity information of anchor pictures or the derived disparity from depth information. Meanwhile, zero-vector is used as a virtual MV due to its simplicity in the proposed method. he overall algorithm of the proposed motion vector prediction is described in Fig Virtual disparity vector Recently, MPEG has started an activity to develop the next generation of 3D video standard (3DV) 9. A more efficient format, multiview color video plus depth sequences (MVD), is used in this standard activity. In MVD format, depth information and color video sequences are transmitted together, while the color video sequences are only transmitted in MVV format. In this paper, two scenarios are assumed for MVV (MVC) and MVD (3DV) formats, respectively. In the first scenario, the color videos are only transmitted and stored. On the other hand, multiview color video sequences and depth information are both transmitted in the second scenario. Accordingly, two virtual DV generation methods are introduced for the two scenarios, respectively. he former is the method based on layered global disparity vectors (GDV) while the latter is the method based on depth information Layered GDV based method (Scenario 1: MVV format) In the first scenario, where only color video sequences are transmitted, there is no directly available disparity information. herefore, disparity information should be derived from other information to obtain virtual disparity vectors. In MVC, the anchor pictures have only DVs because only inter-view predictions are performed in the P-view and B- view. hese DVs are classified into n-layers according to their magnitudes and the average of DVs in each layer is defined as a layered global disparity vector LGDV i given as follows: LGDV i = 1 N DVi, k, (2) i k i th layer where LGDV i is the i th layered global disparity vector, DV i,k is k th DV and N i is the number of DVs in the i th layer.
4 Figure 3. Description of Layered GDV (black circles: DVs of anchor picture) In the proposed method, LGDV i is used as the virtual disparity vector. For this purpose, one of LGDVs is selected among them based on the coarse assumption that an object with large disparity has lager motion than an object with small disparity 10. he global motion vector GMV and the local motion vector LMV are defined as (3) and (4), respectively. GMV LMV 1 = mv N i, (3) i 1 = mv M j, (4) j where mv i, mv j are motion vectors in the previous coded frame and that of the neighbor MBs, respectively. N and M are the number of MBs in a frame and neighbor MBs, respectively. he GMV and the LMV are used to select one of LGDVs. If LMV is larger than GMV, larger LGDV is selected as the virtual disparity vector and vice versa. An example of the procedure (n= 4) is illustrated in Fig. 3 and Fig. 4. Note that the value of 0.7 is empirically used as α. he flow of Selection among LGDVs: If (LMV > (1+ α) * GMV) Virtual DV = LGDV 4 else if (LMV > GMV) Virtual DV = LGDV 3 else if (LMV > (1- α) * GMV) Virtual DV = LGDV 2 else Virtual DV = LGDV 1 Figure 4. Pseudo code for selecting the LGDV
5 Figure 5. Corresponding points between different views Depth based method (Scenario 2: MVD format) In the second scenario, where color videos and depth information are transmitted together, depth information can be converted into disparity information using multiview geometry with camera parameters. Accessibility to both camera parameters and the depth map of the current view is assumed in this scenario. he derivation procedure of a disparity is describes as follows (Fig. 5): 1) Project the pixel location (x c,y c ) of the coded MB from current view cc into world coordinates (u,v,z) using transformation: 1 [ uvz,, ] = Rc ( r) A ( cc)[ xc, yc, 1] Dx ( c, yc, cc) + c ( c) (5) where A(c) is an intrinsic camera parameter matrix of camera c, R(c) is a rotation matrix of camera c, (c) is a translation vector of camera c and D(x,y,c) is a depth value related to camera c, at pixel (x,y). 2) Map the location of world coordinates (u,v,z) into local coordinates of the reference view c r using: 1 [ xrzr, yrzr, zr ] = A( cr ) R ( cr ){[ u, v, w] ( cr )} (6) where (x r,y r ) and z r are a corresponding pixel and a depth value at point (x r,y r ) in coordinates of the reference view, respectively. 3) Calculate a disparity (d x,d y ) between the pixel points in current view and reference view: [ d, d ] = [ x, y ] [ x, y ] (7) x y c c r r he number of disparities obtained by this procedure is as many as the number of pixels in a MB. he disparity of the central pixel is chosen as the representative disparity in order to prevent confusion. he selected representative disparity is used as the virtual DV
6 3. EXPERIMENAL RESULS We implemented the proposed method with the MVC reference software JMVC est sequences 12 named as Kendo, Balloons, Pantomime, and Champagne_ower are used for experiments. he sequences were encoded according to the common conditions 12 with GOP size of 15. he experiments have been performed with quantization parameters QP = 27, 32, 37, and 42. In our experiments, the motion/disparity estimation is performed with search range of In order to evaluate the performance of the proposed motion vector prediction method, comparisons with respect to the original JMVC 6.0 have been done in terms of BontegaarD BitRate (BDBR) 13. A negative sign of BDBR denotes average reduction of bitrate compared to the original JMVC 6.0. he results of the scenario 1 and the scenario 2 are shown in able 1 and able 2, respectively. he coding efficiencies of the Layered GDV based method (scenario 1) and the depth based method (scenario 2) are compared with the original JMVC 6.0, respectively. As seen in the ables, the proposed method always improves the coding efficiency of MVC. he average bitrate savings are about 6.2% for the scenario 1 and 6.7% for the scenario 2 with up to 14.6% (scenario 2, Kendo, B-View) for the view-temporal prediction structure. he overall coding efficiency for the scenario 2 is better than that for the scenario 1 due to relatively more accurate disparity information. In some cases, however, the coding efficiency for the scenario 2 is worse than that of the scenario 1 caused by a crudeness of depth information ( Pantomime and Champagne_ower ). he better quality of depth map can lead to increase of coding efficiency for the scenario 2. On the other hand, the scenario 1 has an advantage that additional disparity information is not required to be transmitted unlike the scenario 2. he proposed method also has gained a bitrate saving up to 1.4% for temporal only prediction structure as well as the view-temporal prediction structure. sequence able 1 Results of the proposed method for scenario 1: MVV format is assumed BDBR (%) for scenario 1 (MVV) emporal-only prediction View-temporal prediction I-View P-View B-View Kendo Balloons Pantomime Champagne_ower Average able 2 Results of the proposed method for scenario 2: MVD format is assumed BDBR (%) for scenario 2 (MVD) sequence emporal-only prediction View-temporal prediction I-View P-View B-View Kendo Balloons Pantomime Champagne_ower Average
7 4. CONCLUSION In this paper, a new motion vector prediction method is proposed to overcome the inconsistency problem caused by two different types of motion vectors. In the proposed method, only same types of motion vectors of neighboring MBs are used to predict the corresponding motion vector. In order to manage the absence of available motion vectors, two methods of virtual DV generation are introduced for two scenarios. Experiments show that the proposed method reduced bitrates about 6.2% and 6.7% respectively for scenarios 1 and 2 in average, and 14.6% at maximum according to the Bjontegaard measure 13 for the view-temporal prediction structure. Future work includes a study on the modified DIREC mode which is more suitable for the proposed method. Another direction of future work includes the generation method of virtual MV. REFERENCES [1] A. Vetro,. Wiegand, and G. Sullivan, Overview of the stereo and multiview video coding extensions of the H.264/MPEG-4 AVC standard, Proc. IEEE, 99(4), (2011). [2] H. Schwarz, D. Marpe, and. Wiegand, "Hierarchical B pictures," ISO/IEC JC1/SC29/WG11 and IU- Q6/SG16, Doc. JV-P014, Poznan, Poland, (2005). [3] J. Konieczny, and M. Domanski, Depth-based Inter-view Prediction of Motion vectors for Improved Multiview Video Coding, Proc. IEEE 3DV-conference: he rue Vision Capture, ransmission and Display of 3D Video, ampere, Finland, (2010). [4] X. Guo, Y. Lu, F. Wu, and W. Gao, Inter-view Direct Mode for Multiview Video Coding, IEEE ransactions on Circuits and Systems for Video echnology, 16(12), (2006). [5] S. Ryu, J. Seo, X. Liu, J. Y. Lee, H. Wey, and K. Sohn, Analysis of Motion Vector Predictor in Multiview Video coding System, Proc. IEEE International Symposium on Parallel and Distributed Processing with Applications Workshops, Busan, Korea, (2011). [6] S. Ryu, J. Seo, D. H. Kim, J. Y. Lee, H. Wey, and K. Sohn, Adaptive competition for motion vector prediction in multi-view video coding, Proc. IEEE 3DV-conference: he rue Vision Capture, ransmission and Display of 3D Video, Antalya, urkey, (2011). [7] J. Y. Lee, H. Wey, D.-S. Park, and C.-Y, Kim, emporal and inter-view skip modes for multi-view video coding, Proc. IEEE 3DV-conference: he rue Vision Capture, ransmission and Display of 3D Video, Antalya, urkey, (2011). [8] S. H. Lee, S. H. Lee, J. H. Yang, and N. I. Cho, A Motion vector Prediction Method for Multi-view Video Coding, Journal of Visual Communication and Image Representation, 21(7), (2010). [9] A. Vetro, S. Yea, and A. Smolic, owards a 3D Video Format for Auto-Stereoscopic Displays, Proc. SPIE 7073, 70730F (2008). [10] D. Kim, D. Min, and K. Sohn, A Stereoscopic Video Generation Method using Stereoscopic Display Characterization and Motion Analysis, IEEE ransactions on Broadcasting, 54(2), (2008). [11] Joint Video eam of IU- VCEG and ISO/IEC MPEG WD1, Reference software for MVC (JMVC) 6.0, Doc. JV-AF14, Geneva, Switzerland, (2009). [12] H. Schwarz, D. Marpe, and. Wiegand, Description of Exploration Experiments in 3D Video Coding, ISO/IEC JC1/SC29/WG11 MPEG2010/N11274, Dresden, Germany, (2010). [13] G. Bjontegaard, Calculation of Average PSNR Differences between RD-curves, IU- Video Coding Experts Group document VCEG-M33, (2001).
FAST MOTION ESTIMATION WITH DUAL SEARCH WINDOW FOR STEREO 3D VIDEO ENCODING
FAST MOTION ESTIMATION WITH DUAL SEARCH WINDOW FOR STEREO 3D VIDEO ENCODING 1 Michal Joachimiak, 2 Kemal Ugur 1 Dept. of Signal Processing, Tampere University of Technology, Tampere, Finland 2 Jani Lainema,
More informationOn the Adoption of Multiview Video Coding in Wireless Multimedia Sensor Networks
2011 Wireless Advanced On the Adoption of Multiview Video Coding in Wireless Multimedia Sensor Networks S. Colonnese, F. Cuomo, O. Damiano, V. De Pascalis and T. Melodia University of Rome, Sapienza, DIET,
More informationAnalysis of 3D and Multiview Extensions of the Emerging HEVC Standard
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Analysis of 3D and Multiview Extensions of the Emerging HEVC Standard Vetro, A.; Tian, D. TR2012-068 August 2012 Abstract Standardization of
More informationPerformance Comparison between DWT-based and DCT-based Encoders
, pp.83-87 http://dx.doi.org/10.14257/astl.2014.75.19 Performance Comparison between DWT-based and DCT-based Encoders Xin Lu 1 and Xuesong Jin 2 * 1 School of Electronics and Information Engineering, Harbin
More informationView Synthesis for Multiview Video Compression
View Synthesis for Multiview Video Compression Emin Martinian, Alexander Behrens, Jun Xin, and Anthony Vetro email:{martinian,jxin,avetro}@merl.com, behrens@tnt.uni-hannover.de Mitsubishi Electric Research
More informationOne-pass bitrate control for MPEG-4 Scalable Video Coding using ρ-domain
Author manuscript, published in "International Symposium on Broadband Multimedia Systems and Broadcasting, Bilbao : Spain (2009)" One-pass bitrate control for MPEG-4 Scalable Video Coding using ρ-domain
More informationFAST SPATIAL LAYER MODE DECISION BASED ON TEMPORAL LEVELS IN H.264/AVC SCALABLE EXTENSION
FAST SPATIAL LAYER MODE DECISION BASED ON TEMPORAL LEVELS IN H.264/AVC SCALABLE EXTENSION Yen-Chieh Wang( 王彥傑 ), Zong-Yi Chen( 陳宗毅 ), Pao-Chi Chang( 張寶基 ) Dept. of Communication Engineering, National Central
More informationComplexity Reduction Tools for MPEG-2 to H.264 Video Transcoding
WSEAS ransactions on Information Science & Applications, Vol. 2, Issues, Marc 2005, pp. 295-300. Complexity Reduction ools for MPEG-2 to H.264 Video ranscoding HARI KALVA, BRANKO PELJANSKI, and BORKO FURH
More informationView Synthesis Prediction for Rate-Overhead Reduction in FTV
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com View Synthesis Prediction for Rate-Overhead Reduction in FTV Sehoon Yea, Anthony Vetro TR2008-016 June 2008 Abstract This paper proposes the
More informationA Fast Depth Intra Mode Selection Algorithm
2nd International Conference on Artificial Intelligence and Industrial Engineering (AIIE2016) A Fast Depth Intra Mode Selection Algorithm Jieling Fan*, Qiang Li and Jianlin Song (Chongqing Key Laboratory
More informationDISPARITY-ADJUSTED 3D MULTI-VIEW VIDEO CODING WITH DYNAMIC BACKGROUND MODELLING
DISPARITY-ADJUSTED 3D MULTI-VIEW VIDEO CODING WITH DYNAMIC BACKGROUND MODELLING Manoranjan Paul and Christopher J. Evans School of Computing and Mathematics, Charles Sturt University, Australia Email:
More informationFast Encoding Techniques for Multiview Video Coding
Fast Encoding Techniques for Multiview Video Coding S. Khattak a, R. Hamzaoui a,, S. Ahmad a, P. Frossard b a Centre for Electronic and Communications Engineering, De Montfort University, United Kingdom
More informationAn Efficient Table Prediction Scheme for CAVLC
An Efficient Table Prediction Scheme for CAVLC 1. Introduction Jin Heo 1 Oryong-Dong, Buk-Gu, Gwangju, 0-712, Korea jinheo@gist.ac.kr Kwan-Jung Oh 1 Oryong-Dong, Buk-Gu, Gwangju, 0-712, Korea kjoh81@gist.ac.kr
More informationAn Efficient Mode Selection Algorithm for H.264
An Efficient Mode Selection Algorithm for H.64 Lu Lu 1, Wenhan Wu, and Zhou Wei 3 1 South China University of Technology, Institute of Computer Science, Guangzhou 510640, China lul@scut.edu.cn South China
More informationTemplate based illumination compensation algorithm for multiview video coding
Template based illumination compensation algorithm for multiview video coding Xiaoming Li* a, Lianlian Jiang b, Siwei Ma b, Debin Zhao a, Wen Gao b a Department of Computer Science and technology, Harbin
More informationFast Mode Decision for H.264/AVC Using Mode Prediction
Fast Mode Decision for H.264/AVC Using Mode Prediction Song-Hak Ri and Joern Ostermann Institut fuer Informationsverarbeitung, Appelstr 9A, D-30167 Hannover, Germany ri@tnt.uni-hannover.de ostermann@tnt.uni-hannover.de
More informationNext-Generation 3D Formats with Depth Map Support
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Next-Generation 3D Formats with Depth Map Support Chen, Y.; Vetro, A. TR2014-016 April 2014 Abstract This article reviews the most recent extensions
More informationAdaptation of Scalable Video Coding to Packet Loss and its Performance Analysis
Adaptation of Scalable Video Coding to Packet Loss and its Performance Analysis Euy-Doc Jang *, Jae-Gon Kim *, Truong Thang**,Jung-won Kang** *Korea Aerospace University, 100, Hanggongdae gil, Hwajeon-dong,
More informationDeblocking Filter Algorithm with Low Complexity for H.264 Video Coding
Deblocking Filter Algorithm with Low Complexity for H.264 Video Coding Jung-Ah Choi and Yo-Sung Ho Gwangju Institute of Science and Technology (GIST) 261 Cheomdan-gwagiro, Buk-gu, Gwangju, 500-712, Korea
More informationUpcoming Video Standards. Madhukar Budagavi, Ph.D. DSPS R&D Center, Dallas Texas Instruments Inc.
Upcoming Video Standards Madhukar Budagavi, Ph.D. DSPS R&D Center, Dallas Texas Instruments Inc. Outline Brief history of Video Coding standards Scalable Video Coding (SVC) standard Multiview Video Coding
More informationHEVC based Stereo Video codec
based Stereo Video B Mallik*, A Sheikh Akbari*, P Bagheri Zadeh *School of Computing, Creative Technology & Engineering, Faculty of Arts, Environment & Technology, Leeds Beckett University, U.K. b.mallik6347@student.leedsbeckett.ac.uk,
More informationReduced 4x4 Block Intra Prediction Modes using Directional Similarity in H.264/AVC
Proceedings of the 7th WSEAS International Conference on Multimedia, Internet & Video Technologies, Beijing, China, September 15-17, 2007 198 Reduced 4x4 Block Intra Prediction Modes using Directional
More informationView Synthesis for Multiview Video Compression
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com View Synthesis for Multiview Video Compression Emin Martinian, Alexander Behrens, Jun Xin, and Anthony Vetro TR2006-035 April 2006 Abstract
More informationFast Decision of Block size, Prediction Mode and Intra Block for H.264 Intra Prediction EE Gaurav Hansda
Fast Decision of Block size, Prediction Mode and Intra Block for H.264 Intra Prediction EE 5359 Gaurav Hansda 1000721849 gaurav.hansda@mavs.uta.edu Outline Introduction to H.264 Current algorithms for
More informationAnalysis of Depth Map Resampling Filters for Depth-based 3D Video Coding
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Analysis of Depth Map Resampling Filters for Depth-based 3D Video Coding Graziosi, D.B.; Rodrigues, N.M.M.; de Faria, S.M.M.; Tian, D.; Vetro,
More informationOptimum Quantization Parameters for Mode Decision in Scalable Extension of H.264/AVC Video Codec
Optimum Quantization Parameters for Mode Decision in Scalable Extension of H.264/AVC Video Codec Seung-Hwan Kim and Yo-Sung Ho Gwangju Institute of Science and Technology (GIST), 1 Oryong-dong Buk-gu,
More informationSTACK ROBUST FINE GRANULARITY SCALABLE VIDEO CODING
Journal of the Chinese Institute of Engineers, Vol. 29, No. 7, pp. 1203-1214 (2006) 1203 STACK ROBUST FINE GRANULARITY SCALABLE VIDEO CODING Hsiang-Chun Huang and Tihao Chiang* ABSTRACT A novel scalable
More informationFAST MOTION ESTIMATION DISCARDING LOW-IMPACT FRACTIONAL BLOCKS. Saverio G. Blasi, Ivan Zupancic and Ebroul Izquierdo
FAST MOTION ESTIMATION DISCARDING LOW-IMPACT FRACTIONAL BLOCKS Saverio G. Blasi, Ivan Zupancic and Ebroul Izquierdo School of Electronic Engineering and Computer Science, Queen Mary University of London
More informationMotion Vector Coding Algorithm Based on Adaptive Template Matching
Motion Vector Coding Algorithm Based on Adaptive Template Matching Wen Yang #1, Oscar C. Au #2, Jingjing Dai #3, Feng Zou #4, Chao Pang #5,Yu Liu 6 # Electronic and Computer Engineering, The Hong Kong
More informationAn Efficient Intra Prediction Algorithm for H.264/AVC High Profile
An Efficient Intra Prediction Algorithm for H.264/AVC High Profile Bo Shen 1 Kuo-Hsiang Cheng 2 Yun Liu 1 Ying-Hong Wang 2* 1 School of Electronic and Information Engineering, Beijing Jiaotong University
More informationOverview of Multiview Video Coding and Anti-Aliasing for 3D Displays
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Overview of Multiview Video Coding and Anti-Aliasing for 3D Displays Anthony Vetro, Sehoon Yea, Matthias Zwicker, Wojciech Matusik, Hanspeter
More informationFast Mode Decision for Depth Video Coding Using H.264/MVC *
JOURNAL OF INFORMATION SCIENCE AND ENGINEERING 31, 1693-1710 (2015) Fast Mode Decision for Depth Video Coding Using H.264/MVC * CHIH-HUNG LU, HAN-HSUAN LIN AND CHIH-WEI TANG* Department of Communication
More informationReusable HEVC Design in 3D-HEVC
Reusable HEVC Design in 3D-HEVC Young Su Heo, Gun Bang, and Gwang Hoon Park This paper proposes a reusable design for the merging process used in three-dimensional High Efficiency Video Coding (3D-HEVC),
More informationMULTIVIEW video is capable of providing viewers
IEEE TRANSACTIONS ON BROADCASTING, VOL. 57, NO. 1, MARCH 2011 15 Efficient Multi-Reference Frame Selection Algorithm for Hierarchical B Pictures in Multiview Video Coding Yun Zhang, Sam Kwong, Senior Member,
More informationInternational Journal of Emerging Technology and Advanced Engineering Website: (ISSN , Volume 2, Issue 4, April 2012)
A Technical Analysis Towards Digital Video Compression Rutika Joshi 1, Rajesh Rai 2, Rajesh Nema 3 1 Student, Electronics and Communication Department, NIIST College, Bhopal, 2,3 Prof., Electronics and
More informationResearch Article Fast Mode Decision for 3D-HEVC Depth Intracoding
e Scientific World Journal, Article ID 620142, 9 pages http://dx.doi.org/10.1155/2014/620142 Research Article Fast Mode Decision for 3D-HEVC Depth Intracoding Qiuwen Zhang, Nana Li, and Qinggang Wu College
More informationLow Complexity Multiview Video Coding
Low Complexity Multiview Video Coding Shadan Khattak Faculty of Technology De Montfort University A thesis submitted for the degree of Doctor of Philosophy April 2014 To my family. Abstract 3D video is
More informationCONTENT ADAPTIVE COMPLEXITY REDUCTION SCHEME FOR QUALITY/FIDELITY SCALABLE HEVC
CONTENT ADAPTIVE COMPLEXITY REDUCTION SCHEME FOR QUALITY/FIDELITY SCALABLE HEVC Hamid Reza Tohidypour, Mahsa T. Pourazad 1,2, and Panos Nasiopoulos 1 1 Department of Electrical & Computer Engineering,
More informationExtensions of H.264/AVC for Multiview Video Compression
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Extensions of H.264/AVC for Multiview Video Compression Emin Martinian, Alexander Behrens, Jun Xin, Anthony Vetro, Huifang Sun TR2006-048 June
More informationSINGLE PASS DEPENDENT BIT ALLOCATION FOR SPATIAL SCALABILITY CODING OF H.264/SVC
SINGLE PASS DEPENDENT BIT ALLOCATION FOR SPATIAL SCALABILITY CODING OF H.264/SVC Randa Atta, Rehab F. Abdel-Kader, and Amera Abd-AlRahem Electrical Engineering Department, Faculty of Engineering, Port
More informationA COST-EFFICIENT RESIDUAL PREDICTION VLSI ARCHITECTURE FOR H.264/AVC SCALABLE EXTENSION
A COST-EFFICIENT RESIDUAL PREDICTION VLSI ARCHITECTURE FOR H.264/AVC SCALABLE EXTENSION Yi-Hau Chen, Tzu-Der Chuang, Chuan-Yung Tsai, Yu-Jen Chen, and Liang-Gee Chen DSP/IC Design Lab., Graduate Institute
More informationA Novel Deblocking Filter Algorithm In H.264 for Real Time Implementation
2009 Third International Conference on Multimedia and Ubiquitous Engineering A Novel Deblocking Filter Algorithm In H.264 for Real Time Implementation Yuan Li, Ning Han, Chen Chen Department of Automation,
More informationA Quantized Transform-Domain Motion Estimation Technique for H.264 Secondary SP-frames
A Quantized Transform-Domain Motion Estimation Technique for H.264 Secondary SP-frames Ki-Kit Lai, Yui-Lam Chan, and Wan-Chi Siu Centre for Signal Processing Department of Electronic and Information Engineering
More informationA NOVEL SCANNING SCHEME FOR DIRECTIONAL SPATIAL PREDICTION OF AVS INTRA CODING
A NOVEL SCANNING SCHEME FOR DIRECTIONAL SPATIAL PREDICTION OF AVS INTRA CODING Md. Salah Uddin Yusuf 1, Mohiuddin Ahmad 2 Assistant Professor, Dept. of EEE, Khulna University of Engineering & Technology
More informationDepth Estimation for View Synthesis in Multiview Video Coding
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Depth Estimation for View Synthesis in Multiview Video Coding Serdar Ince, Emin Martinian, Sehoon Yea, Anthony Vetro TR2007-025 June 2007 Abstract
More informationLow-cost Multi-hypothesis Motion Compensation for Video Coding
Low-cost Multi-hypothesis Motion Compensation for Video Coding Lei Chen a, Shengfu Dong a, Ronggang Wang a, Zhenyu Wang a, Siwei Ma b, Wenmin Wang a, Wen Gao b a Peking University, Shenzhen Graduate School,
More informationHigh Efficiency Video Coding (HEVC) test model HM vs. HM- 16.6: objective and subjective performance analysis
High Efficiency Video Coding (HEVC) test model HM-16.12 vs. HM- 16.6: objective and subjective performance analysis ZORAN MILICEVIC (1), ZORAN BOJKOVIC (2) 1 Department of Telecommunication and IT GS of
More informationNEW CAVLC ENCODING ALGORITHM FOR LOSSLESS INTRA CODING IN H.264/AVC. Jin Heo, Seung-Hwan Kim, and Yo-Sung Ho
NEW CAVLC ENCODING ALGORITHM FOR LOSSLESS INTRA CODING IN H.264/AVC Jin Heo, Seung-Hwan Kim, and Yo-Sung Ho Gwangju Institute of Science and Technology (GIST) 261 Cheomdan-gwagiro, Buk-gu, Gwangju, 500-712,
More informationLBP-GUIDED DEPTH IMAGE FILTER. Rui Zhong, Ruimin Hu
LBP-GUIDED DEPTH IMAGE FILTER Rui Zhong, Ruimin Hu National Engineering Research Center for Multimedia Software,School of Computer, Wuhan University,Wuhan, 430072, China zhongrui0824@126.com, hrm1964@163.com
More informationAdaptive Up-Sampling Method Using DCT for Spatial Scalability of Scalable Video Coding IlHong Shin and Hyun Wook Park, Senior Member, IEEE
206 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL 19, NO 2, FEBRUARY 2009 Adaptive Up-Sampling Method Using DCT for Spatial Scalability of Scalable Video Coding IlHong Shin and Hyun
More informationBlock-based Watermarking Using Random Position Key
IJCSNS International Journal of Computer Science and Network Security, VOL.9 No.2, February 2009 83 Block-based Watermarking Using Random Position Key Won-Jei Kim, Jong-Keuk Lee, Ji-Hong Kim, and Ki-Ryong
More informationGraph-based representation for multiview images with complex camera configurations
Graph-based representation for multiview images with complex camera configurations Xin Su, Thomas Maugey, Christine Guillemot To cite this version: Xin Su, Thomas Maugey, Christine Guillemot. Graph-based
More informationA LOW-COMPLEXITY AND LOSSLESS REFERENCE FRAME ENCODER ALGORITHM FOR VIDEO CODING
2014 IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP) A LOW-COMPLEXITY AND LOSSLESS REFERENCE FRAME ENCODER ALGORITHM FOR VIDEO CODING Dieison Silveira, Guilherme Povala,
More informationIBM Research Report. Inter Mode Selection for H.264/AVC Using Time-Efficient Learning-Theoretic Algorithms
RC24748 (W0902-063) February 12, 2009 Electrical Engineering IBM Research Report Inter Mode Selection for H.264/AVC Using Time-Efficient Learning-Theoretic Algorithms Yuri Vatis Institut für Informationsverarbeitung
More informationA Study on Transmission System for Realistic Media Effect Representation
Indian Journal of Science and Technology, Vol 8(S5), 28 32, March 2015 ISSN (Print) : 0974-6846 ISSN (Online) : 0974-5645 DOI : 10.17485/ijst/2015/v8iS5/61461 A Study on Transmission System for Realistic
More informationRecent, Current and Future Developments in Video Coding
Recent, Current and Future Developments in Video Coding Jens-Rainer Ohm Inst. of Commun. Engineering Outline Recent and current activities in MPEG Video and JVT Scalable Video Coding Multiview Video Coding
More informationSTANDARD COMPLIANT FLICKER REDUCTION METHOD WITH PSNR LOSS CONTROL
STANDARD COMPLIANT FLICKER REDUCTION METHOD WITH PSNR LOSS CONTROL A. Jiménez-Moreno, E. Martínez-Enríquez, F. Díaz-de-María Department of Signal Theory and Communications Universidad Carlos III, Leganés
More informationMulti-View Image Coding in 3-D Space Based on 3-D Reconstruction
Multi-View Image Coding in 3-D Space Based on 3-D Reconstruction Yongying Gao and Hayder Radha Department of Electrical and Computer Engineering, Michigan State University, East Lansing, MI 48823 email:
More informationFast frame memory access method for H.264/AVC
Fast frame memory access method for H.264/AVC Tian Song 1a), Tomoyuki Kishida 2, and Takashi Shimamoto 1 1 Computer Systems Engineering, Department of Institute of Technology and Science, Graduate School
More informationIMPROVED CONTEXT-ADAPTIVE ARITHMETIC CODING IN H.264/AVC
17th European Signal Processing Conference (EUSIPCO 2009) Glasgow, Scotland, August 24-28, 2009 IMPROVED CONTEXT-ADAPTIVE ARITHMETIC CODING IN H.264/AVC Damian Karwowski, Marek Domański Poznań University
More informationReduced Frame Quantization in Video Coding
Reduced Frame Quantization in Video Coding Tuukka Toivonen and Janne Heikkilä Machine Vision Group Infotech Oulu and Department of Electrical and Information Engineering P. O. Box 500, FIN-900 University
More informationEE Low Complexity H.264 encoder for mobile applications
EE 5359 Low Complexity H.264 encoder for mobile applications Thejaswini Purushotham Student I.D.: 1000-616 811 Date: February 18,2010 Objective The objective of the project is to implement a low-complexity
More informationVideo Coding Using Spatially Varying Transform
Video Coding Using Spatially Varying Transform Cixun Zhang 1, Kemal Ugur 2, Jani Lainema 2, and Moncef Gabbouj 1 1 Tampere University of Technology, Tampere, Finland {cixun.zhang,moncef.gabbouj}@tut.fi
More informationNew Techniques for Next Generation Video Coding
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com New Techniques for Next Generation Video Coding Li Liu, Robert Cohen, Huifang Sun, Anthony Vetro, Xinhua Zhuang TR2010-058 April 2010 Abstract
More informationMulti-Level Pipelined Parallel Hardware Architecture for High Throughput Motion and Disparity Estimation in Multiview Video Coding
Multi-Level Pipelined Parallel Hardware Architecture for High Throughput Motion and Disparity Estimation in Multiview Video Coding Bruno Zatt, Muhammad Shafique, Sergio Bampi, Jörg Henkel Karlsruhe Institute
More informationHigh-Performance VLSI Architecture of H.264/AVC CAVLD by Parallel Run_before Estimation Algorithm *
JOURNAL OF INFORMATION SCIENCE AND ENGINEERING 29, 595-605 (2013) High-Performance VLSI Architecture of H.264/AVC CAVLD by Parallel Run_before Estimation Algorithm * JONGWOO BAE 1 AND JINSOO CHO 2,+ 1
More informationImproved Context-Based Adaptive Binary Arithmetic Coding in MPEG-4 AVC/H.264 Video Codec
Improved Context-Based Adaptive Binary Arithmetic Coding in MPEG-4 AVC/H.264 Video Codec Abstract. An improved Context-based Adaptive Binary Arithmetic Coding (CABAC) is presented for application in compression
More informationLow-Cost H.264/AVC Inter Frame Mode Decision Algorithm for Mobile Communication Systems
Mobile Netw Appl (2012) 17:110 118 DOI 10.1007/s11036-011-0315-5 Low-Cost H.264/AVC Inter Frame Mode Decision Algorithm for Mobile Communication Systems Xingang Liu Kwanghoon Sohn Meikang Qiu Minho Jo
More information978 IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, VOL. 11, NO. 4, AUGUST 2015
978 IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, VOL. 11, NO. 4, AUGUST 2015 Fast Mode Decision Using Inter-View and Inter-Component Correlations for Multiview Depth Video Coding Jianjun Lei, Member, IEEE,
More informationAn Efficient Inter-Frame Coding with Intra Skip Decision in H.264/AVC
856 IEEE Transactions on Consumer Electronics, Vol. 56, No. 2, May 2 An Efficient Inter-Frame Coding with Intra Sip Decision in H.264/AVC Myounghoon Kim, Soonhong Jung, Chang-Su Kim, and Sanghoon Sull
More informationHomogeneous Transcoding of HEVC for bit rate reduction
Homogeneous of HEVC for bit rate reduction Ninad Gorey Dept. of Electrical Engineering University of Texas at Arlington Arlington 7619, United States ninad.gorey@mavs.uta.edu Dr. K. R. Rao Fellow, IEEE
More informationH.264 to MPEG-4 Transcoding Using Block Type Information
1568963561 1 H.264 to MPEG-4 Transcoding Using Block Type Information Jae-Ho Hur and Yung-Lyul Lee Abstract In this paper, we propose a heterogeneous transcoding method of converting an H.264 video bitstream
More informationPseudo sequence based 2-D hierarchical coding structure for light-field image compression
2017 Data Compression Conference Pseudo sequence based 2-D hierarchical coding structure for light-field image compression Li Li,ZhuLi,BinLi,DongLiu, and Houqiang Li University of Missouri-KC Microsoft
More informationRate Distortion Optimization in Video Compression
Rate Distortion Optimization in Video Compression Xue Tu Dept. of Electrical and Computer Engineering State University of New York at Stony Brook 1. Introduction From Shannon s classic rate distortion
More informationBANDWIDTH REDUCTION SCHEMES FOR MPEG-2 TO H.264 TRANSCODER DESIGN
BANDWIDTH REDUCTION SCHEMES FOR MPEG- TO H. TRANSCODER DESIGN Xianghui Wei, Wenqi You, Guifen Tian, Yan Zhuang, Takeshi Ikenaga, Satoshi Goto Graduate School of Information, Production and Systems, Waseda
More informationMode-Dependent Pixel-Based Weighted Intra Prediction for HEVC Scalable Extension
Mode-Dependent Pixel-Based Weighted Intra Prediction for HEVC Scalable Extension Tang Kha Duy Nguyen* a, Chun-Chi Chen a a Department of Computer Science, National Chiao Tung University, Taiwan ABSTRACT
More informationBLOCK MATCHING-BASED MOTION COMPENSATION WITH ARBITRARY ACCURACY USING ADAPTIVE INTERPOLATION FILTERS
4th European Signal Processing Conference (EUSIPCO ), Florence, Italy, September 4-8,, copyright by EURASIP BLOCK MATCHING-BASED MOTION COMPENSATION WITH ARBITRARY ACCURACY USING ADAPTIVE INTERPOLATION
More informationAffine SKIP and MERGE Modes for Video Coding
Affine SKIP and MERGE Modes for Video Coding Huanbang Chen #1, Fan Liang #2, Sixin Lin 3 # School of Information Science and Technology, Sun Yat-sen University Guangzhou 510275, PRC 1 chhuanb@mail2.sysu.edu.cn
More informationEE 5359 Low Complexity H.264 encoder for mobile applications. Thejaswini Purushotham Student I.D.: Date: February 18,2010
EE 5359 Low Complexity H.264 encoder for mobile applications Thejaswini Purushotham Student I.D.: 1000-616 811 Date: February 18,2010 Fig 1: Basic coding structure for H.264 /AVC for a macroblock [1] .The
More informationH.264/AVC Baseline Profile to MPEG-4 Visual Simple Profile Transcoding to Reduce the Spatial Resolution
H.264/AVC Baseline Profile to MPEG-4 Visual Simple Profile Transcoding to Reduce the Spatial Resolution Jae-Ho Hur, Hyouk-Kyun Kwon, Yung-Lyul Lee Department of Internet Engineering, Sejong University,
More informationBit-Depth Scalable Coding Using a Perfect Picture and Adaptive Neighboring Filter *
Bit-Depth Scalable Coding Using a Perfect Picture and Adaptive Neighboring Filter * LU Feng ( 陆峰 ) ER Guihua ( 尔桂花 ) ** DAI Qionghai ( 戴琼海 ) XIAO Hongjiang ( 肖红江 ) Department of Automation Tsinghua Universit
More information3366 IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 22, NO. 9, SEPTEMBER 2013
3366 IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 22, NO. 9, SEPTEMBER 2013 3D High-Efficiency Video Coding for Multi-View Video and Depth Data Karsten Müller, Senior Member, IEEE, Heiko Schwarz, Detlev
More informationIntroduction to Video Encoding
Introduction to Video Encoding INF5063 23. September 2011 History of MPEG Motion Picture Experts Group MPEG1 work started in 1988, published by ISO in 1993 Part 1 Systems, Part 2 Video, Part 3 Audio, Part
More informationarxiv: v1 [cs.mm] 8 May 2018
OPTIMIZATION OF OCCLUSION-INDUCING DEPTH PIXELS IN 3-D VIDEO CODING Pan Gao Cagri Ozcinar Aljosa Smolic College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics V-SENSE
More informationERROR-ROBUST INTER/INTRA MACROBLOCK MODE SELECTION USING ISOLATED REGIONS
ERROR-ROBUST INTER/INTRA MACROBLOCK MODE SELECTION USING ISOLATED REGIONS Ye-Kui Wang 1, Miska M. Hannuksela 2 and Moncef Gabbouj 3 1 Tampere International Center for Signal Processing (TICSP), Tampere,
More informationNovel United Buffer Rate Control Methods for Stereoscopic Video
JOURNAL OF SOFTWARE, VOL. 8, NO. 8, AUGUST 2013 2015 Novel United Buffer Rate Control Methods for Stereoscopic Video Yi Liao Faculty of Information Science and Engineering, Ningbo University, Ningbo, China
More informationReducing/eliminating visual artifacts in HEVC by the deblocking filter.
1 Reducing/eliminating visual artifacts in HEVC by the deblocking filter. EE5359 Multimedia Processing Project Proposal Spring 2014 The University of Texas at Arlington Department of Electrical Engineering
More informationTesting HEVC model HM on objective and subjective way
Testing HEVC model HM-16.15 on objective and subjective way Zoran M. Miličević, Jovan G. Mihajlović and Zoran S. Bojković Abstract This paper seeks to provide performance analysis for High Efficient Video
More informationWeek 14. Video Compression. Ref: Fundamentals of Multimedia
Week 14 Video Compression Ref: Fundamentals of Multimedia Last lecture review Prediction from the previous frame is called forward prediction Prediction from the next frame is called forward prediction
More informationFast Mode Decision Algorithm for Multiview Video Coding Based on Binocular Just Noticeable Difference
2428 JOURNAL OF COMPUTERS, VOL. 9, NO., OCTOBER 214 Fast Mode Decision Algorithm for Multiview Video Coding Based on Binocular Just Noticeable Difference Yapei Zhu 1 1 Faculty of Information Science and
More informationPAPER Optimal Quantization Parameter Set for MPEG-4 Bit-Rate Control
3338 PAPER Optimal Quantization Parameter Set for MPEG-4 Bit-Rate Control Dong-Wan SEO, Seong-Wook HAN, Yong-Goo KIM, and Yoonsik CHOE, Nonmembers SUMMARY In this paper, we propose an optimal bit rate
More informationA COMPARISON OF CABAC THROUGHPUT FOR HEVC/H.265 VS. AVC/H.264. Massachusetts Institute of Technology Texas Instruments
2013 IEEE Workshop on Signal Processing Systems A COMPARISON OF CABAC THROUGHPUT FOR HEVC/H.265 VS. AVC/H.264 Vivienne Sze, Madhukar Budagavi Massachusetts Institute of Technology Texas Instruments ABSTRACT
More informationVideo compression with 1-D directional transforms in H.264/AVC
Video compression with 1-D directional transforms in H.264/AVC The MIT Faculty has made this article openly available. Please share how this access benefits you. Your story matters. Citation Kamisli, Fatih,
More informationEE 5359 MULTIMEDIA PROCESSING SPRING Final Report IMPLEMENTATION AND ANALYSIS OF DIRECTIONAL DISCRETE COSINE TRANSFORM IN H.
EE 5359 MULTIMEDIA PROCESSING SPRING 2011 Final Report IMPLEMENTATION AND ANALYSIS OF DIRECTIONAL DISCRETE COSINE TRANSFORM IN H.264 Under guidance of DR K R RAO DEPARTMENT OF ELECTRICAL ENGINEERING UNIVERSITY
More informationEFFICIENT PU MODE DECISION AND MOTION ESTIMATION FOR H.264/AVC TO HEVC TRANSCODER
EFFICIENT PU MODE DECISION AND MOTION ESTIMATION FOR H.264/AVC TO HEVC TRANSCODER Zong-Yi Chen, Jiunn-Tsair Fang 2, Tsai-Ling Liao, and Pao-Chi Chang Department of Communication Engineering, National Central
More informationAnalysis of Motion Estimation Algorithm in HEVC
Analysis of Motion Estimation Algorithm in HEVC Multimedia Processing EE5359 Spring 2014 Update: 2/27/2014 Advisor: Dr. K. R. Rao Department of Electrical Engineering University of Texas, Arlington Tuan
More informationScalable Video Coding
1 Scalable Video Coding Z. Shahid, M. Chaumont and W. Puech LIRMM / UMR 5506 CNRS / Universite Montpellier II France 1. Introduction With the evolution of Internet to heterogeneous networks both in terms
More informationCoding of 3D Videos based on Visual Discomfort
Coding of 3D Videos based on Visual Discomfort Dogancan Temel and Ghassan AlRegib School of Electrical and Computer Engineering, Georgia Institute of Technology Atlanta, GA, 30332-0250 USA {cantemel, alregib}@gatech.edu
More informationRealtime H.264 Encoding System using Fast Motion Estimation and Mode Decision
Realtime H.264 Encoding System using Fast Motion Estimation and Mode Decision Byeong-Doo Choi, Min-Cheol Hwang, Jun-Ki Cho, Jin-Sam Kim, Jin-Hyung Kim, and Sung-Jea Ko Department of Electronics Engineering,
More informationImproving Energy Efficiency of Block-Matching Motion Estimation Using Dynamic Partial Reconfiguration
, pp.517-521 http://dx.doi.org/10.14257/astl.2015.1 Improving Energy Efficiency of Block-Matching Motion Estimation Using Dynamic Partial Reconfiguration Jooheung Lee 1 and Jungwon Cho 2, * 1 Dept. of
More information