Bi-directional optical flow for future video codec
|
|
- Gwen Lee
- 5 years ago
- Views:
Transcription
1 2016 Data Compression Conference Bi-directional optical flow for future video codec Alshin Alexander * and Alshina Elena * * Digital Media R&D Center 416, Maetan 3-dong, Yeongtong-Gu Suwon, , Korea Rep. of {alexander_b.alshin, elena_a.alshina}@samsung.com Abstract: Paper presents theoretical explanation for bi-directional optical flow technique in generic case. Both non-equal distance to reference frames and two reference frames from the same side of predicted frame are allowed. Dynamic range analysis during bi-directional optical flow calculations is provided. Limits for refinement motion vector are recommended. 1. Introduction High Efficient Video Coding (HEVC) [1] is the best performing video compression standard. It is targeted to provide roughly twice better compression compared to its predecessor widely used H.264/AVC. Considering industry needs for further coding efficiency improvements ITU-T Study Group 16 and MPEG established Joined Exploration Team on Video (JVET) for advanced video compression technologies study. Joint Exploration Model (JEM) is common area for testing proposed algorithms. This paper describes some theoretical and implementation aspects of so-called bi-directional optical flow which is the part of first version of JEM1 ([2]). 2. Bi-directional optical flow for arbitrary location of reference frames Technique called Bi-directional Optical flow (BIO) was initially proposed in [3]. Then it was studied in HEVC Core Experiment 1 devoted to decoder motion derivation [4]. Detailed analysis of BIO technology was done in [5]. At that time 8 bits video was mainly in focus and so [3, 5] don t describe peculiarities of BIO implementation for bitdepth. Trying to reduce BIO complexity (which is weak point for all decoder-side motion derivation techniques) after [3, 5] several modifications were introduced. In particular shorter interpolation filter for gradients was introduced and equation for motion vector refinement was simplified in [6]. Since interpolation is much more robust than extrapolation in [3, 5, 6] BIO was applied only in the situation when 2 predictions come from different time directions. Qualcomm experts proposed to remove this restriction [7]. In this paper BIO equations are provided in the generic form, allowing both non-equal distance to reference frames and usage of 2 predictions coming from the same time direction. Let s remind the basic concept for BIO. During bi-directional motion compensation two references are available. The goal of BIO is to refine motion for each sample using only these two references. Suppose block motion is already compensated and both 2 prediction signals and their spatial derivatives are available. In classical biprediction 2 prediction samples located with the same coordinates as currently predicted /16 $ IEEE DOI /DCC
2 samples but in reference blocks after motion compensation are averaged. BIO uses samples A and B (Fig. 1) instead. The fine displacement vector is symmetrical and proportional to the distance to the reference frame. On Fig.1 shows 2 references Ref0 and Ref1 located in opposite time directions relatively to currently predicted B-slice. In this case the distance to the both references is positive and. If references are located on the same side relatively to current frame then all derivations for BIO equations are still valid but on of signs of is negative. Figure 1: bi-directional optical flow. Suppose that model of optical flow is valid along motion trajectory and so =0. (1) Let s model motion trajectory of the sample using 3 rd order polynomial 2 P t a a t a t a (2) t and derive coefficients of this polynomial using Hermite s interpolation. Hermite s curve is depicted on Fig. 2 compared to linear interpolation. The key difference is Hermite s interpolation matches not only values of interpolated function, but also derivative at the end of the interval. Assuming optical flow equation (1) we know values of time-derivatives at the ends of interpolation interval since we know spatial gradients on reference frames. Hermite interpolation (2) results in 84
3 And finally the value of Hermite interpolation polynomial at (currently predicted frame) is. (3) Figure 2: Hermite s interpolation compared to linear interpolation. The most frequently used bi-prediction case the distance to reference frames is the same and (3) becomes which is exactly the same as published in [6]. Applying optical flow PDE in (3) we get which is for the simplest case becomes, (4) 85
4 as published in [6]. 3. Dynamic range analysis in bi-directional optical flow calculations BIO operates as sample-wise motion refinement on top of block-based motion compensation. Let s discuss dynamic range in BIO compared to HEVC motion compensation process. For Luma motion compensation interpolation filters listed in Table 1 are used. Both filters are normalized by 64. Table 1 shows SumPos and SumNeg, which stand for sum of positive and sum of negative filter coefficients correspondently. The ½ interpolation filter has the largest difference between SumPos and SumNeg. This is the worst case from view point of dynamic range accumulation. Table 1. Luma motion compensation interpolation filters in HEVC. Fractional part block MV Filter coefficients, SumPos SumNeg 0 { 0, 0, 0, 64, 0, 0, 0, 0 } 64 0 ¼ { -1, 4, -10, 58, 17, -5, 1, 0 } ½ { -1, 4, -11, 40, 40, -11, 4, -1 } ¾ { 0, 1, -5, 17, 58, -10, 4, -1 } Motion compensation interpolation is 2 stages process: horizontal and vertical interpolation. Each stage is convolution: ;. (5) Here are sample values in Reference Frame; is temporal buffer; is highprecision prediction. Filter size 8 corresponds to Luma motion compensation interpolation. Figure 3. Separable 2D -dimensional interpolation. Series of 2 convolutions (1) is illustrated on Fig.3. Reg1, Reg2 stand for values accumulated in register ( and in Luma motion 86
5 compensation correspondently). Temp1 and Temp2 are temporal buffers (for and in Luma motion compensation correspondently). Using SumPos and SumNeg known for filter with fixed coefficients one can estimate dynamic range of convolution as follows:. (6) Here is input, and are minimum and maximum possible values of R. If is internal bit-depth then. In HEVC,. (7) Using (6) we have for the register (Reg1). Which is after de-scaling becomes (Temp1). Temporal buffer values are an input for the second step of interpolation. Applying (5) again we have for the register (Reg2). Which is after de-scaling becomes (Temp2). Depending on internal bit-depth the bit-width (BW) on each stage of HEVC motion compensation interpolation process is summarized below: BW (Reg1) = d+8; BW (Temp1) = 16; BW (Reg2) = 23; BW (Temp2) = 17 + Max(0;d-12). It is easy to observe that system of shifts () for (5) ensures the register within 32 bits; and temporal buffer Temp1 within 16 bits. There is minor overflow of 16-bits for Temp2 if d12, which becomes more significant at higher d. Additionally to motion compensation prediction ( in (4) for bi-directional optical flow spatial derivatives ( need to be calculated. Derivatives calculation depends on fractional position of block motion vector. The procedure for gradients calculation was designed conceptually similar to (1) in order to reuse as much as possible HEVC implementation. So gradients calculation is system of 2 convolutions: ; ; (8) ; 87
6 . (9) In order to maintain reasonable complexity sizes of interpolation filters sizes for gradients calculation in BIO were chosen smaller (6 taps) compared to motion compensation interpolation (8 taps). The input for the gradient s calculation is reference samples (as well as for motion compensation interpolation). First step is horizontal interpolation and second is vertical (in order to be consistent with HEVC motion compensation design). For horizontal derivative ( ) calculation first gradient interpolation filter () is applied and then derivative is interpolated in vertical direction according to fractional part of vertical component of block motion vector. For vertical derivative ( ) calculation first signal is interpolated in horizontal direction (using ) according to fractional part of horizontal component of block motion vector, and then gradient interpolation filter () is applied in vertical direction. Tables 2 and 3 shows coefficients of BIO interpolation filters for signal ( ) and gradients ( ) correspondently. If is function of then was designed to provide value ; and to provide the value of in fractional position. Table 2. BIO interpolation filters for signal. Fractional part block MV coefficients, SumPos SumNeg 0 {0, 0, 64, 0, 0, 0}, 64 0 ¼ {2, -9, 57, 19, -7, 2}, ½ {1, -7, 38, 38, -7, 1 }, ¾ {2, -7, 19, 57, -9, 2} Table 3. BIO interpolation filters for gradients. Fractional part block MV coefficients, SumPos SumNeg 0 { 8, -39, -3, 46, -17, 5 }, ¼ { 4, -17, -36, 60,-15, 4 }, ½ { -1, 4, -57, 57, -4, 1 }, ¾ { -4, 15, -60, 36, 17, -4 } System of shifts in (8-9) was designed in order to ensure register size within 32 bits and temporal buffers sizes within 16 bits as follows: (10) With selection (10) bit-width for gradients calculation is as follows: 88
7 There is no overflow of 16-bits for both temporal buffers (Temp1 and Temp2) as well as there is no 32 bits overflow in a register. 4. Motion refinement vector calculation The BIO is applied as modification of classical bi-prediction (4). The motion refinement vector minimizes the difference between samples and derivatives values in window surrounding points A and B (Fig. 1): where (11) As shown below the bit-depth of gradients which are input of BIO process is 16. So in a worst case calculation requires >32 bits register. In order to prevent division by 0 in (6) small regularization term is introduced in denominator. Since bit-depth of increases proportionally to, regularization term also increases with internal bit-depth as. Bi-directional optical flow was constructed as fine motion refinement under assumption that, are small. So, there is a clipping to, diapason in (6). Also the denominator in (6) is restricted to be larger than. 5. Conclusions Bi-directional optical flow (BIO) model is presented in generic form in this paper. All formals are derived for arbitrary location of reference frames relatively to currently predicted. Both non-equal distance to reference frames and two predictions coming from the same time directions are allowed. Dynamic range analysis for gradients calculation in BIO as well as recommendation for restriction of for refinement vector diapason is provided. 89
8 References [1] High Efficiency Video Coding, Rec. ITU-T H.265 and ISO/IEC , Jan [2] G.J.Sullivan, J. Boyce, J. Chen, E.Alshina, Future video coding: Joint Exploration Model 1 (JEM1) for future video coding investigation, COM16-TD213, Oct. 2015, Geneva. [3] A. Alshin, E. Alshina, Bi-directional optical flow, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JCTVC-C204, Guangzhou, China, October, [4] Shunichi Sekiguchi, Yusuke Itani (Mitsubishi), Report of CE1 :Decoder-Side Motion Vector Derivation, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JCTVC-D098, Daegu, Jan [5] A. Alshin, E. Alshina, T. Lee Bi-directional optical flow for improving motion compensation, Picture Coding Symposium (PCS), [6] A.Alshin, E.Alshina, M.Budagavi, K. Choi, J. Min, M. Mishourovsky, Y. Piao, A. Saxena Coding efficiency improvements beyond HEVC with known tools, SPIE Optics + Photonics 2015, San Diego. [7] X.Li, J.Chen, W.-J. Chein, M. Karczewicz, Harmonization and improvement for BIO, COM16-C1045, Oct. 2015, Geneva. 90
EFFICIENT PU MODE DECISION AND MOTION ESTIMATION FOR H.264/AVC TO HEVC TRANSCODER
EFFICIENT PU MODE DECISION AND MOTION ESTIMATION FOR H.264/AVC TO HEVC TRANSCODER Zong-Yi Chen, Jiunn-Tsair Fang 2, Tsai-Ling Liao, and Pao-Chi Chang Department of Communication Engineering, National Central
More informationA Dedicated Hardware Solution for the HEVC Interpolation Unit
XXVII SIM - South Symposium on Microelectronics 1 A Dedicated Hardware Solution for the HEVC Interpolation Unit 1 Vladimir Afonso, 1 Marcel Moscarelli Corrêa, 1 Luciano Volcan Agostini, 2 Denis Teixeira
More informationModule 7 VIDEO CODING AND MOTION ESTIMATION
Module 7 VIDEO CODING AND MOTION ESTIMATION Lesson 20 Basic Building Blocks & Temporal Redundancy Instructional Objectives At the end of this lesson, the students should be able to: 1. Name at least five
More informationAn HEVC Fractional Interpolation Hardware Using Memory Based Constant Multiplication
2018 IEEE International Conference on Consumer Electronics (ICCE) An HEVC Fractional Interpolation Hardware Using Memory Based Constant Multiplication Ahmet Can Mert, Ercan Kalali, Ilker Hamzaoglu Faculty
More informationPrediction Mode Based Reference Line Synthesis for Intra Prediction of Video Coding
Prediction Mode Based Reference Line Synthesis for Intra Prediction of Video Coding Qiang Yao Fujimino, Saitama, Japan Email: qi-yao@kddi-research.jp Kei Kawamura Fujimino, Saitama, Japan Email: kei@kddi-research.jp
More informationA COMPARISON OF CABAC THROUGHPUT FOR HEVC/H.265 VS. AVC/H.264. Massachusetts Institute of Technology Texas Instruments
2013 IEEE Workshop on Signal Processing Systems A COMPARISON OF CABAC THROUGHPUT FOR HEVC/H.265 VS. AVC/H.264 Vivienne Sze, Madhukar Budagavi Massachusetts Institute of Technology Texas Instruments ABSTRACT
More informationSelected coding methods in H.265/HEVC
Selected coding methods in H.265/HEVC Andreas Unterweger Salzburg University of Applied Sciences May 29, 2017 Andreas Unterweger (Salzburg UAS) Selected coding methods in H.265/HEVC May 29, 2017 1 / 22
More informationHigh Efficiency Video Coding. Li Li 2016/10/18
High Efficiency Video Coding Li Li 2016/10/18 Email: lili90th@gmail.com Outline Video coding basics High Efficiency Video Coding Conclusion Digital Video A video is nothing but a number of frames Attributes
More informationOptimizing the Deblocking Algorithm for. H.264 Decoder Implementation
Optimizing the Deblocking Algorithm for H.264 Decoder Implementation Ken Kin-Hung Lam Abstract In the emerging H.264 video coding standard, a deblocking/loop filter is required for improving the visual
More information360 degree test image with depth Dominika Łosiewicz, Tomasz Grajek, Krzysztof Wegner, Adam Grzelka, Olgierd Stankiewicz, Marek Domański
INTERNATIONAL ORGANISATION FOR STANDARDISATION ORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC1/SC29/WG11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC1/SC29/WG11 MPEG2017/m41991 January 2018,
More informationNext-Generation 3D Formats with Depth Map Support
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Next-Generation 3D Formats with Depth Map Support Chen, Y.; Vetro, A. TR2014-016 April 2014 Abstract This article reviews the most recent extensions
More informationHomogeneous Transcoding of HEVC for bit rate reduction
Homogeneous of HEVC for bit rate reduction Ninad Gorey Dept. of Electrical Engineering University of Texas at Arlington Arlington 7619, United States ninad.gorey@mavs.uta.edu Dr. K. R. Rao Fellow, IEEE
More informationScalable Extension of HEVC 한종기
Scalable Extension of HEVC 한종기 Contents 0. Overview for Scalable Extension of HEVC 1. Requirements and Test Points 2. Coding Gain/Efficiency 3. Complexity 4. System Level Considerations 5. Related Contributions
More informationFAST MOTION ESTIMATION DISCARDING LOW-IMPACT FRACTIONAL BLOCKS. Saverio G. Blasi, Ivan Zupancic and Ebroul Izquierdo
FAST MOTION ESTIMATION DISCARDING LOW-IMPACT FRACTIONAL BLOCKS Saverio G. Blasi, Ivan Zupancic and Ebroul Izquierdo School of Electronic Engineering and Computer Science, Queen Mary University of London
More informationCONTENT ADAPTIVE COMPLEXITY REDUCTION SCHEME FOR QUALITY/FIDELITY SCALABLE HEVC
CONTENT ADAPTIVE COMPLEXITY REDUCTION SCHEME FOR QUALITY/FIDELITY SCALABLE HEVC Hamid Reza Tohidypour, Mahsa T. Pourazad 1,2, and Panos Nasiopoulos 1 1 Department of Electrical & Computer Engineering,
More informationHigh Efficiency Video Coding (HEVC) test model HM vs. HM- 16.6: objective and subjective performance analysis
High Efficiency Video Coding (HEVC) test model HM-16.12 vs. HM- 16.6: objective and subjective performance analysis ZORAN MILICEVIC (1), ZORAN BOJKOVIC (2) 1 Department of Telecommunication and IT GS of
More informationOVERVIEW OF IEEE 1857 VIDEO CODING STANDARD
OVERVIEW OF IEEE 1857 VIDEO CODING STANDARD Siwei Ma, Shiqi Wang, Wen Gao {swma,sqwang, wgao}@pku.edu.cn Institute of Digital Media, Peking University ABSTRACT IEEE 1857 is a multi-part standard for multimedia
More informationFast HEVC Intra Mode Decision Based on Edge Detection and SATD Costs Classification
Fast HEVC Intra Mode Decision Based on Edge Detection and SATD Costs Classification Mohammadreza Jamali 1, Stéphane Coulombe 1, François Caron 2 1 École de technologie supérieure, Université du Québec,
More informationSample Adaptive Offset Optimization in HEVC
Sensors & Transducers 2014 by IFSA Publishing, S. L. http://www.sensorsportal.com Sample Adaptive Offset Optimization in HEVC * Yang Zhang, Zhi Liu, Jianfeng Qu North China University of Technology, Jinyuanzhuang
More informationLow-cost Multi-hypothesis Motion Compensation for Video Coding
Low-cost Multi-hypothesis Motion Compensation for Video Coding Lei Chen a, Shengfu Dong a, Ronggang Wang a, Zhenyu Wang a, Siwei Ma b, Wenmin Wang a, Wen Gao b a Peking University, Shenzhen Graduate School,
More informationAdaptation of Scalable Video Coding to Packet Loss and its Performance Analysis
Adaptation of Scalable Video Coding to Packet Loss and its Performance Analysis Euy-Doc Jang *, Jae-Gon Kim *, Truong Thang**,Jung-won Kang** *Korea Aerospace University, 100, Hanggongdae gil, Hwajeon-dong,
More informationComparative and performance analysis of HEVC and H.264 Intra frame coding and JPEG2000
Comparative and performance analysis of HEVC and H.264 Intra frame coding and JPEG2000 EE5359 Multimedia Processing Project Proposal Spring 2013 The University of Texas at Arlington Department of Electrical
More informationOptimum Quantization Parameters for Mode Decision in Scalable Extension of H.264/AVC Video Codec
Optimum Quantization Parameters for Mode Decision in Scalable Extension of H.264/AVC Video Codec Seung-Hwan Kim and Yo-Sung Ho Gwangju Institute of Science and Technology (GIST), 1 Oryong-dong Buk-gu,
More informationA Quantized Transform-Domain Motion Estimation Technique for H.264 Secondary SP-frames
A Quantized Transform-Domain Motion Estimation Technique for H.264 Secondary SP-frames Ki-Kit Lai, Yui-Lam Chan, and Wan-Chi Siu Centre for Signal Processing Department of Electronic and Information Engineering
More informationCoding of Coefficients of two-dimensional non-separable Adaptive Wiener Interpolation Filter
Coding of Coefficients of two-dimensional non-separable Adaptive Wiener Interpolation Filter Y. Vatis, B. Edler, I. Wassermann, D. T. Nguyen and J. Ostermann ABSTRACT Standard video compression techniques
More informationHigh Efficiency Video Coding: The Next Gen Codec. Matthew Goldman Senior Vice President TV Compression Technology Ericsson
High Efficiency Video Coding: The Next Gen Codec Matthew Goldman Senior Vice President TV Compression Technology Ericsson High Efficiency Video Coding Compression Bitrate Targets Bitrate MPEG-2 VIDEO 1994
More informationFAST MOTION ESTIMATION WITH DUAL SEARCH WINDOW FOR STEREO 3D VIDEO ENCODING
FAST MOTION ESTIMATION WITH DUAL SEARCH WINDOW FOR STEREO 3D VIDEO ENCODING 1 Michal Joachimiak, 2 Kemal Ugur 1 Dept. of Signal Processing, Tampere University of Technology, Tampere, Finland 2 Jani Lainema,
More informationHEVC The Next Generation Video Coding. 1 ELEG5502 Video Coding Technology
HEVC The Next Generation Video Coding 1 ELEG5502 Video Coding Technology ELEG5502 Video Coding Technology Outline Introduction Technical Details Coding structures Intra prediction Inter prediction Transform
More informationMotion Modeling for Motion Vector Coding in HEVC
Motion Modeling for Motion Vector Coding in HEVC Michael Tok, Volker Eiselein and Thomas Sikora Communication Systems Group Technische Universität Berlin Berlin, Germany Abstract During the standardization
More informationRate Distortion Optimization in Video Compression
Rate Distortion Optimization in Video Compression Xue Tu Dept. of Electrical and Computer Engineering State University of New York at Stony Brook 1. Introduction From Shannon s classic rate distortion
More informationHigh Performance VLSI Architecture of Fractional Motion Estimation for H.264/AVC
Journal of Computational Information Systems 7: 8 (2011) 2843-2850 Available at http://www.jofcis.com High Performance VLSI Architecture of Fractional Motion Estimation for H.264/AVC Meihua GU 1,2, Ningmei
More informationReducing/eliminating visual artifacts in HEVC by the deblocking filter.
1 Reducing/eliminating visual artifacts in HEVC by the deblocking filter. EE5359 Multimedia Processing Project Proposal Spring 2014 The University of Texas at Arlington Department of Electrical Engineering
More informationA comparison of CABAC throughput for HEVC/H.265 VS. AVC/H.264
A comparison of CABAC throughput for HEVC/H.265 VS. AVC/H.264 The MIT Faculty has made this article openly available. Please share how this access benefits you. Your story matters. Citation As Published
More informationIntra Prediction Efficiency and Performance Comparison of HEVC and VP9
EE5359 Spring 2014 1 EE5359 MULTIMEDIA PROCESSING Spring 2014 Project Proposal Intra Prediction Efficiency and Performance Comparison of HEVC and VP9 Under guidance of DR K R RAO DEPARTMENT OF ELECTRICAL
More informationMediaTek High Efficiency Video Coding
MediaTek High Efficiency Video Coding MediaTek White Paper October 2014 MediaTek has pioneered the HEVC in mobile devices and will do the same for TVs by enabling HEVC in 4K TVs in during 2015. MediaTek
More informationA COST-EFFICIENT RESIDUAL PREDICTION VLSI ARCHITECTURE FOR H.264/AVC SCALABLE EXTENSION
A COST-EFFICIENT RESIDUAL PREDICTION VLSI ARCHITECTURE FOR H.264/AVC SCALABLE EXTENSION Yi-Hau Chen, Tzu-Der Chuang, Chuan-Yung Tsai, Yu-Jen Chen, and Liang-Gee Chen DSP/IC Design Lab., Graduate Institute
More informationUpcoming Video Standards. Madhukar Budagavi, Ph.D. DSPS R&D Center, Dallas Texas Instruments Inc.
Upcoming Video Standards Madhukar Budagavi, Ph.D. DSPS R&D Center, Dallas Texas Instruments Inc. Outline Brief history of Video Coding standards Scalable Video Coding (SVC) standard Multiview Video Coding
More informationPERFORMANCE ANALYSIS OF INTEGER DCT OF DIFFERENT BLOCK SIZES USED IN H.264, AVS CHINA AND WMV9.
EE 5359: MULTIMEDIA PROCESSING PROJECT PERFORMANCE ANALYSIS OF INTEGER DCT OF DIFFERENT BLOCK SIZES USED IN H.264, AVS CHINA AND WMV9. Guided by Dr. K.R. Rao Presented by: Suvinda Mudigere Srikantaiah
More informationFraunhofer Institute for Telecommunications - Heinrich Hertz Institute (HHI)
Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG (ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6) 9 th Meeting: 2-5 September 2003, San Diego Document: JVT-I032d1 Filename: JVT-I032d5.doc Title: Status:
More informationDUE TO THE ever-increasing demand for bit rate to
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 22, NO. 12, DECEMBER 2012 1697 Block Partitioning Structure in the HEVC Standard Il-Koo Kim, Junghye Min, Tammy Lee, Woo-Jin Han, and
More informationDevelopment of mixed screen content coding technology: SCC-HEVC extensions framework
Development of mixed screen content coding technology: SCC-HEVC extensions framework DRAGORAD MILOVANOVIC, ZORAN BOJKOVIC University of Belgrade Studentski Trg 1, 11000 Belgrade SERBIA dragoam@gmail.com
More informationFast Mode Decision for H.264/AVC Using Mode Prediction
Fast Mode Decision for H.264/AVC Using Mode Prediction Song-Hak Ri and Joern Ostermann Institut fuer Informationsverarbeitung, Appelstr 9A, D-30167 Hannover, Germany ri@tnt.uni-hannover.de ostermann@tnt.uni-hannover.de
More informationPerformance Comparison between DWT-based and DCT-based Encoders
, pp.83-87 http://dx.doi.org/10.14257/astl.2014.75.19 Performance Comparison between DWT-based and DCT-based Encoders Xin Lu 1 and Xuesong Jin 2 * 1 School of Electronics and Information Engineering, Harbin
More informationINTERNATIONAL ORGANISATION FOR STANDARDISATION ORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC1/SC29/WG11 CODING OF MOVING PICTURES AND AUDIO
INTERNATIONAL ORGANISATION FOR STANDARDISATION ORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC1/SC29/WG11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC1/SC29/WG11 MPEG2011/N12559 February 2012,
More informationCOMPARISON OF HIGH EFFICIENCY VIDEO CODING (HEVC) PERFORMANCE WITH H.264 ADVANCED VIDEO CODING (AVC)
Journal of Engineering Science and Technology Special Issue on 4th International Technical Conference 2014, June (2015) 102-111 School of Engineering, Taylor s University COMPARISON OF HIGH EFFICIENCY
More informationHigh Efficiency Video Decoding on Multicore Processor
High Efficiency Video Decoding on Multicore Processor Hyeonggeon Lee 1, Jong Kang Park 2, and Jong Tae Kim 1,2 Department of IT Convergence 1 Sungkyunkwan University Suwon, Korea Department of Electrical
More informationIntroduction to Video Encoding
Introduction to Video Encoding Preben N. Olsen University of Oslo and Simula Research Laboratory preben@simula.no August 26, 2013 1 / 37 Agenda 1 Introduction Repetition History Quality Assessment Containers
More informationAnalysis of Motion Estimation Algorithm in HEVC
Analysis of Motion Estimation Algorithm in HEVC Multimedia Processing EE5359 Spring 2014 Update: 2/27/2014 Advisor: Dr. K. R. Rao Department of Electrical Engineering University of Texas, Arlington Tuan
More informationDeblocking Filter Algorithm with Low Complexity for H.264 Video Coding
Deblocking Filter Algorithm with Low Complexity for H.264 Video Coding Jung-Ah Choi and Yo-Sung Ho Gwangju Institute of Science and Technology (GIST) 261 Cheomdan-gwagiro, Buk-gu, Gwangju, 500-712, Korea
More informationVideo Codecs. National Chiao Tung University Chun-Jen Tsai 1/5/2015
Video Codecs National Chiao Tung University Chun-Jen Tsai 1/5/2015 Video Systems A complete end-to-end video system: A/D color conversion encoder decoder color conversion D/A bitstream YC B C R format
More informationCROSS-PLANE CHROMA ENHANCEMENT FOR SHVC INTER-LAYER PREDICTION
CROSS-PLANE CHROMA ENHANCEMENT FOR SHVC INTER-LAYER PREDICTION Jie Dong, Yan Ye, Yuwen He InterDigital Communications, Inc. PCS2013, Dec. 8-11, 2013, San Jose, USA 1 2013 InterDigital, Inc. All rights
More informationWhite paper: Video Coding A Timeline
White paper: Video Coding A Timeline Abharana Bhat and Iain Richardson June 2014 Iain Richardson / Vcodex.com 2007-2014 About Vcodex Vcodex are world experts in video compression. We provide essential
More informationMultimedia Systems Video II (Video Coding) Mahdi Amiri April 2012 Sharif University of Technology
Course Presentation Multimedia Systems Video II (Video Coding) Mahdi Amiri April 2012 Sharif University of Technology Video Coding Correlation in Video Sequence Spatial correlation Similar pixels seem
More informationAn Efficient Table Prediction Scheme for CAVLC
An Efficient Table Prediction Scheme for CAVLC 1. Introduction Jin Heo 1 Oryong-Dong, Buk-Gu, Gwangju, 0-712, Korea jinheo@gist.ac.kr Kwan-Jung Oh 1 Oryong-Dong, Buk-Gu, Gwangju, 0-712, Korea kjoh81@gist.ac.kr
More informationDIGITAL TELEVISION 1. DIGITAL VIDEO FUNDAMENTALS
DIGITAL TELEVISION 1. DIGITAL VIDEO FUNDAMENTALS Television services in Europe currently broadcast video at a frame rate of 25 Hz. Each frame consists of two interlaced fields, giving a field rate of 50
More informationIssues in Voice and Video Coding
Issues in Voice and Video Coding Presented at ICME Panel I: Advances in Audio/Video Coding Technologies, July 12, 2011 Jerry D. Gibson Department of Electrical and Computer Engineering gibson@ece.ucsb.edu
More informationFast Transcoding From H.264/AVC To High Efficiency Video Coding
2012 IEEE International Conference on Multimedia and Expo Fast Transcoding From H.264/AVC To High Efficiency Video Coding Dong Zhang* 1, Bin Li 1, Jizheng Xu 2, and Houqiang Li 1 1 University of Science
More informationDigital Image Stabilization and Its Integration with Video Encoder
Digital Image Stabilization and Its Integration with Video Encoder Yu-Chun Peng, Hung-An Chang, Homer H. Chen Graduate Institute of Communication Engineering National Taiwan University Taipei, Taiwan {b889189,
More informationVector Bank Based Multimedia Codec System-on-a-Chip (SoC) Design
2009 10th International Symposium on Pervasive Systems, Algorithms, and Networks Vector Bank Based Multimedia Codec System-on-a-Chip (SoC) Design Ruei-Xi Chen, Wei Zhao, Jeffrey Fan andasaddavari Computer
More informationAnalysis of Information Hiding Techniques in HEVC.
Analysis of Information Hiding Techniques in HEVC. Multimedia Processing EE 5359 spring 2015 Advisor: Dr. K. R. Rao Department of Electrical Engineering University of Texas, Arlington Rahul Ankushrao Kawadgave
More informationBANDWIDTH-EFFICIENT ENCODER FRAMEWORK FOR H.264/AVC SCALABLE EXTENSION. Yi-Hau Chen, Tzu-Der Chuang, Yu-Jen Chen, and Liang-Gee Chen
BANDWIDTH-EFFICIENT ENCODER FRAMEWORK FOR H.264/AVC SCALABLE EXTENSION Yi-Hau Chen, Tzu-Der Chuang, Yu-Jen Chen, and Liang-Gee Chen DSP/IC Design Lab., Graduate Institute of Electronics Engineering, National
More informationA Hybrid Video Codec Based on Extended Block Sizes, Recursive Integer Transforms, Improved Interpolation, and Flexible Motion Representation
A Hybrid Video Codec Based on Extended Block Sizes, Recursive Integer Transforms, Improved Interpolation, and Flexible Motion Representation Marta Karczewicz, Peisong Chen, Rajan Joshi, ianglin Wang, Wei-Jung
More informationENCODER COMPLEXITY REDUCTION WITH SELECTIVE MOTION MERGE IN HEVC ABHISHEK HASSAN THUNGARAJ. Presented to the Faculty of the Graduate School of
ENCODER COMPLEXITY REDUCTION WITH SELECTIVE MOTION MERGE IN HEVC by ABHISHEK HASSAN THUNGARAJ Presented to the Faculty of the Graduate School of The University of Texas at Arlington in Partial Fulfillment
More informationDescrambling Privacy Protected Information for Authenticated users in H.264/AVC Compressed Video
Descrambling Privacy Protected Information for Authenticated users in H.264/AVC Compressed Video R.Hemanth Kumar Final Year Student, Department of Information Technology, Prathyusha Institute of Technology
More informationAn Multi-Mini-Partition Intra Block Copying for Screen Content Coding
3rd International Conference on Mechatronics and Industrial Informatics (ICMII 2015) An Multi-Mini-Partition Intra Block Copying for Screen Content Coding LiPing ZHAO 1, a*, Tao LIN 2,b 1 College of Mathematics,
More informationLocalized Multiple Adaptive Interpolation Filters with Single-Pass Encoding
Localized Multiple Adaptive Interpolation Filters with Single-Pass Encoding Xun Guo 1, Kai Zhang 1,3, Yu-Wen Huang 2, Jicheng An 1, Chih-Ming Fu 2 and Shawmin Lei 2 1 MediaTek Inc., Beijing, China 2 MediaTek
More informationResearch Article A High-Throughput Hardware Architecture for the H.264/AVC Half-Pixel Motion Estimation Targeting High-Definition Videos
Reconfigurable Computing Volume 2, Article ID 25473, 9 pages doi:.55/2/25473 Research Article A High-Throughput Hardware Architecture for the H.264/AVC Half-Pixel Motion Estimation Targeting High-Definition
More informationAiyar, Mani Laxman. Keywords: MPEG4, H.264, HEVC, HDTV, DVB, FIR.
2015; 2(2): 201-209 IJMRD 2015; 2(2): 201-209 www.allsubjectjournal.com Received: 07-01-2015 Accepted: 10-02-2015 E-ISSN: 2349-4182 P-ISSN: 2349-5979 Impact factor: 3.762 Aiyar, Mani Laxman Dept. Of ECE,
More informationFast Decision of Block size, Prediction Mode and Intra Block for H.264 Intra Prediction EE Gaurav Hansda
Fast Decision of Block size, Prediction Mode and Intra Block for H.264 Intra Prediction EE 5359 Gaurav Hansda 1000721849 gaurav.hansda@mavs.uta.edu Outline Introduction to H.264 Current algorithms for
More informationAnalysis of 3D and Multiview Extensions of the Emerging HEVC Standard
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Analysis of 3D and Multiview Extensions of the Emerging HEVC Standard Vetro, A.; Tian, D. TR2012-068 August 2012 Abstract Standardization of
More informationSystem Modeling and Implementation of MPEG-4. Encoder under Fine-Granular-Scalability Framework
System Modeling and Implementation of MPEG-4 Encoder under Fine-Granular-Scalability Framework Literature Survey Embedded Software Systems Prof. B. L. Evans by Wei Li and Zhenxun Xiao March 25, 2002 Abstract
More informationIntra Prediction Efficiency and Performance Comparison of HEVC and VP9
EE5359 Spring 2014 1 EE5359 MULTIMEDIA PROCESSING Spring 2014 Project Interim Report Intra Prediction Efficiency and Performance Comparison of HEVC and VP9 Under guidance of DR K R RAO DEPARTMENT OF ELECTRICAL
More informationA New Configuration of Adaptive Arithmetic Model for Video Coding with 3D SPIHT
A New Configuration of Adaptive Arithmetic Model for Video Coding with 3D SPIHT Wai Chong Chia, Li-Minn Ang, and Kah Phooi Seng Abstract The 3D Set Partitioning In Hierarchical Trees (SPIHT) is a video
More informationView Synthesis for Multiview Video Compression
View Synthesis for Multiview Video Compression Emin Martinian, Alexander Behrens, Jun Xin, and Anthony Vetro email:{martinian,jxin,avetro}@merl.com, behrens@tnt.uni-hannover.de Mitsubishi Electric Research
More informationSparse Coding based Frequency Adaptive Loop Filtering for Video Coding
Sparse Coding based Frequency Adaptive Loop Filtering for Video Coding Outline 1. Sparse Coding based Denoising 2. Frequency Adaptation Model 3. Simulation Setup and Results 4. Summary and Outlook 2 of
More informationFast Implementation of VC-1 with Modified Motion Estimation and Adaptive Block Transform
Circuits and Systems, 2010, 1, 12-17 doi:10.4236/cs.2010.11003 Published Online July 2010 (http://www.scirp.org/journal/cs) Fast Implementation of VC-1 with Modified Motion Estimation and Adaptive Block
More informationResearch Article Block-Matching Translational and Rotational Motion Compensated Prediction Using Interpolated Reference Frame
Hindawi Publishing Corporation EURASIP Journal on Advances in Signal Processing Volume 2010, Article ID 385631, 9 pages doi:10.1155/2010/385631 Research Article Block-Matching Translational and Rotational
More informationExtensions of H.264/AVC for Multiview Video Compression
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Extensions of H.264/AVC for Multiview Video Compression Emin Martinian, Alexander Behrens, Jun Xin, Anthony Vetro, Huifang Sun TR2006-048 June
More informationTranscoding from H.264/AVC to High Efficiency Video Coding (HEVC)
EE5359 PROJECT PROPOSAL Transcoding from H.264/AVC to High Efficiency Video Coding (HEVC) Shantanu Kulkarni UTA ID: 1000789943 Transcoding from H.264/AVC to HEVC Objective: To discuss and implement H.265
More informationScalable Hierarchical Summarization of News Using Fidelity in MPEG-7 Description Scheme
Scalable Hierarchical Summarization of News Using Fidelity in MPEG-7 Description Scheme Jung-Rim Kim, Seong Soo Chun, Seok-jin Oh, and Sanghoon Sull School of Electrical Engineering, Korea University,
More informationIntroduction to Video Encoding
Introduction to Video Encoding INF5063 23. September 2011 History of MPEG Motion Picture Experts Group MPEG1 work started in 1988, published by ISO in 1993 Part 1 Systems, Part 2 Video, Part 3 Audio, Part
More informationRotate Intra Block Copy for Still Image Coding
Rotate Intra Block Copy for Still Image Coding The MIT Faculty has made this article openly available. Please share how this access benefits you. Your story matters. Citation As Published Publisher Zhang,
More informationRecent Developments in Video Compression Standardization CVPR CLIC Workshop, Salt Lake City,
Recent Developments in Video Compression Standardization CVPR CLIC Workshop, Salt Lake City, 2018-06-18 Jens-Rainer Ohm Institute of Communication Engineering RWTH Aachen University ohm@ient.rwth-aachen.de
More informationMotion estimation for video compression
Motion estimation for video compression Blockmatching Search strategies for block matching Block comparison speedups Hierarchical blockmatching Sub-pixel accuracy Motion estimation no. 1 Block-matching
More informationThe Scope of Picture and Video Coding Standardization
H.120 H.261 Video Coding Standards MPEG-1 and MPEG-2/H.262 H.263 MPEG-4 H.264 / MPEG-4 AVC Thomas Wiegand: Digital Image Communication Video Coding Standards 1 The Scope of Picture and Video Coding Standardization
More informationMPEG-2. ISO/IEC (or ITU-T H.262)
MPEG-2 1 MPEG-2 ISO/IEC 13818-2 (or ITU-T H.262) High quality encoding of interlaced video at 4-15 Mbps for digital video broadcast TV and digital storage media Applications Broadcast TV, Satellite TV,
More informationXin-Fu Wang et al.: Performance Comparison of AVS and H.264/AVC 311 prediction mode and four directional prediction modes are shown in Fig.1. Intra ch
May 2006, Vol.21, No.3, pp.310 314 J. Comput. Sci. & Technol. Performance Comparison of AVS and H.264/AVC Video Coding Standards Xin-Fu Wang (ΞΠΛ) and De-Bin Zhao (± ) Department of Computer Science, Harbin
More informationPerformance analysis of Integer DCT of different block sizes.
Performance analysis of Integer DCT of different block sizes. Aim: To investigate performance analysis of integer DCT of different block sizes. Abstract: Discrete cosine transform (DCT) has been serving
More informationView Synthesis for Multiview Video Compression
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com View Synthesis for Multiview Video Compression Emin Martinian, Alexander Behrens, Jun Xin, and Anthony Vetro TR2006-035 April 2006 Abstract
More informationEFFICIENT INTRA PREDICTION SCHEME FOR LIGHT FIELD IMAGE COMPRESSION
2014 IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP) EFFICIENT INTRA PREDICTION SCHEME FOR LIGHT FIELD IMAGE COMPRESSION Yun Li, Mårten Sjöström, Roger Olsson and Ulf Jennehag
More informationIMPLEMENTATION OF H.264 DECODER ON SANDBLASTER DSP Vaidyanathan Ramadurai, Sanjay Jinturkar, Mayan Moudgill, John Glossner
IMPLEMENTATION OF H.264 DECODER ON SANDBLASTER DSP Vaidyanathan Ramadurai, Sanjay Jinturkar, Mayan Moudgill, John Glossner Sandbridge Technologies, 1 North Lexington Avenue, White Plains, NY 10601 sjinturkar@sandbridgetech.com
More informationNew Techniques for Next Generation Video Coding
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com New Techniques for Next Generation Video Coding Li Liu, Robert Cohen, Huifang Sun, Anthony Vetro, Xinhua Zhuang TR2010-058 April 2010 Abstract
More informationR-D points Predicted R-D. R-D points Predicted R-D. Distortion (MSE) Distortion (MSE)
A SCENE ADAPTIVE BITRATE CONTROL METHOD IN MPEG VIDEO CODING Myeong-jin Lee, Soon-kak Kwon, and Jae-kyoon Kim Department of Electrical Engineering, KAIST 373-1 Kusong-dong Yusong-gu, Taejon, Korea ABSTRACT
More informationHigh-Throughput Parallel Architecture for H.265/HEVC Deblocking Filter *
JOURNAL OF INFORMATION SCIENCE AND ENGINEERING 30, 281-294 (2014) High-Throughput Parallel Architecture for H.265/HEVC Deblocking Filter * HOAI-HUONG NGUYEN LE AND JONGWOO BAE 1 Department of Information
More informationOne-pass bitrate control for MPEG-4 Scalable Video Coding using ρ-domain
Author manuscript, published in "International Symposium on Broadband Multimedia Systems and Broadcasting, Bilbao : Spain (2009)" One-pass bitrate control for MPEG-4 Scalable Video Coding using ρ-domain
More informationEE Low Complexity H.264 encoder for mobile applications
EE 5359 Low Complexity H.264 encoder for mobile applications Thejaswini Purushotham Student I.D.: 1000-616 811 Date: February 18,2010 Objective The objective of the project is to implement a low-complexity
More informationBLOCK MATCHING-BASED MOTION COMPENSATION WITH ARBITRARY ACCURACY USING ADAPTIVE INTERPOLATION FILTERS
4th European Signal Processing Conference (EUSIPCO ), Florence, Italy, September 4-8,, copyright by EURASIP BLOCK MATCHING-BASED MOTION COMPENSATION WITH ARBITRARY ACCURACY USING ADAPTIVE INTERPOLATION
More information2014 Summer School on MPEG/VCEG Video. Video Coding Concept
2014 Summer School on MPEG/VCEG Video 1 Video Coding Concept Outline 2 Introduction Capture and representation of digital video Fundamentals of video coding Summary Outline 3 Introduction Capture and representation
More informationLOW BIT-RATE INTRA CODING SCHEME BASED ON CONSTRAINED QUANTIZATION AND MEDIAN-TYPE FILTER. Chen Chen and Bing Zeng
LOW BIT-RAT INTRA CODING SCHM BASD ON CONSTRAIND QUANTIZATION AND MDIAN-TYP FILTR Chen Chen and Bing Zeng Department of lectronic & Computer ngineering The Hong Kong University of Science and Technology,
More informationarxiv: v1 [cs.mm] 9 Aug 2017
Robust Video Watermarking against H.264 and H.265 Compression Attacks Nematollah Zarmehi 1* and Mohammad Javad Barikbin 2 1 Advanced Communication Research Institute, Electrical Engineering Department,
More information