Effective Quadtree Plus Binary Tree Block Partition Decision for Future Video Coding

Size: px
Start display at page:

Download "Effective Quadtree Plus Binary Tree Block Partition Decision for Future Video Coding"

Transcription

1 2017 Data Compression Conference Effective Quadtree Plus Binary Tree Block Partition Decision for Future Video Coding Zhao Wang*, Shiqi Wang +, Jian Zhang*, Shanshe Wang*, Siwei Ma* * Institute of Digital Media, Peking University, Beijing, , China + Rapid-Rich Object Search (ROSE) Lab, Nanyang Technological University, Singapore {zhaowang, sqwang, jian.zhang, sswang, swma }@pku.edu.cn Abstract: Block partition structure has been recognized as a crucial module in video coding scheme. Recently, a quadtree plus binary tree (QTBT) block partition structure has been proposed in the Joint Video Exploration Team (JVET) development. Compared to the quadtree structure in HEVC, QTBT can achieve better coding performance with hugely increased encoding complexity. Here, we propose an effective QTBT partition decision algorithm to achieve a good tradeoff between computational complexity and coding performance. In particular, at the Coding Tree Unit level, the partition parameters of QTBT are dynamically derived to adapt to the local characteristics without transmitting any overhead. Subsequently, at the Coding Unit level, a joint-classifier decision tree structure is designed to eliminate unnecessary iterations and meanwhile control the risk of false prediction. Experimental results show that the proposed algorithm can achieve 64% encoding time reduction on average with only 1.26% increase in terms of bit rate. This greatly benefits the practical implementations of QTBT in real application scenarios. 1. Introduction Block-based coding structure has been recognized as the core of the state-of-the-art video coding standards because of its capability in achieving high compression performance. In HEVC, Coding Tree Unit (CTU) represents equal-sized image area, e.g. 64x64, which will be divided into Coding Units (CU) following a quadtree splitting. Each CU can be further split into Prediction Unit (PU) and Transform Unit (TU), which serve as the basic units of prediction and transformation, respectively. Moreover, CU is the basic granularity to specify intra- or inter-prediction. For the CU encoded with inter mode, it will be further divided into one or more PUs according to the selected splitting mode, while TU also follows the quadtree splitting. After applying all iterations, the optimal splitting mode minimizing the rate distortion cost will be selected. Because luma and chroma components are jointly considered in rate distortion optimization (RDO) process, they usually share the same block partitions [1]. Though the block structure in HEVC has largely improved the coding performance compared with the previous video coding standards, potential improvements based on the following observations have also been recognized [2]: CU, which serves the root node of PU and TU splitting, is limited to be square shape. More flexible shapes may improve the coding performance. The fixed types of PU splitting may restrict the potentials of the prediction ability in video coding. For most of the cases, luma and chroma components share the same splittings. However, if the luma and chroma components can be dealt with separately, they can better adapt to the properties of different components /17 $ IEEE DOI /DCC

2 Binary Tree Splitting Quadtree Splitting 13 MaxBTSize MinQTSize Figure 1: Illustration of the QTBT block partition structure. Based on the above observations, a quadtree plus binary tree (QTBT) block partition structure was proposed during the recent Joint Video Exploration Team (JVET) development [2]. One example of QTBT structure is illustrated in Fig. 1. For a CTU, QTBT first conducts quadtree partition to obtain some small square blocks, which is similar to the quadtree partition in HEVC. After the quadtree partition, binary tree partition can be performed sequentially following the quadtree leaf node, which leads to smaller blocks with various rectangle shapes. The binary tree leaf node is termed as the CU, and also serves as the basic unit of prediction and transformation. Though the binary tree partition only includes two types, horizontal splitting and vertical splitting, the property of recursion provides it higher flexibility than the fixed splitting modes in HEVC. To control the complexity of QTBT, there are three parameters to restrict the depth of quadtree and binary tree. As shown in Fig. 1, MinQTSize represents the minimal allowed quadtree leaf node size, which implies that the quadtree partition must be terminated if the block size reaches MinQTSize. Similarly, MaxBTSize restricts the maximal allowed binary tree root node size and MaxBTDepth limits the maximal allowed binary tree depth. Moreover, a luma-chromaseparated block partition structure is adopted for I slice, while the partitions for luma and chroma are still shared for P and B slice. Though the design of binary tree partition provides higher compression performance compared to that in HEVC, the encoding complexity has also been dramatically increased due to the recursive characteristics. For this reason, it is desirable to propose a lowcomplexity QTBT decision algorithm. Early termination is an effective method to reduce the unnecessary iterations, which can be applied by detecting the Coded Block Flag (CBF) [3], Skip mode [4], etc. Spatio-temporal correlations have also been utilized to speed up the encoding decisions due to similar partitions often appear in adjacent blocks [5-6]. In [7], an optimized scheme was proposed that only part of the inter splitting modes is evaluated according to the intermediate encoding parameters. For the intra coding, Zhang et al. analyzed the relationship between a block s texture characteristics and its best coding mode [8]. In [9], Shen et al. proposed a fast Bayesian theory based CU decision algorithm, where the motion vectors and rate-distortion costs were employed as the features. In [10], a three-output joint classifiers was designed to control the risk of false prediction. The aforementioned methods have been well developed for H.264 or HEVC codec and achieved significant time savings. However, they cannot be directly used in the QTBT scheme due to the new design philosophy of the block partition structure and the elimination of inter splitting modes. Inspired by this, this paper proposes an effective partition decision algorithm based on QTBT structure. On one hand, dynamic partition parameters derivation method is proposed to adapt to the local content properties at CTU 24

3 level. On the other hand, at the CU level the joint-classifier decision tree structure is proposed to achieve a good trade-off between the computational complexity and the coding performance. The remaining of this paper is organized as follows. The proposed effective QTBT partition decision algorithm is presented in Section 2. Simulation results and comparisons are shown in Section 3 and Section 4 concludes this paper. 2. The Proposed QTBT Partition Decision Scheme In this section, the novel splitting mode decision scheme for QTBT is detailed. In particular, two algorithms are coherently proposed to achieve the low complexity QTBT: 1) dynamic partition parameters derivation (DPPD), in which the partition parameters are adaptively derived for each CTU at both encoder and decoder sides to adapt to the local content properties; 2) joint-classifier decision tree (JCDT), in which a four-output decision tree consisting of multiple classifiers is designed to further reduce the computational complexity while simultaneously controlling the risk of false prediction Dynamic Partition Parameters Derivation In QTBT, the partition parameters, e.g., MinQTSize, MaxBTSize, MaxBTDepth, are playing a crucial role in balancing the coding performance and the encoding complexity. In particular, smaller MinQTSize, larger MaxBTSize and MaxBTDepth imply that the block size can vary in a larger range and more splitting iterations will be performed, thus leading to the increase of computational complexity. Regarding the RD performance, more variable block sizes can improve the prediction efficiency, while the side information induced for signaling the splitting flags increases simultaneously. For example, if a quadtree node equals to 32x32, a flag should be transmitted to signal whether the node is further divided by quadtree splitting when MinQTSize is less than 32x32. On the contrary, the bits can be saved if MinQTSize is equivalent to 32x32. To practically explore the influences of partition parameters on the coding performance and the computational complexity, simulations with different partition parameters are conducted based on the QTBT structure. Compared to the HEVC reference software HM- 13.0, the results under each configuration are showed in Table 1. For CFG1-CFG4, it is found that the coding performance improves significantly as the decrease of MinQTSize, and performance loss arises if we further reduce MinQTSize. The reason lies in the fact that smaller MinQTSize improves the partition flexibility at the cost of more coding bits required to signal the splitting types. Comparisons among CFG3, CFG5 and CFG6 reveal that smaller MaxBTSize will decrease the coding performance as binary tree splitting can only be employed for small blocks, and the computational complexity can also be reduced simultaneously. Moreover, when we compare CFG3, CFG7 and CFG8, it is observed that larger MaxBTDepth settings not only bring about dramatically computational complexity increase, but also lead to the loss of coding performance. All these statistics show that proper partition parameters should be selected to achieve a good trade-off between the coding performance and computational complexity. To reduce the unnecessary partition iterations while maintaining the partition flexibility, a dynamic partition parameters derivation algorithm is proposed. In this method, partition parameters are derived for each CTU on both encoder and decoder sides to adapt to the local characteristics, by utilizing the splitting information of neighboring blocks. Fig. 2 25

4 Table 1: Performance and encoding computational complexity comparisons among different QTBT partition parameters with anchor HM Configurations CFG1 CFG2 CFG3 CFG4 CFG5 CFG6 CFG7 CFG8 MinQTSize MaxBTSize MaxBTDepth BD-rate 19% -0.2% -4.6% -4.5% -3.7% -1.8% -3.9% -3.4% Enc Time 78% 137% 158% 181% 129% 104% 127% 213% illustrates the block partitions of two successive frames coded by the QTBT structure, from which one can discern that the optimal partition parameters should be locally adaptive. In particular, for the areas with less texture, larger blocks are preferred. Therefore, larger MinQTSize, MaxBTSize and smaller MaxBTDepth should be used to remove the redundant splitting iterations, while unnecessary bits for signaling the splitting types can also be saved. On the contrary, for the areas rich with texture, the block partition is in fine-grained and the binary tree splitting is frequently used. Hence, smaller MinQTSize, larger MaxBTSize and MaxBTDepth are demanded to suffice elaborate partitions. In this manner, flexible block partitions for the areas with complex texture can be maintained while the splitting iterations are reduced for the homogenous areas. From Fig. 2, we can obviously observe that there exist significant correlations in block splitting modes among spatio-temporal neighboring blocks. Therefore, the partition information of the current CTU can be predicted from the adjacent CTUs. Let and denote the average predicted size of quadtree leaf nodes (QTLNs) and binary tree leaf nodes (BTLNs), respectively. They can be predicted as follows: QT BT N pre i ave _ i i i= 1 i= 1 N = ( α QT ) α (1) N pre i ave _ i i i= 1 i= 1 N = ( α BT ) α (2) where and represent the average sizes of QTLNs and BTLNs in the neighboring CTUs, respectively. Moreover, refers to the corresponding weights. In particular, {0.6, 0.2, 0.2} are assigned to the temporal co-located CTU, top neighboring CTU and left neighboring CTU, respectively. Based on the predicted block sizes of the current CTU, proper partition parameters can be derived. In particular, both MinQTSize and MaxBTSize should be determined by the block sizes of QTLNs, because they limit the minimal size and the maximum size of QTLN, respectively. For example, if the sizes of all QTLNs are between 16x16 and 32x32, MinQTSize and MaxBTSize can be set as 16 and 32 respectively to remove redundant splitting iterations while unnecessary splitting flags can also be avoided. With respect to MaxBTDepth, it determines how small a block can be split compared to the corresponding quadtree leaf nodes. Hence, MaxBTDepth can be set according to the size ratio between the QTLNs and the BTLNs. Thus, we define the following formulas to predict the partition parameters of the current CTU: 26

5 (a) 3rd frame (BasketballPass, LDP, QP 27) (b) 4th frame (BasketballPass, LDP, QP 27) Figure 2: Block partitions of two successive frames coded by QTBT structure. log2 QTpre MinQTSize = 2 log2 QTpre + β MaxBTSize = 2 MaxBTDepth = QTpre BTpre + β (3) where serves as an offset equivalent to 0 or 1 according to whether is larger than Joint-Classifier Decision Tree Structure Based on the DPPD scheme, we can dynamically obtain the partition parameters at both encoder and decoder. In particular, the flexible partitions can be adopted for the rich texture areas while complex partition iterations are reduced for the homogeneous areas. However, DPPD is dedicated for CTU level partitions, and there still exists splitting redundancy in each CU depth. To further speed up the encoding process, a novel joint-classifier decision tree structure is proposed to reduce the redundant splitting iterations. The splitting mode decision in QTBT is a recursive process, as illustrated in Fig. 3-(a). Here, Bn indicates the procedure of checking the CU at depth level n. Then, further quadtree partition (QT), horizontal binary tree partition (HBT) and vertical binary tree partition (VBT) will be checked recursively, and the optimal one or their combinations are finally selected. Though this strategy can achieve best coding performance, it is very time consuming since all the CU sizes (including asymmetric shapes) will be checked. To speed up the CU partition decision process, decision tree is an effective strategy. In [11], Shen et al. proposed a decision tree structure in which Bn is first checked and then a classifier is applied to predict whether the CU coding process should be early terminated (ET) or not. Imbedding this decision tree structure into QTBT, it can be illustrated as Fig. 3-(b). In this structure, no matter which splitting mode is the optimal, Bn will be checked. Such strategy of checking is unnecessary when further splitting is the best, which leads to needless computational cost. Moreover, the time saving can only be obtained when the prediction of classifier is Y, which may make the decision tree not so efficient for QTBT as those three recursive iterations still need to perform. Other decision tree structure is shown in Fig. 3-(c) [10], where only one splitting mode is selected for each CU depth. If integrating this decision structure into QTBT, the classifier can be viewed as realizing multiclassification. For the output Y, the coding process will be early terminated and time saving is achieved. For the output N, the most probable further splitting mode (among 27

6 B n B n B n B n Figure 3: Illustration of various splitting decision structure. (a) original QTBT structure conducting all iterations. (b) Decision tree with early termination. (c) Decision tree with multi-classifications. (d) Proposed joint-classifier decision tree. QT, HBT and VBT) is selected, and the other two modes are also terminated. This decision tree can achieve most time savings, but the drawback is that the prediction accuracy may largely influence the RD performance (selecting the best from four choices). Unfortunately, due to many uncertainties in video coding, such as various video contents, encoding environments and limited available information, it is difficult to guarantee the prediction accuracy within a secure level, e.g. 95%, such that the RD performance may get degraded. To introduce more flexibilities into the decision structure as well as maintain the RD performance, we present a more advanced decision tree structure which jointly utilizes the advantages of Structure (b) and Structure (c). As shown in Fig. 3-(d), two classifiers are used in this structure for jointly decision making. Classifier A is used to decide whether to conduct the quadtree partition or not, and Classifier B is used to decide whether to conduct binary tree partition or not. By combining Classifier A and Classifier B, in total four decisions will be produced in this structure. 1) Both Classifier A and Classifier B output Y. Only the current block Bn will be coded and the other three further partitions will be terminated. In this circumstance, the time saving is achieved and the prediction accuracy can also be guaranteed. 2) Classifier A output N and Classifier B output Y. In this circumstance, the block itself will be coded and further quadtree partition will also be conducted, while binary tree partition is terminated and time saving can be achieved. 3) Classifier A output Y and Classifier B output N. Similar to (2), the block itself and one binary tree mode with higher probability will be processed, while the quadtree partition is terminated. 4) Both Classifier A and Classifier B output N. This means that the current block should not be early terminated, and hence both quadtree partition and binary tree partition are implied. It is worth noting that time saving can still be achieved because of only one binary tree mode conducted. In summary, the proposed joint-classifier decision tree is an improved integration of Structure (b) and Structure (c). On one hand, the decision of early termination is rigorous because it need two classifiers output Y. On the other hand, time saving is always achieved, resulting from only one or two splitting modes will be conducted. This property makes the proposed decision structure more flexible and is capable of controlling the risk of false prediction. Hence, a better trade-off between the computational complexity and the coding performance can be achieved. 28

7 Classifier A Classifier B Information gain Size Lambda Texture T_h / T_v Neigh_ Neigh_ Neigh_ Attributes Depth_QTDepth_BT Partition Figure 4: Information gain for the Classifier A and Classifier B. To establish the classifier, there are some methods to select related features, such as support vector machine (SVM), information gain attribute evaluation (IGAE), etc. Here, we adopt the IGAE method, which employs the information gain [12] as an indicator for data classification. In particular, the entropy difference in terms of the number of bits for each data item to convey its class identity before and after data set classification is calculated. Fig. 4 lists the selected features for Classifier A and Classifier B. From Fig. 4, it is found that the features are consistent for two classifiers, and divergences are also observed on the information gain value. The features are detailed as follows: Size: the block size has obvious high information gain because larger blocks tend to be split and vice versa. Lagrange multiplier: it is employed as an important feature since it controls the tradeoff between rate and distortion. In particular, there is higher probability to select larger CU size when the Lagrange multiplier becomes large. Texture: the influence of content texture on splitting decision has been detailed in above, where the smooth areas often consist of larger blocks and vice versa. T_h/T_v: it represents the ratio between the horizontal texture and vertical texture. It is worth noting that T_h/T_v has a higher information gain for Classifier B, which reveals that the binary tree splitting is more relevant to the texture direction. Neigh_Depth_QT, Neigh_Depth_BT: represent the average depth of quadtree partition and binary tree partition among neighboring blocks, respectively. High information gain of these features also implies the spatio-temporal correlations. Neigh_Partition: it refers to the splitting types of the adjacent blocks. It is observed that this feature also has higher information gain for Classifier B than Classifier A. The reason mainly lies in the fact that the types of binary tree splitting among neighboring blocks are often identical, especially for the temporally co-located block. 3. Experimental Results To evaluate the performance of the proposed scheme, we integrate it into QTBT on the reference software HM-13.0-QTBT released by JVET [13]. The testing configurations and encoding parameters of Anchor and proposed scheme are showed in Table 2, which conform to the common test conditions [14]. With respect to the test sequences, in total six sequences, consisting of Traffic, BasketballDrill, BasketballPass, BasketballDrive, Johnny and ParkScene, are used for training, and the others are used for testing. Table 2 also lists 29

8 Table 2: Testing configurations and encoding parameters. FrameNumber 5*FrameRate CTU Size 128x128 QP 22,27,32, P MinQTSize_I 16 MinQTSize_PB 16 Resolution 720P MaxBTSize_I 32 MaxBTSize_PB 128 WVGA MaxBTDepth_I 4 MaxBTDepth_PB 4 WQVGA MinQTSize_C 4 MaxBTDepth_C 0 Table 3: Performance of the proposed DPPD and JCDT algorithms. DPPD JCDT Sequence All Intra Random Access All Intra Random Access BD-Rate ET BD-Rate ET BD-Rate ET BD-Rate ET PeopleOnStreet +0.26% -23.1% -0.06% -7.2% +1.07% -57.3% +1.03% -67.7% Kimono +0.31% -43.2% -0.08% -4.0% +0.91% -53.2% +1.33% -61.2% Cactus +0.52% -26.7% -0.03% -4.6% +1.13% -61.9% +1.21% -64.6% BQTerrace +0.21% -16.5% -0.29% -2.7% +1.09% -72.1% +1.62% -58.8% BQMall +0.31% -17.3% -0.08% -5.1% +1.08% -64.7% +1.08% -61.9% PartyScene -0.02% -3.8% +0.24% -1.8% +0.86% -59.3% +0.91% -60.3% RaceHorsesC +0.21% -16.5% -0.21% +6.7% +1.11% -60.4% +1.21% -64.7% BasketballPass +0.47% -21.6% -0.22% +4.3% +1.03% -57.7% +1.32% -69.3% BQSquare +0.01% -3.6% -0.04% -0.3% +1.33% -62.6% +1.54% -55.1% RaceHorses -0.01% -8.2% -0.20% +2.7% +1.18% -62.8% +1.19% -68.4% FourPeople +0.72% -28.8% -0.28% -5.8% +1.08% -47.2% +1.32% -61.5% KristenAndSara +0.69% -31.6% +0.18% -8.9% +0.99% -50.2% +1.27% -59.9% Overall +0.31% -20.1% -0.11% -2.2% +1.07% -59.1% +1.25% -62.8% the default parameters of QTBT, where MinQTSize_C and MaxBTDepth_C represent the corresponding parameters for the chroma components. The performance evaluation results by individually comparing the proposed algorithms under all intra (AI) and random access (RA) configurations are shown in Table 3. The coding performance is measured by BD-Rate. Positive and negative values represent coding loss and coding gain, respectively. ET is used to represent the reduction on the encoding time. From Table 3, it is observed that DPPD can reduce the encoding time by 20.1% on average with negligible loss of coding efficiency (0.32% BD-Rate increase) under AI configuration. Under RA configuration, it is interesting to find that 0.11% coding gain is achieved with even 2.2% coding time saving. The coding gain mainly comes from the bits saving of the splitting flags when the selected partition parameters of one CTU are adequate for splitting. With respect to the proposed JCDT method, around 59% and 63% encoding time reductions have been achieved for the two configurations, and the maximum time reduction can be up to 69%. Interestingly, this coding time reduction is remarkable for sequences with high activity, e.g. RaceHorses, BasketballPass and PeopleOnStreet, but still evident for the low-activity sequences such as BQSquare and KristenAndSara. On the other hand, the RD performance degradation is negligible for all the test sequences. This indicates that the proposed JCDT method can efficiently skip unnecessary iterations in the partition decision. In the following, we analyze the experimental results of the proposed scheme by incorporating DPPD and JCDT together. In this case, the computational complexity reduction varies from 51.3% to 77.8% with 64.7% on average, as shown in Table 4. It is 30

9 Table 4: Results of the proposed scheme by combining DPPD and JCDT. Proposed Related Work [15] Sequence All Intra Random Access Lowdelay-B Random Access BD-Rate ET BD-Rate ET BD-Rate ET BD-Rate ET PeopleOnStreet +1.33% -69.2% +0.99% -69.5% +1.02% -71.2% +0.62% -20.8% Kimono +1.25% -72.1% +1.27% -63.0% +1.27% -62.8% +0.47% -16.8% Cactus +1.58% -70.9% +1.29% -66.9% +1.34% -69.0% +0.43% -18.4% BQTerrace +1.17% -77.8% +1.45% -60.2% +1.23% -58.8% +0.40% -17.6% BQMall +1.31% -69.8% +1.06% -63.8% +1.03% -64.2% +0.46% -19.4% PartyScene +0.87% -60.3% +1.14% -60.7% +1.12% -62.3% +0.37% -18.6% RaceHorsesC +1.29% -67.8% +1.15% -59.1% +1.20% -52.7% +0.72% -21.5% BasketballPass +1.40% -65.7% +1.23% -67.8% +1.16% -68.8% +0.52% -17.7% BQSquare +1.35% -64.2% +1.53% -56.2% +1.28% -51.3% +0.13% -15.4% RaceHorses +1.18% -63.8% +1.12% -67.8% +1.18% -64.6% +0.55% -18.2% FourPeople +1.71% -61.6% +1.25% -64.5% +1.32% -61.7% +0.52% -17.3% KristenAndSara +1.64% -66.2% +1.38% -65.7% +1.27% -63.5% +0.56% -18.7% Overall +1.34% -67.6% +1.24% -63.8% +1.20% -62.6% +0.49% -18.4% also worth noticing that the time reduction achieved under AI configuration is higher than that under RA configuration. This is due to the reason that more time reductions can be achieved in AI configuration for the DPPD method. To further verify the proposed scheme, we compare it with the method proposed in the latest JVET meeting [15]. The idea in [15] is based on the adaptive adjustment of MaxBTDepth for each frame according to the temporal level, and about 18.4% time reduction can be achieved with 0.5% coding loss. Therefore, compared to [15], the average BD-Rate increase of 1.26% with average computational complexity reduction of 64.7% shows superiority in terms of the ratedistortion-complexity performance. 4. Conclusion In this paper, we propose an effective QTBT partition decision algorithm to achieve a good compromise between the encoding computational complexity and the RD performance. The novelty of this paper lies in two aspects: 1) we first propose the dynamic partition parameters derivation method at the CTU level to adapt to the local properties; 2) a fouroutput decision tree consisting of joint classifiers is specifically designed for QTBT which can further remove redundant splitting iterations and control the risk of false prediction simultaneously. Experimental results show that the proposed algorithm can significantly reduce the encoding complexity with ignorable coding performance degradation. Acknowledgment This work was supported in part by the National Natural Science Foundation of China under Grant , Grant , and Grant and in part by the National Basic Research Program of China (973 Program) under Grant 2015CB351800, which are gratefully acknowledged. 31

10 References [1] Kim I K, Min J, Lee T, et al. Block partitioning structure in the HEVC standard, IEEE transactions on circuits and systems for video technology, vol. 22, pp , [2] J. An, H. Huang, K. Zhang. Quadtree plus binary tree structure integration with JEM tools, JVET-B0023, Joint Video Exploration Team (JVET). Feb [3] R. H. Gweon, Y.-L Lee, and J. Lim. Early termination of CU encoding to reduce HEVC complexity, JVTVC-F045, ITU-T/ISO/IEC Joint Collaborative Team on Video Coding (JCT-VC). Jul [4] J. Kim, S. Jeong, S. Cho, and J. S. Choi. Adaptive coding unit early termination algorithm for HEVC. Conn.: IEEE International Conference on Consumer Electronics (ICCE), [5] L. Shen, Z. Zhang, Z. Liu. Adaptive inter-mode decision for HEVC jointly utilizing inter-level and spatiotemporal correlations, IEEE Transactions on Circuits and Systems for Video Technology, vol. 24, pp , [6] Z. Wang, S. Wang, J. Zhang, S. Ma. Local-Constrained Quadtree Plus Binary Tree Block Partition Structure for Enhanced Video Coding. Conn.: IEEE Visual Communication and Image Processing Conference (VCIP), [7] J. Vanne, M. Viitanen, T. D. Hämäläinen. Efficient mode decision schemes for HEVC inter prediction, IEEE Transactions on Circuits and Systems for Video Technology, vol. 24, pp , [8] M. Zhang, C. Zhao, J. Xu. An adaptive fast intra mode decision in HEVC. Conn.: IEEE International Conference on Image Processing (ICIP), [9] X. Shen, L. Yu, and J. Chen, Fast coding unit size selection for HEVC based on bayesian decision rule. Conn.:: IEEE Picture Coding Symposium (PCS), [10] Y. Zhang, S. Kwong, X. Wang, H. Yuan, Z. Pan, L. Xu. Machine Learning-Based Coding Unit Depth Decisions for Flexible Complexity Allocation in High Efficiency Video Coding, IEEE Transactions on Image Processing, vol. 24, pp , [11] X. Shen, L. Yu. CU splitting early termination based on weighted SVM, EURASIP Journal on Image and Video Processing, vol. 1, pp. 1, [12] T. M. Cover, J. A. Thomas. Elements of information theory, John Wiley & Sons, [13] JVET software repository. Available online: HMJEMSoftware/branches/HM-13.0-QTBT/ [14] F. Bossen, Common test conditions and software reference configurations, JCTVC- J1100, ITU-T/ISO/IEC Joint Collaborative Team on Video Coding (JCT-VC), Sweden, [15] Y. Yamamoto. AHG5: Fast QTBT encoding configuration, JVET-D0095, Joint Video Exploration Team (JVET). Oct

Sample Adaptive Offset Optimization in HEVC

Sample Adaptive Offset Optimization in HEVC Sensors & Transducers 2014 by IFSA Publishing, S. L. http://www.sensorsportal.com Sample Adaptive Offset Optimization in HEVC * Yang Zhang, Zhi Liu, Jianfeng Qu North China University of Technology, Jinyuanzhuang

More information

Prediction Mode Based Reference Line Synthesis for Intra Prediction of Video Coding

Prediction Mode Based Reference Line Synthesis for Intra Prediction of Video Coding Prediction Mode Based Reference Line Synthesis for Intra Prediction of Video Coding Qiang Yao Fujimino, Saitama, Japan Email: qi-yao@kddi-research.jp Kei Kawamura Fujimino, Saitama, Japan Email: kei@kddi-research.jp

More information

Fast HEVC Intra Mode Decision Based on Edge Detection and SATD Costs Classification

Fast HEVC Intra Mode Decision Based on Edge Detection and SATD Costs Classification Fast HEVC Intra Mode Decision Based on Edge Detection and SATD Costs Classification Mohammadreza Jamali 1, Stéphane Coulombe 1, François Caron 2 1 École de technologie supérieure, Université du Québec,

More information

A HIGHLY PARALLEL CODING UNIT SIZE SELECTION FOR HEVC. Liron Anavi, Avi Giterman, Maya Fainshtein, Vladi Solomon, and Yair Moshe

A HIGHLY PARALLEL CODING UNIT SIZE SELECTION FOR HEVC. Liron Anavi, Avi Giterman, Maya Fainshtein, Vladi Solomon, and Yair Moshe A HIGHLY PARALLEL CODING UNIT SIZE SELECTION FOR HEVC Liron Anavi, Avi Giterman, Maya Fainshtein, Vladi Solomon, and Yair Moshe Signal and Image Processing Laboratory (SIPL) Department of Electrical Engineering,

More information

Low-cost Multi-hypothesis Motion Compensation for Video Coding

Low-cost Multi-hypothesis Motion Compensation for Video Coding Low-cost Multi-hypothesis Motion Compensation for Video Coding Lei Chen a, Shengfu Dong a, Ronggang Wang a, Zhenyu Wang a, Siwei Ma b, Wenmin Wang a, Wen Gao b a Peking University, Shenzhen Graduate School,

More information

EFFICIENT PU MODE DECISION AND MOTION ESTIMATION FOR H.264/AVC TO HEVC TRANSCODER

EFFICIENT PU MODE DECISION AND MOTION ESTIMATION FOR H.264/AVC TO HEVC TRANSCODER EFFICIENT PU MODE DECISION AND MOTION ESTIMATION FOR H.264/AVC TO HEVC TRANSCODER Zong-Yi Chen, Jiunn-Tsair Fang 2, Tsai-Ling Liao, and Pao-Chi Chang Department of Communication Engineering, National Central

More information

Fast CU Encoding Schemes Based on Merge Mode and Motion Estimation for HEVC Inter Prediction

Fast CU Encoding Schemes Based on Merge Mode and Motion Estimation for HEVC Inter Prediction KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS VOL. 10, NO. 3, Mar. 2016 1195 Copyright c2016 KSII Fast CU Encoding Schemes Based on Merge Mode and Motion Estimation for HEVC Inter Prediction Jinfu

More information

FAST CODING UNIT DEPTH DECISION FOR HEVC. Shanghai, China. China {marcusmu, song_li,

FAST CODING UNIT DEPTH DECISION FOR HEVC. Shanghai, China. China {marcusmu, song_li, FAST CODING UNIT DEPTH DECISION FOR HEVC Fangshun Mu 1 2, Li Song 1 2, Xiaokang Yang 1 2, Zhenyi Luo 2 3 1 Institute of Image Communication and Network Engineering, Shanghai Jiao Tong University, Shanghai,

More information

Decoding-Assisted Inter Prediction for HEVC

Decoding-Assisted Inter Prediction for HEVC Decoding-Assisted Inter Prediction for HEVC Yi-Sheng Chang and Yinyi Lin Department of Communication Engineering National Central University, Taiwan 32054, R.O.C. Email: yilin@ce.ncu.edu.tw Abstract In

More information

Edge Detector Based Fast Level Decision Algorithm for Intra Prediction of HEVC

Edge Detector Based Fast Level Decision Algorithm for Intra Prediction of HEVC Journal of Signal Processing, Vol.19, No.2, pp.67-73, March 2015 PAPER Edge Detector Based Fast Level Decision Algorithm for Intra Prediction of HEVC Wen Shi, Xiantao Jiang, Tian Song and Takashi Shimamoto

More information

CONTENT ADAPTIVE COMPLEXITY REDUCTION SCHEME FOR QUALITY/FIDELITY SCALABLE HEVC

CONTENT ADAPTIVE COMPLEXITY REDUCTION SCHEME FOR QUALITY/FIDELITY SCALABLE HEVC CONTENT ADAPTIVE COMPLEXITY REDUCTION SCHEME FOR QUALITY/FIDELITY SCALABLE HEVC Hamid Reza Tohidypour, Mahsa T. Pourazad 1,2, and Panos Nasiopoulos 1 1 Department of Electrical & Computer Engineering,

More information

Hierarchical complexity control algorithm for HEVC based on coding unit depth decision

Hierarchical complexity control algorithm for HEVC based on coding unit depth decision Chen et al. EURASIP Journal on Image and Video Processing (2018) 2018:96 https://doi.org/10.1186/s13640-018-0341-3 EURASIP Journal on Image and Video Processing RESEARCH Hierarchical complexity control

More information

High Efficiency Video Coding (HEVC) test model HM vs. HM- 16.6: objective and subjective performance analysis

High Efficiency Video Coding (HEVC) test model HM vs. HM- 16.6: objective and subjective performance analysis High Efficiency Video Coding (HEVC) test model HM-16.12 vs. HM- 16.6: objective and subjective performance analysis ZORAN MILICEVIC (1), ZORAN BOJKOVIC (2) 1 Department of Telecommunication and IT GS of

More information

Fast Intra Mode Decision in High Efficiency Video Coding

Fast Intra Mode Decision in High Efficiency Video Coding Fast Intra Mode Decision in High Efficiency Video Coding H. Brahmasury Jain 1, a *, K.R. Rao 2,b 1 Electrical Engineering Department, University of Texas at Arlington, USA 2 Electrical Engineering Department,

More information

Fast Coding Unit Decision Algorithm for HEVC Intra Coding

Fast Coding Unit Decision Algorithm for HEVC Intra Coding Journal of Communications Vol. 11, No. 10, October 2016 Fast Coding Unit ecision Algorithm for HEVC Intra Coding Zhilong Zhu, Gang Xu, and Fengsui Wang Anhui Key Laboratory of etection Technology and Energy

More information

Affine SKIP and MERGE Modes for Video Coding

Affine SKIP and MERGE Modes for Video Coding Affine SKIP and MERGE Modes for Video Coding Huanbang Chen #1, Fan Liang #2, Sixin Lin 3 # School of Information Science and Technology, Sun Yat-sen University Guangzhou 510275, PRC 1 chhuanb@mail2.sysu.edu.cn

More information

OVERVIEW OF IEEE 1857 VIDEO CODING STANDARD

OVERVIEW OF IEEE 1857 VIDEO CODING STANDARD OVERVIEW OF IEEE 1857 VIDEO CODING STANDARD Siwei Ma, Shiqi Wang, Wen Gao {swma,sqwang, wgao}@pku.edu.cn Institute of Digital Media, Peking University ABSTRACT IEEE 1857 is a multi-part standard for multimedia

More information

Jun Zhang, Feng Dai, Yongdong Zhang, and Chenggang Yan

Jun Zhang, Feng Dai, Yongdong Zhang, and Chenggang Yan Erratum to: Efficient HEVC to H.264/AVC Transcoding with Fast Intra Mode Decision Jun Zhang, Feng Dai, Yongdong Zhang, and Chenggang Yan Erratum to: Chapter "Efficient HEVC to H.264/AVC Transcoding with

More information

Convolutional Neural Networks based Intra Prediction for HEVC

Convolutional Neural Networks based Intra Prediction for HEVC Convolutional Neural Networks based Intra Prediction for HEVC Wenxue Cui, Tao Zhang, Shengping Zhang, Feng Jiang, Wangmeng Zuo and Debin Zhao School of Computer Science Harbin Institute of Technology,

More information

Mode-Dependent Pixel-Based Weighted Intra Prediction for HEVC Scalable Extension

Mode-Dependent Pixel-Based Weighted Intra Prediction for HEVC Scalable Extension Mode-Dependent Pixel-Based Weighted Intra Prediction for HEVC Scalable Extension Tang Kha Duy Nguyen* a, Chun-Chi Chen a a Department of Computer Science, National Chiao Tung University, Taiwan ABSTRACT

More information

LOW BIT-RATE INTRA CODING SCHEME BASED ON CONSTRAINED QUANTIZATION AND MEDIAN-TYPE FILTER. Chen Chen and Bing Zeng

LOW BIT-RATE INTRA CODING SCHEME BASED ON CONSTRAINED QUANTIZATION AND MEDIAN-TYPE FILTER. Chen Chen and Bing Zeng LOW BIT-RAT INTRA CODING SCHM BASD ON CONSTRAIND QUANTIZATION AND MDIAN-TYP FILTR Chen Chen and Bing Zeng Department of lectronic & Computer ngineering The Hong Kong University of Science and Technology,

More information

Fast and adaptive mode decision and CU partition early termination algorithm for intra-prediction in HEVC

Fast and adaptive mode decision and CU partition early termination algorithm for intra-prediction in HEVC Zhang et al. EURASIP Journal on Image and Video Processing (2017) 2017:86 DOI 10.1186/s13640-017-0237-7 EURASIP Journal on Image and Video Processing RESEARCH Fast and adaptive mode decision and CU partition

More information

Fast inter-prediction algorithm based on motion vector information for high efficiency video coding

Fast inter-prediction algorithm based on motion vector information for high efficiency video coding Lin et al. EURASIP Journal on Image and Video Processing (2018) 2018:99 https://doi.org/10.1186/s13640-018-0340-4 EURASIP Journal on Image and Video Processing RESEARCH Fast inter-prediction algorithm

More information

IMPROVING video coding standards is necessary to allow

IMPROVING video coding standards is necessary to allow 1 Inter-Prediction Optimizations for Video Coding Using Adaptive Coding Unit Visiting Order Ivan Zupancic, Student Member, IEEE, Saverio G. Blasi, Member, IEEE, Eduardo Peixoto, Member, IEEE, and Ebroul

More information

BLOCK STRUCTURE REUSE FOR MULTI-RATE HIGH EFFICIENCY VIDEO CODING. Damien Schroeder, Patrick Rehm and Eckehard Steinbach

BLOCK STRUCTURE REUSE FOR MULTI-RATE HIGH EFFICIENCY VIDEO CODING. Damien Schroeder, Patrick Rehm and Eckehard Steinbach BLOCK STRUCTURE REUSE FOR MULTI-RATE HIGH EFFICIENCY VIDEO CODING Damien Schroeder, Patrick Rehm and Eckehard Steinbach Technische Universität München Chair of Media Technology Munich, Germany ABSTRACT

More information

Rotate Intra Block Copy for Still Image Coding

Rotate Intra Block Copy for Still Image Coding Rotate Intra Block Copy for Still Image Coding The MIT Faculty has made this article openly available. Please share how this access benefits you. Your story matters. Citation As Published Publisher Zhang,

More information

Reducing/eliminating visual artifacts in HEVC by the deblocking filter.

Reducing/eliminating visual artifacts in HEVC by the deblocking filter. 1 Reducing/eliminating visual artifacts in HEVC by the deblocking filter. EE5359 Multimedia Processing Project Proposal Spring 2014 The University of Texas at Arlington Department of Electrical Engineering

More information

Hierarchical Fast Selection of Intraframe Prediction Mode in HEVC

Hierarchical Fast Selection of Intraframe Prediction Mode in HEVC INTL JOURNAL OF ELCTRONICS AND TELECOMMUNICATIONS, 2016, VOL. 62, NO. 2, PP. 147-151 Manuscript received September 19, 2015; revised March, 2016. DOI: 10.1515/eletel-2016-0020 Hierarchical Fast Selection

More information

A BACKGROUND PROPORTION ADAPTIVE LAGRANGE MULTIPLIER SELECTION METHOD FOR SURVEILLANCE VIDEO ON HEVC

A BACKGROUND PROPORTION ADAPTIVE LAGRANGE MULTIPLIER SELECTION METHOD FOR SURVEILLANCE VIDEO ON HEVC A BACKGROUND PROPORTION ADAPTIVE LAGRANGE MULTIPLIER SELECTION METHOD FOR SURVEILLANCE VIDEO ON HEVC Long Zhao, Xianguo Zhang, Yonghong Tian, Ronggang Wang, Tiejun Huang National Engineering Laboratory

More information

HIGH Definition (HD) and Ultra-High Definition (UHD)

HIGH Definition (HD) and Ultra-High Definition (UHD) IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 24, NO. 7, JULY 2015 2225 Machine Learning-Based Coding Unit Depth Decisions for Flexible Complexity Allocation in High Efficiency Video Coding Yun Zhang, Member,

More information

Fast Decision of Block size, Prediction Mode and Intra Block for H.264 Intra Prediction EE Gaurav Hansda

Fast Decision of Block size, Prediction Mode and Intra Block for H.264 Intra Prediction EE Gaurav Hansda Fast Decision of Block size, Prediction Mode and Intra Block for H.264 Intra Prediction EE 5359 Gaurav Hansda 1000721849 gaurav.hansda@mavs.uta.edu Outline Introduction to H.264 Current algorithms for

More information

JOINT RATE ALLOCATION WITH BOTH LOOK-AHEAD AND FEEDBACK MODEL FOR HIGH EFFICIENCY VIDEO CODING

JOINT RATE ALLOCATION WITH BOTH LOOK-AHEAD AND FEEDBACK MODEL FOR HIGH EFFICIENCY VIDEO CODING JOINT RATE ALLOCATION WITH BOTH LOOK-AHEAD AND FEEDBACK MODEL FOR HIGH EFFICIENCY VIDEO CODING Hongfei Fan, Lin Ding, Xiaodong Xie, Huizhu Jia and Wen Gao, Fellow, IEEE Institute of Digital Media, chool

More information

HEVC The Next Generation Video Coding. 1 ELEG5502 Video Coding Technology

HEVC The Next Generation Video Coding. 1 ELEG5502 Video Coding Technology HEVC The Next Generation Video Coding 1 ELEG5502 Video Coding Technology ELEG5502 Video Coding Technology Outline Introduction Technical Details Coding structures Intra prediction Inter prediction Transform

More information

THE High Efficiency Video Coding (HEVC) standard [1] Enhancing Quality for HEVC Compressed Videos. arxiv: v2 [cs.

THE High Efficiency Video Coding (HEVC) standard [1] Enhancing Quality for HEVC Compressed Videos. arxiv: v2 [cs. Enhancing Quality for HEVC Compressed Videos Ren Yang, Student Member, IEEE, Mai Xu, Senior Member, IEEE, Tie Liu, Zulin Wang, Member, IEEE, and Zhenyu Guan arxiv:9.64v2 [cs.mm] 6 Jul 28 Abstract The latest

More information

A COMPARISON OF CABAC THROUGHPUT FOR HEVC/H.265 VS. AVC/H.264. Massachusetts Institute of Technology Texas Instruments

A COMPARISON OF CABAC THROUGHPUT FOR HEVC/H.265 VS. AVC/H.264. Massachusetts Institute of Technology Texas Instruments 2013 IEEE Workshop on Signal Processing Systems A COMPARISON OF CABAC THROUGHPUT FOR HEVC/H.265 VS. AVC/H.264 Vivienne Sze, Madhukar Budagavi Massachusetts Institute of Technology Texas Instruments ABSTRACT

More information

FAST HEVC TO SCC TRANSCODING BASED ON DECISION TREES. Wei Kuang, Yui-Lam Chan, Sik-Ho Tsang, and Wan-Chi Siu

FAST HEVC TO SCC TRANSCODING BASED ON DECISION TREES. Wei Kuang, Yui-Lam Chan, Sik-Ho Tsang, and Wan-Chi Siu FAST HEVC TO SCC TRANSCODING BASED ON DECISION TREES Wei Kuang, Yui-Lam Chan, Sik-Ho Tsang, and Wan-Chi Siu Centre for Signal Processing, Department of Electronic and Information Engineering The Hong Kong

More information

Analysis of Motion Estimation Algorithm in HEVC

Analysis of Motion Estimation Algorithm in HEVC Analysis of Motion Estimation Algorithm in HEVC Multimedia Processing EE5359 Spring 2014 Update: 2/27/2014 Advisor: Dr. K. R. Rao Department of Electrical Engineering University of Texas, Arlington Tuan

More information

Inter Prediction Complexity Reduction for HEVC based on Residuals Characteristics

Inter Prediction Complexity Reduction for HEVC based on Residuals Characteristics Inter Prediction Complexity Reduction for HEVC based on Residuals Characteristics Kanayah Saurty Faculty of Information and Communication Technologies Université des Mascareignes Pamplemousses, Mauritius

More information

A hardware-oriented concurrent TZ search algorithm for High-Efficiency Video Coding

A hardware-oriented concurrent TZ search algorithm for High-Efficiency Video Coding Doan et al. EURASIP Journal on Advances in Signal Processing (2017) 2017:78 DOI 10.1186/s13634-017-0513-9 EURASIP Journal on Advances in Signal Processing RESEARCH A hardware-oriented concurrent TZ search

More information

High Efficiency Video Decoding on Multicore Processor

High Efficiency Video Decoding on Multicore Processor High Efficiency Video Decoding on Multicore Processor Hyeonggeon Lee 1, Jong Kang Park 2, and Jong Tae Kim 1,2 Department of IT Convergence 1 Sungkyunkwan University Suwon, Korea Department of Electrical

More information

Cluster Adaptated Signalling for Intra Prediction in HEVC

Cluster Adaptated Signalling for Intra Prediction in HEVC 2017 Data Compression Conference Cluster daptated Signalling for Intra Prediction in HEVC Kevin Reuzé, Pierrick Philippe, Wassim Hamidouche, Olivier Déforges Orange Labs IER/INS 4 rue du Clos Courtel UMR

More information

Mode-dependent transform competition for HEVC

Mode-dependent transform competition for HEVC Mode-dependent transform competition for HEVC Adrià Arrufat, Pierrick Philippe, Olivier Déforges To cite this version: Adrià Arrufat, Pierrick Philippe, Olivier Déforges. Mode-dependent transform competition

More information

High Efficiency Video Coding. Li Li 2016/10/18

High Efficiency Video Coding. Li Li 2016/10/18 High Efficiency Video Coding Li Li 2016/10/18 Email: lili90th@gmail.com Outline Video coding basics High Efficiency Video Coding Conclusion Digital Video A video is nothing but a number of frames Attributes

More information

A comparison of CABAC throughput for HEVC/H.265 VS. AVC/H.264

A comparison of CABAC throughput for HEVC/H.265 VS. AVC/H.264 A comparison of CABAC throughput for HEVC/H.265 VS. AVC/H.264 The MIT Faculty has made this article openly available. Please share how this access benefits you. Your story matters. Citation As Published

More information

Temporally correlated quadtree partition algorithm for fast intra coding in high e ciency video coding

Temporally correlated quadtree partition algorithm for fast intra coding in high e ciency video coding Scientia Iranica B (2015) 22(6), 2209{2222 Sharif University of Technology Scientia Iranica Transactions B: Mechanical Engineering www.scientiairanica.com Temporally correlated quadtree partition algorithm

More information

Research Article An Effective Transform Unit Size Decision Method for High Efficiency Video Coding

Research Article An Effective Transform Unit Size Decision Method for High Efficiency Video Coding Mathematical Problems in Engineering, Article ID 718189, 10 pages http://dx.doi.org/10.1155/2014/718189 Research Article An Effective Transform Unit Size Decision Method for High Efficiency Video Coding

More information

Effective Data Driven Coding Unit Size Decision Approaches for HEVC INTRA Coding

Effective Data Driven Coding Unit Size Decision Approaches for HEVC INTRA Coding Effective Data Driven Coding Unit Size Decision Approaches for HEVC INTRA Coding Yun Zhang, IEEE Senior Member, Zhaoqing Pan, IEEE Member, Na Li, Xu Wang, IEEE Member Gangyi Jiang, IEEE Member, and Sam

More information

We are IntechOpen, the world s leading publisher of Open Access books Built by scientists, for scientists. International authors and editors

We are IntechOpen, the world s leading publisher of Open Access books Built by scientists, for scientists. International authors and editors We are IntechOpen, the world s leading publisher of Open Access books Built by scientists, for scientists 3,800 116,000 120M Open access books available International authors and editors Downloads Our

More information

MOTION COMPENSATION WITH HIGHER ORDER MOTION MODELS FOR HEVC. Cordula Heithausen and Jan Hendrik Vorwerk

MOTION COMPENSATION WITH HIGHER ORDER MOTION MODELS FOR HEVC. Cordula Heithausen and Jan Hendrik Vorwerk MOTION COMPENSATION WITH HIGHER ORDER MOTION MODELS FOR HEVC Cordula Heithausen and Jan Hendrik Vorwerk Institute of Communications Engineering, RWTH Aachen University, 52056 Aachen, Germany ABSTRACT In

More information

Fast Mode Decision for H.264/AVC Using Mode Prediction

Fast Mode Decision for H.264/AVC Using Mode Prediction Fast Mode Decision for H.264/AVC Using Mode Prediction Song-Hak Ri and Joern Ostermann Institut fuer Informationsverarbeitung, Appelstr 9A, D-30167 Hannover, Germany ri@tnt.uni-hannover.de ostermann@tnt.uni-hannover.de

More information

THE HIGH definition (HD) and ultra HD videos have

THE HIGH definition (HD) and ultra HD videos have IEEE TRANSACTIONS ON BROADCASTING, VOL. 62, NO. 3, SEPTEMBER 2016 675 Fast Motion Estimation Based on Content Property for Low-Complexity H.265/HEVC Encoder Zhaoqing Pan, Member, IEEE, Jianjun Lei, Member,

More information

Complexity Reduced Mode Selection of H.264/AVC Intra Coding

Complexity Reduced Mode Selection of H.264/AVC Intra Coding Complexity Reduced Mode Selection of H.264/AVC Intra Coding Mohammed Golam Sarwer 1,2, Lai-Man Po 1, Jonathan Wu 2 1 Department of Electronic Engineering City University of Hong Kong Kowloon, Hong Kong

More information

CROSS-PLANE CHROMA ENHANCEMENT FOR SHVC INTER-LAYER PREDICTION

CROSS-PLANE CHROMA ENHANCEMENT FOR SHVC INTER-LAYER PREDICTION CROSS-PLANE CHROMA ENHANCEMENT FOR SHVC INTER-LAYER PREDICTION Jie Dong, Yan Ye, Yuwen He InterDigital Communications, Inc. PCS2013, Dec. 8-11, 2013, San Jose, USA 1 2013 InterDigital, Inc. All rights

More information

Fast Transcoding From H.264/AVC To High Efficiency Video Coding

Fast Transcoding From H.264/AVC To High Efficiency Video Coding 2012 IEEE International Conference on Multimedia and Expo Fast Transcoding From H.264/AVC To High Efficiency Video Coding Dong Zhang* 1, Bin Li 1, Jizheng Xu 2, and Houqiang Li 1 1 University of Science

More information

A NOVEL SCANNING SCHEME FOR DIRECTIONAL SPATIAL PREDICTION OF AVS INTRA CODING

A NOVEL SCANNING SCHEME FOR DIRECTIONAL SPATIAL PREDICTION OF AVS INTRA CODING A NOVEL SCANNING SCHEME FOR DIRECTIONAL SPATIAL PREDICTION OF AVS INTRA CODING Md. Salah Uddin Yusuf 1, Mohiuddin Ahmad 2 Assistant Professor, Dept. of EEE, Khulna University of Engineering & Technology

More information

New Rate Control Optimization Algorithm for HEVC Aiming at Discontinuous Scene

New Rate Control Optimization Algorithm for HEVC Aiming at Discontinuous Scene New Rate Control Optimization Algorithm for HEVC Aiming at Discontinuous Scene SHENGYANG XU, EI YU, SHUQING FANG, ZONGJU PENG, XIAODONG WANG Faculty of Information Science and Engineering Ningbo University

More information

Video encoders have always been one of the resource

Video encoders have always been one of the resource Fast Coding Unit Partition Search Satish Lokkoju # \ Dinesh Reddl2 # Samsung India Software Operations Private Ltd Bangalore, India. l l.satish@samsung.com 2 0inesh.reddy@samsung.com Abstract- Quad tree

More information

Transcoding from H.264/AVC to High Efficiency Video Coding (HEVC)

Transcoding from H.264/AVC to High Efficiency Video Coding (HEVC) EE5359 PROJECT PROPOSAL Transcoding from H.264/AVC to High Efficiency Video Coding (HEVC) Shantanu Kulkarni UTA ID: 1000789943 Transcoding from H.264/AVC to HEVC Objective: To discuss and implement H.265

More information

An Efficient Mode Selection Algorithm for H.264

An Efficient Mode Selection Algorithm for H.264 An Efficient Mode Selection Algorithm for H.64 Lu Lu 1, Wenhan Wu, and Zhou Wei 3 1 South China University of Technology, Institute of Computer Science, Guangzhou 510640, China lul@scut.edu.cn South China

More information

Performance Evaluation of Kvazaar HEVC Intra Encoder on Xeon Phi Many-core Processor

Performance Evaluation of Kvazaar HEVC Intra Encoder on Xeon Phi Many-core Processor Performance Evaluation of Kvazaar HEVC Intra Encoder on Xeon Phi Many-core Processor Ari Koivula Marko Viitanen Ari Lemmetti Dr. Jarno Vanne Prof. Timo D. Hämäläinen GlobalSIP 2015 Dec 16, 2015 Orlando,

More information

HEVC. Complexity Reduction Algorithm for Quality Scalability in Scalable. 1. Introduction. Abstract

HEVC. Complexity Reduction Algorithm for Quality Scalability in Scalable. 1. Introduction. Abstract 50 Complexity Reduction Algorithm for Quality Scalability in Scalable HEVC 1 Yuan-Shing Chang, 1 Ke-Nung Huang and *,1 Chou-Chen Wang Abstract SHVC, the scalable extension of high efficiency video coding

More information

Performance Comparison of AV1, JEM, VP9, and HEVC Encoders

Performance Comparison of AV1, JEM, VP9, and HEVC Encoders Performance Comparison of AV1, JEM, VP9, and HEVC Encoders Dan Grois, Tung Nguyen, and Detlev Marpe Video Coding & Analytics Department Fraunhofer Institute for Telecommunications Heinrich Hertz Institute,

More information

Sparse Coding based Frequency Adaptive Loop Filtering for Video Coding

Sparse Coding based Frequency Adaptive Loop Filtering for Video Coding Sparse Coding based Frequency Adaptive Loop Filtering for Video Coding Outline 1. Sparse Coding based Denoising 2. Frequency Adaptation Model 3. Simulation Setup and Results 4. Summary and Outlook 2 of

More information

ENCODER COMPLEXITY REDUCTION WITH SELECTIVE MOTION MERGE IN HEVC ABHISHEK HASSAN THUNGARAJ. Presented to the Faculty of the Graduate School of

ENCODER COMPLEXITY REDUCTION WITH SELECTIVE MOTION MERGE IN HEVC ABHISHEK HASSAN THUNGARAJ. Presented to the Faculty of the Graduate School of ENCODER COMPLEXITY REDUCTION WITH SELECTIVE MOTION MERGE IN HEVC by ABHISHEK HASSAN THUNGARAJ Presented to the Faculty of the Graduate School of The University of Texas at Arlington in Partial Fulfillment

More information

COMPARISON OF HIGH EFFICIENCY VIDEO CODING (HEVC) PERFORMANCE WITH H.264 ADVANCED VIDEO CODING (AVC)

COMPARISON OF HIGH EFFICIENCY VIDEO CODING (HEVC) PERFORMANCE WITH H.264 ADVANCED VIDEO CODING (AVC) Journal of Engineering Science and Technology Special Issue on 4th International Technical Conference 2014, June (2015) 102-111 School of Engineering, Taylor s University COMPARISON OF HIGH EFFICIENCY

More information

SINGLE PASS DEPENDENT BIT ALLOCATION FOR SPATIAL SCALABILITY CODING OF H.264/SVC

SINGLE PASS DEPENDENT BIT ALLOCATION FOR SPATIAL SCALABILITY CODING OF H.264/SVC SINGLE PASS DEPENDENT BIT ALLOCATION FOR SPATIAL SCALABILITY CODING OF H.264/SVC Randa Atta, Rehab F. Abdel-Kader, and Amera Abd-AlRahem Electrical Engineering Department, Faculty of Engineering, Port

More information

Dynamically Reconfigurable Architecture System for Time-varying Image Constraints (DRASTIC) for HEVC Intra Encoding

Dynamically Reconfigurable Architecture System for Time-varying Image Constraints (DRASTIC) for HEVC Intra Encoding Dynamically Reconfigurable Architecture System for Time-varying Image onstraints (DRASTI) for HEV Intra Encoding Yuebing Jiang Email: yuebing@unm.edu Gangadharan Esakki Email: gesakki@ece.unm.edu Marios

More information

DUE TO THE ever-increasing demand for bit rate to

DUE TO THE ever-increasing demand for bit rate to IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 22, NO. 12, DECEMBER 2012 1697 Block Partitioning Structure in the HEVC Standard Il-Koo Kim, Junghye Min, Tammy Lee, Woo-Jin Han, and

More information

Scalable Extension of HEVC 한종기

Scalable Extension of HEVC 한종기 Scalable Extension of HEVC 한종기 Contents 0. Overview for Scalable Extension of HEVC 1. Requirements and Test Points 2. Coding Gain/Efficiency 3. Complexity 4. System Level Considerations 5. Related Contributions

More information

Professor, CSE Department, Nirma University, Ahmedabad, India

Professor, CSE Department, Nirma University, Ahmedabad, India Bandwidth Optimization for Real Time Video Streaming Sarthak Trivedi 1, Priyanka Sharma 2 1 M.Tech Scholar, CSE Department, Nirma University, Ahmedabad, India 2 Professor, CSE Department, Nirma University,

More information

An Information Hiding Algorithm for HEVC Based on Angle Differences of Intra Prediction Mode

An Information Hiding Algorithm for HEVC Based on Angle Differences of Intra Prediction Mode An Information Hiding Algorithm for HEVC Based on Angle Differences of Intra Prediction Mode Jia-Ji Wang1, Rang-Ding Wang1*, Da-Wen Xu1, Wei Li1 CKC Software Lab, Ningbo University, Ningbo, Zhejiang 3152,

More information

Fast Intra-frame Coding Algorithm for HEVC Based on TCM and Machine Learning

Fast Intra-frame Coding Algorithm for HEVC Based on TCM and Machine Learning Fast Intra-frame Coding Algorithm for HEVC Based on TCM and Machine Learning by Yi Shan A thesis presented to the University of Waterloo in fulfillment of the thesis requirement for the degree of Master

More information

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. XX, NO. YY, MONTH YYYY 1

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. XX, NO. YY, MONTH YYYY 1 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. XX, NO. YY, MONTH YYYY 1 Content-Adaptive Feature-Based CU Size Prediction for Fast Low-Delay Video Encoding in HEVC Thanuja Mallikarachchi,

More information

EFFICIENT INTRA PREDICTION SCHEME FOR LIGHT FIELD IMAGE COMPRESSION

EFFICIENT INTRA PREDICTION SCHEME FOR LIGHT FIELD IMAGE COMPRESSION 2014 IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP) EFFICIENT INTRA PREDICTION SCHEME FOR LIGHT FIELD IMAGE COMPRESSION Yun Li, Mårten Sjöström, Roger Olsson and Ulf Jennehag

More information

Machine Learning-based Early Termination in Prediction Block Decomposition for VP9

Machine Learning-based Early Termination in Prediction Block Decomposition for VP9 Machine Learning-based Early Termination in Prediction Block Decomposition for VP9 Xintong Han; University of Maryland; College Park, MD. Yunqing Wang; Google Inc.; Mountain View, C A. Yaowu Xu; Google

More information

High Efficiency Video Coding: The Next Gen Codec. Matthew Goldman Senior Vice President TV Compression Technology Ericsson

High Efficiency Video Coding: The Next Gen Codec. Matthew Goldman Senior Vice President TV Compression Technology Ericsson High Efficiency Video Coding: The Next Gen Codec Matthew Goldman Senior Vice President TV Compression Technology Ericsson High Efficiency Video Coding Compression Bitrate Targets Bitrate MPEG-2 VIDEO 1994

More information

ADAPTIVE INTERPOLATED MOTION COMPENSATED PREDICTION. Wei-Ting Lin, Tejaswi Nanjundaswamy, Kenneth Rose

ADAPTIVE INTERPOLATED MOTION COMPENSATED PREDICTION. Wei-Ting Lin, Tejaswi Nanjundaswamy, Kenneth Rose ADAPTIVE INTERPOLATED MOTION COMPENSATED PREDICTION Wei-Ting Lin, Tejaswi Nanjundaswamy, Kenneth Rose Department of Electrical and Computer Engineering, University of California Santa Barbara, CA 93 Email:

More information

HEVC OVERVIEW. March InterDigital, Inc. All rights reserved.

HEVC OVERVIEW. March InterDigital, Inc. All rights reserved. HEVC OVERVIEW March 2013 2012 InterDigital, Inc. All rights reserved. Agenda Overview of video coding standards The HEVC standard History, schedule, etc Technical details Performance and complexity analysis

More information

FAST PARTITIONING ALGORITHM FOR HEVC INTRA FRAME CODING USING MACHINE LEARNING

FAST PARTITIONING ALGORITHM FOR HEVC INTRA FRAME CODING USING MACHINE LEARNING FAST PARTITIONING ALGORITHM FOR HEVC INTRA FRAME CODING USING MACHINE LEARNING Damián Ruiz-Coll 1, Velibor Adzic 2, Gerardo Fernández-Escribano 1, Hari Kalva 2, José Luis Martínez 1 and Pedro Cuenca 1

More information

Comparative and performance analysis of HEVC and H.264 Intra frame coding and JPEG2000

Comparative and performance analysis of HEVC and H.264 Intra frame coding and JPEG2000 Comparative and performance analysis of HEVC and H.264 Intra frame coding and JPEG2000 EE5359 Multimedia Processing Project Proposal Spring 2013 The University of Texas at Arlington Department of Electrical

More information

Adaptive Interpolated Motion-Compensated Prediction with Variable Block Partitioning

Adaptive Interpolated Motion-Compensated Prediction with Variable Block Partitioning Adaptive Interpolated Motion-Compensated Prediction with Variable Block Partitioning Wei-Ting Lin, Tejaswi Nanjundaswamy, Kenneth Rose Department of Electrical and Computer Engineering, University of California

More information

One-pass bitrate control for MPEG-4 Scalable Video Coding using ρ-domain

One-pass bitrate control for MPEG-4 Scalable Video Coding using ρ-domain Author manuscript, published in "International Symposium on Broadband Multimedia Systems and Broadcasting, Bilbao : Spain (2009)" One-pass bitrate control for MPEG-4 Scalable Video Coding using ρ-domain

More information

QUANTIZER DESIGN FOR EXPLOITING COMMON INFORMATION IN LAYERED CODING. Mehdi Salehifar, Tejaswi Nanjundaswamy, and Kenneth Rose

QUANTIZER DESIGN FOR EXPLOITING COMMON INFORMATION IN LAYERED CODING. Mehdi Salehifar, Tejaswi Nanjundaswamy, and Kenneth Rose QUANTIZER DESIGN FOR EXPLOITING COMMON INFORMATION IN LAYERED CODING Mehdi Salehifar, Tejaswi Nanjundaswamy, and Kenneth Rose Department of Electrical and Computer Engineering University of California,

More information

FAST SPATIAL LAYER MODE DECISION BASED ON TEMPORAL LEVELS IN H.264/AVC SCALABLE EXTENSION

FAST SPATIAL LAYER MODE DECISION BASED ON TEMPORAL LEVELS IN H.264/AVC SCALABLE EXTENSION FAST SPATIAL LAYER MODE DECISION BASED ON TEMPORAL LEVELS IN H.264/AVC SCALABLE EXTENSION Yen-Chieh Wang( 王彥傑 ), Zong-Yi Chen( 陳宗毅 ), Pao-Chi Chang( 張寶基 ) Dept. of Communication Engineering, National Central

More information

Video pre-processing with JND-based Gaussian filtering of superpixels

Video pre-processing with JND-based Gaussian filtering of superpixels Video pre-processing with JND-based Gaussian filtering of superpixels Lei Ding, Ge Li*, Ronggang Wang, Wenmin Wang School of Electronic and Computer Engineering, Shenzhen Graduate School, Peking University

More information

1492 IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, VOL. 11, NO. 6, DECEMBER 2015

1492 IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, VOL. 11, NO. 6, DECEMBER 2015 1492 IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, VOL. 11, NO. 6, DECEMBER 2015 Low Complexity HEVC INTRA Coding for High-Quality Mobile Video Communication Yun Zhang, Member, IEEE, Sam Kwong, Fellow,

More information

A Quantized Transform-Domain Motion Estimation Technique for H.264 Secondary SP-frames

A Quantized Transform-Domain Motion Estimation Technique for H.264 Secondary SP-frames A Quantized Transform-Domain Motion Estimation Technique for H.264 Secondary SP-frames Ki-Kit Lai, Yui-Lam Chan, and Wan-Chi Siu Centre for Signal Processing Department of Electronic and Information Engineering

More information

Bi-directional optical flow for future video codec

Bi-directional optical flow for future video codec 2016 Data Compression Conference Bi-directional optical flow for future video codec Alshin Alexander * and Alshina Elena * * Digital Media R&D Center 416, Maetan 3-dong, Yeongtong-Gu Suwon, 443-742, Korea

More information

IBM Research Report. Inter Mode Selection for H.264/AVC Using Time-Efficient Learning-Theoretic Algorithms

IBM Research Report. Inter Mode Selection for H.264/AVC Using Time-Efficient Learning-Theoretic Algorithms RC24748 (W0902-063) February 12, 2009 Electrical Engineering IBM Research Report Inter Mode Selection for H.264/AVC Using Time-Efficient Learning-Theoretic Algorithms Yuri Vatis Institut für Informationsverarbeitung

More information

Context-Adaptive Binary Arithmetic Coding with Precise Probability Estimation and Complexity Scalability for High- Efficiency Video Coding*

Context-Adaptive Binary Arithmetic Coding with Precise Probability Estimation and Complexity Scalability for High- Efficiency Video Coding* Context-Adaptive Binary Arithmetic Coding with Precise Probability Estimation and Complexity Scalability for High- Efficiency Video Coding* Damian Karwowski a, Marek Domański a a Poznan University of Technology,

More information

Fast intermode decision algorithm based on general and local residual complexity in H.264/ AVC

Fast intermode decision algorithm based on general and local residual complexity in H.264/ AVC Lee et al. EURASIP Journal on Image and Video Processing 2013, 2013:30 RESEARCH Open Access Fast intermode decision algorithm based on general and local residual complexity in H.264/ AVC Jaeho Lee 1, Seongwan

More information

A DYNAMIC MOTION VECTOR REFERENCING SCHEME FOR VIDEO CODING. Jingning Han, Yaowu Xu, and James Bankoski

A DYNAMIC MOTION VECTOR REFERENCING SCHEME FOR VIDEO CODING. Jingning Han, Yaowu Xu, and James Bankoski A DYNAMIC MOTION VECTOR REFERENCING SCHEME FOR VIDEO CODING Jingning Han, Yaowu Xu, and James Bankoski WebM Codec Team, Google Inc. 1600 Amphitheatre Parkway, Mountain View, CA 94043 Emails: {jingning,yaowu,jimbankoski}@google.com

More information

A Hybrid Video Codec Based on Extended Block Sizes, Recursive Integer Transforms, Improved Interpolation, and Flexible Motion Representation

A Hybrid Video Codec Based on Extended Block Sizes, Recursive Integer Transforms, Improved Interpolation, and Flexible Motion Representation A Hybrid Video Codec Based on Extended Block Sizes, Recursive Integer Transforms, Improved Interpolation, and Flexible Motion Representation Marta Karczewicz, Peisong Chen, Rajan Joshi, ianglin Wang, Wei-Jung

More information

An Multi-Mini-Partition Intra Block Copying for Screen Content Coding

An Multi-Mini-Partition Intra Block Copying for Screen Content Coding 3rd International Conference on Mechatronics and Industrial Informatics (ICMII 2015) An Multi-Mini-Partition Intra Block Copying for Screen Content Coding LiPing ZHAO 1, a*, Tao LIN 2,b 1 College of Mathematics,

More information

Multistream Video Encoder for Generating Multiple Dynamic Range Bitstreams

Multistream Video Encoder for Generating Multiple Dynamic Range Bitstreams biblio.ugent.be The UGent Institutional Repository is the electronic archiving and dissemination platform for all UGent research publications. Ghent University has implemented a mandate stipulating that

More information

An Optimized Template Matching Approach to Intra Coding in Video/Image Compression

An Optimized Template Matching Approach to Intra Coding in Video/Image Compression An Optimized Template Matching Approach to Intra Coding in Video/Image Compression Hui Su, Jingning Han, and Yaowu Xu Chrome Media, Google Inc., 1950 Charleston Road, Mountain View, CA 94043 ABSTRACT The

More information

An HEVC Fractional Interpolation Hardware Using Memory Based Constant Multiplication

An HEVC Fractional Interpolation Hardware Using Memory Based Constant Multiplication 2018 IEEE International Conference on Consumer Electronics (ICCE) An HEVC Fractional Interpolation Hardware Using Memory Based Constant Multiplication Ahmet Can Mert, Ercan Kalali, Ilker Hamzaoglu Faculty

More information

Rate Distortion Optimization in Video Compression

Rate Distortion Optimization in Video Compression Rate Distortion Optimization in Video Compression Xue Tu Dept. of Electrical and Computer Engineering State University of New York at Stony Brook 1. Introduction From Shannon s classic rate distortion

More information

FRAME-LEVEL QUALITY AND MEMORY TRAFFIC ALLOCATION FOR LOSSY EMBEDDED COMPRESSION IN VIDEO CODEC SYSTEMS

FRAME-LEVEL QUALITY AND MEMORY TRAFFIC ALLOCATION FOR LOSSY EMBEDDED COMPRESSION IN VIDEO CODEC SYSTEMS FRAME-LEVEL QUALITY AD MEMORY TRAFFIC ALLOCATIO FOR LOSSY EMBEDDED COMPRESSIO I VIDEO CODEC SYSTEMS Li Guo, Dajiang Zhou, Shinji Kimura, and Satoshi Goto Graduate School of Information, Production and

More information

Selected coding methods in H.265/HEVC

Selected coding methods in H.265/HEVC Selected coding methods in H.265/HEVC Andreas Unterweger Salzburg University of Applied Sciences May 29, 2017 Andreas Unterweger (Salzburg UAS) Selected coding methods in H.265/HEVC May 29, 2017 1 / 22

More information