A Rapid Scheme for Slow-Motion Replay Segment Detection
|
|
- Rudolf Shields
- 6 years ago
- Views:
Transcription
1 A Rapid Scheme for Slow-Motion Replay Segment Detection Wei-Hong Chuang, Dun-Yu Hsiao, Soo-Chang Pei, and Homer Chen Department of Electrical Engineering, National Taiwan University, Taipei, Taiwan 10617, R.O.C., {r , {pei, Abstract. Efficient data mining for digital video has become increasingly important in recent years. In this paper, we present a new scheme for automatic detection of slow-motion replays in sports video. Several slow-motion features and some newly discovered characteristics of slowmotion segments are exploited to aid the detection. The first step of our method is based on the macroblock motion vector information, while the second step makes use of frame-to-frame difference under an MC-DCT structure to verify the output of the first step. The last step is applied to refine the segment boundaries. Unlike previous approaches, our method has great improvement in both speed and accuracy and a balance between efficiency and simplicity. 1 Introduction As recent advances in digital video coding and transmission have made digital video very popular, It becomes more and more difficult for end users to go through all received video information. Sports video programs are a good example. Someone may be interested in many games played in a day but does not have the time to watch all of them or even one of them throughout. A tool for automatic detection of important events in sports video and for summary presentation will thus be very useful. Many approaches to event detection have been proposed [2], [6], [7], [10]. Besides these existing ideas, slow-motion replays usually represent the occurrence of important events, too. If these replay segments could be detected effectively, we can extract them from the original video and present them as a meaningful kind of highlights. In this paper, we propose a new scheme for slow-motion replay segments detection (SMRSD). First, we apply a novel procedure by scanning macroblock reference directions to find slow-motion replay segment candidates. Next, a DCT-domain procedure is used to refine the candidates and discard false ones. This method also checks frame differences but avoids inverse DCT operations. Lastly, the resulting replay segments are concatenated and presented to the viewer. This detection scheme performs completely in the compressed domain. With this scheme, the time cost will be low and results will be reliable. K. Aizawa, Y. Nakamura, and S. Satoh (Eds.): PCM 2004, LNCS 3331, pp , c Springer-Verlag Berlin Heidelberg 2004
2 240 W.-H. Chuang et al. 2 Previous Work The SMRSD issue has been addressed in the literature by some researchers [1], [4], [10]. In general, there are two ways to generate slow-motion effects. For videos captured by a standard-speed camera, the slow-motion effect can be generated by frame repetition or frame interpolation [2]. (Note: The frame repetition method is more widely adopted because of its simplicity and maturity.) For videos recorded with a high-speed camera, the slow-motion effect can be generated by simply playing out the video at the normal speed. Since standard-speed cameras are much more widely used (and cheaper) than high-speed cameras [1], in this paper, we concentrate on slow-motion videos generated by frame repetition. Pan et.al [1] proposed an approach to detection of slow-motion segments. They defined the frame difference as D(n) = M p=1 q=1 N (I n (p, q) I n 1 (p, q)) 2, where I n (p, q) denotes a macroblock in frame n. In a slow-motion region, because of the existence of repeated frames, D(n) would have more abrupt changes than what it has in the normal play region. An example is shown in Fig.1, where it can be seen that D(n) exhibits a clear pattern in which a large value is followed by several near zero values. That is, D(n) will cross its mean value in a slow-motion segment more often than in a standard-speed segment. In other words, D(n) has a higher zerocrossing rate in slow-motion segments. Pan [1] defined the zero-crossing as L 1 Z c (n, θ k )= trld(d(n i) D(n),D(n i 1) D(n),θ k ) i=1 where trld(x, y, t) = { 1ifx t and y t 0ifx t and y t. Accordingly, p zc (n) is defined as a measure of the fluctuation of D(n): p zc (n) = arg max Z c (n, θ k ) β. k As suggested in [2], threshold values are set to: L =7,θ k = k, β =1 The reader is referred to [1], [2],and [4] for more details.
3 A Rapid Scheme for Slow-Motion Replay Segment Detection 241 (a) (b) (c) (d) Fig. 1. (a) D(n) of a video segment consisting of a normal play region and a slowmotion region, (b) the zoomed-in view of the normal play region, and (c) the zoomed-in view of the slow-motion region. (d) is a slow-motion segment which has a portion of weak zero-crossing pattern. 3 New Discovery and Compressed Domain SMRSD Our tests told us that the zero crossing is a prevalent characteristic of slowmotion segments. But we have also noted that some slow-motion segments have weak zero-crossing patterns (as displayed in Fig. 1(d)). In such cases, purely rely on the zero-crossing may not give satisfactory results. Based on the observation of many sports videos, we have found that slow-motion segments would likely begin and end with a scene change such as logo flashing and scene wiping. These scene changes work as a clue of the appearance of slow-motion segments. If the segment boundaries are detected first, one may improve the computational efficiency by localizing the zero-crossing operations to only a few frames within each segment. Pan et al. [1] used an HMM model to detect the segment boundaries. This method requires training an HMM model. However, different kinds of video may have different characteristics. One HMM model is not general enough to work for all different kinds of videos. The method developed by Pei and Chou in [5] detects the scene change based on the reference direction of each macroblock of bi-directional prediction (B) frames. The B frames before and after a scene change tend to have different reference directions, as shown in Fig. 2. This method performs consistently well for typical videos such as MTV, TV commercials, etc, but it generates incorrect
4 242 W.-H. Chuang et al. Fig. 2. Scene change detection based on the reference direction of bi-directional prediction (B) macroblocks. P stands for prediction macroblock, and I for intra macroblock. results for sports video where there is a significant amount of motions due to camera panning or zooming. While the detection method described in [5] fails for the specific application targeted in this paper, we found that it exhibits a distinctively different behavior for slow-motion segments: The number of scene changes it detects is far more than that for the normal play regions. This discovery inspires us to develop the new SMRSD scheme discussed here. The false alarms for scene changes generated by the detection method [5] signals the existence of slow-motion replay segments. That is, the more scene changes it detects, and the closer between scene changes, the more likely the segment is a slow-motion segment. This is illustrated in Fig. 3. After further examining the phenomena described above, we found that slowmotion segments usually exhibit a particular pattern. The frame will remain still for some time then change to the next one. Freeze and play is ubiquitous in slow-motion plays, thus motion vectors of the macroblocks are likely to refer to different directions (most macroblocks of one frame refer forward, and most macroblocks of the adjacent frame refer backward) when abrupt shift between frames takes place. Hence it makes sense to detect slow-motion segments in a video by detecting the great change in reference direction of macroblocks. 3.1 Step I. Slow-Motion Segment Detection The purpose of this step is to obtain an initial segmentation of the video sequence. High-density occurrence in Fig. 3 is an implication of the existence of a slow-motion region. Thus we extract those high density segments of the detection of large difference in reference direction change from the input video sequence. This includes an analysis of the spacing between occurrences generated by the detection method [5]. A threshold is applied to select slow-motion segments from all possible candidates. To obtain better detection results, we have many voting rules to account the amount of change in reference direction, then we discarded
5 A Rapid Scheme for Slow-Motion Replay Segment Detection 243 Fig. 3. The occurrence of scene changes detected by the method described in [5]. In those detection regions with high density, we found that there are great possibility that slow-motion segments reside. Fig. 4. A block diagram of the new SMRSD scheme. It consists of three steps as described in the following. or added voting rules regarding to their contribution to detection results and emphasis on the most effective one, which is the reference pattern shown in Fig. 2. This greatly enhances the performance of the method and made much difference than any other kinds of slow-motion detection methods. After such a refinement, it is powerful in detecting jerky changes in video sequences, which is the phenomenon that exhibits in slow-motion segments. In this step, neighboring slow-motion segments are merged to account for the fact that, in practice, scene change can happen in a slow-motion replay. Slow-motion segments that are very short (for example, less than 1 second) are discarded. The candidates generated by this step usually have an accuracy of 70% in detection including miss and false alarm rate. To improve this result, we use the following step to reduce error rate and still preserve a high speed in detection.
6 244 W.-H. Chuang et al. 3.2 Step II. Refinement This refinement step, applied to those candidates found in Step I, is based on the zero-crossing measure [1]. There are two points to be noted. First, our goal is to develop a technique in the compressed domain; however, the zero-crossing method is applied to video frames in the spatial domain. We know that DCT is a unitary transform, and mathematically it makes no difference to calculate frame difference in either spatial domain or transform domain. The other point is that, in an MPEG stream, the DCT coefficients of predicted frames are the transform values of prediction error. Hence, we need to modify the calculation of D(n) in Section 2. Chang et al. [8] suggest using a decoding structure as shown in Fig. 5. This decoder structure is equivalent to the original decoder in that it generates the same decoding results. Under this decoding structure, the motion compensation is performed before the inverse DCT. This way, D(n) and the zero-crossing method can be performed in the compressed domain. This step consists of the following operations that are applied to each candidate segment found in Step I to refine the segment boundary: Find all frames of the segment such that p zc is greater than a preset threshold. For each frame near the segment boundary (both inside and outside the segment), make a merge or discard decision based on its p zc value. Merge two segments if they are close (for example, within 30 frames) to each others. 3.3 Step III. Summarization This step involves the following operations: 1) Choose a key frame from each slow-motion replay segment [7], [9]. 2) Include extra thirty seconds before and after each segment. 4 Experiment Results Our scheme is fast because it uses only motion vector and coefficient information and does not need any decompression operation. This section presents the experimental results of our SMRSD scheme. To see the validity of this scheme, we use three different video clips generated by three different producers in two different countries, as shown in Table 1. The total duration is more than half an hour. Table 1. SMRSD Test Data Sequences Length in min:sec Length in frames : : Final 08:
7 A Rapid Scheme for Slow-Motion Replay Segment Detection 245 Fig. 5. SMRSD System Interface. Table 2. SMRSD Results Sequences # of replay segments Correct False Miss Inaccuracy boundary Time saved % % Final % We also developed a user interface which aids the user browsing the extraction SMRSD results, as follows: The SMRSD results are shown in Table 2. Our results are and visually pleasant. Long segments can be represented effectively by very short ones. Particularly, because the operations are completely in the compressed domain and only use motion vectors most of time, the scheme is very suited for huge amount of data. 5 Conclusions A new scheme for slow-motion replay segment detection has been described in this paper. We have tested this system in a computer environment that is similar to that in ordinary families, and the system (without optimization) runs far faster than real time. Experimental results show that this scheme is effective and superior to other schemes in that it allows a good balance between accuracy and efficiency. Users don t have to take a long time to watch the entire video of races or games, instead, they could watch the generated summaries to save their time.
8 246 W.-H. Chuang et al. Acknowledgement. We thank for those who gave us comments. These advices make this paper more complete and we are very grateful. References 1. H. Pan, P. van Beek, and M. I. Sezan, Detection of slow-motion replay segments in sports video for highlights generation, in Proc. ICASSP 01, pp , A. Ekin, M. Tekalp, and R. Mehrotra, Automatic soccer video analysis and summarization, IEEE Trans. Image Proc., Vol 12, No 7, pp , J. Song and B.-L. Yeo, A fast algorithm for DCT-domain inverse motion compensation based on shared information in a macroblock, IEEE Trans. CSVT, Vol 10, No 5, pp , H. Pan, B. Li, and M. I. Sezan, Automatic detection of replay segments in broadcast sports programs by detection of logos in scene transitions, in Proc. ICASSP 02, pp , S.-C. Pei and Y.-Z.Chou, Efficient MPEG compressed video analysis using macroblock type information, IEEE Trans. Multimedia, Vol 1, No 4, pp , Y. Rui, A. Gupta, and A. Acero, Automatically extracting highlights for TV baseball programs, in Proc. of 8th ACM Inter. Conf. on Multimedia, pp , Y.-F. Ma, L. Lu, H.-J. Zhang, and M.J. Li, A User Attention Model for Video Summarization, in Proc. of 10th ACM Inter. Conf. on Multimedia, pp , S.-F. Chang, and D.G. Messerschmitt, Manipulation and compositing of MC-DCT compressed video, IEEE J. Select. Areas Commun., Vol 13, pp.1 11, Jan T. Liu, H.-J Zhang, and F.Qi, A novel video key-frame-extraction algorithm based on perceived motion energy model, IEEE Trans. CSVT, Vol 13, No 10, pp , V. Kobla, D. DeMenthon, and D. Doermann, Detection of slow-motion replay sequences for identifying sports videos, in Proc. IEEE Third Workshop on Multimedia Signal Processing, pp , 1999.
Automatic Video Caption Detection and Extraction in the DCT Compressed Domain
Automatic Video Caption Detection and Extraction in the DCT Compressed Domain Chin-Fu Tsao 1, Yu-Hao Chen 1, Jin-Hau Kuo 1, Chia-wei Lin 1, and Ja-Ling Wu 1,2 1 Communication and Multimedia Laboratory,
More informationStory Unit Segmentation with Friendly Acoustic Perception *
Story Unit Segmentation with Friendly Acoustic Perception * Longchuan Yan 1,3, Jun Du 2, Qingming Huang 3, and Shuqiang Jiang 1 1 Institute of Computing Technology, Chinese Academy of Sciences, Beijing,
More informationDigital Image Stabilization and Its Integration with Video Encoder
Digital Image Stabilization and Its Integration with Video Encoder Yu-Chun Peng, Hung-An Chang, Homer H. Chen Graduate Institute of Communication Engineering National Taiwan University Taipei, Taiwan {b889189,
More informationFast Mode Decision for H.264/AVC Using Mode Prediction
Fast Mode Decision for H.264/AVC Using Mode Prediction Song-Hak Ri and Joern Ostermann Institut fuer Informationsverarbeitung, Appelstr 9A, D-30167 Hannover, Germany ri@tnt.uni-hannover.de ostermann@tnt.uni-hannover.de
More informationGeneration of Sports Highlights Using a Combination of Supervised & Unsupervised Learning in Audio Domain
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Generation of Sports Highlights Using a Combination of Supervised & Unsupervised Learning in Audio Domain Radhakrishan, R.; Xiong, Z.; Divakaran,
More informationAn Automatic Timestamp Replanting Algorithm for Panorama Video Surveillance *
An Automatic Timestamp Replanting Algorithm for Panorama Video Surveillance * Xinguo Yu, Wu Song, Jun Cheng, Bo Qiu, and Bin He National Engineering Research Center for E-Learning, Central China Normal
More informationA Robust Wipe Detection Algorithm
A Robust Wipe Detection Algorithm C. W. Ngo, T. C. Pong & R. T. Chin Department of Computer Science The Hong Kong University of Science & Technology Clear Water Bay, Kowloon, Hong Kong Email: fcwngo, tcpong,
More informationAbout MPEG Compression. More About Long-GOP Video
About MPEG Compression HD video requires significantly more data than SD video. A single HD video frame can require up to six times more data than an SD frame. To record such large images with such a low
More informationPixSO: A System for Video Shot Detection
PixSO: A System for Video Shot Detection Chengcui Zhang 1, Shu-Ching Chen 1, Mei-Ling Shyu 2 1 School of Computer Science, Florida International University, Miami, FL 33199, USA 2 Department of Electrical
More informationCMPT 365 Multimedia Systems. Media Compression - Video
CMPT 365 Multimedia Systems Media Compression - Video Spring 2017 Edited from slides by Dr. Jiangchuan Liu CMPT365 Multimedia Systems 1 Introduction What s video? a time-ordered sequence of frames, i.e.,
More informationVideo De-interlacing with Scene Change Detection Based on 3D Wavelet Transform
Video De-interlacing with Scene Change Detection Based on 3D Wavelet Transform M. Nancy Regina 1, S. Caroline 2 PG Scholar, ECE, St. Xavier s Catholic College of Engineering, Nagercoil, India 1 Assistant
More informationAlgorithms and System for High-Level Structure Analysis and Event Detection in Soccer Video
Algorithms and Sstem for High-Level Structure Analsis and Event Detection in Soccer Video Peng Xu, Shih-Fu Chang, Columbia Universit Aja Divakaran, Anthon Vetro, Huifang Sun, Mitsubishi Electric Advanced
More informationChapter 11.3 MPEG-2. MPEG-2: For higher quality video at a bit-rate of more than 4 Mbps Defined seven profiles aimed at different applications:
Chapter 11.3 MPEG-2 MPEG-2: For higher quality video at a bit-rate of more than 4 Mbps Defined seven profiles aimed at different applications: Simple, Main, SNR scalable, Spatially scalable, High, 4:2:2,
More informationModule 7 VIDEO CODING AND MOTION ESTIMATION
Module 7 VIDEO CODING AND MOTION ESTIMATION Lesson 20 Basic Building Blocks & Temporal Redundancy Instructional Objectives At the end of this lesson, the students should be able to: 1. Name at least five
More informationOne-pass bitrate control for MPEG-4 Scalable Video Coding using ρ-domain
Author manuscript, published in "International Symposium on Broadband Multimedia Systems and Broadcasting, Bilbao : Spain (2009)" One-pass bitrate control for MPEG-4 Scalable Video Coding using ρ-domain
More informationA Linear Approximation Based Method for Noise-Robust and Illumination-Invariant Image Change Detection
A Linear Approximation Based Method for Noise-Robust and Illumination-Invariant Image Change Detection Bin Gao 2, Tie-Yan Liu 1, Qian-Sheng Cheng 2, and Wei-Ying Ma 1 1 Microsoft Research Asia, No.49 Zhichun
More informationReview and Implementation of DWT based Scalable Video Coding with Scalable Motion Coding.
Project Title: Review and Implementation of DWT based Scalable Video Coding with Scalable Motion Coding. Midterm Report CS 584 Multimedia Communications Submitted by: Syed Jawwad Bukhari 2004-03-0028 About
More informationA COST-EFFICIENT RESIDUAL PREDICTION VLSI ARCHITECTURE FOR H.264/AVC SCALABLE EXTENSION
A COST-EFFICIENT RESIDUAL PREDICTION VLSI ARCHITECTURE FOR H.264/AVC SCALABLE EXTENSION Yi-Hau Chen, Tzu-Der Chuang, Chuan-Yung Tsai, Yu-Jen Chen, and Liang-Gee Chen DSP/IC Design Lab., Graduate Institute
More informationFRAME-RATE UP-CONVERSION USING TRANSMITTED TRUE MOTION VECTORS
FRAME-RATE UP-CONVERSION USING TRANSMITTED TRUE MOTION VECTORS Yen-Kuang Chen 1, Anthony Vetro 2, Huifang Sun 3, and S. Y. Kung 4 Intel Corp. 1, Mitsubishi Electric ITA 2 3, and Princeton University 1
More informationVideo Compression An Introduction
Video Compression An Introduction The increasing demand to incorporate video data into telecommunications services, the corporate environment, the entertainment industry, and even at home has made digital
More informationStreaming Video Based on Temporal Frame Transcoding.
Streaming Video Based on Temporal Frame Transcoding. Fadlallah Ali Fadlallah Othman O. Khalifa and Aisha Hassan Abdalla Department of Computer Science Sudan University of Science and Technology Khartoum-SUDAN
More informationSystem Modeling and Implementation of MPEG-4. Encoder under Fine-Granular-Scalability Framework
System Modeling and Implementation of MPEG-4 Encoder under Fine-Granular-Scalability Framework Literature Survey Embedded Software Systems Prof. B. L. Evans by Wei Li and Zhenxun Xiao March 25, 2002 Abstract
More informationExpress Letters. A Simple and Efficient Search Algorithm for Block-Matching Motion Estimation. Jianhua Lu and Ming L. Liou
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 7, NO. 2, APRIL 1997 429 Express Letters A Simple and Efficient Search Algorithm for Block-Matching Motion Estimation Jianhua Lu and
More informationCOMPRESSED DOMAIN SPATIAL SCALING OF MPEG VIDEO BIT- STREAMS WITH COMPARATIVE EVALUATION
COMPRESSED DOMAIN SPATIAL SCALING OF MPEG VIDEO BIT- STREAMS WITH COMPARATIVE EVALUATION M. Mahdi Ghandi, M. Emad Modirzadeh Tehrani, M. R. Hashemi, and Omid Fatemi ESE Department, University of Essex
More informationAdvances of MPEG Scalable Video Coding Standard
Advances of MPEG Scalable Video Coding Standard Wen-Hsiao Peng, Chia-Yang Tsai, Tihao Chiang, and Hsueh-Ming Hang National Chiao-Tung University 1001 Ta-Hsueh Rd., HsinChu 30010, Taiwan pawn@mail.si2lab.org,
More informationInterframe coding A video scene captured as a sequence of frames can be efficiently coded by estimating and compensating for motion between frames pri
MPEG MPEG video is broken up into a hierarchy of layer From the top level, the first layer is known as the video sequence layer, and is any self contained bitstream, for example a coded movie. The second
More informationHIKVISION H.265+ Encoding Technology. Halve Your Bandwidth and Storage Enjoy the Ultra HD and Fluency
HIKVISION H.265+ Encoding Technology Halve Your Bandwidth and Storage Enjoy the Ultra HD and Fluency Table of Contents 1. Background... 3 2. Key Technologies... 3 2.1. Prediction Encoding... 3 2.1.1. P-Frame
More informationBinju Bentex *1, Shandry K. K 2. PG Student, Department of Computer Science, College Of Engineering, Kidangoor, Kottayam, Kerala, India
International Journal of Scientific Research in Computer Science, Engineering and Information Technology 2018 IJSRCSEIT Volume 3 Issue 3 ISSN : 2456-3307 Survey on Summarization of Multiple User-Generated
More informationAdvanced Encoding Features of the Sencore TXS Transcoder
Advanced Encoding Features of the Sencore TXS Transcoder White Paper November 2011 Page 1 (11) www.sencore.com 1.605.978.4600 Revision 1.0 Document Revision History Date Version Description Author 11/7/2011
More informationOutline Introduction MPEG-2 MPEG-4. Video Compression. Introduction to MPEG. Prof. Pratikgiri Goswami
to MPEG Prof. Pratikgiri Goswami Electronics & Communication Department, Shree Swami Atmanand Saraswati Institute of Technology, Surat. Outline of Topics 1 2 Coding 3 Video Object Representation Outline
More informationTitle: Pyramidwise Structuring for Soccer Highlight Extraction. Authors: Ming Luo, Yu-Fei Ma, Hong-Jiang Zhang
Title: Pyramidwise Structuring for Soccer Highlight Extraction Authors: Ming Luo, Yu-Fei Ma, Hong-Jiang Zhang Mailing address: Microsoft Research Asia, 5F, Beijing Sigma Center, 49 Zhichun Road, Beijing
More informationAIIA shot boundary detection at TRECVID 2006
AIIA shot boundary detection at TRECVID 6 Z. Černeková, N. Nikolaidis and I. Pitas Artificial Intelligence and Information Analysis Laboratory Department of Informatics Aristotle University of Thessaloniki
More informationBaseball Game Highlight & Event Detection
Baseball Game Highlight & Event Detection Student: Harry Chao Course Adviser: Winston Hu 1 Outline 1. Goal 2. Previous methods 3. My flowchart 4. My methods 5. Experimental result 6. Conclusion & Future
More informationKey Frame Extraction and Indexing for Multimedia Databases
Key Frame Extraction and Indexing for Multimedia Databases Mohamed AhmedˆÃ Ahmed Karmouchˆ Suhayya Abu-Hakimaˆˆ ÃÃÃÃÃÃÈÃSchool of Information Technology & ˆˆÃ AmikaNow! Corporation Engineering (SITE),
More informationMotion analysis for broadcast tennis video considering mutual interaction of players
14-10 MVA2011 IAPR Conference on Machine Vision Applications, June 13-15, 2011, Nara, JAPAN analysis for broadcast tennis video considering mutual interaction of players Naoto Maruyama, Kazuhiro Fukui
More informationWeek 14. Video Compression. Ref: Fundamentals of Multimedia
Week 14 Video Compression Ref: Fundamentals of Multimedia Last lecture review Prediction from the previous frame is called forward prediction Prediction from the next frame is called forward prediction
More informationComparative Study of Partial Closed-loop Versus Open-loop Motion Estimation for Coding of HDTV
Comparative Study of Partial Closed-loop Versus Open-loop Motion Estimation for Coding of HDTV Jeffrey S. McVeigh 1 and Siu-Wai Wu 2 1 Carnegie Mellon University Department of Electrical and Computer Engineering
More informationScalable Hierarchical Summarization of News Using Fidelity in MPEG-7 Description Scheme
Scalable Hierarchical Summarization of News Using Fidelity in MPEG-7 Description Scheme Jung-Rim Kim, Seong Soo Chun, Seok-jin Oh, and Sanghoon Sull School of Electrical Engineering, Korea University,
More informationA Semi-Automatic 2D-to-3D Video Conversion with Adaptive Key-Frame Selection
A Semi-Automatic 2D-to-3D Video Conversion with Adaptive Key-Frame Selection Kuanyu Ju and Hongkai Xiong Department of Electronic Engineering, Shanghai Jiao Tong University, Shanghai, China ABSTRACT To
More informationReal-time Monitoring System for TV Commercials Using Video Features
Real-time Monitoring System for TV Commercials Using Video Features Sung Hwan Lee, Won Young Yoo, and Young-Suk Yoon Electronics and Telecommunications Research Institute (ETRI), 11 Gajeong-dong, Yuseong-gu,
More informationImage Error Concealment Based on Watermarking
Image Error Concealment Based on Watermarking Shinfeng D. Lin, Shih-Chieh Shie and Jie-Wei Chen Department of Computer Science and Information Engineering,National Dong Hwa Universuty, Hualien, Taiwan,
More informationVIDEO OBJECT SEGMENTATION BY EXTENDED RECURSIVE-SHORTEST-SPANNING-TREE METHOD. Ertem Tuncel and Levent Onural
VIDEO OBJECT SEGMENTATION BY EXTENDED RECURSIVE-SHORTEST-SPANNING-TREE METHOD Ertem Tuncel and Levent Onural Electrical and Electronics Engineering Department, Bilkent University, TR-06533, Ankara, Turkey
More informationA HIGHLY PARALLEL CODING UNIT SIZE SELECTION FOR HEVC. Liron Anavi, Avi Giterman, Maya Fainshtein, Vladi Solomon, and Yair Moshe
A HIGHLY PARALLEL CODING UNIT SIZE SELECTION FOR HEVC Liron Anavi, Avi Giterman, Maya Fainshtein, Vladi Solomon, and Yair Moshe Signal and Image Processing Laboratory (SIPL) Department of Electrical Engineering,
More informationDefinition, Detection, and Evaluation of Meeting Events in Airport Surveillance Videos
Definition, Detection, and Evaluation of Meeting Events in Airport Surveillance Videos Sung Chun Lee, Chang Huang, and Ram Nevatia University of Southern California, Los Angeles, CA 90089, USA sungchun@usc.edu,
More informationCHAPTER 3 SHOT DETECTION AND KEY FRAME EXTRACTION
33 CHAPTER 3 SHOT DETECTION AND KEY FRAME EXTRACTION 3.1 INTRODUCTION The twenty-first century is an age of information explosion. We are witnessing a huge growth in digital data. The trend of increasing
More informationReduction of Blocking artifacts in Compressed Medical Images
ISSN 1746-7659, England, UK Journal of Information and Computing Science Vol. 8, No. 2, 2013, pp. 096-102 Reduction of Blocking artifacts in Compressed Medical Images Jagroop Singh 1, Sukhwinder Singh
More informationRecall precision graph
VIDEO SHOT BOUNDARY DETECTION USING SINGULAR VALUE DECOMPOSITION Λ Z.»CERNEKOVÁ, C. KOTROPOULOS AND I. PITAS Aristotle University of Thessaloniki Box 451, Thessaloniki 541 24, GREECE E-mail: (zuzana, costas,
More informationA New Fast Motion Estimation Algorithm. - Literature Survey. Instructor: Brian L. Evans. Authors: Yue Chen, Yu Wang, Ying Lu.
A New Fast Motion Estimation Algorithm - Literature Survey Instructor: Brian L. Evans Authors: Yue Chen, Yu Wang, Ying Lu Date: 10/19/1998 A New Fast Motion Estimation Algorithm 1. Abstract Video compression
More informationAn Approximate Approach for Mining Recently Frequent Itemsets from Data Streams *
An Approximate Approach for Mining Recently Frequent Itemsets from Data Streams * Jia-Ling Koh and Shu-Ning Shin Department of Computer Science and Information Engineering National Taiwan Normal University
More informationDIGITAL TELEVISION 1. DIGITAL VIDEO FUNDAMENTALS
DIGITAL TELEVISION 1. DIGITAL VIDEO FUNDAMENTALS Television services in Europe currently broadcast video at a frame rate of 25 Hz. Each frame consists of two interlaced fields, giving a field rate of 50
More informationFrequency Band Coding Mode Selection for Key Frames of Wyner-Ziv Video Coding
2009 11th IEEE International Symposium on Multimedia Frequency Band Coding Mode Selection for Key Frames of Wyner-Ziv Video Coding Ghazaleh R. Esmaili and Pamela C. Cosman Department of Electrical and
More informationVideo shot segmentation using late fusion technique
Video shot segmentation using late fusion technique by C. Krishna Mohan, N. Dhananjaya, B.Yegnanarayana in Proc. Seventh International Conference on Machine Learning and Applications, 2008, San Diego,
More informationIn the name of Allah. the compassionate, the merciful
In the name of Allah the compassionate, the merciful Digital Video Systems S. Kasaei Room: CE 315 Department of Computer Engineering Sharif University of Technology E-Mail: skasaei@sharif.edu Webpage:
More informationA Low Bit-Rate Video Codec Based on Two-Dimensional Mesh Motion Compensation with Adaptive Interpolation
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 11, NO. 1, JANUARY 2001 111 A Low Bit-Rate Video Codec Based on Two-Dimensional Mesh Motion Compensation with Adaptive Interpolation
More informationBrowsing News and TAlk Video on a Consumer Electronics Platform Using face Detection
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Browsing News and TAlk Video on a Consumer Electronics Platform Using face Detection Kadir A. Peker, Ajay Divakaran, Tom Lanning TR2005-155
More informationVideo Analysis for Browsing and Printing
Video Analysis for Browsing and Printing Qian Lin, Tong Zhang, Mei Chen, Yining Deng, Brian Atkins HP Laboratories HPL-2008-215 Keyword(s): video mining, video printing, user intent, video panorama, video
More informationEFFICIENT PU MODE DECISION AND MOTION ESTIMATION FOR H.264/AVC TO HEVC TRANSCODER
EFFICIENT PU MODE DECISION AND MOTION ESTIMATION FOR H.264/AVC TO HEVC TRANSCODER Zong-Yi Chen, Jiunn-Tsair Fang 2, Tsai-Ling Liao, and Pao-Chi Chang Department of Communication Engineering, National Central
More informationMotion Estimation for Video Coding Standards
Motion Estimation for Video Coding Standards Prof. Ja-Ling Wu Department of Computer Science and Information Engineering National Taiwan University Introduction of Motion Estimation The goal of video compression
More informationIntroduction to Video Compression
Insight, Analysis, and Advice on Signal Processing Technology Introduction to Video Compression Jeff Bier Berkeley Design Technology, Inc. info@bdti.com http://www.bdti.com Outline Motivation and scope
More informationScene Change Detection Based on Twice Difference of Luminance Histograms
Scene Change Detection Based on Twice Difference of Luminance Histograms Xinying Wang 1, K.N.Plataniotis 2, A. N. Venetsanopoulos 1 1 Department of Electrical & Computer Engineering University of Toronto
More informationContent Based Image Retrieval Using Color Quantizes, EDBTC and LBP Features
Content Based Image Retrieval Using Color Quantizes, EDBTC and LBP Features 1 Kum Sharanamma, 2 Krishnapriya Sharma 1,2 SIR MVIT Abstract- To describe the image features the Local binary pattern (LBP)
More informationVideo Key-Frame Extraction using Entropy value as Global and Local Feature
Video Key-Frame Extraction using Entropy value as Global and Local Feature Siddu. P Algur #1, Vivek. R *2 # Department of Information Science Engineering, B.V. Bhoomraddi College of Engineering and Technology
More informationVideo Quality Analysis for H.264 Based on Human Visual System
IOSR Journal of Engineering (IOSRJEN) ISSN (e): 2250-3021 ISSN (p): 2278-8719 Vol. 04 Issue 08 (August. 2014) V4 PP 01-07 www.iosrjen.org Subrahmanyam.Ch 1 Dr.D.Venkata Rao 2 Dr.N.Usha Rani 3 1 (Research
More informationVideo Coding Using Spatially Varying Transform
Video Coding Using Spatially Varying Transform Cixun Zhang 1, Kemal Ugur 2, Jani Lainema 2, and Moncef Gabbouj 1 1 Tampere University of Technology, Tampere, Finland {cixun.zhang,moncef.gabbouj}@tut.fi
More informationOptimized Watermarking Using Swarm-Based Bacterial Foraging
Journal of Information Hiding and Multimedia Signal Processing c 2009 ISSN 2073-4212 Ubiquitous International Volume 1, Number 1, January 2010 Optimized Watermarking Using Swarm-Based Bacterial Foraging
More informationFast Decision of Block size, Prediction Mode and Intra Block for H.264 Intra Prediction EE Gaurav Hansda
Fast Decision of Block size, Prediction Mode and Intra Block for H.264 Intra Prediction EE 5359 Gaurav Hansda 1000721849 gaurav.hansda@mavs.uta.edu Outline Introduction to H.264 Current algorithms for
More informationDigital Video Processing
Video signal is basically any sequence of time varying images. In a digital video, the picture information is digitized both spatially and temporally and the resultant pixel intensities are quantized.
More information2014 Summer School on MPEG/VCEG Video. Video Coding Concept
2014 Summer School on MPEG/VCEG Video 1 Video Coding Concept Outline 2 Introduction Capture and representation of digital video Fundamentals of video coding Summary Outline 3 Introduction Capture and representation
More informationA Fast Scheme for Downsampling and Upsampling in the DCT
A Fast Scheme for Downsampling and Upsampling in the DCT \ Domain Rakesh Dugad and Narendra Ahuja* Department of Electrical and Computer Engineering Beckman Institute, University of Illinois, Urbana, IL
More informationSearching Video Collections:Part I
Searching Video Collections:Part I Introduction to Multimedia Information Retrieval Multimedia Representation Visual Features (Still Images and Image Sequences) Color Texture Shape Edges Objects, Motion
More informationKeywords-H.264 compressed domain, video surveillance, segmentation and tracking, partial decoding
Volume 4, Issue 4, April 2014 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com Real Time Moving
More informationHigh Efficient Intra Coding Algorithm for H.265/HVC
H.265/HVC における高性能符号化アルゴリズムに関する研究 宋天 1,2* 三木拓也 2 島本隆 1,2 High Efficient Intra Coding Algorithm for H.265/HVC by Tian Song 1,2*, Takuya Miki 2 and Takashi Shimamoto 1,2 Abstract This work proposes a novel
More informationCORRELATION BASED CAR NUMBER PLATE EXTRACTION SYSTEM
CORRELATION BASED CAR NUMBER PLATE EXTRACTION SYSTEM 1 PHYO THET KHIN, 2 LAI LAI WIN KYI 1,2 Department of Information Technology, Mandalay Technological University The Republic of the Union of Myanmar
More informationCompressed-Domain Shot Boundary Detection for H.264/AVC Using Intra Partitioning Maps
biblio.ugent.be The UGent Institutional Repository is the electronic archiving and dissemination platform for all UGent research publications. Ghent University has implemented a mandate stipulating that
More informationImplementation and analysis of Directional DCT in H.264
Implementation and analysis of Directional DCT in H.264 EE 5359 Multimedia Processing Guidance: Dr K R Rao Priyadarshini Anjanappa UTA ID: 1000730236 priyadarshini.anjanappa@mavs.uta.edu Introduction A
More informationVideo Syntax Analysis
1 Video Syntax Analysis Wei-Ta Chu 2008/10/9 Outline 2 Scene boundary detection Key frame selection 3 Announcement of HW #1 Shot Change Detection Goal: automatic shot change detection Requirements 1. Write
More informationFast Motion Estimation for Shape Coding in MPEG-4
358 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 13, NO. 4, APRIL 2003 Fast Motion Estimation for Shape Coding in MPEG-4 Donghoon Yu, Sung Kyu Jang, and Jong Beom Ra Abstract Effective
More informationLow-Power Data Address Bus Encoding Method
Low-Power Data Address Bus Encoding Method Tsung-Hsi Weng, Wei-Hao Chiao, Jean Jyh-Jiun Shann, Chung-Ping Chung, and Jimmy Lu Dept. of Computer Science and Information Engineering, National Chao Tung University,
More informationContext based optimal shape coding
IEEE Signal Processing Society 1999 Workshop on Multimedia Signal Processing September 13-15, 1999, Copenhagen, Denmark Electronic Proceedings 1999 IEEE Context based optimal shape coding Gerry Melnikov,
More informationHigh Efficiency Video Coding. Li Li 2016/10/18
High Efficiency Video Coding Li Li 2016/10/18 Email: lili90th@gmail.com Outline Video coding basics High Efficiency Video Coding Conclusion Digital Video A video is nothing but a number of frames Attributes
More informationVIDEO COMPRESSION STANDARDS
VIDEO COMPRESSION STANDARDS Family of standards: the evolution of the coding model state of the art (and implementation technology support): H.261: videoconference x64 (1988) MPEG-1: CD storage (up to
More informationVC 12/13 T16 Video Compression
VC 12/13 T16 Video Compression Mestrado em Ciência de Computadores Mestrado Integrado em Engenharia de Redes e Sistemas Informáticos Miguel Tavares Coimbra Outline The need for compression Types of redundancy
More informationPERFORMANCE ANALYSIS OF AVS-M AND ITS APPLICATION IN MOBILE ENVIRONMENT
PERFORMANCE ANALYSIS OF AVS-M AND ITS APPLICATION IN MOBILE ENVIRONMENT Under the guidance of Dr. K R. Rao FINAL REPORT By Vidur Vajani (1000679332) vidur.vajani@mavs.uta.edu Introduction AVS stands for
More informationOVERVIEW OF IEEE 1857 VIDEO CODING STANDARD
OVERVIEW OF IEEE 1857 VIDEO CODING STANDARD Siwei Ma, Shiqi Wang, Wen Gao {swma,sqwang, wgao}@pku.edu.cn Institute of Digital Media, Peking University ABSTRACT IEEE 1857 is a multi-part standard for multimedia
More informationVIDEO STABILIZATION WITH L1-L2 OPTIMIZATION. Hui Qu, Li Song
VIDEO STABILIZATION WITH L-L2 OPTIMIZATION Hui Qu, Li Song Institute of Image Communication and Network Engineering, Shanghai Jiao Tong University ABSTRACT Digital videos often suffer from undesirable
More informationMining Quantitative Association Rules on Overlapped Intervals
Mining Quantitative Association Rules on Overlapped Intervals Qiang Tong 1,3, Baoping Yan 2, and Yuanchun Zhou 1,3 1 Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China {tongqiang,
More informationAn Adaptive Cross Search Algorithm for Block Matching Motion Estimation
An Adaptive Cross Search Algorithm for Block Matching Motion Estimation Jiancong Luo', Ishfaq Ahmad' and Xzhang Luo' 1 Department of Computer Science and Engineering, University of Texas at Arlington,
More informationMark Kogan CTO Video Delivery Technologies Bluebird TV
Mark Kogan CTO Video Delivery Technologies Bluebird TV Bluebird TV Is at the front line of the video industry s transition to the cloud. Our multiscreen video solutions and services, which are available
More informationText Area Detection from Video Frames
Text Area Detection from Video Frames 1 Text Area Detection from Video Frames Xiangrong Chen, Hongjiang Zhang Microsoft Research China chxr@yahoo.com, hjzhang@microsoft.com Abstract. Text area detection
More informationBANDWIDTH-EFFICIENT ENCODER FRAMEWORK FOR H.264/AVC SCALABLE EXTENSION. Yi-Hau Chen, Tzu-Der Chuang, Yu-Jen Chen, and Liang-Gee Chen
BANDWIDTH-EFFICIENT ENCODER FRAMEWORK FOR H.264/AVC SCALABLE EXTENSION Yi-Hau Chen, Tzu-Der Chuang, Yu-Jen Chen, and Liang-Gee Chen DSP/IC Design Lab., Graduate Institute of Electronics Engineering, National
More informationEE 5359 MULTIMEDIA PROCESSING SPRING Final Report IMPLEMENTATION AND ANALYSIS OF DIRECTIONAL DISCRETE COSINE TRANSFORM IN H.
EE 5359 MULTIMEDIA PROCESSING SPRING 2011 Final Report IMPLEMENTATION AND ANALYSIS OF DIRECTIONAL DISCRETE COSINE TRANSFORM IN H.264 Under guidance of DR K R RAO DEPARTMENT OF ELECTRICAL ENGINEERING UNIVERSITY
More informationVIDEO streaming applications over the Internet are gaining. Brief Papers
412 IEEE TRANSACTIONS ON BROADCASTING, VOL. 54, NO. 3, SEPTEMBER 2008 Brief Papers Redundancy Reduction Technique for Dual-Bitstream MPEG Video Streaming With VCR Functionalities Tak-Piu Ip, Yui-Lam Chan,
More informationOptimizing the Deblocking Algorithm for. H.264 Decoder Implementation
Optimizing the Deblocking Algorithm for H.264 Decoder Implementation Ken Kin-Hung Lam Abstract In the emerging H.264 video coding standard, a deblocking/loop filter is required for improving the visual
More informationIntegrating Low-Level and Semantic Visual Cues for Improved Image-to-Video Experiences
Integrating Low-Level and Semantic Visual Cues for Improved Image-to-Video Experiences Pedro Pinho, Joel Baltazar, Fernando Pereira Instituto Superior Técnico - Instituto de Telecomunicações IST, Av. Rovisco
More informationComment Extraction from Blog Posts and Its Applications to Opinion Mining
Comment Extraction from Blog Posts and Its Applications to Opinion Mining Huan-An Kao, Hsin-Hsi Chen Department of Computer Science and Information Engineering National Taiwan University, Taipei, Taiwan
More informationEnhanced Hexagon with Early Termination Algorithm for Motion estimation
Volume No - 5, Issue No - 1, January, 2017 Enhanced Hexagon with Early Termination Algorithm for Motion estimation Neethu Susan Idiculay Assistant Professor, Department of Applied Electronics & Instrumentation,
More informationNOVEL APPROACH TO CONTENT-BASED VIDEO INDEXING AND RETRIEVAL BY USING A MEASURE OF STRUCTURAL SIMILARITY OF FRAMES. David Asatryan, Manuk Zakaryan
International Journal "Information Content and Processing", Volume 2, Number 1, 2015 71 NOVEL APPROACH TO CONTENT-BASED VIDEO INDEXING AND RETRIEVAL BY USING A MEASURE OF STRUCTURAL SIMILARITY OF FRAMES
More informationI. INTRODUCTION. Figure-1 Basic block of text analysis
ISSN: 2349-7637 (Online) (RHIMRJ) Research Paper Available online at: www.rhimrj.com Detection and Localization of Texts from Natural Scene Images: A Hybrid Approach Priyanka Muchhadiya Post Graduate Fellow,
More informationVideo Summarization and Browsing Using Growing Cell Structures
Video Summarization and Browsing Using Growing Cell Structures Irena Koprinska and James Clark School of Information Technologies, The University of Sydney Madsen Building F09, Sydney NSW 2006, Australia
More informationHighlight Ranking for Broadcast Tennis Video Based on Multi-modality Analysis and Relevance Feedback
Highlight Ranking for Broadcast Tennis Video Based on Multi-modality Analysis and Relevance Feedback Guangyu Zhu 1, Qingming Huang 2, and Yihong Gong 3 1 Harbin Institute of Technology, Harbin, P.R. China
More information