Vector Bank Based Multimedia Codec System-on-a-Chip (SoC) Design
|
|
- Martina Houston
- 5 years ago
- Views:
Transcription
1 th International Symposium on Pervasive Systems, Algorithms, and Networks Vector Bank Based Multimedia Codec System-on-a-Chip (SoC) Design Ruei-Xi Chen, Wei Zhao, Jeffrey Fan andasaddavari Computer Science and Information Engineering, St. Johns University, Taipei, Taiwan Electrical and Computer Engineering, Florida International University, Miami, Florida, USA Electrical and Computer Engineering, West Virginia University Institute of Technology, Montgomery, West Virginia, USA Abstract In this paper, we present a design architecture of implementing a Vector Bank into video encoder system, namely, an H.264 encoder, in order to detect and analyze the moving objects within the specific area. Also, we believe that the transmitting bandwidth could be saved with the implementation of Vector Bank design. Motion Estimation is a common technology for today s video codec. By abstracting the vector data from the Motion Estimation block using the motion detection method and with the application of Laplacian of Gaussian operator, we could obtain the object motion data generated by up to 16 reference frames. Thus, it could save the bandwidth, processing load, and memory resources dramatically. Keywords-H.264; Edge Detection; Motion Estimation I. INTRODUCTION People have been using visual sensors to setup surveillance system for years. However, we hardly find any applications that can be used widely for home security purpose due to the lack of ability of data transmitting and analyzing limitation. As you can see in a simple platform that we commonly used for the institutional security in Figure-1, analog sensors along with analog network transfer the TV signals into the eyes of a guard in security room. However, analog signal is good at transmitting, but weak in analyzing, store, and encryption. If we need real-time alert, in most case, human intervention is a must. Apparently, that won t work for regular families in home security. Things have been changed and the whole world is becoming digital. Today, we could purchase a digital visual sensor from any free market. The price is reasonably low and they all do have a video encoding chip inside the camera. But still, the solution is not applicable for home use in some way. As you can see in Figure-2, since most video compression codec are resource consuming, we need a powerful computer to decompress the video data coming from all the sensors and analyze them in real time manner. Definitely, it is not something for home use. The technique we are proposing today is to add a vector bank on a typical video codec core, and use motion object detection method plus boundary detect operator to identify the motion object. Firstly, an H.264/AVC [1] (also called as MPEG-4 Part 10) is becoming the most popular video encoding and Figure 1. Analog Visual Sensors network for Secure Surveillance System decoding standard today. It is developed by the ITU-T (International Telecommunication Union - Telecommunication Standardization Sector) and MPEG (ISO/IEC Moving Picture Experts Group) and it has an advanced compression ratio that is about 50% in size compared to the previous generations, such as MPEG-2 [2]. Figure 2. Digital Visual Sensors network for Secure Surveillance System An important part of H.264 is called Motion Estimation (ME), as shown in Figure-3 [3]. H.264 Encoder pushes both /09 $ IEEE DOI /I-SPAN
2 current frame and reference frames (i.e. previous frames) to the ME block. The ME block will analyze the similarity of the Marco Blocks (MB) between the current frame and several reference frames. Finally, the relations from ME block are called Motion Vectors. Figure 3. General H.264 Encoder Core Architecture Moving object detection and tracking technique has been studied for years. It is served widely in different areas, such as video surveillance, machine-human interfaces and authentication systems. There are different algorithms today in use to track moving objects [4] [5] [6] [7]. Most of them are using the frame differences of the neighbor frames to detect moving objects. In this paper, we use Motion Vectors generated by H.264 encoder to indicate the difference between two frames and moving objects. After we detect the moving objects using the vector data coming out of the H.264 encoder, we pass those vectors into the edge detection unit. There are several edge detection operators [8] that we can use. In this paper, we suggest two operators: a first-derivative operator Sobel or a secondderivative operator Laplacian of Gaussian operator. The rest of the paper is organized as follows. The Vector Bank and Motion Detection based on vectors will be introduced in Section 2. The edge detection operator will be mentioned in section 3. After that, we will demonstrate some experimental results in Section 4. Finally, the conclusion will be described at Section 5. II. VECTOR BASED MOVING OBJECT DETECTION Basically, Vector Bank is a memory based analyzer which should be attached to the Motion Estimation block of an typical H.264 hard encoder [9] [10]. A. Motion Estimation and Motion Vectors Figure-4 [3] shows portion of a typical Motion Vector Map of a video encoding procedure. With current frame and reference frames (decoded previous frames), the Motion Estimation Block generates the Macro-Block based Motion Vectors. These vectors along with residues are going to be transformed, quantized and compressed into video codes. And the Motion Estimation Block will dump the Vectors so that next MB would come in. In general, if we want to analyze the vector information inside the video code, we need to decompress the video file to see it again. Generally, an H.264Standard Definition (SD) file (e.g.ntsc 480pfile) would be decoded in real time by a full-running Pentium-4 CPU platform. If we simply have 2 video cameras, we need two PCs. And if the Video Sensor is HD (High Definition, e.g. 1080p), it is almost impossible for us to decode it in real-time, even harder for us to implement other algorithms to detect the motion object by the motion vectors. B. Vector Bank As you can see from Figure-6, the Vector Bank grabs Motion Vectors from the output of the Motion Estimation Block. With a queue, the Vector Bank could recover the Block-Based motion vectors back to frame-based. It is important because motion objects are base on frames but not Marco-Blocks. Figure 5. Block Implement Vector Bank into a typical H.264 Motion Estimation Figure 4. A typical Motion Vector Map in H.264 encoding procedure C. Moving Object Detection Basically, a digital camera for surveillance purpose will be placed with fixed and still location. That means the picture will have still or almost steady background. In most cases, the background won t move as there are no vector yields. However, if any movement occurs, the module with vector banks would generate a non-zero interrupt to the CPU. Then the CPU (or a programmed embedded DSP) will process the vector data in order to get the information of the moving object. Here is an example of how we identify moving objects. Figure-6 shows 2 frames of a home video taken by a steady 516
3 III. EDGE DETECTION OPERATOR As one important component of theory of Computer Vision, Edge Detection is well developed and widely used for Digital Image Processing Field. There are a lot of edge detection algorithms, including the first-derivative operators and second-derivative operators. First-derivative operators such as the Roberts, Prewitt and Sobel [8], can detect the edge of an image in one dimension (horizontal or vertical), while second-derivative operators, such as Laplacian operator could detect in both dimensions at the same time. In this paper, we propose two most famous edge operators, Sobel and Laplacian of Gaussian. Figure 6. An example 2 frame of home video camcorder. The only moving object here is a person. Two frames are taken with the time interval of 0.3 seconds, and the field that we see in the Figure-6 is only a portion of the whole frame. With H.264 motion estimation algorithm, vectors of MBs have been generated by the differences from two frames. And after the Vector Bank collected every Motion Vectors, it should have a view of Figure-7. As you can see, the vectors are not all the same for every individual MB, but the still background has no vector at all in this case. That could easily isolate the motion object from the background. If a programmable DSP or intelligent CPU is provided, the object detection would be more smoothly and the direction and speed of the object could be predictable. Figure 8. The Sobel Operator 3-D Plot in MatLab A. Sobel Operator The Sobel operator is a first-derivative edge detection operator. It is simple and easy to realize in most cases. But in order to detect a 2-D image edge, we need to run Sobel twice with different directions. A typical Sobel bi-directional kernel (also shown in Figure-8): G y = (1) and G x = (2) Figure 7. The Motion Vector indicate the frame difference of two frames G x and G y can be combined together to get the absolute magnitude of the gradient: G = G 2 x + G 2 y (3) for the fast computation, the magnitude could also be approximate computed as: G = G x + G y (4) 517
4 Thus, the approximate kernel for 2-D sobel detection operator is: G = (z 1 +2 z 2 + z 3 ) (z 7 +2 z 8 + z 9 ) (5) + (z 3 +2 z 6 + z 9 ) (z 1 +2 z 4 + z 7 ) B. Laplacian of Gaussian (LoG) Operator The Laplacian of Gaussian (LoG) Operator is a seconddirevative edge operator, the 2-D function is going to be: 2 f = 2 f x f y 2 (6) The typical Gaussian Kernel with width σ is: G σ = 1 e x2 +y 2 2σ 2 (7) 2πσ IV. EXPERIMENTAL RESULT A. Experiment Assumptions Consider a typical home security video surveillance sensor monitoring a specific area that contains moving objects, public areas and restricted areas shown in the Figure-10. In this case, we have monitored every possible movement in addition to the restricted area. If the moving object is approaching the restricted area (e.g. private garden or yard), then our system should siren an alert and tries to locate the object. So, the Laplacian of Gaussian will be: 2 G σ = 2 G σ x G σ y 2 (8) Variable x and y is equal in this equation, we determine the xpartfirst: 2 G σ x 2 = x2 σ 2 σ 4 e x 2 +y 2 2σ 2 (9) Let x 2 +y 2 = r 2, and put x, y together back to the equation: 2 G σ = x2 + y 2 2σ 2 σ 4 e x 2 +y 2 2σ 2 = r2 2σ 2 σ 4 e r 2 2σ 2 (10) Figure 10. The Experiment Scene Setup B. LoG result without Motion Vector Bank As we mentioned in the last section, the LoG algorithm is for the still image to use color differential boundary to detect object. But with still image, it is easy to imagine that the boundary of the moving object should be hard to detected and obtained because of the other high-frequency spatial color signals. Figure-11 shows the output for the LoG algorithm from a single frame input of our video. Figure 9. The Laplacian of Gaussian 3D Plot in MatLab Finally, with the selection of σ, wefind the 9 9 digital approximation of equation [9]: (11) Figure 11. The Laplacian of Gaussian (LoG) output for a single frame C. LoG result with Motion Vector Bank In comparison to color-based LoG processing, the vector-based LoG processing has 2 important advantages: 518
5 1) Result of Vector different will not contain still color noises. No matter how colorful the still background is, the Vector-Based LoG result would just contain the moving object(s). 2) Vector-Based LoG processing would be more efficient. Instead of processing 16x16 (256) color points, each 16x16 Macro-Block would generate one Vector data. That is a 256 times saving. Let s take a look the result of the vector-based LoG processing Figure-12. The only result is two moving object borders (the background is for readers to better understand those borders). Figure 13. The Laplacian of Gaussian (LoG) output for a single frame compressed video data. The proposed approach could save the bandwidth when there are more than one visual camera out there which could share the bandwidth with equal priorities. Figure 12. The Laplacian of Gaussian (LoG) output for a single frame In the real algorithm, we select the appropriate threshold to achieve the best results. We assign threshold =0.7 for the color frame LoG and threshold = 0.5 for Vector frame LoG. In this case, the color frame LoG threshold tolerance is quite small that either 0.6 or 0.8 would mess up the whole picture because of the large variety of color schemes. But for the Motion Vectors, they are quite same in the case. Even if we use as the vector, the result will still remain the same. D. Border violation detection and feedback Border violation detection is based on the result of moving object border output of Vector LoG processing. We can easily detect that the object 1 is inside the pre-defined restricted area, while object 2 is in the public area. So, our system should start to give the feedback that signals the alert, while starting to store the H.264 streaming data from this point on. V. CONCLUSION The Vector Bank based H.264 architecture could abstract the motion vectors during the encoding processing. By using a few steps of mathematical analysis, such as Laplacian of Gaussian filter, we could locate and identify the moving object. Furthermore, the Vector Bank could tell if there is movement in the observed area, that would be the key switch to start recording or transmitting the 1) An extended memory structure for H.264 is not hard to build. The cost of the implementation would not be higher than today s video encoder chips. It means the proposed approach is affordable and achievable. 2) Never need a separate computer (or people) to monitor the video stream. Make home-based surveillance network sensor possible. 3) Sensors do not need to stream out the video data when there is no occurrence of moving violations. That saves the bandwidth of the overall surveillance networks. 4) The surveillance video could only be taken while moving violation is taking place. This could potentially save the memory resources dramatically. REFERENCES [1] Joint Video Team of ITU-T and ISO/IEC JTC 1, Draft ITU- T recommendation and final draft international standard of joint video specification (ITU-T Rec. H.264 ISO/IEC AVC), Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG, Document JVT-GO50, December [2] R. Chen, W. Zhao, Q. Liu, J. Fan, Efficient H.264 architecture using modular bandwidth estimation, IEEE 5th International Conference on Embedded Software and Systems (ICESS 08), pp , Chengdu, China, July 29-31, [3] I. E. G. Richardson, H.264 and mpeg-4 video compression, pp , August [4] D. Li, Moving objects detection by block comparison, Electronics, Circuits and Systems, vol. 1, pp , Dec, [5] R. Cucchiara, C. Grana, M. Piccardi and A. Prati, Statistic and knowledge-based moving object detection in traffic scenes, IEEE Proceedings. Intelligent Transportation Systems, pp , Oct,
6 [6] Y.K. Jung, K.W. Lee and Y.S. Ho, Content-based event retrieval using semantic scene interpretation for automated traffic surveillance, IEEE Transactions on Intelligent Transportation Systems, vol. 2, pp , Sep, [7] R. Montoliu and F. Pla, Multiple parametric motion model estimation and segmentation, ICIP 2001, vol. 2, pp , Oct, [8] R. C. Gonzalez and R. E. Woods, Digital image processing, vol. 10, no. 2, pp , [9] W. Zhao, Z. Luo, Jeffrey Fan, S. Tan, Vector edge detection in H.264 Implementation, IEEE 5th International Conference on Embedded Software and Systems Symposia (ISHSO 08), pp , Chengdu, China, July 29-31, [10] W. Zhao, Jeffrey Fan, A. Davari, Vector bank based target tracking via vision sensors in aviation systems, IEEE 41st Southeastern Symposium on System Theory (SSST 09), pp , Tullahoma, TN, March 15-17,
International Journal of Emerging Technology and Advanced Engineering Website: (ISSN , Volume 2, Issue 4, April 2012)
A Technical Analysis Towards Digital Video Compression Rutika Joshi 1, Rajesh Rai 2, Rajesh Nema 3 1 Student, Electronics and Communication Department, NIIST College, Bhopal, 2,3 Prof., Electronics and
More informationDesign Considerations of SOPC-Based H.264/AVC Systems
Design Considerations of SOPC-Based H.26/AVC Systems Wei Zhao, Charles Castello, Jeffrey Fan Department of Electrical and Computer Engineering, Florida International University, Miami, Florida, USA Abstract
More informationUpcoming Video Standards. Madhukar Budagavi, Ph.D. DSPS R&D Center, Dallas Texas Instruments Inc.
Upcoming Video Standards Madhukar Budagavi, Ph.D. DSPS R&D Center, Dallas Texas Instruments Inc. Outline Brief history of Video Coding standards Scalable Video Coding (SVC) standard Multiview Video Coding
More informationReducing/eliminating visual artifacts in HEVC by the deblocking filter.
1 Reducing/eliminating visual artifacts in HEVC by the deblocking filter. EE5359 Multimedia Processing Project Proposal Spring 2014 The University of Texas at Arlington Department of Electrical Engineering
More informationNEW CAVLC ENCODING ALGORITHM FOR LOSSLESS INTRA CODING IN H.264/AVC. Jin Heo, Seung-Hwan Kim, and Yo-Sung Ho
NEW CAVLC ENCODING ALGORITHM FOR LOSSLESS INTRA CODING IN H.264/AVC Jin Heo, Seung-Hwan Kim, and Yo-Sung Ho Gwangju Institute of Science and Technology (GIST) 261 Cheomdan-gwagiro, Buk-gu, Gwangju, 500-712,
More informationFast frame memory access method for H.264/AVC
Fast frame memory access method for H.264/AVC Tian Song 1a), Tomoyuki Kishida 2, and Takashi Shimamoto 1 1 Computer Systems Engineering, Department of Institute of Technology and Science, Graduate School
More informationTitle Adaptive Lagrange Multiplier for Low Bit Rates in H.264.
Provided by the author(s) and University College Dublin Library in accordance with publisher policies. Please cite the published version when available. Title Adaptive Lagrange Multiplier for Low Bit Rates
More informationDeblocking Filter Algorithm with Low Complexity for H.264 Video Coding
Deblocking Filter Algorithm with Low Complexity for H.264 Video Coding Jung-Ah Choi and Yo-Sung Ho Gwangju Institute of Science and Technology (GIST) 261 Cheomdan-gwagiro, Buk-gu, Gwangju, 500-712, Korea
More informationAdvanced Video Coding: The new H.264 video compression standard
Advanced Video Coding: The new H.264 video compression standard August 2003 1. Introduction Video compression ( video coding ), the process of compressing moving images to save storage space and transmission
More informationEFFICIENT PU MODE DECISION AND MOTION ESTIMATION FOR H.264/AVC TO HEVC TRANSCODER
EFFICIENT PU MODE DECISION AND MOTION ESTIMATION FOR H.264/AVC TO HEVC TRANSCODER Zong-Yi Chen, Jiunn-Tsair Fang 2, Tsai-Ling Liao, and Pao-Chi Chang Department of Communication Engineering, National Central
More informationIMPROVED CONTEXT-ADAPTIVE ARITHMETIC CODING IN H.264/AVC
17th European Signal Processing Conference (EUSIPCO 2009) Glasgow, Scotland, August 24-28, 2009 IMPROVED CONTEXT-ADAPTIVE ARITHMETIC CODING IN H.264/AVC Damian Karwowski, Marek Domański Poznań University
More informationAn Efficient Table Prediction Scheme for CAVLC
An Efficient Table Prediction Scheme for CAVLC 1. Introduction Jin Heo 1 Oryong-Dong, Buk-Gu, Gwangju, 0-712, Korea jinheo@gist.ac.kr Kwan-Jung Oh 1 Oryong-Dong, Buk-Gu, Gwangju, 0-712, Korea kjoh81@gist.ac.kr
More informationSTUDY AND IMPLEMENTATION OF VIDEO COMPRESSION STANDARDS (H.264/AVC, DIRAC)
STUDY AND IMPLEMENTATION OF VIDEO COMPRESSION STANDARDS (H.264/AVC, DIRAC) EE 5359-Multimedia Processing Spring 2012 Dr. K.R Rao By: Sumedha Phatak(1000731131) OBJECTIVE A study, implementation and comparison
More informationFast Decision of Block size, Prediction Mode and Intra Block for H.264 Intra Prediction EE Gaurav Hansda
Fast Decision of Block size, Prediction Mode and Intra Block for H.264 Intra Prediction EE 5359 Gaurav Hansda 1000721849 gaurav.hansda@mavs.uta.edu Outline Introduction to H.264 Current algorithms for
More informationOne-pass bitrate control for MPEG-4 Scalable Video Coding using ρ-domain
Author manuscript, published in "International Symposium on Broadband Multimedia Systems and Broadcasting, Bilbao : Spain (2009)" One-pass bitrate control for MPEG-4 Scalable Video Coding using ρ-domain
More informationFast Wavelet-based Macro-block Selection Algorithm for H.264 Video Codec
Proceedings of the International MultiConference of Engineers and Computer Scientists 8 Vol I IMECS 8, 19-1 March, 8, Hong Kong Fast Wavelet-based Macro-block Selection Algorithm for H.64 Video Codec Shi-Huang
More informationImproving the quality of H.264 video transmission using the Intra-Frame FEC over IEEE e networks
Improving the quality of H.264 video transmission using the Intra-Frame FEC over IEEE 802.11e networks Seung-Seok Kang 1,1, Yejin Sohn 1, and Eunji Moon 1 1Department of Computer Science, Seoul Women s
More informationComparison of Some Motion Detection Methods in cases of Single and Multiple Moving Objects
Comparison of Some Motion Detection Methods in cases of Single and Multiple Moving Objects Shamir Alavi Electrical Engineering National Institute of Technology Silchar Silchar 788010 (Assam), India alavi1223@hotmail.com
More informationRECOMMENDATION ITU-R BT
Rec. ITU-R BT.1687-1 1 RECOMMENDATION ITU-R BT.1687-1 Video bit-rate reduction for real-time distribution* of large-screen digital imagery applications for presentation in a theatrical environment (Question
More informationDepartment of Electrical Engineering
Department of Electrical Engineering Multimedia Processing Spring 2011 IMPLEMENTATION OF H.264/AVC, AVS China Part 7 and Dirac VIDEO CODING STANDARDS INSTRUCTOR Dr. K R. Rao Term Project Sharan K Chandrashekar
More informationA Novel Deblocking Filter Algorithm In H.264 for Real Time Implementation
2009 Third International Conference on Multimedia and Ubiquitous Engineering A Novel Deblocking Filter Algorithm In H.264 for Real Time Implementation Yuan Li, Ning Han, Chen Chen Department of Automation,
More informationWhite paper: Video Coding A Timeline
White paper: Video Coding A Timeline Abharana Bhat and Iain Richardson June 2014 Iain Richardson / Vcodex.com 2007-2014 About Vcodex Vcodex are world experts in video compression. We provide essential
More informationModule 7 VIDEO CODING AND MOTION ESTIMATION
Module 7 VIDEO CODING AND MOTION ESTIMATION Lesson 20 Basic Building Blocks & Temporal Redundancy Instructional Objectives At the end of this lesson, the students should be able to: 1. Name at least five
More informationMediaTek High Efficiency Video Coding
MediaTek High Efficiency Video Coding MediaTek White Paper October 2014 MediaTek has pioneered the HEVC in mobile devices and will do the same for TVs by enabling HEVC in 4K TVs in during 2015. MediaTek
More informationPerformance Analysis of DIRAC PRO with H.264 Intra frame coding
Performance Analysis of DIRAC PRO with H.264 Intra frame coding Presented by Poonam Kharwandikar Guided by Prof. K. R. Rao What is Dirac? Hybrid motion-compensated video codec developed by BBC. Uses modern
More informationOptimizing the Deblocking Algorithm for. H.264 Decoder Implementation
Optimizing the Deblocking Algorithm for H.264 Decoder Implementation Ken Kin-Hung Lam Abstract In the emerging H.264 video coding standard, a deblocking/loop filter is required for improving the visual
More informationPupil Localization Algorithm based on Hough Transform and Harris Corner Detection
Pupil Localization Algorithm based on Hough Transform and Harris Corner Detection 1 Chongqing University of Technology Electronic Information and Automation College Chongqing, 400054, China E-mail: zh_lian@cqut.edu.cn
More informationComparison between Various Edge Detection Methods on Satellite Image
Comparison between Various Edge Detection Methods on Satellite Image H.S. Bhadauria 1, Annapurna Singh 2, Anuj Kumar 3 Govind Ballabh Pant Engineering College ( Pauri garhwal),computer Science and Engineering
More informationH.264/AVC BASED NEAR LOSSLESS INTRA CODEC USING LINE-BASED PREDICTION AND MODIFIED CABAC. Jung-Ah Choi, Jin Heo, and Yo-Sung Ho
H.264/AVC BASED NEAR LOSSLESS INTRA CODEC USING LINE-BASED PREDICTION AND MODIFIED CABAC Jung-Ah Choi, Jin Heo, and Yo-Sung Ho Gwangju Institute of Science and Technology {jachoi, jinheo, hoyo}@gist.ac.kr
More informationA Dedicated Hardware Solution for the HEVC Interpolation Unit
XXVII SIM - South Symposium on Microelectronics 1 A Dedicated Hardware Solution for the HEVC Interpolation Unit 1 Vladimir Afonso, 1 Marcel Moscarelli Corrêa, 1 Luciano Volcan Agostini, 2 Denis Teixeira
More informationMotion Estimation for Video Coding Standards
Motion Estimation for Video Coding Standards Prof. Ja-Ling Wu Department of Computer Science and Information Engineering National Taiwan University Introduction of Motion Estimation The goal of video compression
More informationInvestigation of the GoP Structure for H.26L Video Streams
Investigation of the GoP Structure for H.26L Video Streams F. Fitzek P. Seeling M. Reisslein M. Rossi M. Zorzi acticom GmbH mobile networks R & D Group Germany [fitzek seeling]@acticom.de Arizona State
More informationBIG DATA-DRIVEN FAST REDUCING THE VISUAL BLOCK ARTIFACTS OF DCT COMPRESSED IMAGES FOR URBAN SURVEILLANCE SYSTEMS
BIG DATA-DRIVEN FAST REDUCING THE VISUAL BLOCK ARTIFACTS OF DCT COMPRESSED IMAGES FOR URBAN SURVEILLANCE SYSTEMS Ling Hu and Qiang Ni School of Computing and Communications, Lancaster University, LA1 4WA,
More informationOverview of H.264 and Audio Video coding Standards (AVS) of China
Overview of H.264 and Audio Video coding Standards (AVS) of China Prediction is difficult - especially of the future. Bohr (1885-1962) Submitted by: Kaustubh Vilas Dhonsale 5359 Multimedia Processing Spring
More informationPerformance Comparison between DWT-based and DCT-based Encoders
, pp.83-87 http://dx.doi.org/10.14257/astl.2014.75.19 Performance Comparison between DWT-based and DCT-based Encoders Xin Lu 1 and Xuesong Jin 2 * 1 School of Electronics and Information Engineering, Harbin
More informationImproved Context-Based Adaptive Binary Arithmetic Coding in MPEG-4 AVC/H.264 Video Codec
Improved Context-Based Adaptive Binary Arithmetic Coding in MPEG-4 AVC/H.264 Video Codec Abstract. An improved Context-based Adaptive Binary Arithmetic Coding (CABAC) is presented for application in compression
More informationEE 5359 Low Complexity H.264 encoder for mobile applications. Thejaswini Purushotham Student I.D.: Date: February 18,2010
EE 5359 Low Complexity H.264 encoder for mobile applications Thejaswini Purushotham Student I.D.: 1000-616 811 Date: February 18,2010 Fig 1: Basic coding structure for H.264 /AVC for a macroblock [1] .The
More informationAdaptation of Scalable Video Coding to Packet Loss and its Performance Analysis
Adaptation of Scalable Video Coding to Packet Loss and its Performance Analysis Euy-Doc Jang *, Jae-Gon Kim *, Truong Thang**,Jung-won Kang** *Korea Aerospace University, 100, Hanggongdae gil, Hwajeon-dong,
More informationReduced Frame Quantization in Video Coding
Reduced Frame Quantization in Video Coding Tuukka Toivonen and Janne Heikkilä Machine Vision Group Infotech Oulu and Department of Electrical and Information Engineering P. O. Box 500, FIN-900 University
More informationComplexity Reduced Mode Selection of H.264/AVC Intra Coding
Complexity Reduced Mode Selection of H.264/AVC Intra Coding Mohammed Golam Sarwer 1,2, Lai-Man Po 1, Jonathan Wu 2 1 Department of Electronic Engineering City University of Hong Kong Kowloon, Hong Kong
More informationDigital Image Stabilization and Its Integration with Video Encoder
Digital Image Stabilization and Its Integration with Video Encoder Yu-Chun Peng, Hung-An Chang, Homer H. Chen Graduate Institute of Communication Engineering National Taiwan University Taipei, Taiwan {b889189,
More informationPart 1 of 4. MARCH
Presented by Brought to You by Part 1 of 4 MARCH 2004 www.securitysales.com A1 Part1of 4 Essentials of DIGITAL VIDEO COMPRESSION By Bob Wimmer Video Security Consultants cctvbob@aol.com AT A GLANCE Compression
More informationComplexity Reduction Tools for MPEG-2 to H.264 Video Transcoding
WSEAS ransactions on Information Science & Applications, Vol. 2, Issues, Marc 2005, pp. 295-300. Complexity Reduction ools for MPEG-2 to H.264 Video ranscoding HARI KALVA, BRANKO PELJANSKI, and BORKO FURH
More informationOptimized architectures of CABAC codec for IA-32-, DSP- and FPGAbased
Optimized architectures of CABAC codec for IA-32-, DSP- and FPGAbased platforms Damian Karwowski, Marek Domański Poznan University of Technology, Chair of Multimedia Telecommunications and Microelectronics
More information[30] Dong J., Lou j. and Yu L. (2003), Improved entropy coding method, Doc. AVS Working Group (M1214), Beijing, Chaina. CHAPTER 4
[30] Dong J., Lou j. and Yu L. (3), Improved entropy coding method, Doc. AVS Working Group (M1214), Beijing, Chaina. CHAPTER 4 Algorithm for Implementation of nine Intra Prediction Modes in MATLAB and
More informationVideo Compression An Introduction
Video Compression An Introduction The increasing demand to incorporate video data into telecommunications services, the corporate environment, the entertainment industry, and even at home has made digital
More informationAutomatic Shadow Removal by Illuminance in HSV Color Space
Computer Science and Information Technology 3(3): 70-75, 2015 DOI: 10.13189/csit.2015.030303 http://www.hrpub.org Automatic Shadow Removal by Illuminance in HSV Color Space Wenbo Huang 1, KyoungYeon Kim
More informationAn Edge Based Adaptive Interpolation Algorithm for Image Scaling
An Edge Based Adaptive Interpolation Algorithm for Image Scaling Wanli Chen, Hongjian Shi Department of Electrical and Electronic Engineering Southern University of Science and Technology, Shenzhen, Guangdong,
More informationObjective: Introduction: To: Dr. K. R. Rao. From: Kaustubh V. Dhonsale (UTA id: ) Date: 04/24/2012
To: Dr. K. R. Rao From: Kaustubh V. Dhonsale (UTA id: - 1000699333) Date: 04/24/2012 Subject: EE-5359: Class project interim report Proposed project topic: Overview, implementation and comparison of Audio
More informationUsing Shift Number Coding with Wavelet Transform for Image Compression
ISSN 1746-7659, England, UK Journal of Information and Computing Science Vol. 4, No. 3, 2009, pp. 311-320 Using Shift Number Coding with Wavelet Transform for Image Compression Mohammed Mustafa Siddeq
More informationPattern based Residual Coding for H.264 Encoder *
Pattern based Residual Coding for H.264 Encoder * Manoranjan Paul and Manzur Murshed Gippsland School of Information Technology, Monash University, Churchill, Vic-3842, Australia E-mail: {Manoranjan.paul,
More informationJPEG Compression Using MATLAB
JPEG Compression Using MATLAB Anurag, Sonia Rani M.Tech Student, HOD CSE CSE Department, ITS Bhiwani India ABSTRACT Creating, editing, and generating s in a very regular system today is a major priority.
More informationDetection and Classification of a Moving Object in a Video Stream
Detection and Classification of a Moving Object in a Video Stream Asim R. Aldhaheri and Eran A. Edirisinghe Abstract In this paper we present a new method for detecting and classifying moving objects into
More informationAnalysis of Motion Estimation Algorithm in HEVC
Analysis of Motion Estimation Algorithm in HEVC Multimedia Processing EE5359 Spring 2014 Update: 2/27/2014 Advisor: Dr. K. R. Rao Department of Electrical Engineering University of Texas, Arlington Tuan
More informationSAD implementation and optimization for H.264/AVC encoder on TMS320C64 DSP
SETIT 2007 4 th International Conference: Sciences of Electronic, Technologies of Information and Telecommunications March 25-29, 2007 TUNISIA SAD implementation and optimization for H.264/AVC encoder
More informationEE Low Complexity H.264 encoder for mobile applications
EE 5359 Low Complexity H.264 encoder for mobile applications Thejaswini Purushotham Student I.D.: 1000-616 811 Date: February 18,2010 Objective The objective of the project is to implement a low-complexity
More informationTech Note - 05 Surveillance Systems that Work! Calculating Recorded Volume Disk Space
Tech Note - 05 Surveillance Systems that Work! Surveillance Systems Calculating required storage drive (disk space) capacity is sometimes be a rather tricky business. This Tech Note is written to inform
More informationMegapixel Video for. Part 2 of 4. Brought to You by. Presented by Video Security Consultants
rought to You by 2009 Video Security Consultants Presented by Part 2 of 4 A1 Part 2 of 4 How to Avert a Compression Depression Illustration by Jerry King While bandwidth is widening, larger video systems
More informationInternational Journal of Advance Engineering and Research Development
Scientific Journal of Impact Factor (SJIF): 4.72 International Journal of Advance Engineering and Research Development Volume 4, Issue 11, November -2017 e-issn (O): 2348-4470 p-issn (P): 2348-6406 Comparative
More informationCONTENT ADAPTIVE COMPLEXITY REDUCTION SCHEME FOR QUALITY/FIDELITY SCALABLE HEVC
CONTENT ADAPTIVE COMPLEXITY REDUCTION SCHEME FOR QUALITY/FIDELITY SCALABLE HEVC Hamid Reza Tohidypour, Mahsa T. Pourazad 1,2, and Panos Nasiopoulos 1 1 Department of Electrical & Computer Engineering,
More informationFast Mode Decision for H.264/AVC Using Mode Prediction
Fast Mode Decision for H.264/AVC Using Mode Prediction Song-Hak Ri and Joern Ostermann Institut fuer Informationsverarbeitung, Appelstr 9A, D-30167 Hannover, Germany ri@tnt.uni-hannover.de ostermann@tnt.uni-hannover.de
More informationA REAL-TIME H.264/AVC ENCODER&DECODER WITH VERTICAL MODE FOR INTRA FRAME AND THREE STEP SEARCH ALGORITHM FOR P-FRAME
A REAL-TIME H.264/AVC ENCODER&DECODER WITH VERTICAL MODE FOR INTRA FRAME AND THREE STEP SEARCH ALGORITHM FOR P-FRAME Dr. Mohammed H. Al-Jammas 1 and Mrs. Noor N. Hamdoon 2 1 Deputy Dean/College of Electronics
More informationOVERVIEW OF IEEE 1857 VIDEO CODING STANDARD
OVERVIEW OF IEEE 1857 VIDEO CODING STANDARD Siwei Ma, Shiqi Wang, Wen Gao {swma,sqwang, wgao}@pku.edu.cn Institute of Digital Media, Peking University ABSTRACT IEEE 1857 is a multi-part standard for multimedia
More informationAbout MPEG Compression. More About Long-GOP Video
About MPEG Compression HD video requires significantly more data than SD video. A single HD video frame can require up to six times more data than an SD frame. To record such large images with such a low
More informationVIDEO AND IMAGE PROCESSING USING DSP AND PFGA. Chapter 3: Video Processing
ĐẠI HỌC QUỐC GIA TP.HỒ CHÍ MINH TRƯỜNG ĐẠI HỌC BÁCH KHOA KHOA ĐIỆN-ĐIỆN TỬ BỘ MÔN KỸ THUẬT ĐIỆN TỬ VIDEO AND IMAGE PROCESSING USING DSP AND PFGA Chapter 3: Video Processing 3.1 Video Formats 3.2 Video
More informationPERFORMANCE ANALYSIS OF CANNY AND OTHER COMMONLY USED EDGE DETECTORS Sandeep Dhawan Director of Technology, OTTE, NEW YORK
International Journal of Science, Environment and Technology, Vol. 3, No 5, 2014, 1759 1766 ISSN 2278-3687 (O) PERFORMANCE ANALYSIS OF CANNY AND OTHER COMMONLY USED EDGE DETECTORS Sandeep Dhawan Director
More informationJPEG 2000 vs. JPEG in MPEG Encoding
JPEG 2000 vs. JPEG in MPEG Encoding V.G. Ruiz, M.F. López, I. García and E.M.T. Hendrix Dept. Computer Architecture and Electronics University of Almería. 04120 Almería. Spain. E-mail: vruiz@ual.es, mflopez@ace.ual.es,
More informationMixed Raster Content for Compound Image Compression
Mixed Raster Content for Compound Image Compression Final Project Presentation EE-5359 Spring 2009 Submitted to: Dr. K.R. Rao Submitted by: Pritesh Shah (1000555858) MOTIVATION In today s world it is impossible
More informationA Hybrid Architecture for Video Transmission
2017 Asia-Pacific Engineering and Technology Conference (APETC 2017) ISBN: 978-1-60595-443-1 A Hybrid Architecture for Video Transmission Qian Huang, Xiaoqi Wang, Xiaodan Du and Feng Ye ABSTRACT With the
More informationVideo Object Extraction for Surveillance System. Like Zhang CS, UTSA
Video Object Extraction for Surveillance System Like Zhang CS, UTSA 10/22/2004 Reference 1. C. Kim and J.-N. Hwang, Object-based video abstraction for video surveillance systems, IEEE Transactions on Circuits
More informationOptimized Progressive Coding of Stereo Images Using Discrete Wavelet Transform
Optimized Progressive Coding of Stereo Images Using Discrete Wavelet Transform Torsten Palfner, Alexander Mali and Erika Müller Institute of Telecommunications and Information Technology, University of
More informationAn Efficient Mode Selection Algorithm for H.264
An Efficient Mode Selection Algorithm for H.64 Lu Lu 1, Wenhan Wu, and Zhou Wei 3 1 South China University of Technology, Institute of Computer Science, Guangzhou 510640, China lul@scut.edu.cn South China
More informationHigh Efficiency Video Decoding on Multicore Processor
High Efficiency Video Decoding on Multicore Processor Hyeonggeon Lee 1, Jong Kang Park 2, and Jong Tae Kim 1,2 Department of IT Convergence 1 Sungkyunkwan University Suwon, Korea Department of Electrical
More informationHigh Performance VLSI Architecture of Fractional Motion Estimation for H.264/AVC
Journal of Computational Information Systems 7: 8 (2011) 2843-2850 Available at http://www.jofcis.com High Performance VLSI Architecture of Fractional Motion Estimation for H.264/AVC Meihua GU 1,2, Ningmei
More informationVideo Inter-frame Forgery Identification Based on Optical Flow Consistency
Sensors & Transducers 24 by IFSA Publishing, S. L. http://www.sensorsportal.com Video Inter-frame Forgery Identification Based on Optical Flow Consistency Qi Wang, Zhaohong Li, Zhenzhen Zhang, Qinglong
More informationBi-directional optical flow for future video codec
2016 Data Compression Conference Bi-directional optical flow for future video codec Alshin Alexander * and Alshina Elena * * Digital Media R&D Center 416, Maetan 3-dong, Yeongtong-Gu Suwon, 443-742, Korea
More informationDigital Image Processing COSC 6380/4393
Digital Image Processing COSC 6380/4393 Lecture 21 Nov 16 th, 2017 Pranav Mantini Ack: Shah. M Image Processing Geometric Transformation Point Operations Filtering (spatial, Frequency) Input Restoration/
More informationONVIF Profile T and H.265: the evolution of video compression
ONVIF Profile T and H.265: the evolution of video compression Published on 3 Oct 2018 In today s market, efficient use of bandwidth and storage is an essential part of maintaining an effective video surveillance
More informationA Quantized Transform-Domain Motion Estimation Technique for H.264 Secondary SP-frames
A Quantized Transform-Domain Motion Estimation Technique for H.264 Secondary SP-frames Ki-Kit Lai, Yui-Lam Chan, and Wan-Chi Siu Centre for Signal Processing Department of Electronic and Information Engineering
More informationFRAME-RATE UP-CONVERSION USING TRANSMITTED TRUE MOTION VECTORS
FRAME-RATE UP-CONVERSION USING TRANSMITTED TRUE MOTION VECTORS Yen-Kuang Chen 1, Anthony Vetro 2, Huifang Sun 3, and S. Y. Kung 4 Intel Corp. 1, Mitsubishi Electric ITA 2 3, and Princeton University 1
More informationMultimedia Systems Video II (Video Coding) Mahdi Amiri April 2012 Sharif University of Technology
Course Presentation Multimedia Systems Video II (Video Coding) Mahdi Amiri April 2012 Sharif University of Technology Video Coding Correlation in Video Sequence Spatial correlation Similar pixels seem
More informationFor layered video encoding, video sequence is encoded into a base layer bitstream and one (or more) enhancement layer bit-stream(s).
3rd International Conference on Multimedia Technology(ICMT 2013) Video Standard Compliant Layered P2P Streaming Man Yau Chiu 1, Kangheng Wu 1, Zhibin Lei 1 and Dah Ming Chiu 2 Abstract. Peer-to-peer (P2P)
More informationUnit-level Optimization for SVC Extractor
Unit-level Optimization for SVC Extractor Chang-Ming Lee, Chia-Ying Lee, Bo-Yao Huang, and Kang-Chih Chang Department of Communications Engineering National Chung Cheng University Chiayi, Taiwan changminglee@ee.ccu.edu.tw,
More informationEDGE BASED REGION GROWING
EDGE BASED REGION GROWING Rupinder Singh, Jarnail Singh Preetkamal Sharma, Sudhir Sharma Abstract Image segmentation is a decomposition of scene into its components. It is a key step in image analysis.
More informationA Novel Statistical Distortion Model Based on Mixed Laplacian and Uniform Distribution of Mpeg-4 FGS
A Novel Statistical Distortion Model Based on Mixed Laplacian and Uniform Distribution of Mpeg-4 FGS Xie Li and Wenjun Zhang Institute of Image Communication and Information Processing, Shanghai Jiaotong
More informationA LOW-COMPLEXITY AND LOSSLESS REFERENCE FRAME ENCODER ALGORITHM FOR VIDEO CODING
2014 IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP) A LOW-COMPLEXITY AND LOSSLESS REFERENCE FRAME ENCODER ALGORITHM FOR VIDEO CODING Dieison Silveira, Guilherme Povala,
More informationEFFICIENT DEISGN OF LOW AREA BASED H.264 COMPRESSOR AND DECOMPRESSOR WITH H.264 INTEGER TRANSFORM
EFFICIENT DEISGN OF LOW AREA BASED H.264 COMPRESSOR AND DECOMPRESSOR WITH H.264 INTEGER TRANSFORM 1 KALIKI SRI HARSHA REDDY, 2 R.SARAVANAN 1 M.Tech VLSI Design, SASTRA University, Thanjavur, Tamilnadu,
More informationH.264 to MPEG-4 Transcoding Using Block Type Information
1568963561 1 H.264 to MPEG-4 Transcoding Using Block Type Information Jae-Ho Hur and Yung-Lyul Lee Abstract In this paper, we propose a heterogeneous transcoding method of converting an H.264 video bitstream
More informationCompression; Error detection & correction
Compression; Error detection & correction compression: squeeze out redundancy to use less memory or use less network bandwidth encode the same information in fewer bits some bits carry no information some
More informationReview and Implementation of DWT based Scalable Video Coding with Scalable Motion Coding.
Project Title: Review and Implementation of DWT based Scalable Video Coding with Scalable Motion Coding. Midterm Report CS 584 Multimedia Communications Submitted by: Syed Jawwad Bukhari 2004-03-0028 About
More informationStudy on Jabber Be Applied to Video Diagnosis for Plant Diseases and Insect Pests
Study on Jabber Be Applied to Video Diagnosis for Plant Diseases and Insect Pests Wei Zhang *, JunFeng Zhang, Feng Yu, JiChun Zhao, and RuPeng Luan Agriculture and Forestry Academy of Beijing; Beijing
More informationHigh Efficiency Video Coding: The Next Gen Codec. Matthew Goldman Senior Vice President TV Compression Technology Ericsson
High Efficiency Video Coding: The Next Gen Codec Matthew Goldman Senior Vice President TV Compression Technology Ericsson High Efficiency Video Coding Compression Bitrate Targets Bitrate MPEG-2 VIDEO 1994
More informationHigh-Performance VLSI Architecture of H.264/AVC CAVLD by Parallel Run_before Estimation Algorithm *
JOURNAL OF INFORMATION SCIENCE AND ENGINEERING 29, 595-605 (2013) High-Performance VLSI Architecture of H.264/AVC CAVLD by Parallel Run_before Estimation Algorithm * JONGWOO BAE 1 AND JINSOO CHO 2,+ 1
More informationA threshold decision of the object image by using the smart tag
A threshold decision of the object image by using the smart tag Chang-Jun Im, Jin-Young Kim, Kwan Young Joung, Ho-Gil Lee Sensing & Perception Research Group Korea Institute of Industrial Technology (
More informationA 4-way parallel CAVLC design for H.264/AVC 4 Kx2 K 60 fps encoder
A 4-way parallel CAVLC design for H.264/AVC 4 Kx2 K 60 fps encoder Huibo Zhong, Sha Shen, Yibo Fan a), and Xiaoyang Zeng State Key Lab of ASIC and System, Fudan University 825 Zhangheng Road, Shanghai,
More informationCODING METHOD FOR EMBEDDING AUDIO IN VIDEO STREAM. Harri Sorokin, Jari Koivusaari, Moncef Gabbouj, and Jarmo Takala
CODING METHOD FOR EMBEDDING AUDIO IN VIDEO STREAM Harri Sorokin, Jari Koivusaari, Moncef Gabbouj, and Jarmo Takala Tampere University of Technology Korkeakoulunkatu 1, 720 Tampere, Finland ABSTRACT In
More informationAdvanced Encoding Features of the Sencore TXS Transcoder
Advanced Encoding Features of the Sencore TXS Transcoder White Paper November 2011 Page 1 (11) www.sencore.com 1.605.978.4600 Revision 1.0 Document Revision History Date Version Description Author 11/7/2011
More informationAN EFFICIENT APPROACH FOR IMPROVING CANNY EDGE DETECTION ALGORITHM
AN EFFICIENT APPROACH FOR IMPROVING CANNY EDGE DETECTION ALGORITHM Shokhan M. H. Department of Computer Science, Al-Anbar University, Iraq ABSTRACT Edge detection is one of the most important stages in
More informationCS334: Digital Imaging and Multimedia Edges and Contours. Ahmed Elgammal Dept. of Computer Science Rutgers University
CS334: Digital Imaging and Multimedia Edges and Contours Ahmed Elgammal Dept. of Computer Science Rutgers University Outlines What makes an edge? Gradient-based edge detection Edge Operators From Edges
More informationCompression of Stereo Images using a Huffman-Zip Scheme
Compression of Stereo Images using a Huffman-Zip Scheme John Hamann, Vickey Yeh Department of Electrical Engineering, Stanford University Stanford, CA 94304 jhamann@stanford.edu, vickey@stanford.edu Abstract
More information