Compression techniques

Similar documents
WHITE PAPER. An explanation of video compression techniques.

What is a Network Camera?

Tech Note - 05 Surveillance Systems that Work! Calculating Recorded Volume Disk Space

Video Compression An Introduction

STUDY AND IMPLEMENTATION OF VIDEO COMPRESSION STANDARDS (H.264/AVC, DIRAC)

Audio and video compression

DIGITAL TELEVISION 1. DIGITAL VIDEO FUNDAMENTALS

Video coding. Concepts and notations.

Migrating Video Surveillance Systems from Analog to Digital

Video Compression MPEG-4. Market s requirements for Video compression standard

Part 1 of 4. MARCH

About MPEG Compression. More About Long-GOP Video

Interframe coding A video scene captured as a sequence of frames can be efficiently coded by estimating and compensating for motion between frames pri

ONVIF Profile T and H.265: the evolution of video compression

Advanced Video Coding: The new H.264 video compression standard

Axis IP-Surveillance. Endless possibilities for video surveillance.

Streaming Technologies Glossary

[Support Package] August 21, Created -D TS Updated Category Hardware Sub Category. Quality/Bandwidth /Frame rate

An Enhanced Approach for Video Compression

Outline Introduction MPEG-2 MPEG-4. Video Compression. Introduction to MPEG. Prof. Pratikgiri Goswami

Digital video coding systems MPEG-1/2 Video

MPEG-l.MPEG-2, MPEG-4

Axis Zipstream technology

ZEN / ZEN Vision Series Video Encoding Guidelines

Digital Video Processing

Multimedia Standards

CSCD 443/533 Advanced Networks Fall 2017

INTERNATIONAL STANDARD

REVIEW ON IMAGE COMPRESSION TECHNIQUES AND ADVANTAGES OF IMAGE COMPRESSION

VIDEO AND IMAGE PROCESSING USING DSP AND PFGA. Chapter 3: Video Processing

White paper: Video Coding A Timeline

CCTV & Video Surveillance over 10G ip

Surveillance Dell EMC Storage in Physical Security Solutions with Axis NAS-Attached Cameras

In the first part of our project report, published

15 Data Compression 2014/9/21. Objectives After studying this chapter, the student should be able to: 15-1 LOSSLESS COMPRESSION

International Journal of Emerging Technology and Advanced Engineering Website: (ISSN , Volume 2, Issue 4, April 2012)

Megapixel Video for. Part 2 of 4. Brought to You by. Presented by Video Security Consultants

Multimedia Signals and Systems Motion Picture Compression - MPEG

WHITE PAPER. Director Prof. Dr.-Ing. Albert Heuberger Am Wolfsmantel Erlangen

Wireless Communication

DigiPoints Volume 1. Student Workbook. Module 8 Digital Compression

ISO/IEC INTERNATIONAL STANDARD. Information technology - Digital compression and coding of continuous-tone still images: Compliance testing

JPEG 2000 vs. JPEG in MPEG Encoding

Mark Kogan CTO Video Delivery Technologies Bluebird TV

ECE 417 Guest Lecture Video Compression in MPEG-1/2/4. Min-Hsuan Tsai Apr 02, 2013

ISO/IEC INTERNATIONAL STANDARD. Information technology JPEG XR image coding system Part 5: Reference software

Optical Storage Technology. MPEG Data Compression

Axis Megapixel Network Cameras. See what you ve been missing

EE 5359 Low Complexity H.264 encoder for mobile applications. Thejaswini Purushotham Student I.D.: Date: February 18,2010

Optimizing A/V Content For Mobile Delivery

Objective: Introduction: To: Dr. K. R. Rao. From: Kaustubh V. Dhonsale (UTA id: ) Date: 04/24/2012

Video Coding Standards. Yao Wang Polytechnic University, Brooklyn, NY11201 http: //eeweb.poly.edu/~yao

Performance analysis of AAC audio codec and comparison of Dirac Video Codec with AVS-china. Under guidance of Dr.K.R.Rao Submitted By, ASHWINI S URS

CS 335 Graphics and Multimedia. Image Compression

This document is a preview generated by EVS

Communications and Networking 1

Compression and File Formats

ISO/IEC INTERNATIONAL STANDARD. Information technology JPEG 2000 image coding system: An entry level JPEG 2000 encoder

Introduction to LAN/WAN. Application Layer 4

VMDC Version 7.0 Performance Guide

Ch. 4 - WAN, Wide Area Networks

Department of Electrical Engineering

Digital Image Processing

ISO/IEC INTERNATIONAL STANDARD

ISO/IEC INTERNATIONAL STANDARD

Video Coding Standards: H.261, H.263 and H.26L

The Scope of Picture and Video Coding Standardization

H.264 A Saturday night in front of the TV maybe doesn t make you think of video streaming standards any more than watching a

ECE 499/599 Data Compression & Information Theory. Thinh Nguyen Oregon State University

Reducing/eliminating visual artifacts in HEVC by the deblocking filter.

Professor Laurence S. Dooley. School of Computing and Communications Milton Keynes, UK

ISO/IEC Information technology Coding of audio-visual objects Part 15: Advanced Video Coding (AVC) file format

Express Letters. A Simple and Efficient Search Algorithm for Block-Matching Motion Estimation. Jianhua Lu and Ming L. Liou

UNIT 3 INTEGRATED SERVICES DIGITAL NETWORK (ISDN)

INTERNATIONAL STANDARD

White Paper. Defining the Future of Multi-Gigabit Wireless Communications. July 2010

Intelligent IP Video Surveillance

The most flexible home network, with television, phone and data on the same cable

Compression Part 2 Lossy Image Compression (JPEG) Norm Zeck

Latitude Network Video Management System

Emerging Markets for H.264 Video Encoding

Technical guide to network video. Techniques and factors to consider for the successful deployment of IP-based security surveillance and remote

Computer and Machine Vision

Digital Image Representation Image Compression

IO [io] MAYAH. IO [io] Audio Video Codec Systems

Chapter 1. Digital Data Representation and Communication. Part 2

The Best-Performance Digital Video Recorder JPEG2000 DVR V.S M-PEG & MPEG4(H.264)

ISO/IEC INTERNATIONAL STANDARD. Information technology JPEG 2000 image coding system Part 3: Motion JPEG 2000

Multimedia Storage Servers

The following bit rates are recommended for broadcast contribution employing the most commonly used audio coding schemes:

INTERNATIONAL STANDARD

Fundamentals of Video Compression. Video Compression

Robert Matthew Buckley. Nova Southeastern University. Dr. Laszlo. MCIS625 On Line. Module 2 Graphics File Format Essay

Introduction to Computer Science (I1100) Data Storage

Multimedia on the Web

Index. 1. Motivation 2. Background 3. JPEG Compression The Discrete Cosine Transformation Quantization Coding 4. MPEG 5.

INTERNATIONAL TELECOMMUNICATION UNION 4%,%-!4)# 3%26)#%3 4%2-).!, %15)0-%.43!.$ 02/4/#/,3 &/2 4%,%-!4)# 3%26)#%3

Zonal MPEG-2. Cheng-Hsiung Hsieh *, Chen-Wei Fu and Wei-Lung Hung

Video Coding Standards

ISO/IEC INTERNATIONAL STANDARD. Information technology JPEG 2000 image coding system: Motion JPEG 2000

Transcription:

DIGITAL IMAGES AND VIDEO FOR SURVEILLANCE APPLICATIONS WHITE PAPER Axis White Paper, 2002-1 - Copyright 2002, Axis Communications

TABLE OF CONTENTS 1. INTRODUCTION TO COMPRESSION TECHNIQUES...3 2. TWO BASIC STANDARDS JPEG AND MPEG...3 3. IMAGE DATA REDUCTION...4 4. AN OVERVIEW OF COMPRESSION TECHNIQUES...5 4.1 JPEG...5 4.2 MOTION JPEG...6 4.3 JPEG 2000...6 4.4 MOTION JPEG 2000...6 4.5 H.261/H.263...7 4.6 MPEG-1...7 4.7 MPEG-2...8 4.8 MPEG-4...8 5. MPEG COMPARISON...8 6. CONCLUSION STILL PICTURES...9 7. CONCLUSION MOTION PICTURES...9 8. ACRONYMS...10 Axis White Paper, 2002-2 - Copyright 2002, Axis Communications

1. Introduction to compression techniques JPEG, Motion JPEG and MPEG are three well-used acronyms used to describe different types of image compression format. But what do they mean, and why are they so relevant to today s rapidly expanding surveillance markets? This White Paper describes the differences, and aims to provide a few answers as to why they are so important and for which surveillance applications they are more suitable. When designing a networked digital surveillance application, developers need to initially consider the following factors: Is a still picture or a video sequence required? What is the available network bandwidth? What image degradation is allowed due to compression - artifacts? What is the budget for the system? When an ordinary analog video sequence is digitized according to the standard CCIR 601, it can consume as much as 165 Mbps, which is 165 million bits every second. With most surveillance applications infrequently having to share the network with other data intensive applications, this is very rarely the bandwidth available. To circumvent this problem, a series of techniques called picture and video compression techniques have been derived to reduce this high bit rate. Their ability to perform this task is quantified by the compression ratio. The higher the compression ratio is, the smaller is the bandwidth consumption. However, there is a price to pay for this compression. Because increasing compression causes an increasing degradation of the image. This is called artifacts. But the dilemma is; the more sophisticated the employed compression technique is, the more complex and expensive the system. This generally makes sophisticated compression restrictive in terms of maintaining low system costs. In describing the widespread use of different compression techniques, this document presents the associated advantages and disadvantages of each, giving the reader the ability to make decisions that are based on fact, not rumor. 2. Two basic standards JPEG and MPEG The two basic compression standards are JPEG and MPEG. In broad terms, JPEG is associated with still digital pictures, whilst MPEG is dedicated to digital video sequences. But these traditional JPEG and JPEG 2000 image formats also come in flavors that are appropriate for digital video as well; Motion JPEG and Motion JPEG 2000 formats. The group of MPEG standards that include the MPEG-1, MPEG-2 and MPEG-4 formats, share some similarities, as well as some notable differences: One thing they all have in common is that they are all International Standards set by the ISO (International Organization for Standardization) and IEC (International Electrotechnical Commission) with contributors from the US, Europe and Japan among others. They are Axis White Paper, 2002-3 - Copyright 2002, Axis Communications

also recommendations proposed by the ITU (International Telecommunication Union), which has further helped to establish them as the globally accepted de facto standards for digital still picture and video coding. The foundation of these standards was started in the mid-1980s when a group called the Joint Photographic Experts Group (a.k.a. JPEG) was formed. With a mission to develop a standard for color picture compression, the group s first public contribution was the release of the first part of the JPEG standard, in 1991. Since then the JPEG group has continued to work on both the original JPEG standard, and it s later successor: the JPEG 2000 standard. In the late 1980s the Motion Picture Experts Group (a.k.a. MPEG) was formed with the purpose of deriving a standard for the coding of moving pictures and audio. It has since produced the standards for MPEG-1, MPEG-2, and MPEG-4. The group s current work is focused on the next generation of standards, called MPEG-7 and MPEG-21. As these standards do not concern themselves with video compression, they are not explained in any further detail within this white paper. 3. Image data reduction As mentioned previously, a digitized video sequence can comprise of up to 165 Mbps of data. To reduce the media overheads for distributing these sequences, the following criteria is commonly employed to achieve desirable reductions in image data: Reduce color nuances within the image Reduce the color resolution with respect to the prevailing light intensity Remove small, invisible parts, of the picture In the case of a video sequence, parts of the picture that are unchanged are left as such. All of these techniques are based on an acute understanding of how the human brain and eyes work together to form a complex visual system. As a result of these subtle reductions, a significant reduction in the resultant file size for the image sequences is achievable with little or no adverse effect in their visual quality. The extent to which these image modifications are humanly visible, is typically dependent upon the degree to which the chosen compression technique is used. Axis White Paper, 2002-4 - Copyright 2002, Axis Communications

4. An overview of compression techniques Figure 1: The original picture. 4.1 JPEG The JPEG standard, ISO/IEC 10918, is the single most widespread picture compression format of today. It offers the flexibility to either select high picture quality with fairly high compression ratio or to get a very high compression ratio at the expense of a reasonable lower picture quality. Systems, such as cameras and viewers, can be made inexpensive due to the low complexity of the technique. The artifacts show the blockiness as seen in Figure 2. Compare it to the original picture in Figure 1. The blockiness appears when the compression ratio is pushed too high. In normal use, a JPEG compressed picture shows no visual difference to the original uncompressed picture. JPEG image compression contains a series of advanced techniques. The main one that does the real image compression is the Discrete Cosine Transform (DCT) followed by a quantization that removes the redundant information (the "invisible" parts). Figure 2: A JPEG compressed picture. Axis White Paper, 2002-5 - Copyright 2002, Axis Communications

4.2 Motion JPEG A digital video sequence can be represented as a series of JPEG pictures. The advantages are the same as with single still JPEG pictures flexibility both in terms of quality and compression ratio. The main disadvantage of Motion JPEG (a.k.a. MJPEG) is that since it uses only a series of still pictures it makes no use of video compression techniques. The result is a slightly lower compression ratio for video sequences compared to real video compression techniques. 4.3 JPEG 2000 Recently, the successor to the successful JPEG compression standard has seen the light of day. The basis was to incorporate new advances in picture compression research into an international standard. Instead of the DCT transformation, JPEG 2000, ISO/IEC 15444, uses the Wavelet transformation. The advantage of JPEG 2000 is that the blockiness of JPEG is removed, but replaced with a more overall fuzzy picture, as can be seen in Figure 3. Figure 3: A JPEG 2000 compressed picture. Whether this fuzziness of JPEG 2000 is preferred compared to the blockiness of JPEG is a matter of personal preference. However, the compression ratio for JPEG 2000 is higher than for JPEG and the difference increases with a higher compression ratio. For moderate compression ratios, JPEG 2000 produces pictures typically about 25% the size of JPEG at equal picture quality. The price to pay is a far more complex compression technique. 4.4 Motion JPEG 2000 As with JPEG and Motion JPEG, JPEG 2000 can also be used to represent a video sequence. The advantages are equal to JPEG 2000, i.e., a slightly better compression ratio compared to JPEG but at the price of complexity. The disadvantage reassembles that of Motion JPEG. Since it is a still picture compression technique it doesn t take any advantages of the video sequence compression. This results in a lower compression ration compared to real video compression techniques. Axis White Paper, 2002-6 - Copyright 2002, Axis Communications

4.5 H.261/H.263 The H.261 and H.263 are not International Standards but only Recommendations of the ITU. They are both based on the same technique as the MPEG standards and can be seen as simplified versions of MPEG video compression. They were originally designed for video-conferencing over telephone lines, i.e. low bandwidth. However, it is a bit contradictory that they lack some of the more advanced MPEG techniques to really provide efficient bandwidth use. The conclusion is therefore that the H.261/H.263 are not suitable for usage in general digital video coding. 4.6 MPEG-1 The first public standard of the MPEG committee was the MPEG-1, ISO/IEC 11172, which first parts were released in 1993. MPEG-1 video compression is based upon the same technique that is used in JPEG. In addition to that it also includes techniques for efficient coding of a video sequence. Figure 4: A three-picture JPEG video sequence. Consider the video sequence displayed in Figure 4. The picture to the left is the first picture in the sequence followed by the picture in the middle and then the picture to the right. When displayed, the video sequence shows a man walking from right to left with a tree that stands still. In Motion JPEG/Motion JPEG 2000 each picture in the sequence is coded as a separate unique picture resulting in the same sequence as the original one. In MPEG video only the new parts of the video sequence is included together with information of the moving parts. The video sequence of Figure 4 will then appear as in Figure 5. But this is only true during the transmission of the video sequence to limit the bandwidth consumption. When displayed it appears as the original video sequence again. Figure 5: A three-picture MPEG video sequence. Axis White Paper, 2002-7 - Copyright 2002, Axis Communications

MPEG-1 is focused on bit-streams of about 1,5 Mbps and originally for storage of digital video on CDs. The focus is on compression ratio rather than picture quality. It can be considered as traditional VCR quality but digital instead. 4.7 MPEG-2 The MPEG-2 project focused on extending the compression technique of MPEG-1 to cover larger pictures and higher quality at the expense of a lower compression ratio and therefore also higher bandwidth usage. MPEG-2, ISO/IEC 13818, also provides more advanced techniques to enhance the video quality at the same bit-rate. The expense is the need for far more complex equipment. Therefore these features are not suitable for use in real-time surveillance applications. As a note, DVD movies are compressed using the techniques of MPEG-2. 4.8 MPEG-4 Also the third generation of MPEG is based upon the same technique. Once again, the new project focused on new application usages. The most important new features of MPEG-4, ISO/IEC 14496, concerning video compression are the support of even lower bandwidth consuming applications, e.g. mobile units, and on the other hand applications with extremely high quality and almost unlimited bandwidth. The making of studio movies is one such an example. Most of the differences between MPEG-2 and MPEG-4 are features not related to video coding and therefore not related to surveillance applications. 5. MPEG comparison All MPEG standards are back compatible. This means that an MPEG-1 video sequence also can be packetized as MPEG-2 or MPEG-4 video. Similarly, MPEG-2 can be packetized as an MPEG-4 video sequence. The difference between a true MPEG-4 video and an MPEG-4-packetized MPEG-1 video sequence is that the lower standard does not make use of the enhanced or new features of the higher standard. Since both MPEG-2 and MPEG-4 covers a wide range of picture sizes, picture rates and bandwidth usage, the MPEG-2 introduced a concept called Profile@Level. This was created to make it possible to communicate compatibilities among applications. For example, the Studio profile of MPEG-4 is not suitable for a PDA and vice versa. Axis White Paper, 2002-8 - Copyright 2002, Axis Communications

The comparison of the MPEGs in Table 1, contains the MPEG-1 with its most often used limitation (Constrained Parameters Bitstream, CPB), MPEG-2 with its Main Profile at Main Level (MP@ML), and MPEG-4 Main Profile at L3 Level. MPEG 1 2 4 Max bit rate (Mbps) 1,86 15 15 Picture width (pixels) 352 720 720 Picture height (pixels) 288 576 576 Picture rate (fps) 30 30 30 Table 1: MPEG comparison. Neither Motion JPEG nor Motion JPEG 2000 specifies maximal picture size or rate or bandwidth usage. 6. Conclusion Still Pictures For single still pictures both JPEG and JPEG 2000 offers good flexibility in terms of picture quality and compression ratio. While JPEG 2000 compress slightly better then JPEG, especially at very high compression ratios, the momentum of the advantage compared to the price to pay for the extra complexity, makes it a less preferred choice of today. To state it in another way: The advantages of JPEG 2000 are in compression at very high compression ratio. But then the picture contains very little information and is therefore not suitable for surveillance of any kind. The advantages of JPEG in terms of inexpensive equipment both for coding and viewing makes it the selection for still picture compression. 7. Conclusion Motion Pictures Especially the Motion JPEG is a good choice when use in many applications due to its simplicity. This ensures inexpensive equipment at the cost of slightly higher bandwidth consumption. For more efficient bandwidth usage some of the true motion picture compression standards are preferred. MPEG 1 can be more effective than MJPEG, but for just a slightly higher cost, MPEG 2 provides some advantages supporting better image quality - comprising of frame rate and resolution - but requires more network bandwidth consumption and is a technique of greater complexity. MPEG 4 is developed to offer a compression technique for applications demanding less image quality and bandwidth. It is also able to deliver video compression similar to MPEG 1 and MPEG 2, higher image quality at higher bandwidth consumption. Since the H.261/H.263 recommendations are neither international standards nor offers any compression enhancements compared to MPEG, they are not of any real interest. Axis White Paper, 2002-9 - Copyright 2002, Axis Communications

8. Acronyms The following is a description of the acronyms used in this white paper. Interlaced A technique used in old television system where the picture is divided into two half pictures containing every other line each. When displayed, first the odd lines are displayed then the even lines followed by the odd lines of the next picture and so on. This is the opposite of Progressive Scan. Progressive Scan Each picture in the video sequence is the full picture displayed all in once. This is the opposite of Interlaced. PAL Phase Alternating Line. This is the standard for the analog television format used in Europe with 625 lines at 50 half-pictures per second, i.e. Interlaced video. NTSC National Television Standards Committee. This is the standard for the analog television format used in the US with 525 lines at near 60 pictures per second, i.e. Interlaced video. CCIR 601 A standard for digital video for picture size of 720 485 at 60 interlaced pictures per second or 720 576 at 50 interlaced pictures per second. CIF Common Intermediate Format. Video of picture size 352 288 at 30 pictures per second. QCIF Quarter CIF. Video of picture size 176 144 at 30 pictures per second. HDTV High-Definition Television. A standard for television of picture size 1920 1044 at 30 pictures per second. DVD Digital Versatile Disc. A standard to store digital audio and/or video on a CDsized disc. MPEG Motion Picture Experts Group. The committee responsible for developing the MPEG standards. Homepage at: www.mpeg.telecomitalialab.com JPEG Joint Photographic Experts Group. The committee responsible for developing the JPEG and JPEG 2000 standards. Homepage at: www.jpeg.org ISO International Standards Organization. A worldwide federation of national standards bodies from some 140 countries. Homepage at: www.iso.ch IEC International Electrotechnical Commission. International Electrotechnical Commission. An international standards and conformity assessment body for all fields of electro technology. Homepage at: www.iec.ch ITU International Telecommunications Union. An international organization within the United Nations System where governments and the private sector coordinate global telecom networks and services. Homepage at: www.itu.int Axis White Paper, 2002-10 - Copyright 2002, Axis Communications

Axis Communications Axis develops solutions for user-friendly and secure communication over wired and wireless networks. The company is a worldwide market leader in network connectivity, with products for office, facility and industrial environments. Axis was founded in 1984 and is listed on the O-list (Attract 40) of Stockholmsbörsen (XSSE:AXIS). With more than 300 employees, and offices in 14 countries, Axis operates globally in cooperation with distributors and OEM partners in some 70 countries. Markets outside Sweden account for more than 95 percent of sales. Information about Axis can be found at Contact Axis info@axis.com Head office, Lund Axis Communications AB Emdalavägen 14 SE-223 69 Lund Tel: +46 46 272 18 00 Fax: +46 46 13 61 30 Subsidiaries BOSTON: Phone:+1 978 614 20 00 MIAMI: Phone:+1 305 629 3524 LONDON: Phone:+44 20 7553 9200 MADRID: Phone:+34 91 803 46 43 MUNICH: Phone:+49 811 555 0810 PARIS: Phone:+33 1 49 69 15 50 ROTTERDAM: Phone:+31 10 444 34 34 TURIN: Phone:+39 011 841 321 HONG KONG: Phone:+852 2836 0813 SEOUL: Phone:+82 2 780 9636 SHANGHAI: Phone:+86 21 6431 1690 SINGAPORE: Phone:+65 836 2777 TAIPEI: Phone:+886 2 2546 9668 TOKYO: Phone:+81-3-5531-8041 SYDNEY: Phone:+61 2 9967 5700 KUALA LUMPUR: Phone:+60 3 2474 582 Axis White Paper, 2002-11 - Copyright 2002, Axis Communications