An Adaptive MPEG-4 Streaming System Based on Object Prioritisation
|
|
- Grant Booker
- 5 years ago
- Views:
Transcription
1 ISSC 2003, Limerick. July 1-2 An Adaptive MPEG-4 Streaming System Based on Object Prioritisation Stefan A. Goor and Liam Murphy Performance Engineering Laboratory, Department of Computer Science, University College Dublin, Dublin IRELAND {stefan.goor, Abstract Streaming of video and multimedia content has generated a lot of interest, especially with the recent development of mobile devices with multimedia capabilities. However, ubiquitous multimedia systems face many challenges, such as varied and limited network performance and viewing device capabilities. Adaptive streaming systems are frequently used to reconcile these limitations, while also providing an acceptable level of perceptible quality to the end user. In this paper, we propose an adaptive streaming system that exploits the Video Object (VO) coding capabilities of MPEG-4 by applying priorities to the individual objects. By allowing the content provider to define prioritisation of objects, video adaptation can be customised based on the content. Keywords Video Streaming, Scalability, MPEG-4, Video Objects, Prioritisation. I INTRODUCTION The demand for rich content, such as video and multimedia, on mobile devices is rapidly increasing. Advances in such terminal hardware have resulted in mobile phones and palm devices that are capable of supporting complex media types. In addition to these advances, mobile network capacity has also been improving with the introduction of GPRS, b and UMTS wireless networks [1]. However, even with these advances, many limitations in both network and viewing device capabilities still exist. Scalability of video is commonly used to address such problems to ensure the stream(s) and content received at the client terminal match the available network and device resources. Many systems using MPEG-2, H.263 or similar technologies have been proposed or implemented [2]. Frame rate is generally used for temporal scalability, while resolution provides spatial scalability. Providing adaptation can be achieved in a number of ways, such as dynamic encoding or selection of preencoded clips of different temporal and spatial complexities at the server, based on client feedback. Other options include the use of layered encoding, multiple description encoding [3] or fine granular scalability (FGS). Ordinarily, all of these techniques are based on rectangular frames of video, so the whole of the rectangular area is adjusted by the same factors. This paper discusses a shift from this traditional frame based scalability, by exploiting the features of MPEG-4 such as Video Object (VO) coding, Binary Format for Scenes (BIFS), MPEG-Java (MPEG-J) and the use of MPEG-7 [4]. Using this technology, video clips can be encoded as a number of independent objects that form the video content when composed according to the BIFS. Individual objects can thus be encoded and / or adapted independently and arranged into a single scene. Independence of object scalability means we can thus set a preference or priority on the objects in the scene. For example, a video clip of a news broadcast may have the presenter prioritised higher than the background. If scaling back is required, the background will have its spatial and / or temporal complexity reduced more than the object representing the presenter. Human comprehension of the content should be improved by object-based
2 adaptive techniques because the object(s) of focus in the clip are maintained at a relatively high quality level. This assumes that maintaining prioritised objects at a relatively high level of quality and degrading the lower priority objects to a greater extent should result in a more comprehensible clip than uniformly encoding the complete clip at a compromis ed quality. If all objects are indiscriminately degraded then important perceptible features such as text or lip-synch may be lost due to the requirements of other less perceptually important objects such as backgrounds. The system proposed in this paper has two main features, firstly a tool for segmentation, prioritisation and encoding of VOs from a media clip (section III), and secondly a client-server based system for streaming this object-based media (section IV). II MPEG-4 FEATURES The MPEG-4 standard [5] was produced with the aim of providing video and multimedia content for varied environments and enhanced functionality. MPEG-4 was originally aimed at audio-visual information with very high compression in low bit rate environments. In fact, the standard was explicitly optimised for three bit rate ranges, below 64 kbps, 64 to 384 kbps and 384 kbps to 4 Mbps. MPEG-4 also specifies a number of new functionalities not available in previous standards like MPEG-1, MPEG-2 or H.263, such as contentbased mu ltimedia data access tools, content-based manipulation and bit stream editing, improved coding efficiency, and robustness in error-prone environments. Therefore MPEG-4 is appropriate for flexible audio-visual content communication over wireless networks. In terms of the system proposed in this paper the most important features are: Video Object (VO) coding, Binary Format for Scenes BIFS, MPEG-J and MPEG-7. a) Video Object (VO) Coding MPEG-4 supports coded representation of media objects [6]. Primitive media objects can be still images (e.g. a fixed background for some clip), video objects (e.g. a newsreader) or audio objects (e.g. a voice or music). Primitive media objects such as these can be either natural or synthetic. Many primitive media objects may represent a single VO. Consider the case of the news program: if we consider the presenter as a separate object from other content in the clip, then the VO must represent both the primitive video object (i.e. the presenter) as a sequence of textures or images, and the primitive audio object (i.e. the presenter s voice). As a result usually more than one Elementary Stream (ES) is required to represent the object. An Object Descriptor (OD) is used to identify all streams associated with a particular object. (a) (b) Figure 1: Demonstrating the encoding of an arbitrary shaped video object. (a) the original sequence with all the content, (b) the extracted YUV VOP and shape matrix. Arbitrarily shaped video objects are possible due to the use of a shape matrix or mask, as shown in Figure 1. A VO is represented by a sequence of Video Object Planes (VOPs) composed of YUV texture matrices and shape matrices that indicate the parts of the VOP that are part of the VO. YUV is a colour-encoding scheme in which luminance and chrominance are separate. Chrominance of images is less perceptually noticeable to the human eye and, as a result, it is commonly sub sampled. b) Binary Format for Scenes (BIFS) BIFS provide a method to compose a set of objects into a scene. BIFS can be use to describe a scene in terms of how objects are grouped together (as shown in Figure 2), and how objects are positioned in space and time. Voice Figure 2: Illustration of how a scene is described hierarchically in terms of objects. c) MPEG-J Intelligent management of the operation of audiovisual sessions is promoted by MPEG-J. MPEG-4 players and Java code used collaboratively allow authors to embed complex control and data processing mechanisms with their media data. Included in MPEG-J are Terminal, Scene, Resource, Decoder and Network APIs. MPEG-J applications that use these APIs are referred to as MPEGlets, which are similar to Java applets. These APIs can be used to assess the capabilities and available resources for streaming of video to a terminal and also apply appropriate changes to the stream by sending responses via a back channel to the server. Scene descriptions can be altered by the use of MPEG-J. Altering the scene descriptions means objects may be changed or omitted completely from the scene. d) MPEG-7 Person Scene Sprite 2D Background
3 Effective and efficient cataloguing of the content of media clips cannot be achieved by solely examining the clip s constituent data. Auxiliary data or metadata is necessary to explicitly describe the content in an informative manner. With such metadata, the versatility of clips is increased as they can be indexed in a database style approach based on their content. Utilising metadata means we could search for specific content in a clip, for example, finding a clip that contains Bertie Aherne and Tony Blair in London. MPEG-7 [7] provides support for stipulating such metadata for a given clip. Although the most apparent use of MPEG-7 is for searching and retrieval, any kind of metadata can be recorded that may be beneficial for reasons other than searchable indexing. degraded but the background is reduced in complexity and then omitted completely. III MEDIA PREPARATION In order to allow manipulation of video objects based on prioritisation, a technique for creation of objects and assignment of priority values is required. We propose a tool, as shown in figure 4, similar to the VOGUE tool [8] that will allow the content provider to allocate priority values to the objects they identify. This tool will also encode each object to a number of specified encoding parameters. e) Scalability Ordinarily rectangular frame based video is scalable with only two degrees of freedom, namely, spatial and temporal parameters. Spatial scalability involves an adjustment in the resolution of a video sample, whereas temporal scalability involves changing the frequency of distinct frames during play out. Other scalability techniques exist, however they tend to be fundamentally based on these two adaptation dimensions. For example, enhancement layers or multiple description encoding can be applied to provide improvements in quality of the sample, but the net effect of this process is generally increased spatial and temporal complexity. Exploiting MPEG-4 s VO capabilities means we can introduce an extra degree of freedom for scalability because we can choose to include or omit individual objects from a scene as an extra adaptation parameter. Scalability of MPEG-4 is also much more versatile than simple frame based scaling because each object, of which there may be many in a single scene, can be modified independently in each of the adaptation dimensions. Figure 3: An illustration of the differences between rectangular frame based scalability (top row) and object based scalability (bottom row). Figure 3 illustrates a coarse example of spatial scalability in both frame and object based paradigms. In the diagram, we can see that frame based scalability affects the whole of the scene, whereas in the case of object based scalability, the objects are degraded independently: the tennis player is not Figure 4: A screenshot of the Segmentation Tool being developed. a) Video Object Segmentation Streaming video in terms of objects means that video content must be converted to a collection of specified objects comprising the original scene. Manual identification of objects in a video can be achieved by the use of such a video segmentation tool. Identifying objects enables the content provider to define objects of interest to them for a particular purpose or domain. For example, during a football match a content provider may wish to have their logo displayed as an object so it can be manipulated independently of the other objects in the clip such as the players. Generally video segmentation tools are graphical based applications with simple user interfaces that enable a user to identify an object s shape by drawing a polygon or editing an alpha mask to match the object boundaries. Some basic systems require identification of the object in every frame of the source clip, although others employ automated object tracking algorithms to determine the objects position and shape in subsequent frames. In addition, some automated techniques for identifying key objects without user interaction have been suggested, however for this project we maintain the use of manual object segmentation to provide content providers greater control of the media content. b) Metadata (MPEG-7) for VOs Once the VOs have been identified and defined, a method to distinguish between them and provide information about the objects is needed. For the
4 purposes of this project, the priority level of each object must be specified and recorded. Conveniently, MPEG-7 provides an appropriate solution for this task. The metadata required for the VOs, including priority information, will therefore be stored in MPEG-7 format. IV SYSTEM ARCHITECTURE We propose a client server system architecture, as shown in Figure 5. Communication channels are available in both directions, one for transmission of content streams to the client and a back channel for receipt of feedback from the client. a) Server Figure 5: Overview of the system architecture. The server is responsible for the transmission of the audio-visual data and so must have a library or database of media it can stream. This library of media must be form into objects, each encoded to a number of specified configurations. The tool discussed in the previous section is responsible for encoding of the objects. Due to the VO nature of the streamed video, the server must also have a catalogue of metadata so it stores MPEG-7 information referring to the media clips in the server s library. Scalability of the system is achieved by selection of particular VO encodings for each Vo in the scene. A control unit is responsible for selecting appropriate coded object streams based on the feedback it receives from the client. Multiplexing is also required because each object may generate a number of ESs to represent its content. These streams are combined into a single stream to transmit to the client in the multiplexer. b) Client Playing the stream sent by the server requires decoding of the ESs to gather the data needed for each object, the BIFS and the MPEGlet. However because the server sends these streams to the client in a single multiplexed stream, a demultiplexer must first be applied to extract the individual ESs. Decoded streams are then supplied to the compositor that arranges the media content according to the BIFS information. An MPEGlet is used to provide the server with greater control over playback because the MPEG-J application can be used to monitor resources and send feedback when required. The Delivery Multimedia Integration Framework (DMIF) handles the communication of the responses from the client to the server. V SYSTEM OPERATION As mentioned earlier, before a clip can be streamed it will require some preparation in the form of segmentation and prioritisation. Preparation of video clips before streaming is not a new concept, as streaming systems often require videos to be hinted for streaming. Upon notification of a client wishing to view streamed content, an MPEGlet will be transmitted to the client to present the media clip and provide intelligent control of the transmission i.e. feedback for adaptation. Feedback is given in relation to the network and terminal device resources, which can be assessed using the MPEG-J APIs. This feedback will be fed to the control unit at the server and different objects will then be selected at a complexity based on a calculation involving their priority and the resources available at the client terminal. Unlike most adaptive systems which use periodic polling for assessment of performance, this system only sends feedback when the MPEGlet detects an event or situation that calls for degradation or improvement of the stream e.g. a significant change of available memory in the terminal device or a large shift in network capacity. a) Adaptation Processing Adaptation of video streams is done to try and achieve a stream that can be facilitated by the resources available. Both terminal device resources (i.e. CPU power and memory) and network resources are utilised in our system to indicate how to configure an appropriate stream. Whenever either or both of these resources are overloaded, the MPEGlet at the client will detect the problem and send feedback to the server. Information received by the server will indicate the available resource limit. This is calculated as the maximum bit rate that all resources at the client terminal can sufficiently handle. Each object contained in the scene, will then be apportioned a weighted fraction of the available resources according to its associated priority. Spatial and temporal complexities of the object are the primary factors involved in determining the required bit rate for a video object. Therefore, an encoded stream that requires approximately the allocated resources for that object will be selected. If an object is assigned an insufficient bit rate to present an object with an acceptable quality in terms of resolution and frame rate it will be omitted from the scene. Although an available resource limit may be determined, the adaptation of the stream has
5 numerous possibilities. Each object may be encoded with many temporal and spatial complexities and the proportioning of resources to objects can be varied hugely. In an effort to optimise the adaptation process, the system will use a scheme based on the results of proposed perceptual experiments to allocate resources among objects and determine appropriate encoding parameters for objects. VI CONCLUSIONS This paper proposes a system that streams MPEG-4 content from a server to a client and static encoding adaptation of the content in terms of VOs based on client feedback. The adaptation is achieved by calculation of available resources and VO priorities to determine each VO s appropriate encoded stream. While similar work has been carried out [9], the proposed system includes the addition of tools to allow content providers to specifically define, prioritise and encode objects to suit their requirements. In addition, the adaptation process will be based the results of perceptual quality experiments and the system will use static encodings, eliminating the need for a dynamic encoder. MPEGlets are also used for the purpose gathering information at the client side such as device and network performance and supplying feedback to the server when required. Using MPEGlets means the adaptations can be event driven removing the need for user interaction at the client side. Future work for this project involves implementing the proposed system, consisting of a media preparation tool, a client and a server. Perceptual testing of object-based adaptation compared to traditional frame based adaptation will be investigated. This perceptual testing will additionally be used to define the adaptation process and encoding parameters. ACKNOWLEDGEMENT The support of the Irish Research Council for Science, Engineering and Technology (IRCSET) is gratefully acknowledged. REFERENCES [1] Andrew S. Tanenbaum. Computer Networks: 4 th Edition. Prentice Hall ISBN: , pages and , [2] Gabriel-Miro Muntean and Liam Murphy. Adaptive Pre-recorded Multimedia Streaming. IEEE GLOBECOM 2002, Taipei, Taiwan, November 17-21, [3] J.G. Apostolopoulos. Reliable Video Communication over Lossy Packet Networks using Multiple State Encoding and Packet Path Diversity. Visual Communications and Image Processing (VCIP), pages , January [4] ISO/IEC JTC1/SC29/WG11 N4668. MPEG-4 Overview. -4/mpeg-4.htm, [5] Fernando Pereira and Touradj Ebrahimi. The MPEG-4 Book. Prentice Hall ISBN: , pages 1-34, [6] Coding of Audio-Visual Objects Part 2: Visual, 2d Edition. ISO/IEC :2001, [7] ISO/IEC JTC1/SC29/WG11. MPEG-7 Overview. -7/mpeg-7.htm, July [8] B. Marcotegui, P. Correia, F. Marques, R. Mech, R. Rosa, M. Wollborn and F. Zanoguera. A Video Object Generator Tool Allowing Friendly User Interaction. ICIP-99, Kobe, Japan, October [9] Anthony Vetro, Huifang Sun and Yao Wang. Object-Based Transcoding for Adaptable Video Content Delivery. IEEE Transactions on Circuits and Systems for Video Technology VOL. 11, NO. 3, March 2001.
EE Multimedia Signal Processing. Scope & Features. Scope & Features. Multimedia Signal Compression VI (MPEG-4, 7)
EE799 -- Multimedia Signal Processing Multimedia Signal Compression VI (MPEG-4, 7) References: 1. http://www.mpeg.org 2. http://drogo.cselt.stet.it/mpeg/ 3. T. Berahimi and M.Kunt, Visual data compression
More informationMPEG-4: Overview. Multimedia Naresuan University
MPEG-4: Overview Multimedia Naresuan University Sources - Chapters 1 and 2, The MPEG-4 Book, F. Pereira and T. Ebrahimi - Some slides are adapted from NTNU, Odd Inge Hillestad. MPEG-1 and MPEG-2 MPEG-1
More informationMPEG-4. Today we'll talk about...
INF5081 Multimedia Coding and Applications Vårsemester 2007, Ifi, UiO MPEG-4 Wolfgang Leister Knut Holmqvist Today we'll talk about... MPEG-4 / ISO/IEC 14496...... is more than a new audio-/video-codec...
More informationMPEG-4 AUTHORING TOOL FOR THE COMPOSITION OF 3D AUDIOVISUAL SCENES
MPEG-4 AUTHORING TOOL FOR THE COMPOSITION OF 3D AUDIOVISUAL SCENES P. Daras I. Kompatsiaris T. Raptis M. G. Strintzis Informatics and Telematics Institute 1,Kyvernidou str. 546 39 Thessaloniki, GREECE
More informationIST MPEG-4 Video Compliant Framework
IST MPEG-4 Video Compliant Framework João Valentim, Paulo Nunes, Fernando Pereira Instituto de Telecomunicações, Instituto Superior Técnico, Av. Rovisco Pais, 1049-001 Lisboa, Portugal Abstract This paper
More informationThanks for slides preparation of Dr. Shawmin Lei, Sharp Labs of America And, Mei-Yun Hsu February Material Sources
An Overview of MPEG4 Thanks for slides preparation of Dr. Shawmin Lei, Sharp Labs of America And, Mei-Yun Hsu February 1999 1 Material Sources The MPEG-4 Tutuorial, San Jose, March 1998 MPEG-4: Context
More informationBluray (
Bluray (http://www.blu-ray.com/faq) MPEG-2 - enhanced for HD, also used for playback of DVDs and HDTV recordings MPEG-4 AVC - part of the MPEG-4 standard also known as H.264 (High Profile and Main Profile)
More informationSpatial Scene Level Shape Error Concealment for Segmented Video
Spatial Scene Level Shape Error Concealment for Segmented Video Luis Ducla Soares 1, Fernando Pereira 2 1 Instituto Superior de Ciências do Trabalho e da Empresa Instituto de Telecomunicações, Lisboa,
More informationPerformance comparison of multiplexing techniques for MPEG-4 objectbased
Performance comparison of multiplexing techniques for MPEG-4 objectbased content Seán Murphy, Stefan Goor, Liam Murphy Department of Computer Science, University College Dublin, Dublin 4, Ireland. Email:
More informationOutline Introduction MPEG-2 MPEG-4. Video Compression. Introduction to MPEG. Prof. Pratikgiri Goswami
to MPEG Prof. Pratikgiri Goswami Electronics & Communication Department, Shree Swami Atmanand Saraswati Institute of Technology, Surat. Outline of Topics 1 2 Coding 3 Video Object Representation Outline
More informationMPEG-4 Structured Audio Systems
MPEG-4 Structured Audio Systems Mihir Anandpara The University of Texas at Austin anandpar@ece.utexas.edu 1 Abstract The MPEG-4 standard has been proposed to provide high quality audio and video content
More informationIntroduction to LAN/WAN. Application Layer 4
Introduction to LAN/WAN Application Layer 4 Multimedia Multimedia: Audio + video Human ear: 20Hz 20kHz, Dogs hear higher freqs DAC converts audio waves to digital E.g PCM uses 8-bit samples 8000 times
More informationAn Adaptive Scene Compositor Model in MPEG-4 Player for Mobile Device
An Adaptive Scene Compositor Model in MPEG-4 Player for Mobile Device Hyunju Lee and Sangwook Kim Computer Science Department, Kyungpook National University 1370 Sankyuk-dong Buk-gu, Daegu, 702-701, Korea
More informationLesson 6. MPEG Standards. MPEG - Moving Picture Experts Group Standards - MPEG-1 - MPEG-2 - MPEG-4 - MPEG-7 - MPEG-21
Lesson 6 MPEG Standards MPEG - Moving Picture Experts Group Standards - MPEG-1 - MPEG-2 - MPEG-4 - MPEG-7 - MPEG-21 What is MPEG MPEG: Moving Picture Experts Group - established in 1988 ISO/IEC JTC 1 /SC
More informationDIGITAL TELEVISION 1. DIGITAL VIDEO FUNDAMENTALS
DIGITAL TELEVISION 1. DIGITAL VIDEO FUNDAMENTALS Television services in Europe currently broadcast video at a frame rate of 25 Hz. Each frame consists of two interlaced fields, giving a field rate of 50
More informationDelivery Context in MPEG-21
Delivery Context in MPEG-21 Sylvain Devillers Philips Research France Anthony Vetro Mitsubishi Electric Research Laboratories Philips Research France Presentation Plan MPEG achievements MPEG-21: Multimedia
More informationGeorgios Tziritas Computer Science Department
New Video Coding standards MPEG-4, HEVC Georgios Tziritas Computer Science Department http://www.csd.uoc.gr/~tziritas 1 MPEG-4 : introduction Motion Picture Expert Group Publication 1998 (Intern. Standardization
More informationFast Region-of-Interest Transcoding for JPEG 2000 Images
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Fast Region-of-Interest Transcoding for JPEG 2000 Images Kong, H-S; Vetro, A.; Hata, T.; Kuwahara, N. TR2005-043 May 2005 Abstract This paper
More informationOptimal Video Adaptation and Skimming Using a Utility-Based Framework
Optimal Video Adaptation and Skimming Using a Utility-Based Framework Shih-Fu Chang Digital Video and Multimedia Lab ADVENT University-Industry Consortium Columbia University Sept. 9th 2002 http://www.ee.columbia.edu/dvmm
More informationLecture 3 Image and Video (MPEG) Coding
CS 598KN Advanced Multimedia Systems Design Lecture 3 Image and Video (MPEG) Coding Klara Nahrstedt Fall 2017 Overview JPEG Compression MPEG Basics MPEG-4 MPEG-7 JPEG COMPRESSION JPEG Compression 8x8 blocks
More informationCMPT 365 Multimedia Systems. Media Compression - Video Coding Standards
CMPT 365 Multimedia Systems Media Compression - Video Coding Standards Spring 2017 Edited from slides by Dr. Jiangchuan Liu CMPT365 Multimedia Systems 1 Video Coding Standards H.264/AVC CMPT365 Multimedia
More informationA MULTIPOINT VIDEOCONFERENCE RECEIVER BASED ON MPEG-4 OBJECT VIDEO. Chih-Kai Chien, Chen-Yu Tsai, and David W. Lin
A MULTIPOINT VIDEOCONFERENCE RECEIVER BASED ON MPEG-4 OBJECT VIDEO Chih-Kai Chien, Chen-Yu Tsai, and David W. Lin Dept. of Electronics Engineering and Center for Telecommunications Research National Chiao
More informationUSING METADATA TO PROVIDE SCALABLE BROADCAST AND INTERNET CONTENT AND SERVICES
USING METADATA TO PROVIDE SCALABLE BROADCAST AND INTERNET CONTENT AND SERVICES GABRIELLA KAZAI 1,2, MOUNIA LALMAS 1, MARIE-LUCE BOURGUET 1 AND ALAN PEARMAIN 2 Department of Computer Science 1 and Department
More informationChapter 11.3 MPEG-2. MPEG-2: For higher quality video at a bit-rate of more than 4 Mbps Defined seven profiles aimed at different applications:
Chapter 11.3 MPEG-2 MPEG-2: For higher quality video at a bit-rate of more than 4 Mbps Defined seven profiles aimed at different applications: Simple, Main, SNR scalable, Spatially scalable, High, 4:2:2,
More informationSystem Modeling and Implementation of MPEG-4. Encoder under Fine-Granular-Scalability Framework
System Modeling and Implementation of MPEG-4 Encoder under Fine-Granular-Scalability Framework Final Report Embedded Software Systems Prof. B. L. Evans by Wei Li and Zhenxun Xiao May 8, 2002 Abstract Stream
More informationInteroperable Content-based Access of Multimedia in Digital Libraries
Interoperable Content-based Access of Multimedia in Digital Libraries John R. Smith IBM T. J. Watson Research Center 30 Saw Mill River Road Hawthorne, NY 10532 USA ABSTRACT Recent academic and commercial
More informationFRACTAL COMPRESSION USAGE FOR I FRAMES IN MPEG4 I MPEG4
FRACTAL COMPRESSION USAGE FOR I FRAMES IN MPEG4 I MPEG4 Angel Radanov Kanchev FKTT, Technical University of Sofia, Todor Alexandrov bvd 14, 1303 Sofia, Bulgaria, phone: +3592 9306413, e-mail: angel_kanchev@mail.bg
More informationMPEG-4 Tools and Applications: An Overview 1
MPEG-4 Tools and Applications: An Overview 1 B. Lehane, N. O Connor, N. Murphy Centre for Digital Video Processing Dublin City University lehaneb@eeng.dcu.ie Abstract In this paper we present an overview
More informationSURVEILLANCE VIDEO FOR MOBILE DEVICES
SURVEILLANCE VIDEO FOR MOBILE DEVICES Olivier Steiger, Touradj Ebrahimi Signal Processing Institute Ecole Polytechnique Fédérale de Lausanne (EPFL) CH-1015 Lausanne, Switzerland {olivier.steiger,touradj.ebrahimi}@epfl.ch
More informationA Novel Adaptive Multimedia Delivery Algorithm for Increasing User Quality of Experience during Wireless and Mobile E-learning
mm09-59 1 A Novel Adaptive Multimedia Delivery Algorithm for Increasing User Quality of Experience during Wireless and Mobile E-learning Vasile Horia Muntean and Gabriel-Miro Muntean, Member, IEEE Abstract
More informationDigital Image Processing
Digital Image Processing Fundamentals of Image Compression DR TANIA STATHAKI READER (ASSOCIATE PROFFESOR) IN SIGNAL PROCESSING IMPERIAL COLLEGE LONDON Compression New techniques have led to the development
More informationInformation technology - Coding of audiovisual objects - Part 2: Visual
This is a preview of "INCITS/ISO/IEC 14496...". Click here to purchase the full version from the ANSI store. INCITS/ISO/IEC 14496-2:2004[R2012] (ISO/IEC 14496-2:2004, IDT) Information technology - Coding
More informationMPEG-4 departs from its predecessors in adopting a new object-based coding:
MPEG-4: a newer standard. Besides compression, pays great attention to issues about user interactivities. MPEG-4 departs from its predecessors in adopting a new object-based coding: Offering higher compression
More informationSystem Modeling and Implementation of MPEG-4. Encoder under Fine-Granular-Scalability Framework
System Modeling and Implementation of MPEG-4 Encoder under Fine-Granular-Scalability Framework Literature Survey Embedded Software Systems Prof. B. L. Evans by Wei Li and Zhenxun Xiao March 25, 2002 Abstract
More informationQoS-Aware IPTV Routing Algorithms
QoS-Aware IPTV Routing Algorithms Patrick McDonagh, Philip Perry, Liam Murphy. School of Computer Science and Informatics, University College Dublin, Belfield, Dublin 4. {patrick.mcdonagh, philip.perry,
More informationSORENSON VIDEO COMPRESSION
R O S E B R U F O R D C O L L E G E S O U N D & I M A G E D E S I G N D e s k t o p P u b l i s h i n g U n i t SORENSON VIDEO COMPRESSION B y D a n e R a m s h a w 2nd March 2000 Semester 2a - Course
More informationMPEG-4 is a standardized digital video technology
MPEG-4 is a standardized digital video technology What is Digital Video? What are Digital Video Standards? What is MPEG-4? How MPEG-4 is the same as other digital video technologies. How MPEG-4 is different
More informationDigital Image Stabilization and Its Integration with Video Encoder
Digital Image Stabilization and Its Integration with Video Encoder Yu-Chun Peng, Hung-An Chang, Homer H. Chen Graduate Institute of Communication Engineering National Taiwan University Taipei, Taiwan {b889189,
More informationTHE MPEG-4 STANDARD FOR INTERNET-BASED MULTIMEDIA APPLICATIONS
Chapter 3 THE MPEG-4 STANDARD FOR INTERNET-BASED MULTIMEDIA APPLICATIONS Charles Law and Borko Furht Abstract With the development of the MPEG-4 standard in 1998, a new way of creating and interacting
More informationLecture 5: Video Compression Standards (Part2) Tutorial 3 : Introduction to Histogram
Lecture 5: Video Compression Standards (Part) Tutorial 3 : Dr. Jian Zhang Conjoint Associate Professor NICTA & CSE UNSW COMP9519 Multimedia Systems S 006 jzhang@cse.unsw.edu.au Introduction to Histogram
More informationSecure Scalable Streaming and Secure Transcoding with JPEG-2000
Secure Scalable Streaming and Secure Transcoding with JPEG- Susie Wee, John Apostolopoulos Mobile and Media Systems Laboratory HP Laboratories Palo Alto HPL-3-117 June 13 th, 3* secure streaming, secure
More informationThe Virtual Meeting Room
Contact Details of Presenting Authors Stefan Rauthenberg (rauthenberg@hhi.de), Peter Kauff (kauff@hhi.de) Tel: +49-30-31002 266, +49-30-31002 615 Fax: +49-30-3927200 Summation Brief explaination of the
More informationISO/IEC INTERNATIONAL STANDARD. Information technology Coding of audio-visual objects Part 18: Font compression and streaming
INTERNATIONAL STANDARD ISO/IEC 14496-18 First edition 2004-07-01 Information technology Coding of audio-visual objects Part 18: Font compression and streaming Technologies de l'information Codage des objets
More informationSurveillance System with Mega-Pixel Scalable Transcoder
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Surveillance System with Mega-Pixel Scalable Transcoder Toshihiko Hata, Naoki Kuwahara, Derek Schwenke, Anthony Vetro TR2007-008 January 2007
More informationTypes and Methods of Content Adaptation. Anna-Kaisa Pietiläinen
Types and Methods of Content Adaptation Anna-Kaisa Pietiläinen Agenda Introduction Multimedia Content Types Types of Adaptation Methods of Adaptation Conclusion Networks 2 Introduction Networks 3 The Problem
More informationNetworking Applications
Networking Dr. Ayman A. Abdel-Hamid College of Computing and Information Technology Arab Academy for Science & Technology and Maritime Transport Multimedia Multimedia 1 Outline Audio and Video Services
More informationVideo Coding Standards
Based on: Y. Wang, J. Ostermann, and Y.-Q. Zhang, Video Processing and Communications, Prentice Hall, 2002. Video Coding Standards Yao Wang Polytechnic University, Brooklyn, NY11201 http://eeweb.poly.edu/~yao
More informationCODING METHOD FOR EMBEDDING AUDIO IN VIDEO STREAM. Harri Sorokin, Jari Koivusaari, Moncef Gabbouj, and Jarmo Takala
CODING METHOD FOR EMBEDDING AUDIO IN VIDEO STREAM Harri Sorokin, Jari Koivusaari, Moncef Gabbouj, and Jarmo Takala Tampere University of Technology Korkeakoulunkatu 1, 720 Tampere, Finland ABSTRACT In
More informationMPEG-4 - Twice as clever?
MPEG-4 - Twice as clever? Graham Thomas BBC R&D Kingswood Warren graham.thomas@rd.bbc.co.uk www.bbc.co.uk/rd 1 1 MPEG OVERVIEW MPEG = Moving Pictures Expert Group formally ISO/IEC JTC1/SC29 WG11 Mission
More informationOptical Storage Technology. MPEG Data Compression
Optical Storage Technology MPEG Data Compression MPEG-1 1 Audio Standard Moving Pictures Expert Group (MPEG) was formed in 1988 to devise compression techniques for audio and video. It first devised the
More informationKNOWLEDGE-BASED MULTIMEDIA ADAPTATION DECISION-TAKING
K KNOWLEDGE-BASED MULTIMEDIA ADAPTATION DECISION-TAKING Dietmar Jannach a, Christian Timmerer b, and Hermann Hellwagner b a Department of Computer Science, Dortmund University of Technology, Germany b
More informationAn Introduction to Content Based Image Retrieval
CHAPTER -1 An Introduction to Content Based Image Retrieval 1.1 Introduction With the advancement in internet and multimedia technologies, a huge amount of multimedia data in the form of audio, video and
More informationVideo Compression MPEG-4. Market s requirements for Video compression standard
Video Compression MPEG-4 Catania 10/04/2008 Arcangelo Bruna Market s requirements for Video compression standard Application s dependent Set Top Boxes (High bit rate) Digital Still Cameras (High / mid
More informationVideo Compression Standards (II) A/Prof. Jian Zhang
Video Compression Standards (II) A/Prof. Jian Zhang NICTA & CSE UNSW COMP9519 Multimedia Systems S2 2009 jzhang@cse.unsw.edu.au Tutorial 2 : Image/video Coding Techniques Basic Transform coding Tutorial
More informationOverview of the MPEG-4 Version 1 Standard
INTERNATIONAL ORGANISATION FOR STANDARDISATION ORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC1/SC29/WG11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC1/SC29/WG11 N1909 MPEG97 Oct 1997/Fribourg
More informationAbout MPEG Compression. More About Long-GOP Video
About MPEG Compression HD video requires significantly more data than SD video. A single HD video frame can require up to six times more data than an SD frame. To record such large images with such a low
More informationOverview of the MPEG-4 Standard
Page 1 of 78 INTERNATIONAL ORGANISATION FOR STANDARDISATION ORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC1/SC29/WG11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC1/SC29/WG11 N4668 March 2002
More informationJPEG 2000 A versatile image coding system for multimedia applications
International Telecommunication Union JPEG 2000 A versatile image coding system for multimedia applications Touradj Ebrahimi EPFL Why another still image compression standard? Low bit-rate compression
More informationThe following bit rates are recommended for broadcast contribution employing the most commonly used audio coding schemes:
Page 1 of 8 1. SCOPE This Operational Practice sets out guidelines for minimising the various artefacts that may distort audio signals when low bit-rate coding schemes are employed to convey contribution
More informationOptimizing A/V Content For Mobile Delivery
Optimizing A/V Content For Mobile Delivery Media Encoding using Helix Mobile Producer 11.0 November 3, 2005 Optimizing A/V Content For Mobile Delivery 1 Contents 1. Introduction... 3 2. Source Media...
More informationVIDEO streaming applications over the Internet are gaining. Brief Papers
412 IEEE TRANSACTIONS ON BROADCASTING, VOL. 54, NO. 3, SEPTEMBER 2008 Brief Papers Redundancy Reduction Technique for Dual-Bitstream MPEG Video Streaming With VCR Functionalities Tak-Piu Ip, Yui-Lam Chan,
More information15 Data Compression 2014/9/21. Objectives After studying this chapter, the student should be able to: 15-1 LOSSLESS COMPRESSION
15 Data Compression Data compression implies sending or storing a smaller number of bits. Although many methods are used for this purpose, in general these methods can be divided into two broad categories:
More informationVideo coding. Concepts and notations.
TSBK06 video coding p.1/47 Video coding Concepts and notations. A video signal consists of a time sequence of images. Typical frame rates are 24, 25, 30, 50 and 60 images per seconds. Each image is either
More informationMISB EG Motion Imagery Standards Board Engineering Guideline. 24 April Delivery of Low Bandwidth Motion Imagery. 1 Scope.
Motion Imagery Standards Board Engineering Guideline Delivery of Low Bandwidth Motion Imagery MISB EG 0803 24 April 2008 1 Scope This Motion Imagery Standards Board (MISB) Engineering Guideline (EG) provides
More informationEXPLORING ON STEGANOGRAPHY FOR LOW BIT RATE WAVELET BASED CODER IN IMAGE RETRIEVAL SYSTEM
TENCON 2000 explore2 Page:1/6 11/08/00 EXPLORING ON STEGANOGRAPHY FOR LOW BIT RATE WAVELET BASED CODER IN IMAGE RETRIEVAL SYSTEM S. Areepongsa, N. Kaewkamnerd, Y. F. Syed, and K. R. Rao The University
More informationHigher National Unit specification: general information
Higher National Unit specification: general information Unit code: H31B 35 Superclass: KG Publication date: January 2013 Source: Scottish Qualifications Authority Version: 01 Unit purpose This Unit is
More informationSHAPE CODING IN MPEG-4: AN OVERVIEW Signal Compression, ECE 242, Project Report
-1- SHAPE CODING IN MPEG-4: AN OVERVIEW Signal Compression, ECE 242, Project Report Sandeep Bhat sandeepkbhat@ece.ucsb.edu -2- Contents Contents... 2 1. Introduction... 3 2. Shape Coding... 5 2.1 Overview...
More informationPrioritisation of Data Partitioned MPEG-4 Video over Mobile Networks Λ
Communication Networks Prioritisation of Data Partitioned MPEG-4 Video over Mobile Networks Λ STEWART T. WORRALL, SIMON N. FABRI, ABDUL H. SADKA, AHMET M. KONDOZ Centre for Communication Systems Research
More informationObject-Based Transcoding for Adaptable Video Content Delivery
IEEE, TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY VOL. 11, NO. 3, MARCH 2001 387 Object-Based Transcoding for Adaptable Video Content Delivery Anthony Vetro, Member, IEEE, Huifang Sun, Fellow
More informationQoE Characterization for Video-On-Demand Services in 4G WiMAX Networks
QoE Characterization for Video-On-Demand Services in 4G WiMAX Networks Amitabha Ghosh IBM India Research Laboratory Department of Electrical Engineering University of Southern California, Los Angeles http://anrg.usc.edu/~amitabhg
More informationInternational Journal of Emerging Technology and Advanced Engineering Website: (ISSN , Volume 2, Issue 4, April 2012)
A Technical Analysis Towards Digital Video Compression Rutika Joshi 1, Rajesh Rai 2, Rajesh Nema 3 1 Student, Electronics and Communication Department, NIIST College, Bhopal, 2,3 Prof., Electronics and
More informationELL 788 Computational Perception & Cognition July November 2015
ELL 788 Computational Perception & Cognition July November 2015 Module 11 Audio Engineering: Perceptual coding Coding and decoding Signal (analog) Encoder Code (Digital) Code (Digital) Decoder Signal (analog)
More informationModeling of an MPEG Audio Layer-3 Encoder in Ptolemy
Modeling of an MPEG Audio Layer-3 Encoder in Ptolemy Patrick Brown EE382C Embedded Software Systems May 10, 2000 $EVWUDFW MPEG Audio Layer-3 is a standard for the compression of high-quality digital audio.
More informationParallel Implementation of Arbitrary-Shaped MPEG-4 Decoder for Multiprocessor Systems
Parallel Implementation of Arbitrary-Shaped MPEG-4 oder for Multiprocessor Systems Milan Pastrnak *,a,c, Peter H.N. de With a,c, Sander Stuijk c and Jef van Meerbergen b,c a LogicaCMG Nederland B.V., RTSE
More informationA Study on Transmission System for Realistic Media Effect Representation
Indian Journal of Science and Technology, Vol 8(S5), 28 32, March 2015 ISSN (Print) : 0974-6846 ISSN (Online) : 0974-5645 DOI : 10.17485/ijst/2015/v8iS5/61461 A Study on Transmission System for Realistic
More informationOptimal Estimation for Error Concealment in Scalable Video Coding
Optimal Estimation for Error Concealment in Scalable Video Coding Rui Zhang, Shankar L. Regunathan and Kenneth Rose Department of Electrical and Computer Engineering University of California Santa Barbara,
More informationAdvanced Encoding Features of the Sencore TXS Transcoder
Advanced Encoding Features of the Sencore TXS Transcoder White Paper November 2011 Page 1 (11) www.sencore.com 1.605.978.4600 Revision 1.0 Document Revision History Date Version Description Author 11/7/2011
More informationIn the name of Allah. the compassionate, the merciful
In the name of Allah the compassionate, the merciful Digital Video Systems S. Kasaei Room: CE 315 Department of Computer Engineering Sharif University of Technology E-Mail: skasaei@sharif.edu Webpage:
More informationIntra-Mode Indexed Nonuniform Quantization Parameter Matrices in AVC/H.264
Intra-Mode Indexed Nonuniform Quantization Parameter Matrices in AVC/H.264 Jing Hu and Jerry D. Gibson Department of Electrical and Computer Engineering University of California, Santa Barbara, California
More informationMOBILE VIDEO COMMUNICATIONS IN WIRELESS ENVIRONMENTS. Jozsef Vass Shelley Zhuang Jia Yao Xinhua Zhuang. University of Missouri-Columbia
MOBILE VIDEO COMMUNICATIONS IN WIRELESS ENVIRONMENTS Jozsef Vass Shelley Zhuang Jia Yao Xinhua Zhuang Multimedia Communications and Visualization Laboratory Department of Computer Engineering & Computer
More informationChannel-Adaptive Error Protection for Scalable Audio Streaming over Wireless Internet
Channel-Adaptive Error Protection for Scalable Audio Streaming over Wireless Internet GuiJin Wang Qian Zhang Wenwu Zhu Jianping Zhou Department of Electronic Engineering, Tsinghua University, Beijing,
More informationISO/IEC INTERNATIONAL STANDARD. Information technology Coding of audio-visual objects Part 12: ISO base media file format
INTERNATIONAL STANDARD ISO/IEC 14496-12 Third edition 2008-10-15 Information technology Coding of audio-visual objects Part 12: ISO base media file format Technologies de l'information Codage des objets
More informationsignal-to-noise ratio (PSNR), 2
u m " The Integration in Optics, Mechanics, and Electronics of Digital Versatile Disc Systems (1/3) ---(IV) Digital Video and Audio Signal Processing ƒf NSC87-2218-E-009-036 86 8 1 --- 87 7 31 p m o This
More informationThe Standardization process
JPEG2000 The Standardization process International Organization for Standardization (ISO) 75 Member Nations 150+ Technical Committees 600+ Subcommittees 1500+ Working Groups International Electrotechnical
More informationMULTIMEDIA ADAPTATION FOR DYNAMIC ENVIRONMENTS
MULTIMEDIA ADAPTATION FOR DYNAMIC ENVIRONMENTS Maija Metso, Antti Koivisto and Jaakko Sauvola Machine Vision and Media Processing Group Infotech Oulu, University of Oulu PO BOX 444, 90570 Oulu, FINLAND
More informationMulti-path Transport of FGS Video
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Multi-path Transport of FGS Video Jian Zhou, Huai-Rong Shao, Chia Shen and Ming-Ting Sun TR2003-10 March 2003 Abstract Fine-Granularity-Scalability
More informationInternational Journal of Scientific & Engineering Research Volume 8, Issue 5, May ISSN
International Journal of Scientific & Engineering Research Volume 8, Issue 5, May-2017 106 Self-organizing behavior of Wireless Ad Hoc Networks T. Raghu Trivedi, S. Giri Nath Abstract Self-organization
More informationData Storage Exploration and Bandwidth Analysis for Distributed MPEG-4 Decoding
Data Storage Exploration and Bandwidth Analysis for Distributed MPEG-4 oding Milan Pastrnak, Peter H. N. de With, Senior Member, IEEE Abstract The low bit-rate profiles of the MPEG-4 standard enable video-streaming
More informationTRIBHUVAN UNIVERSITY Institute of Engineering Pulchowk Campus Department of Electronics and Computer Engineering
TRIBHUVAN UNIVERSITY Institute of Engineering Pulchowk Campus Department of Electronics and Computer Engineering A Final project Report ON Minor Project Java Media Player Submitted By Bisharjan Pokharel(061bct512)
More information4G WIRELESS VIDEO COMMUNICATIONS
4G WIRELESS VIDEO COMMUNICATIONS Haohong Wang Marvell Semiconductors, USA Lisimachos P. Kondi University of Ioannina, Greece Ajay Luthra Motorola, USA Song Ci University of Nebraska-Lincoln, USA WILEY
More informationMULTIMEDIA COMMUNICATION
MULTIMEDIA COMMUNICATION Laboratory Session: JPEG Standard Fernando Pereira The objective of this lab session about the JPEG (Joint Photographic Experts Group) standard is to get the students familiar
More informationAn Efficient Player for MPEG-4 Contents on a Mobile Device
An Efficient Player for MPEG-4 Contents on a Mobile Device Sangwook Kim 1 and Kyungdeok Kim 2 1 Department of Computer Science, Kyungpook National University, Daegu, 702-701, Korea swkim@cs.knu.ac.kr 2
More informationQuality of Service Management for Teleteaching Applications Using the MPEG-4/DMIF
Quality of Service Management for Teleteaching Applications Using the MPEG-4/DMIF Gregor v. Bochmann and Zhen Yang School of Information Technology and Engineering (SITE), University of Ottawa, Canada
More informationImproving student feedback in virtual classrooms
Improving student feedback in virtual classrooms M. van der Schyff, H.C. Ferreira Department of Electrical and Electronic Engineering Rand Afrikaans University, South Africa mvds@ing.rau.ac.za, hcf@ing.rau.ac.za
More informationTRANSCODER SDK CERTIFICATION PROCESS VENDORS. Instructions to Validate the Correct Implementation of the Nielsen ID3 Software Development Kit
TRANSCODER SDK CERTIFICATION PROCESS VENDORS Instructions to Validate the Correct Implementation of the Nielsen ID3 Software Development Kit Page 2 Copyright 2016 The Nielsen Company (US) LLC. All rights
More informationThe MPEG-7 Description Standard 1
The MPEG-7 Description Standard 1 Nina Jaunsen Dept of Information and Media Science University of Bergen, Norway September 2004 The increasing use of multimedia in the general society and the need for
More informationMPEG: It s Need, Evolution and Processing Methods
MPEG: It s Need, Evolution and Processing Methods Ankit Agarwal, Prateeksha Suwalka, Manohar Prajapati ECE DEPARTMENT, Baldev Ram mirdha institute of technology (EC) ITS- 3,EPIP SItapura, Jaipur-302022(India)
More informationInternet Video Delivery. Professor Hui Zhang
18-345 Internet Video Delivery Professor Hui Zhang 1 1990 2004: 1 st Generation Commercial PC/Packet Video Technologies Simple video playback, no support for rich app Not well integrated with Web browser
More informationTracking of video objects using a backward projection technique
Tracking of video objects using a backward projection technique Stéphane Pateux IRISA/INRIA, Temics Project Campus Universitaire de Beaulieu 35042 Rennes Cedex, FRANCE ABSTRACT In this paper, we present
More informationECE 417 Guest Lecture Video Compression in MPEG-1/2/4. Min-Hsuan Tsai Apr 02, 2013
ECE 417 Guest Lecture Video Compression in MPEG-1/2/4 Min-Hsuan Tsai Apr 2, 213 What is MPEG and its standards MPEG stands for Moving Picture Expert Group Develop standards for video/audio compression
More information