The MPEG-4 1 and MPEG-7 2 standards provide
|
|
- Shanon Armstrong
- 6 years ago
- Views:
Transcription
1 Multimedia at Work Editor: Tiziana Catarci University of Rome Authoring 744: Writing Descriptions to Create Content José M. Martínez Universidad Autónoma de Madrid Francisco Morán Universidad Politécnica de Madrid The MPEG-4 1 and MPEG-7 2 standards provide new ways for authoring, transporting, accessing, retrieving, and interacting with multimedia content. MPEG-4 is the first standard that supports interactive and complex audio visual presentations, while MPEG-7 standardizes the description of various types of multimedia content. Complex authoring tools are required to create the powerful reusable and interactive content allowed by MPEG-4. On the other hand, MPEG-7 describes content in a more natural manner. Currently, MPEG-7 applications extract the characteristic features of some existing content to generate a standardized description of it. This is the straightforward way of using MPEG-7, but it may be also possible to synthesize the content from such descriptions. This article introduces the first results of the Authoring 744 research initiative, which uses MPEG-7 to synthesize content instead of analyzing it. Authoring 744 aims to develop a prototype system that creates audio visual content through writing scripts and descriptions in a user-friendly GUI. By script writing we mean completing forms and choosing some media description examples (such as a melody s key, an object s shape and texture or its trajectory within the scene, and a region s dominant color). Potential applications Authoring 744 mostly provides an alternative multimedia authoring methodology that s simpler than traditional authoring tools and more human focused. Of course, this vision may yield (in most cases) only drafts of the audio visual content that will bring the author s idea to reality, but it will ease the quick creation of initial prototypes such as advertisement images, soundtracks, jingles, storyboards for a TV pilot series, publicity/music video clips, and so on. Nevertheless, in some cases, it should be possible to create final content. In fact, the synthesized content uses extensible MPEG-4 textual format A (XMT-A), which is part of MPEG-4 s XMT, 3 as the representation format. XMT-A is a textual representation of MPEG-4 using XML, 4 which provides a direct one-to-one mapping between MPEG-4 in both binary and textual representation formats. In the field of computer games, Authoring 744 could also be useful. A key asset for the design of any game is a toolset for content creation and conversion, providing artists with flexible solutions to recycle already existing 4D content to create new content. Among the tools in such a toolset, it would make a lot of sense to have one that semiautomatically synthesizes content from MPEG-7 descriptions. This would not only save design time, but also storage space, as it wouldn t be necessary to store different formats for a single object. Some game companies are already doing research on how to generate online game content from non-mpeg-7-compliant descriptions. This is hardly surprising, since the expected benefit of doing so is enormous: instead of having to generate and transmit potentially bulky audio visual content, very compact descriptions of it would be sent from servers to clients. Additionally, small parametric changes in the descriptions can generate totally new or significantly modified content, something much sought after by game companies trying to increase the replayability of their games. Another potential application of Authoring 744 is sheer compression. Instead of transmitting (or storing) the rendered version of audio visual content, it should be possible to transmit an MPEG-7 description of it and let the transcoding and rendering of that content be done at the client side (or at an intermediate network node, acting as a transcoder for a set of final client terminals). This would impose higher requirements for CPU and memory resources at the terminals (or proxies), but the compression benefits might X/03/$ IEEE Published by the IEEE Computer Society
2 well be worth it. Imagine, in the case of sound, the difference between transmitting the sound itself, even compressed with the most efficient tools, versus sending low-level (for example, pitch, volume, and duration) or higher level (such as statistical characterization of noise in a stadium) descriptions of it. Harmonizing MPEG-7 and MPEG-4 XMT Before starting our project, we had to ensure harmonization between MPEG-7 and MPEG-4. With MPEG-4 nodes, the harmonization consists of identifying the MPEG-7 description tools that can be mapped to XMT-A MPEG-4. Many times the MPEG-7 approach for describing content is similar to the MPEG-4 approach for representing it. For example, the structural description of content defined by MPEG-7 uses hierarchical decompositions (spatial, temporal, and media component ones), while MPEG-4 defines a hierarchy of nodes for the representation (composition) of a multimedia scene. This is a key point in the harmonization between both standards. MPEG-7 description tools (see the sidebar Current MPEG-7 Tools ) are standardized in ISO/IEC (MPEG-7) parts 3 (visual 5 ), 4 (audio 6 ), and 5 (multimedia description schemes, or MDS). MPEG-7 structural and audio visual description tools are mapped to MPEG-4 that represent MPEG-4 multimedia content. We can map MPEG-7 media information description tools to MPEG-4 elementary stream object descriptors and map creation information description tools to object content information object descriptors. We can map MPEG-7 visual description tools for color, movement, and location to the XMT-A covering the corresponding functionalities. However, we currently can t map MPEG-7 audio description tools to XMT-A, but we can use the tools for creating audio content (using additional audio creation tools) that s part of the multimedia scene, such as synthesizing a sound track. Current MPEG-7 Tools MPEG-7 description tools 1 currently cover six viewpoints: Basic and schema tools provide support for building the real descriptions, so no implicit matching is required. Content management tools cover the description of the media, creation and classification of content, and usage information. Most of these description tools have no direct use for creating content. However, some of them could be used to support intellectual property management and protection (IPMP) functionalities, and the identification of actors, presenters, and so on might help to synthesize characters in the content (or to create characters that would resemble the desired one). Content description tools (structural and conceptual) describe the content to be generated. Structural tools describe content in terms of segments: temporal, spatial, and spatio-temporal. Conceptual tools describe content in terms of the events, (semantic) objects, places, and times present in the content and the relationships among them. Content organization tools describe collections of objects, and although they may have future use (creation of similar contents), currently they aren t under consideration for Authoring 744. Navigation and access tools let users create alternative presentations of the content in terms of resolution views (in space and frequency), summaries, and transcoded variations (in resolution or media translation). These tools, although not directly implied in the generation of content, may be useful in providing hints for generating the alternative presentations of the content depending on the terminal, user, and network preferences. The user interaction tools currently cover only the description of user preferences and usage history, so they don t provide tools for creating content with interaction options. The only relevant tools for the Authoring 744 objective are the content description tools, although some description tools from content management and navigation and access may provide value-added functionalities. Reference 1. J.M. Martínez, Overview of MPEG-7 Description Tools, IEEE MultiMedia, vol. 9, no. 3, July Sept. 2002, pp Selected MPEG-7 description tools The MPEG-7 MDS tools currently used in the Authoring 744 software modules are for the description of an image or a 2D spatial region from an image or video frame. ImageText for the description of a spatial region in an image or a video frame containing text. for the description of a spatiotemporal region within a video. AudioSegment for the description of a (temporal) audio segment. AudioVisualRegion for the description of an audio visual content or a region of it. The audio is described as a temporal interval, while the October December 95
3 Multimedia at Work MPEG-7 Scriptr (MP7 ScriptrLite) 724Transcoder (724TranscoderLite) Figure 1. Authoring 744 general software architecture. User-friendly GUI (coming soon ) MPEG-7 description (.mp7) MPEG-4 XMT-A content (.xml) Transcoder2Play, (ENST s MP4 Manager 6.31) video is specified via a spatio-temporal region. MultimediaSegment for the description of a multimedia content or a segment of it. The segment is described as the decomposition of the different media sources segments (spatial and/or temporal ones). MediaSourceDecomposition for the description of the media sources decomposition of a segment. TemporalRelation classification schemes for the description of temporal relationships in the temporal organization of segments. Graph for the description of a graph of relationships among description instances. The MPEG-7 visual descriptors used are DominantColor for the description of the set of dominant colors of a region. MP4 content (.mp4) MotionTrajectory for the description of the temporal and spatial location of the representative points of an object. This descriptor provides an ordered list of key points and interpolation functions. Player (Envivio TV) the full mapping details in Rubio. 9 content representation format for mapping MPEG-7 to MPEG-4 nodes, we selected the appropriate MPEG-7 description tools and mapped them to XMT-A (and XMT-Ω). You can find the first results in Martínez et al. 8 and Software architecture The Authoring 744 prototype consists of the four software modules shown in Figure 1. Each box shows two names. The top one is the generic tool of our prototype and the bottom one (in parentheses) is the current implementation: 1. The MPEG-7 Scriptr tool lets the user write high-level descriptions of the content (or scene) to be generated and outputs an MPEG-7 description of the content. 2. The 724 Transcoder tool takes this output and creates the actual MPEG-4 XMT-A files. The advantages of using MPEG-4 XMT 3 are that it uses XML-Schema 4 (as MPEG-7 does) and that it s designed to be easily transcoded into MPEG-4 binary format for scenes (BIFS), Virtual Reality Modeling Language (VRML), or Synchronized Multimedia Integration Language (SMIL). This enables displaying the content in various terminals and within different applications. 3. The Transcoder2Play tools takes the MPEG-4 XMT-A files and produces the content in format suitable for the corresponding player. IEEE MultiMedia RegionLocator for the description of the location of regions within images and video frames. Currently, we haven t included any MPEG-7 audio description tool. Also, MPEG-7 lacks description tools for synthetic content. However, we re working toward identifying description tools for synthetic content for a future extension of our system. MPEG-7 and MPEG-4 XMT mapping After choosing MPEG-4 XMT as the target 4. The Player presents and allows interaction with the content. MPEG-7 Scriptr The MPEG-7 Scriptr generates the MPEG- 7 description (in XML) from the user input. The user specifies the multimedia content (or scene) in terms of high-level descriptions like coordinates of regions, colors, text (including font and size), temporal intervals, and media source locations (URLs). After completing the description of the different segments, we can define temporal relationships among segments of the same type. 96
4 Figure 2 illustrates the current implementation of this software module, called MP7ScriptrLite. 724Transcoder The 724Transcoder generates an XMT-A representation of the MPEG-7 description. The 724Transcoder parses the description and loads the information required for generating the corresponding XMT-A specified in the mapping. The output is an XMT-A file that includes all the nodes, object descriptors, and required BIFS commands. Currently, our implementation of the 724Transcoder, named 724TranscoderLite, only runs as a stand-alone application (see Figure 3). In the future, we ll upgrade the 724Transcoder to allow its use at the server side (to store and/or GUI (command line) ImageText AudioSegment AVRegion and generate graph ImageText AudioSegment AVRegion Figure 2. MP7ScriptrLite software architecture. MPEG-7 description Texture type InitialObject descriptor Figure TranscoderLite software architecture. geometry ImageText textual MPEG-7 descripton geometry AudioSegment audio route route XMT-A document AudioVisualRegion Extract object descriptor TemporalRelation AudioVisualRegion object descriptors BIFS commands October December
5 Multimedia at Work SMIL SVG XMT MPEG-7 X3D Figure 4. Playing XMT content. Figure 5. Abstraction of the example scene. Parse Compile MPEG-4 representation (MP4) SMIL player VRML browser MPEG-4 player transmit MPEG-4 XMT content) and at the terminal side (to reduce the size of storage and bit rate by storing and transmitting the description, which will then be transcoded just before presentation). Playing XMT content To play XMT content, we can translate the files to one of the following content representation standards (see Figure 4): SMIL, VRML, and MPEG-4. 3 As Figure 4 shows, we can parse and play the XMT content (representation) directly with a World Wide Web Consortium SMIL player, preprocess it to Web3D X3D, and play it back with a VRML player, or compile it to an MPEG-4 representation such as MP4, which an MPEG-4 player can then play. Because several freely available players exist, we re not currently implementing a tool for playing content, but integrating available ones. In the first phase, we integrated the tools for playing the XMT-A content as MPEG-4 files. For the Transcoder2Play module we re currently considering only a transcoder tool from MPEG-4 textual to binary. We integrated the MP4Tool (version 6.31) from École Nationale Supérieure des Télécommunications, or ENST (see MP4Tool transcodes from XMT-A to MPEG-4 binary representation format, allowing the possibility of importing audio, video, and image archives in the MP4 file. For playing the MPEG-4 file, we integrated the Envivio TV Player, a plug-in for playing MPEG-4 streams and files in the RealNetworks player (see for more information). Sample result Here we present an example where we created a multimedia scene containing video, text, audio, images, and geometric regions (static and moving ones). Figure 5 shows an abstraction of the scene, consisting of one audio visual region (playing two videos sequentially), two colored moving regions, three static regions (with temporal relationships among them and with different textures), and three textual regions (with temporal relationships among them). Colored moving region 1 with video texture (t = 2) Text Several lines of text (t= 2) 2 AV objects: sequential (t = 0, t= 25) The MP7ScriptrLite writes the scene script via an easy-to-use menu and generates an MPEG-7 description that s the output file for the 724TranscoderLite. Taking as input the output file resulting from the 724Transcoder- Lite, the MP4Tool generates the binary MPEG-4 file that the Envivio TV player plays (see Figure 6 for five moments of the scene play). with image texture with image texture Colored moving region 2 Conclusions We selected MPEG-4 and MPEG- 7, respectively, for content and description representation of the Authoring 744 research initiative. At this stage of our research, we believe that you can use this authoring methodology (writing descrip- 98
6 (a) (b) (c) Figure 6. Five moments from the generated content. (a) t = start, (b) t = 2 seconds, (c) t = 10 seconds, (d) t = 25 seconds, and (e) t = end. (d) (e) tions to be transcoded to content) to generate content as in a multimedia object editor. Current work includes developing a userfriendly GUI for the MP7ScriptrLite and additional MPEG-7 Scriptr modules. We ve begun exploring how to translate the conceptual information from MPEG-7 descriptions to MPEG- 4 content to create content using more abstract and generic components and concepts in the writing process. We ve also identified 10 the need for further MPEG-7 description tools such as the description of synthetic objects through the Animation Framework Extension (AFX). 11 MM References 1. R. Koenen, ed., MPEG-4 Overview, ISO/MPEG N5522, Mar J.M. Martínez, ed., Overview of the MPEG-7 Standard, ISO/MPEG N5525, Mar MPEG Systems Group, Final Draft Amendment of ISO/IEC :2001/Amd2 Information Technology Coding of Audio-Visual Objects Part 1: Systems Amendment 2: XMT (MPEG N4698), Mar D.C. Fallside, ed., XML Schema Part 0: Premiere (W3C Candidate Recommendation), Oct MPEG Video Group, Final Draft Int l Std. ISO/IEC Information Technology Multimedia Content Description Interface Part 3: Visual (MPEG N4358), July MPEG Audio Group, Final Draft Int l Std. ISO/IEC Information Technology Multimedia Content Description Interface Part 4: Audio (MPEG N4224), July MPEG Multimedia Description Schemes Group, Final Draft Int l Std. ISO/IEC Information Technology Multimedia Content Description Interface Part 5: Multimedia Description Schemes (MPEG N4242), July J.M. Martínez, L.F. Rubio, and F. Morán, Authoring 744: First Results, Proc. ACM Multimedia 2002 Conf., ACM Press, pp L.F. Rubio, Autoría de Documentos Multimedia Mediante Descripciones de Alto Nivel (Authoring Multimedia Documents via High-Level Descriptions), master s thesis, ETSI Telecomunicación, Univ. Politécnica de Madrid, July J.M. Martínez and F. Morán, From Descriptions to Content: Inverting the Sense (Authoring 744), Proc. Int l Conf. Media Futures 2001, 2001, pp M. Bourges-Sévenier et al., eds., Final Draft Int l Std. ISO/IEC Information Technology Coding of Audio-Visual Objects Part 16: Animation Framework extension (MPEG N5397), Dec Readers may contact José M. Martínez at Grupo de Tratamiento de Imágenes, Escuela Politécnica Superior, Universidad Autónoma de Madrid, Ctra. Colmenar Viejo, km. 15, E Madrid, Spain; JoseM.Martinez@uam.es. Contact editor Tiziana Catarci at the Dept. of Information Systems, Univ. of Rome La Sapienza, Via Salaria 113, Rome, Italy; catarci@dis.uniroma1.it. October December
MPEG-4. Today we'll talk about...
INF5081 Multimedia Coding and Applications Vårsemester 2007, Ifi, UiO MPEG-4 Wolfgang Leister Knut Holmqvist Today we'll talk about... MPEG-4 / ISO/IEC 14496...... is more than a new audio-/video-codec...
More informationMPEG-4 AUTHORING TOOL FOR THE COMPOSITION OF 3D AUDIOVISUAL SCENES
MPEG-4 AUTHORING TOOL FOR THE COMPOSITION OF 3D AUDIOVISUAL SCENES P. Daras I. Kompatsiaris T. Raptis M. G. Strintzis Informatics and Telematics Institute 1,Kyvernidou str. 546 39 Thessaloniki, GREECE
More informationLesson 6. MPEG Standards. MPEG - Moving Picture Experts Group Standards - MPEG-1 - MPEG-2 - MPEG-4 - MPEG-7 - MPEG-21
Lesson 6 MPEG Standards MPEG - Moving Picture Experts Group Standards - MPEG-1 - MPEG-2 - MPEG-4 - MPEG-7 - MPEG-21 What is MPEG MPEG: Moving Picture Experts Group - established in 1988 ISO/IEC JTC 1 /SC
More informationInteractive Authoring Tool for Extensible MPEG-4 Textual Format (XMT)
Interactive Authoring Tool for Extensible MPEG-4 Textual Format (XMT) Kyungae Cha 1 and Sangwook Kim 2 Abstract. MPEG-4 is an ISO/IEC standard which defines a multimedia system for communicating interactive
More informationM PEG-7,1,2 which became ISO/IEC 15398
Editor: Peiya Liu Siemens Corporate Research MPEG-7 Overview of MPEG-7 Tools, Part 2 José M. Martínez Polytechnic University of Madrid, Spain M PEG-7,1,2 which became ISO/IEC 15398 standard in Fall 2001,
More informationMPEG-4: Overview. Multimedia Naresuan University
MPEG-4: Overview Multimedia Naresuan University Sources - Chapters 1 and 2, The MPEG-4 Book, F. Pereira and T. Ebrahimi - Some slides are adapted from NTNU, Odd Inge Hillestad. MPEG-1 and MPEG-2 MPEG-1
More informationThe BilVideo video database management system
Editor: Tiziana Catarci University of Rome BilVideo: A Video Database Management System Mehmet Emin Dönderler, Ediz Şaykol, Özgür Ulusoy, and Uğur Güdükbay Bilkent University, Ankara, Turkey Figure 1.
More informationMPEG 기반 AR 표준화현황. 건국대학교컴퓨터공학부윤경로 (yoonk_at_konkuk.ac.kr)
MPEG 기반 AR 표준화현황 건국대학교컴퓨터공학부윤경로 (yoonk_at_konkuk.ac.kr) CONTENTS Background of MPEG Status of MPEG-AR activities AR from MPEG s view AR Application Format (23000-13) AR Reference Model (23000-14) Use Cases
More informationDelivery Context in MPEG-21
Delivery Context in MPEG-21 Sylvain Devillers Philips Research France Anthony Vetro Mitsubishi Electric Research Laboratories Philips Research France Presentation Plan MPEG achievements MPEG-21: Multimedia
More informationEE Multimedia Signal Processing. Scope & Features. Scope & Features. Multimedia Signal Compression VI (MPEG-4, 7)
EE799 -- Multimedia Signal Processing Multimedia Signal Compression VI (MPEG-4, 7) References: 1. http://www.mpeg.org 2. http://drogo.cselt.stet.it/mpeg/ 3. T. Berahimi and M.Kunt, Visual data compression
More informationInteroperable Content-based Access of Multimedia in Digital Libraries
Interoperable Content-based Access of Multimedia in Digital Libraries John R. Smith IBM T. J. Watson Research Center 30 Saw Mill River Road Hawthorne, NY 10532 USA ABSTRACT Recent academic and commercial
More informationINTEGRATING MPEG-4 MEDIA IN THE CONTEXT OF HTML5 TECHNOLOGIES DIONISIOS KLADIS. B.A., Technological Educational Institute of Crete, 2010 A THESIS
INTEGRATING MPEG-4 MEDIA IN THE CONTEXT OF HTML5 TECHNOLOGIES by DIONISIOS KLADIS B.A., Technological Educational Institute of Crete, 2010 A THESIS submitted in partial fulfillment of the requirements
More informationCONTENT MODEL FOR MOBILE ADAPTATION OF MULTIMEDIA INFORMATION
CONTENT MODEL FOR MOBILE ADAPTATION OF MULTIMEDIA INFORMATION Maija Metso, Antti Koivisto and Jaakko Sauvola MediaTeam, MVMP Unit Infotech Oulu, University of Oulu e-mail: {maija.metso, antti.koivisto,
More informationIST MPEG-4 Video Compliant Framework
IST MPEG-4 Video Compliant Framework João Valentim, Paulo Nunes, Fernando Pereira Instituto de Telecomunicações, Instituto Superior Técnico, Av. Rovisco Pais, 1049-001 Lisboa, Portugal Abstract This paper
More informationISO/IEC INTERNATIONAL STANDARD. Information technology Coding of audio-visual objects Part 18: Font compression and streaming
INTERNATIONAL STANDARD ISO/IEC 14496-18 First edition 2004-07-01 Information technology Coding of audio-visual objects Part 18: Font compression and streaming Technologies de l'information Codage des objets
More informationExtraction, Description and Application of Multimedia Using MPEG-7
Extraction, Description and Application of Multimedia Using MPEG-7 Ana B. Benitez Depart. of Electrical Engineering, Columbia University, 1312 Mudd, 500 W 120 th Street, MC 4712, New York, NY 10027, USA
More informationAn Adaptive Scene Compositor Model in MPEG-4 Player for Mobile Device
An Adaptive Scene Compositor Model in MPEG-4 Player for Mobile Device Hyunju Lee and Sangwook Kim Computer Science Department, Kyungpook National University 1370 Sankyuk-dong Buk-gu, Daegu, 702-701, Korea
More informationTypes and Methods of Content Adaptation. Anna-Kaisa Pietiläinen
Types and Methods of Content Adaptation Anna-Kaisa Pietiläinen Agenda Introduction Multimedia Content Types Types of Adaptation Methods of Adaptation Conclusion Networks 2 Introduction Networks 3 The Problem
More informationMPEG-7. Multimedia Content Description Standard
MPEG-7 Multimedia Content Description Standard Abstract The purpose of this presentation is to provide a better understanding of the objectives & components of the MPEG-7, "Multimedia Content Description
More informationThe ToCAI Description Scheme for Indexing and Retrieval of Multimedia Documents 1
The ToCAI Description Scheme for Indexing and Retrieval of Multimedia Documents 1 N. Adami, A. Bugatti, A. Corghi, R. Leonardi, P. Migliorati, Lorenzo A. Rossi, C. Saraceno 2 Department of Electronics
More informationOn Design of 3D and Multimedia Extension of Information System Using VRML
On Design of 3D and Multimedia Extension of Information System Using VRML Jiří Žára Daniel Černohorský Department of Computer Science & Engineering Czech Technical University Karlovo nam 13 121 35 Praha
More informationAn Intelligent System for Archiving and Retrieval of Audiovisual Material Based on the MPEG-7 Description Schemes
An Intelligent System for Archiving and Retrieval of Audiovisual Material Based on the MPEG-7 Description Schemes GIORGOS AKRIVAS, SPIROS IOANNOU, ELIAS KARAKOULAKIS, KOSTAS KARPOUZIS, YANNIS AVRITHIS
More informationMPEG-21 IPMP. Jeong Hyun Kim, Seong Oun Hwang, Ki Song Yoon, Chang Soon Park
MPEG-21 IPMP Jeong Hyun Kim, Seong Oun Hwang, Ki Song Yoon, Chang Soon Park Abstract Intellectual Property Management and Protection (IPMP) is a work in progress for MPEG content. Through the activities
More informationVideo Search and Retrieval Overview of MPEG-7 Multimedia Content Description Interface
Video Search and Retrieval Overview of MPEG-7 Multimedia Content Description Interface Frederic Dufaux LTCI - UMR 5141 - CNRS TELECOM ParisTech frederic.dufaux@telecom-paristech.fr SI350, May 31, 2013
More informationIntroduction to X3D. Roberto Ranon HCI Lab University of Udine, Italy
Introduction to X3D Roberto Ranon ranon@dimi.uniud.it HCI Lab University of Udine, Italy http://hcilab.uniud.it Outline What is X3D? X3D basics including some new capabilities and details on the (near)
More informationISO/IEC INTERNATIONAL STANDARD. Information technology Multimedia content description interface Part 5: Multimedia description schemes
INTERNATIONAL STANDARD ISO/IEC 15938-5 First edition 2003-05-15 Information technology Multimedia content description interface Part 5: Multimedia description schemes Technologies de l'information Interface
More informationISO/IEC INTERNATIONAL STANDARD. Information technology Coding of audio-visual objects Part 16: Animation Framework extension (AFX)
INTERNATIONAL STANDARD ISO/IEC 14496-16 Fourth edition 2011-11-01 Information technology Coding of audio-visual objects Part 16: Animation Framework extension (AFX) Technologies de l'information Codage
More informationUSING METADATA TO PROVIDE SCALABLE BROADCAST AND INTERNET CONTENT AND SERVICES
USING METADATA TO PROVIDE SCALABLE BROADCAST AND INTERNET CONTENT AND SERVICES GABRIELLA KAZAI 1,2, MOUNIA LALMAS 1, MARIE-LUCE BOURGUET 1 AND ALAN PEARMAIN 2 Department of Computer Science 1 and Department
More informationRegion Feature Based Similarity Searching of Semantic Video Objects
Region Feature Based Similarity Searching of Semantic Video Objects Di Zhong and Shih-Fu hang Image and dvanced TV Lab, Department of Electrical Engineering olumbia University, New York, NY 10027, US {dzhong,
More informationExternal Interaction Management of VRML Scenes for E-Learning Applications
External Interaction Management of VRML Scenes for E-Learning Applications José M. Cubero, Luis Salgado, Jesús Bescós, Francisco Morán and Julián Cabrera ETS. Ing. Telecomunicación Universidad Politécnica
More informationLecture 3: Multimedia Metadata Standards. Prof. Shih-Fu Chang. EE 6850, Fall Sept. 18, 2002
Lecture 3: Multimedia Metadata Standards Prof. Shih-Fu Chang EE 6850, Fall 2002 Sept. 18, 2002 Course URL: http://www.ee.columbia.edu/~sfchang/course/vis/ EE 6850, F'02, Chang, Columbia U 1 References
More informationThe MPEG-7 Description Standard 1
The MPEG-7 Description Standard 1 Nina Jaunsen Dept of Information and Media Science University of Bergen, Norway September 2004 The increasing use of multimedia in the general society and the need for
More informationScalable Hierarchical Summarization of News Using Fidelity in MPEG-7 Description Scheme
Scalable Hierarchical Summarization of News Using Fidelity in MPEG-7 Description Scheme Jung-Rim Kim, Seong Soo Chun, Seok-jin Oh, and Sanghoon Sull School of Electrical Engineering, Korea University,
More informationINTERNATIONAL STANDARD
INTERNATIONAL STANDARD ISO/IEC 14496-1 Third edition 2004-11-15 Information technology Coding of audio-visual objects Part 1: Systems Technologies de l'information Codage des objets audiovisuels Partie
More informationScript for Visualization of Algorithms: Framework for Animation Environment and Composite Structures
DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING, IIT KHARAGPUR Script for Visualization of Algorithms: Framework for Animation Environment and Composite Structures A synopsis of the thesis to be submitted
More informationlesson 24 Creating & Distributing New Media Content
lesson 24 Creating & Distributing New Media Content This lesson includes the following sections: Creating New Media Content Technologies That Support New Media Distributing New Media Content Creating New
More informationIntroduction. Multimedia Applications and Data Management Requirements 1.1 HETEROGENEITY
1 Introduction Multimedia Applications and Data Management Requirements Among countless others, applications of multimedia databases include personal and public photo/media collections, personal information
More informationFramework for Supporting Metadata Services
Framework for Supporting Services Mitsuaki Tsunakara, Ryoji Kataoka, and Masashi Morimoto Abstract -sharing businesses have been attracting considerable attention recently. These include highspeed search
More informationMPEG-4 Structured Audio Systems
MPEG-4 Structured Audio Systems Mihir Anandpara The University of Texas at Austin anandpar@ece.utexas.edu 1 Abstract The MPEG-4 standard has been proposed to provide high quality audio and video content
More informationFor many years, the creation and dissemination
Standards in Industry John R. Smith IBM The MPEG Open Access Application Format Florian Schreiner, Klaus Diepold, and Mohamed Abo El-Fotouh Technische Universität München Taehyun Kim Sungkyunkwan University
More information5th AR Standards Community Meeting March 19-20, Austin, US Marius Preda Institut TELECOM
MPEG Technologies and Roadmap for AR 5th AR Standards Community Meeting March 19-20, Austin, US Marius Preda Institut TELECOM What is MPEG? A family of standards published by ISO/IEC dealing with: Coding/compression
More informationA SMIL Editor and Rendering Tool for Multimedia Synchronization and Integration
A SMIL Editor and Rendering Tool for Multimedia Synchronization and Integration Stephen J.H. Yang 1, Norman W.Y. Shao 2, Kevin C.Y. Kuo 3 National Central University 1 National Kaohsiung First University
More informationAUDIOVISUAL ARCHIVE WITH MPEG-7 VIDEO DESCRIPTION AND XML DATABASE
AUDIOVISUAL ARCHIVE WITH MPEG-7 VIDEO DESCRIPTION AND XML DATABASE Pedro Almeida, Joaquim Arnaldo Martins, Joaquim Sousa Pinto, Helder Troca Zagalo IEETA Instituto Engenharia Electrónica e Telemática de
More informationVolume 4, Number 3 MPEG-V and Other Virtual Worlds Standards December 2011
Volume 4, Number 3 MPEG-V and Other Virtual Worlds Standards December 2011 Editor-in-Chief Managing Editor Guest Editors Jeremiah Spence Yesha Sivan Jean H.A. Gelissen, Philips Research, Netherlands Marius
More informationLesson 11. Media Retrieval. Information Retrieval. Image Retrieval. Video Retrieval. Audio Retrieval
Lesson 11 Media Retrieval Information Retrieval Image Retrieval Video Retrieval Audio Retrieval Information Retrieval Retrieval = Query + Search Informational Retrieval: Get required information from database/web
More informationApple Inc. November 2007
Standardized multimedia elements in HTML5 Position paper for the W3C Video on the web workshop Kevin Calhoun, Eric Carlson, Adele Peterson, Antti Koivisto Apple Inc. November 2007 1 Introduction We believe
More informationISO/IEC Information technology Coding of audio-visual objects Part 15: Advanced Video Coding (AVC) file format
This is a preview - click here to buy the full publication INTERNATIONAL STANDARD ISO/IEC 14496-15 First edition 2004-04-15 Information technology Coding of audio-visual objects Part 15: Advanced Video
More informationMPEG-7 Audio: Tools for Semantic Audio Description and Processing
MPEG-7 Audio: Tools for Semantic Audio Description and Processing Jürgen Herre for Integrated Circuits (FhG-IIS) Erlangen, Germany Jürgen Herre, hrr@iis.fhg.de Page 1 Overview Why semantic description
More informationIncreazing interactivity in IPTV using MPEG-21 descriptors
Increazing interactivity in IPTV using MPEG-21 descriptors Christos-Nikolaos Anagnostopoulos 1, George Tsekouras 1, Damianos Gavalas 1, Daphne Economou 1 and Ioannis Psoroulas 2 1 University of the Aegean,
More informationISO/IEC INTERNATIONAL STANDARD. Information technology Coding of audio-visual objects Part 12: ISO base media file format
INTERNATIONAL STANDARD ISO/IEC 14496-12 Third edition 2008-10-15 Information technology Coding of audio-visual objects Part 12: ISO base media file format Technologies de l'information Codage des objets
More informationMPEG-4 is a standardized digital video technology
MPEG-4 is a standardized digital video technology What is Digital Video? What are Digital Video Standards? What is MPEG-4? How MPEG-4 is the same as other digital video technologies. How MPEG-4 is different
More informationOverview of the MPEG-7 Standard and of Future Challenges for Visual Information Analysis
EURASIP Journal on Applied Signal Processing 2002:4, 343 353 c 2002 Hindawi Publishing Corporation Overview of the MPEG-7 Standard and of Future Challenges for Visual Information Analysis Philippe Salembier
More informationLecture Encoding of Distance Education by Multimedia Integration
Journal of Engineering Education Research Vol. 17, No. 3, pp. 34~41, May 2014 Lecture Encoding of Distance Education by Multimedia Integration Wouseok Jou *, *Dept. of Computer Engineering, Myongji University
More informationAbout MPEG Compression. More About Long-GOP Video
About MPEG Compression HD video requires significantly more data than SD video. A single HD video frame can require up to six times more data than an SD frame. To record such large images with such a low
More informationINTERNATIONAL ORGANISATION FOR STANDARDISATION ORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC1/SC29/WG11 CODING OF MOVING PICTURES AND AUDIO
INTERNATIONAL ORGANISATION FOR STANDARDISATION ORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC1/SC29/WG11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC1/SC29/WG11/ N2461 MPEG 98 October1998/Atlantic
More informationOverview of the MPEG-7 Standard and of Future Challenges for Visual Information Analysis
EURASIP Journal on Applied Signal Processing 2002:4, 1 11 c 2002 Hindawi Publishing Corporation Overview of the MPEG-7 Standard and of Future Challenges for Visual Information Analysis Philippe Salembier
More informationGeorgios Tziritas Computer Science Department
New Video Coding standards MPEG-4, HEVC Georgios Tziritas Computer Science Department http://www.csd.uoc.gr/~tziritas 1 MPEG-4 : introduction Motion Picture Expert Group Publication 1998 (Intern. Standardization
More informationWorkshop W14 - Audio Gets Smart: Semantic Audio Analysis & Metadata Standards
Workshop W14 - Audio Gets Smart: Semantic Audio Analysis & Metadata Standards Jürgen Herre for Integrated Circuits (FhG-IIS) Erlangen, Germany Jürgen Herre, hrr@iis.fhg.de Page 1 Overview Extracting meaning
More informationAdaptive Multimedia Messaging based on MPEG-7 The M 3 -Box
Adaptive Multimedia Messaging based on MPEG-7 The M 3 -Box Abstract Jörg Heuer José Luis Casas André Kaup {Joerg.Heuer, Jose.Casas, Andre.Kaup}@mchp.siemens.de Siemens Corporate Technology, Information
More informationWhat is multimedia? Multimedia. Continuous media. Most common media types. Continuous media processing. Interactivity. What is multimedia?
Multimedia What is multimedia? Media types +Text + Graphics + Audio +Image +Video Interchange formats What is multimedia? Multimedia = many media User interaction = interactivity Script = time 1 2 Most
More informationAn Efficient Player for MPEG-4 Contents on a Mobile Device
An Efficient Player for MPEG-4 Contents on a Mobile Device Sangwook Kim 1 and Kyungdeok Kim 2 1 Department of Computer Science, Kyungpook National University, Daegu, 702-701, Korea swkim@cs.knu.ac.kr 2
More informationHIERARCHICAL VISUAL DESCRIPTION SCHEMES FOR STILL IMAGES AND VIDEO SEQUENCES
HIERARCHICAL VISUAL DESCRIPTION SCHEMES FOR STILL IMAGES AND VIDEO SEQUENCES Universitat Politècnica de Catalunya Barcelona, SPAIN philippe@gps.tsc.upc.es P. Salembier, N. O Connor 2, P. Correia 3 and
More informationISO/IEC INTERNATIONAL STANDARD. Information technology Coding of audio-
INTERNATIONAL STANDARD This is a preview - click here to buy the full publication ISO/IEC 14496-15 Third edition 2014 07 01 Information technology Coding of audio- visual objects Part 15: Carriage of network
More informationMultimedia. What is multimedia? Media types. Interchange formats. + Text +Graphics +Audio +Image +Video. Petri Vuorimaa 1
Multimedia What is multimedia? Media types + Text +Graphics +Audio +Image +Video Interchange formats Petri Vuorimaa 1 What is multimedia? Multimedia = many media User interaction = interactivity Script
More informationThe Virtual Meeting Room
Contact Details of Presenting Authors Stefan Rauthenberg (rauthenberg@hhi.de), Peter Kauff (kauff@hhi.de) Tel: +49-30-31002 266, +49-30-31002 615 Fax: +49-30-3927200 Summation Brief explaination of the
More informationViz Multi Platform Suite
Viz Multi Platform Suite Viz Multi Platform Suite distributes high-quality video and graphics content to the internet and multimedia-enabled devices. Viz Multi Platform Suite Personalize the live experience
More informationTable of Contents. Table of Figures. Document Change Log
The Virtual Producer Project All information is subject to change without notice and does not represent a commitment on the part of. Release 1.40 (October 2013) Table of Contents 1. Introduction 2. Goals
More informationTitle: Automatic event detection for tennis broadcasting. Author: Javier Enebral González. Director: Francesc Tarrés Ruiz. Date: July 8 th, 2011
MASTER THESIS TITLE: Automatic event detection for tennis broadcasting MASTER DEGREE: Master in Science in Telecommunication Engineering & Management AUTHOR: Javier Enebral González DIRECTOR: Francesc
More information0 MPEG Systems Technologies- 27/10/2007. MPEG Systems and 3DGC Technologies Olivier Avaro Systems Chairman
0 MPEG Systems Technologies- 27/10/2007 MPEG Systems and 3DGC Technologies Olivier Avaro Systems Chairman Overview of The Presentation 1 MPEG Systems Technologies- 27/10/2007 Key Standards Developed in
More informationISO/IEC INTERNATIONAL STANDARD. Information technology Multimedia application format (MPEG-A) Part 13: Augmented reality application format
INTERNATIONAL STANDARD This is a preview - click here to buy the full publication ISO/IEC 23000-13 First edition 2014-05-15 Information technology Multimedia application format (MPEG-A) Part 13: Augmented
More informationIntroduction to MPEG-4
5255ch01.qxd_sm 11/29/01 9:22 AM Page 1 CHAPTER 1 Introduction to MPEG-4 OLIVIER AVARO TOPICS IN THIS CHAPTER THE MPEG BRAIN AND ITS ARTIFACTS MPEG-4 IN A NUTSHELL ARCHITECTURE AND TOOLS NEXT GENERATION
More informationHermes - A Framework for Location-Based Data Management *
Hermes - A Framework for Location-Based Data Management * Nikos Pelekis, Yannis Theodoridis, Spyros Vosinakis, and Themis Panayiotopoulos Dept of Informatics, University of Piraeus, Greece {npelekis, ytheod,
More informationA MULTIPOINT VIDEOCONFERENCE RECEIVER BASED ON MPEG-4 OBJECT VIDEO. Chih-Kai Chien, Chen-Yu Tsai, and David W. Lin
A MULTIPOINT VIDEOCONFERENCE RECEIVER BASED ON MPEG-4 OBJECT VIDEO Chih-Kai Chien, Chen-Yu Tsai, and David W. Lin Dept. of Electronics Engineering and Center for Telecommunications Research National Chiao
More informationDeveloping a Reference Model for Augmented Reality. 5th International AR Standards Community Meeting 19 March 2012
Developing a Reference Model for Augmented Reality 5th International AR Standards Community Meeting 19 March 2012 What are uses of a Reference Model? Basis for coordination and understanding of the AR
More informationLecture 7: Introduction to Multimedia Content Description. Reji Mathew & Jian Zhang NICTA & CSE UNSW COMP9519 Multimedia Systems S2 2009
Lecture 7: Introduction to Multimedia Content Description Reji Mathew & Jian Zhang NICTA & CSE UNSW COMP9519 Multimedia Systems S2 2009 Outline Why do we need to describe multimedia content? Low level
More informationOptimal Video Adaptation and Skimming Using a Utility-Based Framework
Optimal Video Adaptation and Skimming Using a Utility-Based Framework Shih-Fu Chang Digital Video and Multimedia Lab ADVENT University-Industry Consortium Columbia University Sept. 9th 2002 http://www.ee.columbia.edu/dvmm
More informationMPEG-4 Authoring Tool for the Composition of 3D Audiovisual Scenes
1 MPEG-4 Authoring Tool for the Composition of 3D Audiovisual Scenes Petros Daras, Ioannis Kompatsiaris, Member, IEEE, Theodoros Raptis and Michael G. Strintzis* Fellow, IEEE This work was supported by
More informationClustering Methods for Video Browsing and Annotation
Clustering Methods for Video Browsing and Annotation Di Zhong, HongJiang Zhang 2 and Shih-Fu Chang* Institute of System Science, National University of Singapore Kent Ridge, Singapore 05 *Center for Telecommunication
More informationAUTOMATIC VIDEO INDEXING
AUTOMATIC VIDEO INDEXING Itxaso Bustos Maite Frutos TABLE OF CONTENTS Introduction Methods Key-frame extraction Automatic visual indexing Shot boundary detection Video OCR Index in motion Image processing
More informationX3D Specification Activities
X3D Specification Activities fasten your seat belts! Don Brutzman X3D Working Group Web3D Consortium 22 January 2019 1 First Many thanks to Korea Chapter of Web3D Consortium for Many sustained and stellar
More informationPreparing design to support automation and robotisation in construction
Preparing design to support automation and robotisation in construction Yuhua Luo University of Balearic Islands 07122 Palma de Mallorca, Spain dmilyu0@uib.es ABSTRACT: To support automation and robotisation
More informationA MPEG-4/7 based Internet Video and Still Image Browsing System
A MPEG-4/7 based Internet Video and Still Image Browsing System Miroslaw Bober 1, Kohtaro Asai 2 and Ajay Divakaran 3 1 Mitsubishi Electric Information Technology Center Europe VIL, Guildford, Surrey,
More informationArich media service is a dynamic, interactive
What s New with MPEG? An MPEG Standard for Rich Media Services Lightweight Application Scene Representation () is the Moving Picture Expert Group s solution for delivering rich media services to mobile,
More informationInteractive Media CTAG Alignments
Interactive Media CTAG Alignments This document contains information about eight Career-Technical Articulation Numbers (CTANs) for the Media Arts Career-Technical Assurance Guide (CTAG). The CTANs are:
More informationOptical Storage Technology. MPEG Data Compression
Optical Storage Technology MPEG Data Compression MPEG-1 1 Audio Standard Moving Pictures Expert Group (MPEG) was formed in 1988 to devise compression techniques for audio and video. It first devised the
More information8 Description of a Single Multimedia Document
8 Description of a Single Multimedia Document Ana B. Benitez 1, José M.Martinez 2, Hawley Rising 3 and Philippe Salembier 4 1 Columbia University, New York, USA, 2 Universidad Politècnica de Madrid, Madrid,
More informationWebGL Meetup GDC Copyright Khronos Group, Page 1
WebGL Meetup GDC 2012 Copyright Khronos Group, 2012 - Page 1 Copyright Khronos Group, 2012 - Page 2 Khronos API Ecosystem Trends Neil Trevett Vice President Mobile Content, NVIDIA President, The Khronos
More informationISO/IEC JTC 1/SC 29 N 15974
ISO/IEC JTC 1/SC 29 N 15974 ISO/IEC JTC 1/SC 29 Coding of audio, picture, multimedia and hypermedia information Secretariat: JISC (Japan) Document type: Title: Status: Meeting Agenda Draft Agenda, the
More informationOverview of the MPEG-4 Standard
Page 1 of 78 INTERNATIONAL ORGANISATION FOR STANDARDISATION ORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC1/SC29/WG11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC1/SC29/WG11 N4668 March 2002
More informationAbstractions in Multimedia Authoring: The MAVA Approach
Abstractions in Multimedia Authoring: The MAVA Approach Jürgen Hauser, Jing Tian Institute of Parallel and Distributed High-Performance Systems (IPVR) University of Stuttgart, Breitwiesenstr. 20-22, D
More informationFuture of X3D: X3D version 4 with HTML5/DOM
7 June 2017 Future of X3D: X3D version 4 with HTML5/DOM Don Brutzman and Roy Walmsley, X3D Working Group Cochairs Summary. This presentation discusses working-group design and execution strategies for
More informationInterworking Between SIP and MPEG-4 DMIF For Heterogeneous IP Video Conferencing
Interworking Between SIP and DMIF For Heterogeneous IP Video Conferencing Toufik Ahmed 1, Ahmed Mehaoua 1 and Raouf Boutaba 2 1 University of Versailles, CNRS-PRiSM Lab. 45 av. des Etats-Unis, 78000, Versailles,
More informationDeveloping a Multimedia Toolbox for the Khoros System. Yuh-Lin Chang. Rafael Alonso. Matsushita Information Technology Laboratory
Developing a Multimedia Toolbox for the Khoros System Yuh-Lin Chang Rafael Alonso Matsushita Information Technology Laboratory Panasonic Technologies, Inc. Two Research Way Princeton, NJ 08540, USA fyuhlin,alonsog@mitl.research.panasonic.com
More informationTopics. Overview of VRML 97 VRML Today After VRML
VRML Ruth Aylett Topics Overview of VRML 97 VRML Today After VRML What is VRML? VR modelling language NOT a programming language! Open standard (1997) for Internet sharing of 3D files and Virtual Worlds
More informationManagement of Multimedia Semantics Using MPEG-7
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Management of Multimedia Semantics Using MPEG-7 Uma Srinivasan and Ajay Divakaran TR2004-116 October 2004 Abstract This chapter presents the
More informationWHAT IS BFA NEW MEDIA?
VISUAL & TYPE WEB & INTERACTIVE MOTION GRAPHICS DIGITAL IMAGING VIDEO DIGITAL PHOTO VECTOR DRAWING AUDIO To learn more and see three years of our best student work, please visit: webdesignnewmedia.com
More informationCONTEXT-SENSITIVE VISUAL RESOURCE BROWSER
CONTEXT-SENSITIVE VISUAL RESOURCE BROWSER Oleksiy Khriyenko Industrial Ontologies Group, Agora Center, University of Jyväskylä P.O. Box 35(Agora), FIN-40014 Jyväskylä, Finland ABSTRACT Now, when human
More informationX3D Efficient Binary Encoding (EBE)
X3D Efficient Binary Encoding (EBE) Background and Overview Web3D 2015 Conference Heraklion Crete, 18 June 2015 1 Long straight trail has led here... Compressed Binary Encoding (CBE) Call for Contributions
More informationCloud-Based Multimedia Content Protection System
Cloud-Based Multimedia Content Protection System Abstract Shivanand S Rumma Dept. of P.G. Studies Gulbarga University Kalaburagi Karnataka, India shivanand_sr@yahoo.co.in In day to day life so many multimedia
More informationVector Bank Based Multimedia Codec System-on-a-Chip (SoC) Design
2009 10th International Symposium on Pervasive Systems, Algorithms, and Networks Vector Bank Based Multimedia Codec System-on-a-Chip (SoC) Design Ruei-Xi Chen, Wei Zhao, Jeffrey Fan andasaddavari Computer
More information