0 MPEG Systems Technologies- 27/10/2007. MPEG Systems and 3DGC Technologies Olivier Avaro Systems Chairman

Size: px

Start display at page:

Download "0 MPEG Systems Technologies- 27/10/2007. MPEG Systems and 3DGC Technologies Olivier Avaro Systems Chairman"

Dennis Brown
5 years ago
Views:

1 0 MPEG Systems Technologies- 27/10/2007 MPEG Systems and 3DGC Technologies Olivier Avaro Systems Chairman

2 Overview of The Presentation 1 MPEG Systems Technologies- 27/10/2007 Key Standards Developed in the Systems Group so Far MPEG-2 Systems MPEG-4 Systems and BIFS MP4 File Format Standards Developed in the Last 2 Years MPEG-B BiM : Binarization of XML Data Open Font Format LASeR : Light Application Scene Representation On-going / Future Activities MPEG Application Formats Developed in Systems Musical Slide Show, Portable Video and Digital Broadcasting, Stereoscopic, Web-IP-Mobile TV Multimedia extensible Middleware Information Exchange with Virtual Worlds

3 MPEG-4 Systems : Architecture and BIFS 2 MPEG Systems Technologies- 27/10/2007

4 MPEG-4 File Format 3 MPEG Systems Technologies- 27/10/2007 ISO ISO File Format is based on ISO Base Base Media Media File File Format QT architecture. Format ( ) ( ) Apple s Apple s QuickTime QuickTime (QT) (QT) File File Format Format (*.mov) (*.mov) Original Design MPEG-4 MPEG-4 File File Format Format ( ) ( ) AVC AVC File File Format Format ( ) ( ) *.mp4 files 3GPP 3GPP & 3GPP2 3GPP2 File File Format Format (.3gp (.3gp &.3g2).3g2) Motion Motion JPEG2000 JPEG2000 File File Format Format ( ) ( ) (.mj2) (.mj2) MPEG-21 MPEG-21 File File Format Format ( ) ( )

5 MPEG-B BiM : Binarization of XML Data 4 MPEG Systems Technologies- 27/10/2007 AU3 AU2 AU1 FUU FUU Description Fragmentation Fragment based representation of the scene Enables the dynamic and/or progressive transmission of descriptions Streams the fragment in sequence (allowing dynamic evolution of the description) Description Encoding TeM : Text-based representation BiM: Efficient binarized form. Description Indexing Indexing functionality without the cost of a real database. Allow search the index information to determine which description fragments contain specific searched information.

5 MPEG Systems Technologies- 27/10/2007 Open Font Format New MPEG-4 standard based on OpenType font format Complex script layout The use of the OpenType layout

6 5 MPEG Systems Technologies- 27/10/2007 Open Font Format New MPEG-4 standard based on OpenType font format Complex script layout The use of the OpenType layout tables for complex language scripts supports: Bi-directional text flow Horizontal and vertical writing Ligatures Contextual substitution Glyph positioning Glyph variants

7 LASeR : The Standard for Rich Media Services Objectives: Standard format Interactive RichMedia services for Standardized as MPEG-4 Part 20 LASeR : Lightweight Application Scene Representation SAF : Simple Aggregation Format Roadmap Final technical V1 spec. October 2005 Final technical V2 spec. April 2007 Final technical V3 spec. October 2007 Now : Promotion in OMA, 3GPP, DVB, FLO, LASeR Updates W3C/SVG Scenes LASeR Extensions Binary Encoding LASeR 6 MPEG Systems Technologies- 27/10/2007

8 What Does LASeR Specify? 7 MPEG Systems Technologies- 27/10/2007 Reference to SVG Tiny 1.2 graphics, text, media, structure, hyperlink, interpolation animation, reuse, scripting, font, plugin, gradients, metadata LASeR key extensions clipping, pointer emulation, events, scrolling, fast switching, screen orientation Scene updates/commands Binary format compatible with MPEG-B, MPEG- 7, DVB-CBMS Core profile J2ME LASeR Updates W3C/SVG Scenes LASeR Extensions Binary Encoding LASeR

LASeR Engine as Middleware 8 MPEG Systems Technologies- 27/10/2007 MMI Player App Browser App Mobile TV RichMedia Apps LASeR Browser Java RichMedia Apps MW Web

9 LASeR Engine as Middleware 8 MPEG Systems Technologies- 27/10/2007 MMI Player App Browser App Mobile TV RichMedia Apps LASeR Browser Java RichMedia Apps MW Web Browser Engine AV player LASeR Engine (C/C++ Version) JSR 287/MHP interfaces JVM Network Stacks RTP/RTSP Protocol File System HTTP Protocol Broadcast & Interactive Network

9 MPEG Systems Technologies- 27/10/2007 Musical Slide Show MAF Personal image slide show

language exercise tools, e.g. Toefl) Storytelling, Karaoke applications ISO Base Media and

Image 3 Image 4 Image 5 Image Samples Images Time stamps 0sec 5sec 7sec 10 sec 14 sec Text Time

10 9 MPEG Systems Technologies- 27/10/2007 Musical Slide Show MAF Personal image slide show Photo-Music album Educational materials (foreign language exercise tools, e.g. Toefl) Storytelling, Karaoke applications ISO Base Media and MPEG-4 File Format MPEG-1/-2 Layer 3 ( mp3 ) audio coding JPEG ISO Standard MPEG-7 Meta-data (aligned to Music Player MAF and Photo Player MAF) MPEG-4 Part-20 LASeR Mini Profile 3GPP TS Timed Text LASeR Script animation animation animation animation animation Image 1 Image 2 Image 3 Image 4 Image 5 Image Samples Images Time stamps 0sec 5sec 7sec 10 sec 14 sec Text Time stamps Text Samples 0sec 4sec 8sec 12sec Synchronized text (Lyric 1 ) Synchronized text (Lyric 2) Synchronized text (Lyric 3) Synchronized text (Lyric 4) t

11 10 MPEG Systems Technologies- 27/10/2007 Portable Video Player MAF Playback of content the users generated on their own for PVP (downsize and encode), e.g. user created content ( UCC ) Playback of content sold on disk media (mini- DVD), comparable to the DVD business Playback of content sold over the internet, comparable to the online music store business ISO Base Media / MPEG-4 / AVC File Format MPEG-4 AVC Baseline Profile, Level 1.2 MPEG-4 HE-AAC Profile, Level 2, Stereo 48kHz MPEG-4 Streaming Text Format for subtitles MPEG-7 Metadata for movie information like film title, etc. JPEG ISO Standard for still images of e.g. movie posters MPEG-7 Multimedia description scheme, UsageHistory DS, HierarchicalSummary DS MPEG-21 File Format and DID MPEG-4 LASeR Menu options Play Artist Info Gallery Background image with changing opacity value Cappuccino Kiss Only U Scrolling text (e.g. a song title)

12 Digital Multimedia Broadcasting MAF 11 MPEG Systems Technologies- 27/10/ Storage of Mobile Broadcasting Contents 2. IP Media Services 3. Interchange of DMB contents between Terminals 4. User-Creative DMB contents 5. Metadata Applications with DMB MAF Contents, Metadata, Data, License <XML > <!--> </XML> DMB-HE DMB Data Server IP-HE DMB Network (terrestrial /satellite) Internet IP Network (wired/wireless, fixed/mobile) Internet DMB-MAF Terminals 4 Interchange 3 IP-net. Internet

stereoscopic sequences Support of interaction functionality on stereoscopic contents

13 Stereoscopic MAF Storage of Stereoscopic Richmedia Contents Support of the combination contents of 2D and stereoscopic sequences Support of interaction functionality on stereoscopic contents Interchange of stereoscopic contents between mobile devices including phones Metadata Applications with stereoscopic MAF MPEG Systems Technologies- 27/10/2007

14 Web-IP-Mobile TV 13 MPEG Systems Technologies- 27/10/2007 TV on IP Heavily use Metadata XML Data representing information from the Electronic Service Guide. Only the «What» is specified (semantic). No presentation layer. ISO/MPEG - LASeR Rich Media scene description format Only the «How» is specified (presentation). No semantic layer. Areas of Work Define a way to link LASeR scene representation to the elements of XML structured data Define a way to embed LASeR scene component as a part of XML structured data to define its graphical representation

15 14 MPEG Systems Technologies- 27/10/2007 Multimedia extensible Middleware (MxM) Status : Exploration Requirement Phase Mission : A project to exploit MPEG standards in tune with industry practices and needs APIs for : Media encoders/decoders IPMP functionality Audio/Video players Presentation Engine Metadata editing/parsing File Format editing/parsing Stream/consume content OS standard APIs OS OS Areas of Work Architecture Components APIs Reference Software Open Source Project MXM Applications MXM APIs MXM Components

15 MPEG Systems Technologies- 27/10/2007 Information Exchange with Virtual Worlds Status : New Project Started Requirement Phase Mission : Enable

16 15 MPEG Systems Technologies- 27/10/2007 Information Exchange with Virtual Worlds Status : New Project Started Requirement Phase Mission : Enable interoperability between virtual worlds and the real world Interoperability Interfaces for displays, control devices, sensors, robotics, Framework for security, trust, privacy, Metadata supporting avatar mobility and platform diversification User profile characterization Combining the new media paradigm with the best of traditional media Applications Interplay of Virtual and Real World Social Behavior Virtual Travel Serious Gaming for Ambient Assisted Living Serious Games for Disaster management

17 16 MPEG Systems Technologies- 27/10/2007 Let s go now to 3DGC

ISO/IEC INTERNATIONAL STANDARD. Information technology Multimedia application format (MPEG-A) Part 4: Musical slide show application format

ISO/IEC INTERNATIONAL STANDARD. Information technology Multimedia application format (MPEG-A) Part 4: Musical slide show application format INTERNATIONAL STANDARD ISO/IEC 23000-4 Second edition 2009-01-15 Information technology Multimedia application format (MPEG-A) Part 4: Musical slide show application format Technologies de l'information