Streaming Media. Advanced Audio. Erik Noreke Standardization Consultant Chair, OpenSL ES. Copyright Khronos Group, Page 1

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "Streaming Media. Advanced Audio. Erik Noreke Standardization Consultant Chair, OpenSL ES. Copyright Khronos Group, Page 1"

Transcription

1 Streaming Media Advanced Audio Erik Noreke Standardization Consultant Chair, OpenSL ES Copyright Khronos Group, Page 1

2 Today s Consumer Requirements Rich media applications and UI - Consumer decisions are driven by multimedia experince - Drives smart phone market Enhanced user experience - Games - Theater like audio for video - Streaming media services - Mobile TV Availability of third party applications - Consumers purchased $4.5 billion of mobile applications in Number growing exponentially Copyright Khronos Group, Page 2

3 Application Developer Requirements Use case driven design - For ease of use Comprehensive feature set - Including advanced audio and streaming media Consistent APIs - Same APIs for both hardware and software implementations Full, predictable functionality - No need to guess available or what is going to work Portable - No need to port application for different platforms Copyright Khronos Group, Page 3

4 Why Create A Khronos Media Framework? Khronos APIs Conformance Tests Portable IP Protection Profiles Predictable set of functionality Open Source Framework Free to change Every implementation unique GPL license Plugins Functionality dependent on implementation

5 Mobile OS Fragmentation Every handset is unique from the programmers perspective - Differences in OS functions, Java implementations and media functionality Symbian^3, PocketPC / Windows Mobile / WinCE Linux variants Android, Limo, WebOS Java MIDP-1, MIDP-2, JSR fragmentation RTOS Nucleus, Synergy Brew, WIPI, iphone OS We need cross platform standard APIs to defragment access to multimedia acceleration if the market is to be fully realized Severe platform fragmentation ISVs need to port to and support 100s (even 1000s) of source variants of each title Copyright Khronos Group, Page 5

6 & Application Access Layer Copyright Khronos Group, Page 6

7 The Need for Application Access Hardware and low level access is powerful but complex - More power than most application developers require Most application developers just want to playback and record media - Specifying where the content comes from - Specifying where the content should be rendered to - Manipulate a few playback controls - Have simple configurability That s what OpenMAX AL and OpenSL ES provides - A simple high-level multimedia APIs for playback and recording use cases - With hardware acceleration capabilities built in With Cross-platform portability - No need to rewrite an application for every platform Copyright Khronos Group, Page 7

8 OpenSL ES and OpenMAX AL Framework Enhanced Audio Multimedia 3D Audio Advanced MIDI Audio Playback Video playback Recording Audio Effects Equalizer Image Rendering Camera Image capture Stereo widening Basic MIDI Radio and RDS Copyright Khronos Group, Page 8

9 Why Profiles? Functionality divided into basic groups - Most common groupings Profiles reduce fragmentation - Not all devices support all functionality - Only support profiles you need Application can query available profiles - Adapt to current system - Facilitates porting of applications Profiles can be combined - To best suit any product Optional features - Some features optional in all profiles - APIs are consistent when hardware is available Copyright Khronos Group, Page 9

10 Object Oriented Media Access Simplified object-oriented streaming media - Built to enable common use cases - But also has access to advanced functionality Media Objects enable PLAY and RECORD of content - Media Objects input and output to Devices - Perform some operation on an input and emit the result as output Objects have control interfaces - Play, Record, Seek, Rate Media Input Audio Mix Camera (AL) Display Window (AL) URI DSrc Player Object DSnk URI Memory Memory Content pipe Content pipe Copyright Khronos Group, Page 10

11 OpenSL ES and OpenMAX AL Independent - No dependency between the APIs either one can exist by itself - But designed to work together Compatible - Working groups collaborated to make sure the APIs work together well Consistent - Identical API architecture - Identical APIs for same functionality Distinct - OpenMAX AL represents basic multimedia functionality (audio, video and image) - OpenSL ES represents advanced audio functionality Copyright Khronos Group, Page 11

12 Application Layer Copyright Khronos Group, Page 12

13 OpenMAX AL Focused on Streaming Media Media playback and recording - Playback and recording of everything from video files to radio to camera input Full range of video effects and controls including playback rate, post processing and image manipulation - Apply advanced effects to captured images and video before sending to friends Complete metadata support - Read, Edit and Set the metadata for most types of content OpenMAX AL gives easy access to streaming media - Allowing time to be spent on developing applications, not using frameworks Designed as a complete set of multimedia functionality - Unlike any other streaming media API Copyright Khronos Group, Page 13

14 OpenMAX AL Features Extensive camera controls - Flash modes, Metering modes - White balance controls, Focusing controls - Exposure compensation, ISO Sensitivity - Shutter speed & Aperture - Zoom (digital and optical) Analog radio controls - Tuning, RDS Audio routing - Application-selectable audio inputs and outputs, based on location, connectivity, etc. - I/O device capability querying Metadata extraction and insertion - Search/extract and insert/overwrite metadata in a variety of file formats Copyright Khronos Group, Page 14

15 OpenMAX AL Profiles Two profiles: - Media Player media playback-only devices - Media Player/Recorder full-featured media devices Optional features - Some features optional in all profiles hardware or use case constraints - APIs are consistent when hardware is available - Vibra, LED, Analog Radio and MIDI are optional features of OpenMAX AL Media Player Audio playback Video playback Image rendering Media Player/Recorder Camera controls Audio recording Video recording Image capture Copyright Khronos Group, Page 15

16 Embedded Audio Copyright Khronos Group, Page 16

17 OpenSL ES Powerful Mobile Audio Create theater quality audio experience - In a mobile device! Profiles reduce application customization - Applications can query available profiles - Develop to a specific profile or profile combination Full 3D audio functionality enhances any gaming experience - Perfect companion to OpenGL ES Designed for implementation by either a hardware or software solution - Unlike any other advanced audio API Copyright Khronos Group, Page 17

18 Designed with audio application developers in mind Audio Playback and Recording - Playback of everything from music files to MIDI ring-tones to UI sounds Full range of effects and controls including advanced 3D effects such as Doppler and virtualization - Experience rich, enhanced sound from locations other than the handset, even moving, for the ultimate multimedia experience Advanced MIDI - Use the output of the MIDI engine as a 3D sound source, making the ring tone appear coming from another direction than the music 3D Audio makes OpenSL ES the natural choice for any audio applicaiton - Better gaming experience; 3D-audio for conferencing calls; more vivid music experience 3D position Doppler MIDI messages Rate Preset Reverb Stereo widening Environmental Reverb Buffer Queues Pitch EQ Metadata extraction Virtualization LED & Vibra Copyright Khronos Group, Page 18

19 OpenSL ES Profiles Game-centric mobile devices Advanced MIDI functionality, sophisticated audio capabilities such as 3D audio, audio effects, ability to handle buffers of audio, etc. Music-centric mobile devices High quality audio, ability to support multiple music audio codecs, audio streaming support Basic mobile phones Ring tone and alert tone playback (basic MIDI functionality), basic audio playback and record functionality, simple 2D audio games Copyright Khronos Group, Page 19

20 & Practical Applications Copyright Khronos Group, Page 20

21 Audio Playback Example Create Engine object - To drive this session Create Audio Output Mix object - Method on Engine interface - Mix object drives audio output devices Create Media Player object - Method on Engine interface - Input is URI pointing to a local mp3 file - Output drives audio output mix Register event callback - Method on Media Player interface Set PlayState to Playing - Method on Media Player interface Wait for end of file event - Via registered callback Play Event Callback Media Player Object Application PlayItf Engine Object Output Mix Object EngineItf

22 Example: Playback of two audio files URI Memory Buffer Queue URI Memory Buffer Queue Audio Player SLPlayItf Audio Player SLPlayItf SL3DLocationItf SLVolumeItf Output Mix SLVolumeItf Copyright Khronos Group, Page 22

23 OpenSL ES and OpenMAX AL Framework Enhanced Audio Multimedia Advanced MIDI 3D Audio Audio Decoders Readers Audio Playback Video playback Writers Recording Video Scheduler Stereo Widening Clock Reverb Audio Effects Equalizer Audio post-processors Image Rendering Video Renderer Camera Image Image Decoders capture Audio Renderer Audio Encoders Stereo widening Equalizer Basic MIDI Image Encoders Radio and RDS Video Encoders Video Decoders Camera Copyright Khronos Group, Page 23

24 Integration Layer Copyright Khronos Group, Page 24

25 OpenMAX IL Component Networks Enables arbitrary multimedia pipelines by plugging blocks together - Componentized architecture abstracts multimedia functionality block interfaces Wide variety of building blocks for imaging, video and audio functions - Encode, decode, apply an effect, capture, render, split, mix, etc Enables blocks from different sources to work together - Blocks can be implemented in software or hardware Portable & Re-usable streaming media building blocks Copyright Khronos Group, Page 25

26 OpenMAX IL Component A component is a building block encapsulating one function - Parser, codec etc. Plumbing - Each component port is the entry point or exit point for a stream of data - Ports are connected between components Knobs - A component parameter is a value that is set prior to component execution - A component config is a value that may be set during component execution - Examples: rate, volume, resolution, scaling, bit rate, error correction, brightness, etc Control a standard interface common to all components to control: - The connection of ports and how data flows in and out of ports - Query/set configs and parameters - State management Copyright Khronos Group, Page 26

27 OpenMAX IL 1.1 OpenMAX IL 1.1 defines a set of standard components - To make most streaming applications easier to construct and more portable Standardized interfaces and controls - Readers/writers: 3gp, asf, image, video, audio - Audio decoders/encoders: AAC, AMR, MP3, WMA, Real Video - Audio post-processor: stereo widening, equalizer, reverb - Video decoders/encoders: MPEG4, H.264, etc - Image decoders/encoders: JPEG - Input devices: camera, audio input - Output devices: audio renderer, video renderer - Synchronization: clock component, video scheduler Copyright Khronos Group, Page 27

28 OpenMAX IL Example Graph Standardized component interfaces enable flexible media graphs Includes multi-stream synchronization Allows for custom plug-ins OpenMAX Component Interfaces Enables components to be flexibly connected in any graph topology E.g. send dance beats to 3D application for visualization AAC Audio Audio Decoder Plug-in Audio Renderer Speakers *.mp4 / *.3gp File Reader Clock for AV Sync MPEG4/ H.264 Video Video Decoder Time Data Decompressed Video Video Scheduler Video Renderer Display Example: MPEG-4 video synchronized with AAC audio decode Copyright Khronos Group, Page 28

29 OpenSL ES / OpenMAX AL Example Use Case with OpenMAX IL OR URI DataSource Media Player Output Mix File Reader Audio Decoder Audio Effect Audio Mixer Audio Sink Clock Copyright Khronos Group, Page 29

30 Khronos Audio and Streaming Media Khronos provides a full multimedia framework solution through OpenMAX and OpenSL ES - Components and applications are easily ported between platforms The complete package provides innumerable market opportunities for silicon, OS vendors, IP vendors and application developers - With both hardware and software solutions possible Meets the consumer demand for rich multimedia - Everything from interactive games to streaming content Copyright Khronos Group, Page 30

31 Thank You Copyright Khronos Group, Page 31

32 Copyright Khronos Group, Page 32

33 Sneak Peak Shhh! Copyright Khronos Group, Page 33

34 OpenMAX IL 1.2 Sneak Peek OpenMAX IL 1.1 can encounter interoperability issues when building complex multi-vendor graphs - Is primarily used in simpler use cases, for example codec plug-in, or closed frameworks OpenMAX IL 1.2 will address the needs of the multi-vendor market - Bug fixes & enhancements - Focus is on ability to build multi-vendor frameworks - Improved component interoperability - Easier replacement of components from different vendors - Better component control - Expected to be completed second half of 2011 Copyright Khronos Group, Page 34

35 OpenMAX AL & OpenSL ES Looking Forward 1.0 Conformance tests - Bug fixes and improved use case tests API Reference cards Q Easy access to information for developers OpenMAX AL 1.1 & OpenSL ES 1.1 Due out soon - Better support for portability between varying operating systems - Additional functionality - Improved buffer queues - Full set of conformance tests Updating example code - Ensuring example code is correct and functional OpenMAX AL Digital TV Extension - Technology-neutral access to Digital TV Copyright Khronos Group, Page 35

36 OpenMAX and OpenSL ES developer resources Growing developer community Khronos Message Boards - Monitored by the Khronos working groups Open source implementations - OpenMAX IL - OpenMAX AL Examples and tutorials - Provided by the working groups Reference cards - In the works available 2011 Copyright Khronos Group, Page 36

37 Market Overview OpenMAX IL - Implemented in a number of Smartphone operating systems - As well as in numerous feature phones - Open source implementation available Bellagio OpenMAX AL - Targeting the growing smartphone market - Native API for multimedia in Symbian^3 - Partial open source implementation available OpenSL ES - Targeting the growing smartphone market - Growing number of adopters - Native audio API in Android 2.3 Copyright Khronos Group, Page 37

38 OpenMAX & OpenSL ES Multimedia frameworks designed for the mobile arena - Designed by the mobile industry - Used by the mobile industry - Enable a complete mobile multimedia experience Copyright Khronos Group, Page 38

39 Thank You Copyright Khronos Group, Page 39

Completing the Multimedia Architecture

Completing the Multimedia Architecture Copyright Khronos Group, 2011 - Page 1 Completing the Multimedia Architecture Erik Noreke Chair of OpenSL ES Working Group Chair of OpenMAX AL Working Group Copyright Khronos Group, 2011 - Page 2 Today

More information

OpenMAX AL, OpenSL ES

OpenMAX AL, OpenSL ES Copyright Khronos Group, 2011 - Page 1 OpenMAX AL, OpenSL ES Native Multimedia in Android Erik Noreke Chair of OpenMAX AL and OpenSL ES Working Groups Copyright Khronos Group, 2011 - Page 2 Why Create

More information

The Mobile Advantage. Erik Noreke Independent Standardization Consultant Chair, OpenSL ES. Copyright Khronos Group, Page 1

The Mobile Advantage. Erik Noreke Independent Standardization Consultant Chair, OpenSL ES. Copyright Khronos Group, Page 1 & The Mobile Advantage Erik Noreke Independent Standardization Consultant Chair, OpenSL ES Copyright Khronos Group, 2010 - Page 1 Focused on Creating an Open Market Open Standards Open Markets - Developed

More information

Copyright Khronos Group, Page 1

Copyright Khronos Group, Page 1 1HLO7UHYHWW 19,',$.KURQRV *URXS 2SHQ*/(6 Copyright Khronos Group, 2007 - Page 1 Handsets are becoming personal computing platform - not just phones - A real computer in your hand mobility, connectedness

More information

Copyright Khronos Group, Page 1

Copyright Khronos Group, Page 1 3RUWDEOH1DWLYH0RELOH 0HGLD$SSOLFDWLRQV 1HLO7UHYHWW 9LFH3UHVLGHQW(PEHGGHG&RQWHQW19,',$ 3UHVLGHQW.KURQRV*URXS Copyright Khronos Group, 2007 - Page 1 3HUYDVLYH0RELOH0HGLD&RPSXWLQJ Handsets are becoming personal

More information

Mobile AR Hardware Futures

Mobile AR Hardware Futures Copyright Khronos Group, 2010 - Page 1 Mobile AR Hardware Futures Neil Trevett Vice President Mobile Content, NVIDIA President, The Khronos Group Two Perspectives NVIDIA - Tegra 2 mobile processor Khronos

More information

Copyright Khronos Group, Page 1

Copyright Khronos Group, Page 1 3RUWDEOH1DWLYH0RELOH 0HGLD$SSOLFDWLRQV 1HLO7UHYHWW 9LFH3UHVLGHQW(PEHGGHG&RQWHQW19,',$ 3UHVLGHQW.KURQRV*URXS Copyright Khronos Group, 2007 - Page 1 3HUYDVLYH0RELOH0HGLD&RPSXWLQJ Handsets are becoming personal

More information

Embedded Media Processing Ecosystem

Embedded Media Processing Ecosystem Embedded Media Processing Ecosystem Neil Trevett Vice President Mobile Content, NVIDIA President, Khronos Group Copyright Khronos Group, 2007 - Page 1 Pervasive Mobile Media Computing Handsets are becoming

More information

Streaming Media Portability

Streaming Media Portability Streaming Media Portability July 2006 Copyright Khronos Group, 2006 - Page 1 Copyright Khronos Group, 2006 - Page 2 Media Portability Problem Media infrastructure portability is a multi-level industry

More information

Creating the Embedded Media Processing Ecosystem

Creating the Embedded Media Processing Ecosystem Creating the Embedded Media Processing Ecosystem Neil Trevett Vice President Embedded Content, NVIDIA President, Khronos Chairman, OpenGL ES Working Group Mobile Convergence Handsets are becoming the predominant

More information

MMAPI (Mobile Media API) Multimedia Framework for Mobile Devices

MMAPI (Mobile Media API) Multimedia Framework for Mobile Devices MMAPI (Mobile Media API) Multimedia Framework for Mobile Devices Zohar Sivan IBM Research Laboratory in Haifa IBM Labs in Haifa MMAPI Objectives Provide a standards-based Java multimedia framework for

More information

Adding Advanced Shader Features and Handling Fragmentation

Adding Advanced Shader Features and Handling Fragmentation Copyright Khronos Group, 2010 - Page 1 Adding Advanced Shader Features and Handling Fragmentation How to enable your application on a wide range of devices Imagination Technologies Copyright Khronos Group,

More information

The Mobile Internet: The Potential of Handhelds to Bring Internet to the Masses. April 2008

The Mobile Internet: The Potential of Handhelds to Bring Internet to the Masses. April 2008 The Mobile Internet: The Potential of Handhelds to Bring Internet to the Masses April 2008 Agenda Today s Mobile Internet Market Mobile Convergence Products Internet Browsing on a Handheld Separating Fact

More information

Dave Shreiner, ARM March 2009

Dave Shreiner, ARM March 2009 4 th Annual Dave Shreiner, ARM March 2009 Copyright Khronos Group, 2009 - Page 1 Motivation - What s OpenGL ES, and what can it do for me? Overview - Lingo decoder - Overview of the OpenGL ES Pipeline

More information

Android Multimedia Framework Overview. Li Li, Solution and Service Wind River

Android Multimedia Framework Overview. Li Li, Solution and Service Wind River Android Multimedia Framework Overview Li Li, Solution and Service Wind River Agenda What is Multimedia in a mobile device MPEG standard File format Codec Android Multimedia Framework OpenCORE OpenMAX What

More information

Our Technology Expertise for Software Engineering Services. AceThought Services Your Partner in Innovation

Our Technology Expertise for Software Engineering Services. AceThought Services Your Partner in Innovation Our Technology Expertise for Software Engineering Services High Performance Computing MultiCore CPU AceThought experts will re-design your sequential algorithms or applications to execute in parallel by

More information

the gamedesigninitiative at cornell university Lecture 15 Game Audio

the gamedesigninitiative at cornell university Lecture 15 Game Audio Lecture 15 The Role of Audio in Games Engagement Entertains player Music/Soundtrack Enhances realism Sound effects Establishes atmosphere Ambient sounds Or reasons? 2 The Role of Audio in Games Feedback

More information

Bringing it all together: The challenge in delivering a complete graphics system architecture. Chris Porthouse

Bringing it all together: The challenge in delivering a complete graphics system architecture. Chris Porthouse Bringing it all together: The challenge in delivering a complete graphics system architecture Chris Porthouse System Integration & the role of standards Content Ecosystem Java Execution Environment Native

More information

Hardware Accelerated Graphics for High Performance JavaFX Mobile Applications

Hardware Accelerated Graphics for High Performance JavaFX Mobile Applications Hardware Accelerated Graphics for High Performance JavaFX Mobile Applications Pavel Petroshenko, Sun Microsystems Jan Valenta, Sun Microsystems Jerry Evans, Sun Microsystems Goal of this Session Demonstrate

More information

Copyright Khronos Group, Page 1. Khronos Overview. Taiwan, February 2012

Copyright Khronos Group, Page 1. Khronos Overview. Taiwan, February 2012 Copyright Khronos Group, 2012 - Page 1 Khronos Overview Taiwan, February 2012 Copyright Khronos Group, 2012 - Page 2 Khronos - Connecting Software to Silicon Creating open, royalty-free API standards -

More information

Technology in Action. Chapter Topics. Participation Question. Chapter 8 Summary Questions. Participation Question 8/17/11

Technology in Action. Chapter Topics. Participation Question. Chapter 8 Summary Questions. Participation Question 8/17/11 Technology in Action Chapter 8 Digital Lifestyle: Managing Digital Data and Devices 1 2 Chapter Topics Changes that have brought us a digital lifestyle The impact of a digital lifestyle Cell phones and

More information

INTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY

INTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY INTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY A PATH FOR HORIZING YOUR INNOVATIVE WORK A REVIEW ON THE ARCHITECTURE OF ANDROID IN SMART PHONES RAVNEET KAUR T. BAGGA 1,

More information

System-Level Software Performance: How to get the most performance out of the OMAP 4 platform

System-Level Software Performance: How to get the most performance out of the OMAP 4 platform WHITE PAPER Atul Aggarwal OMAP Product Marketing atula@ti.com Introduction TI s OMAP 4 platform is the most highly optimized platform that addresses the features of today s applications and tomorrow s

More information

Applications and Implementations

Applications and Implementations Copyright Khronos Group, 2010 - Page 1 Applications and Implementations Hwanyong LEE CTO and Technical Marketing Director HUONE System Integration Application Acceleration Authoring and accessibility Khronos

More information

The Benefits of GPU Compute on ARM Mali GPUs

The Benefits of GPU Compute on ARM Mali GPUs The Benefits of GPU Compute on ARM Mali GPUs Tim Hartley 1 SEMICON Europa 2014 ARM Introduction World leading semiconductor IP Founded in 1990 1060 processor licenses sold to more than 350 companies >

More information

Khronos and the Mobile Ecosystem

Khronos and the Mobile Ecosystem Copyright Khronos Group, 2011 - Page 1 Khronos and the Mobile Ecosystem Neil Trevett VP Mobile Content, NVIDIA President, Khronos Copyright Khronos Group, 2011 - Page 2 Topics It s not just about individual

More information

Copyright Khronos Group Page 1. Vulkan Overview. June 2015

Copyright Khronos Group Page 1. Vulkan Overview. June 2015 Copyright Khronos Group 2015 - Page 1 Vulkan Overview June 2015 Copyright Khronos Group 2015 - Page 2 Khronos Connects Software to Silicon Open Consortium creating OPEN STANDARD APIs for hardware acceleration

More information

SC24/WG9 Liaison Meeting

SC24/WG9 Liaison Meeting Copyright Khronos Group, 2011 - Page 1 SC24/WG9 Liaison Meeting Seoul, November 2011 Neil Trevett Vice President Mobile Content, NVIDIA President, The Khronos Group Copyright Khronos Group, 2011 - Page

More information

Next Generation OpenGL Neil Trevett Khronos President NVIDIA VP Mobile Copyright Khronos Group Page 1

Next Generation OpenGL Neil Trevett Khronos President NVIDIA VP Mobile Copyright Khronos Group Page 1 Next Generation OpenGL Neil Trevett Khronos President NVIDIA VP Mobile Ecosystem @neilt3d Copyright Khronos Group 2015 - Page 1 Copyright Khronos Group 2015 - Page 2 Khronos Connects Software to Silicon

More information

Core Audio. MSDOSX : Lecture 20

Core Audio. MSDOSX : Lecture 20 Core Audio MSDOSX : Lecture 20 Overview What is Core Audio? Core Audio Programming Interfaces Common Tasks With Core Audio Core Audio Frameworks What s Been Shipping Since 10.4? Supported Audio and Data

More information

JSR 248: Taking Java Platform, Micro Edition (Java ME) to the Next Level

JSR 248: Taking Java Platform, Micro Edition (Java ME) to the Next Level JSR 248: Taking Java Platform, Micro Edition (Java ME) to the Next Level Kay Glahn Consultant Mobile Service Architecture, Vodafone http://www.vodafone.com Erkki Rysä Technologist Nokia Corporation http://www.nokia.com

More information

The GStreamer Multimedia Architecture. What is GStreamer. What is GStreamer. Why create GStreamer

The GStreamer Multimedia Architecture. What is GStreamer. What is GStreamer. Why create GStreamer The GStreamer Multimedia Architecture Steve Baker steve@stevebaker.org What is GStreamer A library for building multimedia applications Allows complex graphs to be built from simple elements Supports any

More information

Java Technology-Based VAS in China Mobile: Today and Tomorrow

Java Technology-Based VAS in China Mobile: Today and Tomorrow Java Technology-Based VAS in China Mobile: Today and Tomorrow Chuan YU Director, Terminal Technology Research Department Research Institute of China Mobile http://www.chinamobile.com/ TS-5184 2007 JavaOne

More information

2012 product introduction

2012 product introduction 2012 product introduction Brand represents products designed to be simple, useful and easily adapted to your mobile lifestyle Features that enable you to be productive, deliver rich entertainment with

More information

WIFI VS BLUETOOTH Bluetooth. Wi-Fi.

WIFI VS BLUETOOTH   Bluetooth. Wi-Fi. TECHNICAL WRITING WIFI VS BLUETOOTH http://www.bfrx.com/wifi-vs-bluetooth/ Bluetooth. Developed in 1994 by telecommunications vendor, Ericsson, Bluetooth has a transmission range of about 30 feet, so it

More information

Types and Methods of Content Adaptation. Anna-Kaisa Pietiläinen

Types and Methods of Content Adaptation. Anna-Kaisa Pietiläinen Types and Methods of Content Adaptation Anna-Kaisa Pietiläinen Agenda Introduction Multimedia Content Types Types of Adaptation Methods of Adaptation Conclusion Networks 2 Introduction Networks 3 The Problem

More information

A Linux multimedia platform for SH-Mobile processors

A Linux multimedia platform for SH-Mobile processors A Linux multimedia platform for SH-Mobile processors Embedded Linux Conference 2009 April 7, 2009 Abstract Over the past year I ve been working with the Japanese semiconductor manufacturer Renesas, developing

More information

Multimedia Platform. Mainstream wireless multimedia expands globally with the industry s first single-chipset solution

Multimedia Platform. Mainstream wireless multimedia expands globally with the industry s first single-chipset solution CONVERGENCE ENHANCED MULTIMEDIA MULTIMEDIA VALUE Multimedia Platform Mainstream wireless multimedia expands globally with the industry s first single-chipset solution F I N D A R E S T A U R A N T S E

More information

Transcoding SDK. Professional Transcoding Engine

Transcoding SDK. Professional Transcoding Engine Transcoding SDK Professional Transcoding Engine Formerly known as Reference SDK, Transcoding SDK offers improved quality and performance as well as exciting new features and stability enhancements to further

More information

Audio for Everybody. OCPUG/PATACS 21 January Tom Gutnick. Copyright by Tom Gutnick. All rights reserved.

Audio for Everybody. OCPUG/PATACS 21 January Tom Gutnick. Copyright by Tom Gutnick. All rights reserved. Audio for Everybody OCPUG/PATACS 21 January 2017 Copyright 2012-2017 by Tom Gutnick. All rights reserved. Tom Gutnick Session overview Digital audio properties and formats ADC hardware Audacity what it

More information

Multimedia in Mobile Phones. Architectures and Trends Lund

Multimedia in Mobile Phones. Architectures and Trends Lund Multimedia in Mobile Phones Architectures and Trends Lund 091124 Presentation Henrik Ohlsson Contact: henrik.h.ohlsson@stericsson.com Working with multimedia hardware (graphics and displays) at ST- Ericsson

More information

How many of us own. Mobile markets and development environments. Petri Vesikivi (Erkki Rämö) Fixed Telephone 1.3B TV 1.5B Credit card 1.

How many of us own. Mobile markets and development environments. Petri Vesikivi (Erkki Rämö) Fixed Telephone 1.3B TV 1.5B Credit card 1. Mobile markets and development environments Petri Vesikivi (Erkki Rämö) How many of us own a car 800M Fixed Telephone 1.3B TV 1.5B Credit card 1.3B Mobile phone? PC? How many of us own a car 800M Fixed

More information

Mobile Graphics Ecosystem. Tom Olson OpenGL ES working group chair

Mobile Graphics Ecosystem. Tom Olson OpenGL ES working group chair OpenGL ES in the Mobile Graphics Ecosystem Tom Olson OpenGL ES working group chair Director, Graphics Research, ARM Ltd 1 Outline Why Mobile Graphics? OpenGL ES Overview Getting Started with OpenGL ES

More information

ITP 342 Mobile App Dev. Audio

ITP 342 Mobile App Dev. Audio ITP 342 Mobile App Dev Audio File Formats and Data Formats 2 pieces to every audio file: file format (or audio container) data format (or audio encoding) File formats describe the format of the file itself

More information

Developing Core Software Technologies for TI s OMAP Platform

Developing Core Software Technologies for TI s OMAP Platform SWPY006 - August 2002 White Paper By Justin Helmig Texas Instruments Senior Technical Staff, Wireless Software Applications Texas Instruments OMAP platform for wireless handsets offers a powerful hardware

More information

More performance options

More performance options More performance options OpenCL, streaming media, and native coding options with INDE April 8, 2014 2014, Intel Corporation. All rights reserved. Intel, the Intel logo, Intel Inside, Intel Xeon, and Intel

More information

UNDERSTANDING MUSIC & VIDEO FORMATS

UNDERSTANDING MUSIC & VIDEO FORMATS ComputerFixed.co.uk Page: 1 Email: info@computerfixed.co.uk UNDERSTANDING MUSIC & VIDEO FORMATS Are you confused with all the different music and video formats available? Do you know the difference between

More information

SIGGRAPH Briefing August 2014

SIGGRAPH Briefing August 2014 Copyright Khronos Group 2014 - Page 1 SIGGRAPH Briefing August 2014 Neil Trevett VP Mobile Ecosystem, NVIDIA President, Khronos Copyright Khronos Group 2014 - Page 2 Significant Khronos API Ecosystem Advances

More information

HIGH POWER STREET DANCE BOOMBOX

HIGH POWER STREET DANCE BOOMBOX HIGH POWER STREET DANCE BOOMBOX PBMSPG260L USER MANUAL Location of Controls 1. POWER SWITCH 2. DC IN JACK 3. USB PORT 4. AUX IN JACK 5. BATTERY INDICATOR 6. BLUETOOTH INDICATOR 7. GUITAR INPUT JACK 8.

More information

Acceleration Standards for Mobile Augmented Reality

Acceleration Standards for Mobile Augmented Reality Acceleration Standards for Mobile Augmented Reality Neil Trevett Khronos President Vice President Mobile Content, NVIDIA November 2012 Copyright Khronos Group 2012 Page 1 Copyright Khronos Group 2012 Page

More information

The Handheld Graphics. Market. Size, needs, and opportunities. Jon Peddie Research

The Handheld Graphics. Market. Size, needs, and opportunities. Jon Peddie Research The Handheld Graphics Market Size, needs, and opportunities Founded in 2001 - our 24th year Focus and emphasis on Digital Technology, Multi Media, and Graphics Consulting and market research - Advisor

More information

3.01C Multimedia Elements and Guidelines Explore multimedia systems, elements and presentations.

3.01C Multimedia Elements and Guidelines Explore multimedia systems, elements and presentations. 3.01C Multimedia Elements and Guidelines 3.01 Explore multimedia systems, elements and presentations. Multimedia Fair Use Guidelines Guidelines for using copyrighted multimedia elements include: Text Motion

More information

HTML 5 and CSS 3, Illustrated Complete. Unit K: Incorporating Video and Audio

HTML 5 and CSS 3, Illustrated Complete. Unit K: Incorporating Video and Audio HTML 5 and CSS 3, Illustrated Complete Unit K: Incorporating Video and Audio Objectives Understand Web video and audio Use the video element Incorporate the source element Control playback HTML 5 and CSS

More information

OneClick Video Converter Free Version

OneClick Video Converter Free Version Document No.: OneClickSoftware OneClick Video Converter Free Version OneClick Software Inc. http://www.oneclicksoftware.com Page 1 Pages Order Introduction...Pages 3 Button Preview...Pages 4 How to...pages

More information

Introduction into Game Programming (CSC329)

Introduction into Game Programming (CSC329) Introduction into Game Programming (CSC329) Sound Ubbo Visser Department of Computer Science University of Miami Content taken from http://docs.unity3d.com/manual/ March 7, 2018 Outline 1 Audio overview

More information

GETTING STARTED WITH DJCONTROL COMPACT AND DJUCED 18

GETTING STARTED WITH DJCONTROL COMPACT AND DJUCED 18 GETTING STARTED WITH DJCONTROL COMPACT AND DJUCED 18 INSTALLATION Connect the DJControl Compact to your computer Install the DJUCED 18 software Launch the DJUCED 18 software More information (forums, tutorials,

More information

PMX6BU. Wireless DJ Sound FX Audio Mixer

PMX6BU. Wireless DJ Sound FX Audio Mixer PMX6BU Wireless DJ Sound FX Audio Mixer Wireless BT Streaming Stage & Studio Mixer System with Karaoke Style Mic-Talkover, MP3/USB/SD Readers, FM Radio PMX6BU Wireless DJ Sound FX Audio Mixer Wireless

More information

Applications and Implementations

Applications and Implementations Copyright Khronos Group, 2010 - Page 1 Applications and Implementations Hwanyong LEE CTO and Technical Marketing Director HUONE OpenVG Royalty-free open standard API Low-level 2D vector graphics rendering

More information

Chapter 5.5 Audio Programming

Chapter 5.5 Audio Programming Chapter 5.5 Audio Programming Audio Programming Audio in games is more important than ever before 2 Programming Basic Audio Most gaming hardware has similar capabilities (on similar platforms) Mostly programming

More information

Copyright Khronos Group Page 1

Copyright Khronos Group Page 1 Gaming Market Briefing Overview of APIs GDC March 2016 Neil Trevett Khronos President NVIDIA Vice President Developer Ecosystem ntrevett@nvidia.com @neilt3d Copyright Khronos Group 2016 - Page 1 Copyright

More information

0 MPEG Systems Technologies- 27/10/2007. MPEG Systems and 3DGC Technologies Olivier Avaro Systems Chairman

0 MPEG Systems Technologies- 27/10/2007. MPEG Systems and 3DGC Technologies Olivier Avaro Systems Chairman 0 MPEG Systems Technologies- 27/10/2007 MPEG Systems and 3DGC Technologies Olivier Avaro Systems Chairman Overview of The Presentation 1 MPEG Systems Technologies- 27/10/2007 Key Standards Developed in

More information

Digital Sample-to-Memory

Digital Sample-to-Memory Digital Sample-to-Memory The Digital Sample-to-Memory option for Synclavier PowerPC is a PCI hardware module and a collection of software drivers that let you record digital audio directly into the Sample-to-Memory

More information

CS 528 Mobile and Ubiquitous Computing Lecture 4a: Playing Sound and Video Emmanuel Agu

CS 528 Mobile and Ubiquitous Computing Lecture 4a: Playing Sound and Video Emmanuel Agu CS 528 Mobile and Ubiquitous Computing Lecture 4a: Playing Sound and Video Emmanuel Agu Reminder: Final Project 1-slide from group in 2 weeks Thursday October 11: 2/30 of final project grade Slide should

More information

AR Standards Update Austin, March 2012

AR Standards Update Austin, March 2012 AR Standards Update Austin, March 2012 Neil Trevett President, The Khronos Group Vice President Mobile Content, NVIDIA Copyright Khronos Group, 2012 - Page 1 Topics Very brief overview of Khronos Update

More information

Accompanying documentation Fireface UFX Class Compliant Mode Technical background, mode of operation, practical use

Accompanying documentation Fireface UFX Class Compliant Mode Technical background, mode of operation, practical use Accompanying documentation Fireface UFX Class Compliant Mode Technical background, mode of operation, practical use Background information on Class Compliant operation of the Fireface UFX 1. General remarks

More information

Switch Release Notes. Switch

Switch Release Notes. Switch Switch 3.0.1 Release Notes Switch Telestream Switch is an award-winning cross platform media player, inspector, and correction tool for professionals. Switch comes in three versions: Switch Player (free),

More information

Build high performance video apps for mobile, game consoles, streaming pucks, set top boxes, and smart TVs from a single codebase

Build high performance video apps for mobile, game consoles, streaming pucks, set top boxes, and smart TVs from a single codebase Video Experience Platform Build high performance video apps for mobile, game consoles, streaming pucks, set top boxes, and smart TVs from a single codebase You.i Engine One is a multi-screen app platform

More information

Copyright Khronos Group, Page 1. OpenCL. GDC, March 2010

Copyright Khronos Group, Page 1. OpenCL. GDC, March 2010 Copyright Khronos Group, 2011 - Page 1 OpenCL GDC, March 2010 Authoring and accessibility Application Acceleration System Integration Copyright Khronos Group, 2011 - Page 2 Khronos Family of Standards

More information

Mobile Application Development

Mobile Application Development Mobile Application Development The principal goal of education is to create men and women who are capable of doing new things, not simply repeating what other generations have done. -Jean Piaget Mobile

More information

WebGL Meetup GDC Copyright Khronos Group, Page 1

WebGL Meetup GDC Copyright Khronos Group, Page 1 WebGL Meetup GDC 2012 Copyright Khronos Group, 2012 - Page 1 Copyright Khronos Group, 2012 - Page 2 Khronos API Ecosystem Trends Neil Trevett Vice President Mobile Content, NVIDIA President, The Khronos

More information

ANDROID APPS DEVELOPMENT FOR MOBILE AND TABLET DEVICE (LEVEL II)

ANDROID APPS DEVELOPMENT FOR MOBILE AND TABLET DEVICE (LEVEL II) ANDROID APPS DEVELOPMENT FOR MOBILE AND TABLET DEVICE (LEVEL II) Media Playback Engine Android provides a media playback engine at the native level called Stagefright that comes built-in with software-based

More information

Remote Health Monitoring for an Embedded System

Remote Health Monitoring for an Embedded System July 20, 2012 Remote Health Monitoring for an Embedded System Authors: Puneet Gupta, Kundan Kumar, Vishnu H Prasad 1/22/2014 2 Outline Background Background & Scope Requirements Key Challenges Introduction

More information

Leica Viva TS11 & TS15 Hardware

Leica Viva TS11 & TS15 Hardware Leica Viva TS11 & TS15 Hardware Contents 1. Introduction 2. Product Variants 3. Side Cover 4. Display and Keyboard 5. Environmental Rating 6. Telescope 8. Operating System & Software 9. Summary 1. Introduction

More information

Introduction Understanding The Basics Introducing ACID Pro 3.0 Making Music with ACID Setting Up the Hardware Installing and Registering ACID

Introduction Understanding The Basics Introducing ACID Pro 3.0 Making Music with ACID Setting Up the Hardware Installing and Registering ACID Introduction Understanding The Basics Introducing ACID Pro 3.0 Making Music with ACID Setting Up the Hardware Installing and Registering ACID Understanding the Interface Understanding What's New in Version

More information

English SCHUBERTH SC1. User s Guide.

English SCHUBERTH SC1. User s Guide. English SCHUBERTH SC1 www.schuberth.com User s Guide CONTENTS 1 INTRODUCTION... 4 2 PACKAGE CONTENTS...5 3 INSTALLING THE SC1 ON YOUR HELMET...6 3.1 Installing the SC1...7 3.2 Taking out the SC1...7 4

More information

English SCHUBERTH SC1. User s Guide.

English SCHUBERTH SC1. User s Guide. English SCHUBERTH SC1 www.schuberth.com User s Guide CONTENTS 1 INTRODUCTION... 4 2 PACKAGE CONTENTS...5 3 INSTALLING THE SC1 ON YOUR HELMET...6 3.1 Installing the SC1...7 3.2 Taking out the SC1...7 4

More information

Mul$media Support in Android

Mul$media Support in Android Mul$media Support in Android Mul$media Support Android provides comprehensive mul$media func$onality: Audio: all standard formats including MP3, Ogg, Midi, Video: MPEG- 4, H.263, H.264, Images: PNG (preferred),

More information

Enabling a Richer Multimedia Experience with GPU Compute. Roberto Mijat Visual Computing Marketing Manager

Enabling a Richer Multimedia Experience with GPU Compute. Roberto Mijat Visual Computing Marketing Manager Enabling a Richer Multimedia Experience with GPU Compute Roberto Mijat Visual Computing Marketing Manager 1 What is GPU Compute Operating System and most application processing continue to reside on the

More information

Quick Start Guide for Shooting Video with the Panasonic GH4

Quick Start Guide for Shooting Video with the Panasonic GH4 Quick Start Guide for Shooting Video with the Panasonic GH4 Two options for using this camera: Option 1: The simplest method is to use the C1 Preset that has been entered into the camera. Option 2: Put

More information

Media player for windows 10 free download

Media player for windows 10 free download Media player for windows 10 free download Update to the latest version of Internet Explorer. You need to update your browser to use the site. PROS: High-quality playback, Wide range of formats, Fast and

More information

Introduction and Datacenter Topology For Your System

Introduction and Datacenter Topology For Your System Introduction and Datacenter Topology For Your System This chapter provides an introduction, a datacenter overview, and VMware vcenter requirements for your system. Introducing Cisco WebEx Meetings Server,

More information

Visual Voice Mail Client - VVMC. Product Description

Visual Voice Mail Client - VVMC. Product Description Visual Voice Mail Client - VVMC Product Description Table of Contents 1. Introduction... 3 2. User experience... 3 3. Service flow... 4 3.1. Installation... 4 3.2. Setup... 4 3.3. Message inbox... 5 3.4.

More information

Module Introduction. Content 15 pages 2 questions. Learning Time 25 minutes

Module Introduction. Content 15 pages 2 questions. Learning Time 25 minutes Purpose The intent of this module is to introduce you to the multimedia features and functions of the i.mx31. You will learn about the Imagination PowerVR MBX- Lite hardware core, graphics rendering, video

More information

Chapter 28. Multimedia

Chapter 28. Multimedia Chapter 28. Multimedia 28-1 Internet Audio/Video Streaming stored audio/video refers to on-demand requests for compressed audio/video files Streaming live audio/video refers to the broadcasting of radio

More information

Software Development & Education Center. Java Platform, Micro Edition. (Mobile Java)

Software Development & Education Center. Java Platform, Micro Edition. (Mobile Java) Software Development & Education Center Java Platform, Micro Edition (Mobile Java) Detailed Curriculum UNIT 1: Introduction Understanding J2ME Configurations Connected Device Configuration Connected, Limited

More information

Mul$media Techniques in Android. Some of the informa$on in this sec$on is adapted from WiseAndroid.com

Mul$media Techniques in Android. Some of the informa$on in this sec$on is adapted from WiseAndroid.com Mul$media Techniques in Android Some of the informa$on in this sec$on is adapted from WiseAndroid.com Mul$media Support Android provides comprehensive mul$media func$onality: Audio: all standard formats

More information

ZEN / ZEN Vision Series Video Encoding Guidelines

ZEN / ZEN Vision Series Video Encoding Guidelines CREATIVE LABS, INC. Digital Media Relations Americas 1901 McCarthy Boulevard Milpitas, CA 95035 USA +1 408 432-6717 fax Europe 3DLabs Building Meadlake Place Thorpe Lea Road Egham, Surrey, TW20 8HE UK

More information

Vulkan 1.1 March Copyright Khronos Group Page 1

Vulkan 1.1 March Copyright Khronos Group Page 1 Vulkan 1.1 March 2018 Copyright Khronos Group 2018 - Page 1 Vulkan 1.1 Launch and Ongoing Momentum Strengthening the Ecosystem Improved developer tools (SDK, validation/debug layers) More rigorous conformance

More information

Solving Audio Subsystem Challenges Using a Crossfade/Level Controller Algorithm in Portable Media Applications

Solving Audio Subsystem Challenges Using a Crossfade/Level Controller Algorithm in Portable Media Applications Soling Audio Subsystem Challenges Using a Crossfade/Leel Controller Algorithm in Portable Media Applications Danny Jochelson DSP Solutions R&D Digital Audio Branch Texas Instruments, dsjochel@ti.com Jason

More information

Lesson 5: Multimedia on the Web

Lesson 5: Multimedia on the Web Lesson 5: Multimedia on the Web Lesson 5 Objectives Define objects and their relationships to multimedia Explain the fundamentals of C, C++, Java, JavaScript, JScript, C#, ActiveX and VBScript Discuss

More information

A Multimedia Streaming Server/Client Framework for DM64x

A Multimedia Streaming Server/Client Framework for DM64x SEE THEFUTURE. CREATE YOUR OWN. A Multimedia Streaming Server/Client Framework for DM64x Bhavani GK Senior Engineer Ittiam Systems Pvt Ltd bhavani.gk@ittiam.com Agenda Overview of Streaming Application

More information

History of Audio in Unity

History of Audio in Unity Audio Showcase About Me (Wayne) Core / Audio team at Unity Work in the Copenhagen office Originally worked for FMOD (Audio Engine) Work on Audio and other new tech in Unity Interested in most phases of

More information

Frequently Asked Questions. Nokia E71x

Frequently Asked Questions. Nokia E71x Frequently Asked Questions Nokia E71x general Is the Nokia E71x a quad band device? Yes. What is the battery life of the Nokia E71x? The Nokia E71x offers up to 4.5 hours of 3G talk time*. * Talk and standby

More information

1. HOST- Connect USB flash or HDD for saving recoded video file or still image 2. DC- DC 5V power supply. 3. HDMI IN- HDMI input.

1. HOST- Connect USB flash or HDD for saving recoded video file or still image 2. DC- DC 5V power supply. 3. HDMI IN- HDMI input. With this PVRC75 HD Video Capture Pro, you can capture up to 1080P video from HDMI,Ypbpr (component) or composite port, such as blue ray, set-top-box, computer, game box, VHS, etc. And you can playback

More information

Lesson 5: Multimedia on the Web

Lesson 5: Multimedia on the Web Lesson 5: Multimedia on the Web Learning Targets I can: Define objects and their relationships to multimedia Explain the fundamentals of C, C++, Java, JavaScript, JScript, C#, ActiveX and VBScript Discuss

More information

S1 Smart Watch APPS GUIDE. Models: S1, S1C & S1 PLUS

S1 Smart Watch APPS GUIDE. Models: S1, S1C & S1 PLUS S1 Smart Watch APPS GUIDE Models: S1, S1C & S1 PLUS SETTINGS The settings app in the S1 allows you to make adjustments on all local settings on the watch. You can change the look of the screen, sound and

More information

1. INTRODUCTION 2. OVERVIEW

1. INTRODUCTION 2. OVERVIEW 1. INTRODUCTION As computers grow and evolve, so do the tools for inputting information into computers. Ports are holes in computers where one can connect various external devices such as mice, keyboards,

More information

1.2. Terminal Configuration Use-Cases SyncML Device Management

1.2. Terminal Configuration Use-Cases SyncML Device Management MOBILE DEVICE MANAGEMENT WITH SYNCML Alan Bok, Alan.Bok@motorola.com, Sandeep Adwankar, Sandeep.Adwankar@motorola.com, John Grosspietsch, John.Grosspietsch@motorola.com, Venu Vasudevan, venuv@labs.mot.com,

More information

Fusing Sensors into Mobile Operating Systems & Innovative Use Cases

Fusing Sensors into Mobile Operating Systems & Innovative Use Cases Fusing Sensors into Mobile Operating Systems & Innovative Use Cases May 23, 2012 Tristan Joo (tristanjoo@wca.org) Board Director & Co-Chair of Mobile SIG Wireless Communications Alliance, Independent Executive

More information

Multimedia Content. Web Architecture and Information Management [./] Spring 2009 INFO (CCN 42509) Contents. Erik Wilde, UC Berkeley School of

Multimedia Content. Web Architecture and Information Management [./] Spring 2009 INFO (CCN 42509) Contents. Erik Wilde, UC Berkeley School of Contents Multimedia Content Contents Web Architecture and Information Management [./] Spring 2009 INFO 190-02 (CCN 42509) Erik Wilde, UC Berkeley School of Information [http://creativecommons.org/licenses/by/3.0/]

More information