Embedded Media Processing Ecosystem

Size: px
Start display at page:

Download "Embedded Media Processing Ecosystem"

Transcription

1 Embedded Media Processing Ecosystem Neil Trevett Vice President Mobile Content, NVIDIA President, Khronos Group Copyright Khronos Group, Page 1

2 Pervasive Mobile Media Computing Handsets are becoming personal computing devices - not just phones - Your most personal computer mobility, connectedness and numerous sensors Sophisticated media processing will be central to handheld revolution - Graphics and media will become as pervasive as it is on the PC Diverse applications will drive the need for handheld accelerated media - User Interface, 2D maps and 3D navigation, TV/Video, games 100Ms / year 100Ks / year 10Ms / year Media Platforms 80 s Workstations Copyright Khronos Group, Page 2 90 s PCs 00 s Handhelds

3 Khronos Open Standards Khronos develops state-of-the-art open standards for the Authoring and Acceleration of graphics and media content - 3D and Vector 2D Graphics, Video, Imaging, Audio Khronos API standards provide Foundation-Level acceleration - Close-to-the-silicon access to media processors for efficiency and generality Khronos standards are royalty-free - For wide adoption on multiple platforms reducing application source fragmentation Khronos APIs APIs enable enable mobile mobile software to to be be PORTABLE and and to to EFFICIENTLY use use graphics and and media media acceleration Copyright Khronos Group, Page 3

4 Around 100 companies creating media authoring and acceleration standards Copyright Khronos Group, Page 4

5 Khronos Participation Model Board decides strategy approves working groups, controls budget, ratifies specifications. $25,000 annual membership dues Promoters Contributors Any company can join Khronos to participate in any number of working groups to produce specifications. $7,500 annual membership dues A Working Group for each API standard one company one vote Openly and publicly distributed free of charge, royalty free Ratified Specifications SDKs Conformance Tests Conformance Tests and Conformance Test Process. Typically $10K per API fee Free libraries, utilities, examples, open source Adopters Conforming products can use API trademark and logo Copyright Khronos Group, Page 5

6 Khronos Standards Ecosystem Dynamic Media Authoring 3D Authoring Dynamic Media Authoring Standards Open Standards Effects Framework Bridging 3D Authoring and Acceleration for advanced visual effects Family of Market-focused 3D APIs Safety Critical 3D Cross platform desktop 3D Embedded 3D Vector 2D Application Acceleration APIs Streaming Media AL Enhanced Audio Embedded Media APIs DirectX-like API set with OS Abstraction and API Interoperability System Integration Standards CODEC and media component portability DL Streaming Media System Integration IL Open Standards for window systems Copyright Khronos Group, Page 6

7 Adoption of Embedded Khronos APIs Market adoption in media-accelerated handsets We Are Here - OpenGL ES 1.1 is widespread - OpenVG is in adoption ramp - OpenMAX is in adoption ramp 100% 3D Graphics Vector 2D Streaming Media Enhanced Audio Mid-2004 OpenGL ES 1.1 Spec release Mid-2005 OpenVG 1.0 Spec release Beginning-2006 OpenMax IL 1.0 Spec release TODAY! OpenSL ES 1.0 and OpenMAX AL 1.0 Spec release News Flash! Copyright Khronos Group, Page 7

8 Penetration of Native Media APIs MM phones Non 3D MM phones Native API based phones Millions of units Jon Peddie Research Handheld Multimedia Devices report Copyright Khronos Group, Page 8

9 OpenGL ES Applications and Devices OpenGL ES 1.1 has become the most widely deployed 3D API - Used in diverse applications, devices and markets Advanced User Interfaces - iphone uses OpenGL ES 3D Navigation - Google Earth and 3D city data Mobile Games Nokia - $7.2Bn market in 2010 (Informa) Nokia N93, N93, iphone, iphone, Sony Sony PS3 PS3 All All use use OpenGL OpenGL ES ES Copyright Khronos Group, Page 9

10 OpenGL ES Central to Mobile 3D JSR 239 Direct Java Bindings to OpenGL ES Java Applications C/C++ Applications Usable directly by applications Usable by higherlevel graphics libraries Close to the hardware API provides portability AND flexibility Hardware OpenGL ES Engines Scenegraph APIs M3G (JSR 184) Games Engines Middleware Libraries Software OpenGL ES Engines Brings advanced 2D/3D graphics to a wide range of OS platforms Copyright Khronos Group, Page 10

11 OpenGL ES Roadmap Stability and reducing fragmentation is currently the key concern - More important than new functionality in the current phase of market development - Industry is still absorbing and implementing current OpenGL ES specifications OpenGL ES 2.0 provisional specification August 2005 OpenGL ES 2.0 Conformance Tests Mid-2007 OpenGL ES 2.0 final specification March 2007 Halti only when NEEDED to address market needs or 2.0 shortcomings OpenGL ES 2.0 accelerated products begin to ship Platforms can ship either 1.X and 2.X libraries or both Cheaper, more flexible than one large driver with both fixed and programmable functions Halti products ship in volume OpenGL ES 1.1 with hardware acceleration remains the Sweet Spot at least through 2008 OpenGL ES 1.1 will continue to be used in lower-cost devices ? Copyright Khronos Group, Page 11

12 Shaders and Next Generation 3D OpenGL ES 1.1 for fixed function 3D graphics hardware - OpenGL ES 1.1 drivers can be shipped on new generation programmable hardware OpenGL ES 2.0 for new generation programmable 3D hardware - Vertex and pixel shaders programmed through GLSL ES shading language 3D Tomorrow - Shader Programmability Doom 3 s Zombies Unreal s Rocks 3D Today Fixed Functionality Halo s Ice Far Cry s Water Copyright Khronos Group, Page 12

13 OpenGL ES 2.0 Design OpenGL ES 2.0 eliminates all fixed function redundancy - Fixed function transform and lighting, texturing, fog, etc. that can be shader-programmed - Significant reduction in driver complexity but not 100% backwards compatible Adds full Shader Programmability - Vertex and Fragment Shaders - Shader Language (GLSL ES) VERY similar to desktop GLSL - Adds option for off-line compilation by loading binary shaders - Add more control over buffer precision to save memory 8, 10, 16 bit precisions Other features added - Cube Map, 3D and NPOT Textures - Frame Buffer Objects - Point Sprites - Float / Half Float Textures ETC Texture Compression - ROYALTY-FREE - Developed by Ericsson - Better quality than DXTC Copyright Khronos Group, Page 13

14 OpenGL ES 2.0 Programmable Pipeline Triangles/Lines/Points Vertex shaders replace Fixed Function Transform and Lighting API API Processing Primitive Primitive Processing Vertices Transform Transform Shader Vertex Vertex and Lighting Shader and Lighting Assembly Primitive Primitive Assembly Rasterizer Rasterizer Vertex Buffer Vertex Objects Buffer Objects Fragment shaders replace Fixed Function Texture, Color and Fog Environment Texture Texture Environment Fragment Fragment Colour Shader Colour Shader Sum Sum Fog Fog Alpha Test Alpha Test Stencil Depth Depth Stencil Colour Buffer Colour Blend Buffer Blend Dither Dither Frame Frame Buffer Buffer Copyright Khronos Group, Page 14

15 Visual Advantages of Shaders Vertex and pixel shaders lead to better image synthesis with same data - Significant increase is visual quality with NO extra CPU load Copyright Khronos Group, Page 15

16 Safety Critical OpenGL SC 1.0 Targeted at safety-certified avionics and automotive displays - Minimum possible driver size and complexity for DO-178B certification Developed by avionics and automotive graphics vendors - Seaweed, 3Dlabs, ALT, Barco, Diehl, Esmertec, Quantum3D in working group - Positive specification review by major avionics companies and software tools vendors Removes functionality not needed in instrumentation displays: format conversions and color manipulations, blending combinations etc. Safety Critical Profile Restores functionality used by legacy and auto-generated applications: e.g. display lists Copyright Khronos Group, Page 16

17 OpenVG - Accelerated Vector Graphics Vector graphics - basis of popular formats such as Flash and SVG - Bezier curves - scaled and positioned at full quality - not polygon based But 2D vector graphics historically run un-accelerated! - Not effective on low-powered handset CPUs OpenVG is the industry s first native Bezier acceleration API - Enables a new class of hardware acceleration avoiding tesselation to 3D polygons OpenVG is an OpenGL-style, low-level API - Can be used by players such as Flash and SVG or programmed directly Applications and UI SVG/Flash/ Font Packages etc.. 2D Hardware Acceleration Copyright Khronos Group, Page 17

18 OpenVG Pipeline Definition of path, transformation, stroke and paint Stroked path generation Transformation Rasterization Clipping and Masking Paint Generation Image Interpolation Blending Copyright Khronos Group, Page 18

19 OpenGL ES and OpenVG OpenGL ES Accurately represents PERSPECTIVE and LIGHTING OpenVG Accurately represents SHAPE and COLOR Compelling user interfaces require both OpenGL and OpenVG Copyright Khronos Group, Page 19

20 OpenVG Deployment X20 OpenVG 1.0 beginning to be widely deployed - A range of software and hardware implementations are coming to market Vector Graphics Performance X1 Software Implementations X3-7 Layered Implementations over OpenGL ES hardware Dedicated OpenVG Cores low power Copyright Khronos Group, Page 20

21 OpenMAX - Three Layer Solution Media Infrastructure Portability Open, royalty-free standard AL Application Layer Media Application Portability Applications programmed using cross-vendor interfaces IL Integration Layer Media Graph Portability Integrate media networks using standard interconnect protocols DL Development Layer Media Component Portability Develop portable media components using low-level media APIs More media applications available on more platforms for more end-user value! Portable and powerful media processing graphs can flexibly leverage available platform media components Component vendors can ship more advanced functionality across more processors. Media silicon vendors reduce costs and time to market OpenMAX defines three holistically designed media open standards to provide complete media infrastructure portability Copyright Khronos Group, Page 21

22 OpenMAX IL Streaming Media Enables arbitrary multimedia pipelines by plugging blocks together - Componentized architecture abstracts multimedia functionality block interfaces Wide variety of building blocks for imaging, video and audio functions - Encode, decode, apply an effect, capture, render, split, mix, etc Enables blocks from different sources to work together - Blocks can be implemented in software or hardware Portable & Re-usable streaming media building blocks Copyright Khronos Group, Page 22

23 OpenMAX IL Example Graph Standardized component interfaces enable flexible media graphs Includes multi-stream synchronization Allows for custom plug-ins OpenMAX Component Interfaces Enables components to be flexibly connected in any graph topology E.g. send dance beats to 3D application for visualization *.mp4 *.mp4 / / *.3gp File *.3gp File Reader Reader AAC Audio Clock for Clock for AV AV Sync Sync Audio Decoder Audio Decoder Time Data Plug-in Plug-in Audio Renderer Audio Renderer Speakers MPEG4/ H.264 Video Video Decoder Video Decoder Decompressed Video Video Scheduler Video Scheduler Video Renderer Video Renderer Display Example: MPEG-4 video synchronized with AAC audio decode Copyright Khronos Group, Page 23

24 OpenMAX AL Object Oriented Media OpenMAX AL - simplified object-oriented streaming media - Built to enable common use cases but also extensible - Can be implemented over OpenMAX IL OpenMAX AL Media Objects enable PLAY and RECORD of media - Media Objects input and output to Devices - Perform some operation on an input and emit the result as output - Can handle audio, images, video with synchronized audio Objects have control interfaces - Play, Seek, Rate, Audio, Display Region, Metadata Extraction - Record, Camera, Video Encoder, Audio Encoder, Metadata Insertion, Radio, MIDI Camera Audio Input URI Memory Content pipe? OpenMAX AL? Media Object Audio Mix Display Window URI Memory Content pipe Copyright Khronos Group, Page 24

25 OpenMAX Milestone Overview OpenMAX IL 1.0 Specification and Conformance Process Released ST releases Bellagio OpenMAX IL 1.0 Linux Sample Implementation on Source Forge OpenMAX AL 1.0 Provisional Release 1Q06 2Q06 3Q06 4Q06 1Q07 2Q07 3Q07 4Q07 1Q08 OpenMAX DL 1.0 Specification Released OpenMAX DL/IL 1.0 Conformance Tests released OpenMAX IL 1.1 Released with Conformance Tests Copyright Khronos Group, Page 25

26 OpenSL ES Enhanced Audio Audio API space is fragmented - Many proprietary audio APIs of varying functionality native and Java - Even playing a simple sound on different platform requires different code No standard foundation-level API to expose audio hardware acceleration - Audio silicon developers have to support many high-level APIs directly on silicon Applications OpenSL ES is a royalty-free, open standard Native interface to audio acceleration Broad audio functionality for applications, high-level libraries or middleware Middleware, JSR 135, JSR 234 High-level Audio Libraries Media Silicon (Audio HW, CPUs, DSPs) Copyright Khronos Group, Page 26

27 OpenSL ES Functionality Playback of audio files - Playback PCM and encoded content - Good for sound effects; device UI sounds SP-MIDI, Mobile DLS, Mobile XMF - For interactive music and ring-tones Effects & Controls - Music and media player effects - Advanced environmental effects for gaming 3D Audio - Provided for gaming as companion to OpenGL ES 3D position Doppler MIDI messages Preset Reverb Environmental Reverb Volume EQ Pitch Rate Buffer Queues Metadata extraction Virtualization Stereo widening LED & Vibra Copyright Khronos Group, Page 27

28 Three OpenSL ES Profiles Phone, Music and Game - Sufficient to cover all the market segments of importance to OpenSL ES Some profile overlap - Mostly in basic audio functionality Game-centric mobile devices Advanced MIDI functionality, sophisticated audio capabilities such as 3D audio, audio effects, ability to handle buffers of audio, etc. Music-centric mobile devices High quality audio, ability to support multiple music audio codecs, audio streaming support Game Music Phone Basic mobile phones Ring tone and alert tone playback (basic MIDI functionality), basic audio playback and record functionality, simple 2D audio games Copyright Khronos Group, Page 28

29 OpenSL ES Members and Milestones OpenSL ES 1.0 Provisional Release 4Q07 1Q08 2Q08 3Q08 4Q08 1Q09 Conformance Tests and OpenSL ES 1.0 Final Copyright Khronos Group, Page 29

30 OpenSL ES and OpenMAX AL (Enhanced audio API) Audio Effects Advanced MIDI 3D Audio Buffer queues Audio Playback Audio Recording MIDI Video playback Video recording Analog Radio & RDS Camera Image capture & display (Streaming Media APIs) Overlap streaming media functionality uses consistent APIs Copyright Khronos Group, Page 30

31 Complete Khronos Media Stack The Khronos API family provides a complete ROYALTY-FREE, cross-platform media acceleration platform Applications or middleware libraries (JSR 184 engines, Flash players, media players etc.) AL 3D Small footprint 3D for embedded systems Vector 2D Low-level vector acceleration API Platform Media Frameworks IL Playback and recording interfaces Component interfaces for codec integration SOUND Enhanced audio EGL Graphics surface management for efficient mixed mode 2D/3D/video rendering Image Libraries, Video Codecs, Sound Libraries DL Accelerated media primitives for codec development Media Engines CPUs, DSP, Hardware Accelerators etc. Khronos defines low-level, FOUNDATION-level APIs. Close to the hardware abstraction provides portability AND flexibility Copyright Khronos Group, Page 31

32 A SET of native APIs to de-fragment mobile application development. Like DirectX but an open standard for mobile platforms Operating System Abstraction APIs Define APIs to isolate applications from operating system differences SOURCE PORTABILITY for rich media applications Media APIs with defined and tested Interoperability Include Khronos media APIs and define how they work together Copyright Khronos Group, Page 32

33 OpenKODE API Set Software Platform (e.g. Brew, Symbian UIQ, S60, WIPI) Native Applications Java JVM Java Applications User Interface 3D Game Engines Flash/SVG Native Applications Players Players TV/Video/Audio Bindings OpenKODE Core OS Abstraction EGL Surface abstraction and Trans-API Communication AL 3D Vector 2D Streaming Media Enhanced Audio Media Acceleration GPU / DSPs / CPUs Kernel Operating System (e.g. Rex, Symbian OS, Windows Mobile, Linux, Nucleus) Copyright Khronos Group, Page 33

34 OpenKODE Components A conformant OpenKODE must pass all individual conformance tests PLUS trans-api tests to ensure APIs can communicate and operate concurrently Trans-API Conformance Tests 3D Enhanced Audio EGL Trans-API Communication OpenKODE Core Events, IO, files, memory, threads, strings, math, locale, time, networking, windowing, crypto, debug Vector 2D Streaming Media Selected Media APIs PLUS any EGL necessary for those APIs to communicate. (OpenGL ES 2.0, OpenMAX AL and OpenSL ES will be in OpenKODE 1.1 added through extensions to OpenKODE 1.0) POSIX-like APIs - mandatory for a compliant OpenKODE. Standalone conformance tests OpenKODE provides RELIABLE foundation-level acceleration for for media media applications that that MIX MIX multiple multiple media media types types Copyright Khronos Group, Page 34

35 SoftBank Mobile Announcement New-generation mobile platform will provide native access to OpenKODE - POP-I Portable Open Platform Initiative Mandated native API set for advanced UI and games Copyright Khronos Group, Page 35

36 OpenKODE Milestones OpenKODE 1.0 Provisional released at 3GSM Twelve months from kick-off meeting to specification on web-site - Encouraging developer feedback before spec finalization Full conformance tests being prepared in parallel with specification - Written by Futuremark tests OpenKODE Core AND trans-api operation OpenKODE 1.0 Provisional Release OpenKODE 1.0 Final Release Target with full conformance tests OpenKODE 1.1? Release add OpenMAX and OpenSL ES support 1Q07 2Q07 3Q07 4Q07 1Q08 2Q08 3Q08 Provisional Conformance Tests to be Released Copyright Khronos Group, Page 36

37 OpenKODE 1.1-3D Video Textures EGL is a Khronos API for abstracting rendering surfaces - OpenKODE 1.1 working to define how surfaces shared between OpenGL ES and OpenMAX - Aiming to eliminate unnecessary copies for power and processing efficiency Without EGLImage the game must copy the OpenMAX buffer into an OpenGL ES texture Data copy wastes cycles and space MPEG Video OpenMAX MPEG-4 Decode OpenMAX Buffer glteximage2d Surface OpenGL ES 3D Engine An EGLImage surface can be used as both the destination of the decode and a texture without copying the data MPEG Video OpenMAX MPEG-4 Decode EGLImage Surface OpenGL ES 3D Engine Copyright Khronos Group, Page 37

38 Raising 2D and 3D Visual Quality State-of-the-art APIs enable compelling consumer displays Advanced functionality, fast interactivity and extremely high quality High-quality 2D graphics using OpenVG Video processing with OpenMAX High-quality 3D displays using OpenGL ES Older generation APIs Provide rudimentary graphics functionality and quality Copyright Khronos Group, Page 38

39 COLLADA = Powerful Authoring COLLADA is a XML database schema for 3D assets - Can hold geometry, animation, visual effects, physics everything to do with a scene COLLADA transports 3D assets between applications - Enables binding of diverse DCC and 3D processing tools into a production pipeline COLLADA can be lossless never lose information - Retains all information - even multiple versions of the same asset COLLADA is an open, archive-grade format that retains meta information - When your DCC tool upgrades, you keep your assets COLLADA is non-destructive and so supports roundtripping of tools to enable powerful authoring pipelines Custom Tools Copyright Khronos Group, Page 39

40 COLLADA Momentum COLLADA 1.4 supported by all major tools and thousands of users - 3ds Max, Photoshop CS3, Blender, DAZ Studio, C4 Game Engine, Poser - NVIDIA FX Composer, Google Earth, Houdini, Maya, Sketchup, and XSI DAZ Studio 1.7 exports COLLADA - Complete export of mesh, skinning, rigging, lighting, camera, and animation data. Caligari truespace7.5 exports COLLADA Adobe Photoshop CS3 Extended imports COLLADA - For texture editing on 3D objects Copyright Khronos Group, Page 40

41 COLLADA UI Bringing 2D vector graphics to COLLADA file format Enables deep intermixing of 2D and 3D graphics Support for 2D and 3D Font libraries Font glyphs to support effects and animation for advanced rendering Copyright Khronos Group, Page 41

42 COLLADA Conditioning COLLADA is an interchange format - not a delivery format or a scene graph Conditioning pipelines take authored assets and: 1. Strips out authoring-only information 2. Re-sizes to suit the target platform 3. Compresses and formats binary data for the target platform Multiple tools create assets and scenes in a COLLADA Database Different target platforms can use the same asset database with the appropriate conditioning pipeline Conditioning Pipeline Conditioning Pipeline Copyright Khronos Group, Page 42

43 glfx Effects Framework COLLADA File format for 3D asset interchange widely adopted by DCC tools vendors and Google, Adobe, Epic etc. COLLADA FX Textures, shaders programs, geometry, control and pass information Conditioning - Existing Khronos standards - New glfx standard glfx File Format - OPTIONAL Contains effects optimized for deployment Runtime file format Application glfx Run-time API Application traverses scene data, uses the glfx Runtime API to use effects information to setup the rendering pipeline Runtime API OpenGL 2.1 / OpenGL 3.0 / ES 2.0 (Also ES 1.1 / Mount Evans) Copyright Khronos Group, Page 43

44 Benefits of One Organization OpenGL and OpenGL ES are now evolving under one IP framework - Design innovations can be freely shared between the APIs OpenGL and OpenGL ES can share same resources and outreach - Common Conformance tests, marketing and web-site, tool chains etc. OpenGL and OpenGL ES Working Groups will remain independent - Both groups will be able to make decisions that best serve their own markets Architectural design expertise Embedded Markets Desktop Markets Market feedback on streamlining functionality Momentum - hundreds of millions of OpenGL ES devices Copyright Khronos Group, Page 44

45 OpenGL Roadmap Synergy OpenGL ES has leveraged desktop OpenGL architecture - OpenGL ES 1.1 streamlined OpenGL OpenGL ES 2.0 streamlined OpenGL 2.0 and the GLSL shading language Next Generation OpenGL 3 and Mount Evans leverages OpenGL ES Learning from the streamlining of OpenGL ES 2.0 core OpenGL ES will benefit from the architectural innovation of Mount Evans - Nexgen OpenGL ES Halti will use desktop innovations for performance and functionality OpenGL 1.5/2.0 Architectural Foundation OpenGL ES 1.1/2.0 Functional Streamlining OpenGL 3 / Mount Evans Architectural Streamlining and next generation functionality Halti Next generation functionality for embedded markets Copyright Khronos Group, Page 45

46 OpenGL 3 and Mount Evans OpenGL 3 before end of Architectural streamlining of OpenGL - Elimination of fixed functionality evolving work in OpenGL ES New object model for speed and simpler programming - GL allocates handles, Direct editing, Efficient state grouping, Efficient sharing OpenGL 3 provides backwards compatibility - OpenGL 3 requires a new context - Both OpenGL 2.1 and OpenGL 3 contexts may bind to same drawable - Legacy code and LP code may peacefully co-exist - developers migrate at their own pace Mount Evans early Adds significant new features to OpenGL 3 - Geometry shaders - Greatly increased integer support in the OpenGL Shading Language - Stream out of vertex data to a buffer object - Texture arrays - Texture buffer objects - Numerous new texture formats - Instanced rendering Copyright Khronos Group, Page 46

47 OpenWF Windowing Foundation APIs to enable window systems to be built entirely on open standards - System-level APIs not intended for application developers First API is 2D screen composition API - Other APIs display control? 3D Composition Framework APIs? Portable applications use OpenKODE Core window system abstraction calls to communicate with the Windowing System OpenKODE Core Advanced Window System Applications and Media Engines Khronos Media APIs Khronos media APIs can be used by applications - and the window system to render and compose UI elements e.g. with 3D effects Window System can use OpenWF 2D Screen Composition API to bring application and UI elements together on the screen Screen Composition GPU Multi-tasking GPU accelerates multiple applications, window system UI / transitions and screen composition Copyright Khronos Group, Page 47

48 Khronos 2007 Milestones iphone launched uses OpenGL ES 1.1 for UI and display composition OpenMAX AL 1.0 Provisional Released OpenSL ES 1.0 Provisional Released OpenMAX IL 1.1 Public Release with Conformance Tests OpenKODE 1.0 Provisional Released COLLADA Adopted by Adobe for Photoshop CS3 OpenVG 1.0 Conformance Tests Released OpenVG 1.0 Reference Implementation open sourced glfx Working Group Announced OpenWF Working Group Announced COLLADA UI TSG Announced OpenGL 3 features revealed OpenVG 1.1 Public Release OpenKODE 1.0 Final Release COLLADA Conformance Tests Release OpenGL 3 Release 1Q07 2Q07 3Q07 4Q07 Copyright Khronos Group, Page 48

49 Why Are Khronos Standards Key? Foundation Level APIs to enable software to effectively use silicon - Close to the silicon fundamental functionality needed on every platform Synergistic mix of authoring and acceleration standards - Being designed together Hundreds of man years invested - Beyond any single company now to produce specifications of this breadth and depth Royalty-free - Khronos is committed to generating market opportunities for its members and the industry Copyright Khronos Group, Page 49

50 More Details? Khronos Mobile and Embedded Graphics track Here at ARM Developer Conference 9AM Thursday Speakers from Khronos, Imagination, ARM Copyright Khronos Group, Page 50

51 Help Khronos Help You! Please consider joining Khronos! - Developer feedback and participation is always very welcome Please review our specifications and provide feedback - Public forums and developer resources here - Slides and Khronos membership details at Copyright Khronos Group, Page 51

Copyright Khronos Group, Page 1

Copyright Khronos Group, Page 1 1HLO7UHYHWW 19,',$.KURQRV *URXS 2SHQ*/(6 Copyright Khronos Group, 2007 - Page 1 Handsets are becoming personal computing platform - not just phones - A real computer in your hand mobility, connectedness

More information

Copyright Khronos Group, Page 1

Copyright Khronos Group, Page 1 3RUWDEOH1DWLYH0RELOH 0HGLD$SSOLFDWLRQV 1HLO7UHYHWW 9LFH3UHVLGHQW(PEHGGHG&RQWHQW19,',$ 3UHVLGHQW.KURQRV*URXS Copyright Khronos Group, 2007 - Page 1 3HUYDVLYH0RELOH0HGLD&RPSXWLQJ Handsets are becoming personal

More information

Copyright Khronos Group, Page 1

Copyright Khronos Group, Page 1 3RUWDEOH1DWLYH0RELOH 0HGLD$SSOLFDWLRQV 1HLO7UHYHWW 9LFH3UHVLGHQW(PEHGGHG&RQWHQW19,',$ 3UHVLGHQW.KURQRV*URXS Copyright Khronos Group, 2007 - Page 1 3HUYDVLYH0RELOH0HGLD&RPSXWLQJ Handsets are becoming personal

More information

Streaming Media. Advanced Audio. Erik Noreke Standardization Consultant Chair, OpenSL ES. Copyright Khronos Group, Page 1

Streaming Media. Advanced Audio. Erik Noreke Standardization Consultant Chair, OpenSL ES. Copyright Khronos Group, Page 1 Streaming Media Advanced Audio Erik Noreke Standardization Consultant Chair, OpenSL ES Copyright Khronos Group, 2010 - Page 1 Today s Consumer Requirements Rich media applications and UI - Consumer decisions

More information

Completing the Multimedia Architecture

Completing the Multimedia Architecture Copyright Khronos Group, 2011 - Page 1 Completing the Multimedia Architecture Erik Noreke Chair of OpenSL ES Working Group Chair of OpenMAX AL Working Group Copyright Khronos Group, 2011 - Page 2 Today

More information

Creating the Embedded Media Processing Ecosystem

Creating the Embedded Media Processing Ecosystem Creating the Embedded Media Processing Ecosystem Neil Trevett Vice President Embedded Content, NVIDIA President, Khronos Chairman, OpenGL ES Working Group Mobile Convergence Handsets are becoming the predominant

More information

Dave Shreiner, ARM March 2009

Dave Shreiner, ARM March 2009 4 th Annual Dave Shreiner, ARM March 2009 Copyright Khronos Group, 2009 - Page 1 Motivation - What s OpenGL ES, and what can it do for me? Overview - Lingo decoder - Overview of the OpenGL ES Pipeline

More information

Copyright Khronos Group Page 1

Copyright Khronos Group Page 1 Gaming Market Briefing Overview of APIs GDC March 2016 Neil Trevett Khronos President NVIDIA Vice President Developer Ecosystem ntrevett@nvidia.com @neilt3d Copyright Khronos Group 2016 - Page 1 Copyright

More information

Next Generation OpenGL Neil Trevett Khronos President NVIDIA VP Mobile Copyright Khronos Group Page 1

Next Generation OpenGL Neil Trevett Khronos President NVIDIA VP Mobile Copyright Khronos Group Page 1 Next Generation OpenGL Neil Trevett Khronos President NVIDIA VP Mobile Ecosystem @neilt3d Copyright Khronos Group 2015 - Page 1 Copyright Khronos Group 2015 - Page 2 Khronos Connects Software to Silicon

More information

WebGL Meetup GDC Copyright Khronos Group, Page 1

WebGL Meetup GDC Copyright Khronos Group, Page 1 WebGL Meetup GDC 2012 Copyright Khronos Group, 2012 - Page 1 Copyright Khronos Group, 2012 - Page 2 Khronos API Ecosystem Trends Neil Trevett Vice President Mobile Content, NVIDIA President, The Khronos

More information

AR Standards Update Austin, March 2012

AR Standards Update Austin, March 2012 AR Standards Update Austin, March 2012 Neil Trevett President, The Khronos Group Vice President Mobile Content, NVIDIA Copyright Khronos Group, 2012 - Page 1 Topics Very brief overview of Khronos Update

More information

Mobile AR Hardware Futures

Mobile AR Hardware Futures Copyright Khronos Group, 2010 - Page 1 Mobile AR Hardware Futures Neil Trevett Vice President Mobile Content, NVIDIA President, The Khronos Group Two Perspectives NVIDIA - Tegra 2 mobile processor Khronos

More information

OpenMAX AL, OpenSL ES

OpenMAX AL, OpenSL ES Copyright Khronos Group, 2011 - Page 1 OpenMAX AL, OpenSL ES Native Multimedia in Android Erik Noreke Chair of OpenMAX AL and OpenSL ES Working Groups Copyright Khronos Group, 2011 - Page 2 Why Create

More information

SIGGRAPH Briefing August 2014

SIGGRAPH Briefing August 2014 Copyright Khronos Group 2014 - Page 1 SIGGRAPH Briefing August 2014 Neil Trevett VP Mobile Ecosystem, NVIDIA President, Khronos Copyright Khronos Group 2014 - Page 2 Significant Khronos API Ecosystem Advances

More information

Copyright Khronos Group, Page 1

Copyright Khronos Group, Page 1 2SHQ*/(6%2) 7RP2OVRQ7, 2SHQ*/(6:RUNLQJ*URXS&KDLU Copyright Khronos Group, 2007 - Page 1 2XWOLQH Khronos and OpenGL ES Overview Working Group News Current Working Group Activities Discussion and Feedback

More information

Press Briefing SIGGRAPH 2015 Neil Trevett Khronos President NVIDIA Vice President Mobile Ecosystem. Copyright Khronos Group Page 1

Press Briefing SIGGRAPH 2015 Neil Trevett Khronos President NVIDIA Vice President Mobile Ecosystem. Copyright Khronos Group Page 1 Press Briefing SIGGRAPH 2015 Neil Trevett Khronos President NVIDIA Vice President Mobile Ecosystem Copyright Khronos Group 2015 - Page 1 Khronos Connects Software to Silicon Open Consortium creating ROYALTY-FREE,

More information

Press Briefing SIGGRAPH 2015 Neil Trevett Khronos President NVIDIA Vice President Mobile Ecosystem. Copyright Khronos Group Page 1

Press Briefing SIGGRAPH 2015 Neil Trevett Khronos President NVIDIA Vice President Mobile Ecosystem. Copyright Khronos Group Page 1 Press Briefing SIGGRAPH 2015 Neil Trevett Khronos President NVIDIA Vice President Mobile Ecosystem Copyright Khronos Group 2015 - Page 1 Khronos Connects Software to Silicon Open Consortium creating ROYALTY-FREE,

More information

Copyright Khronos Group, Page 1. Khronos Overview. Taiwan, February 2012

Copyright Khronos Group, Page 1. Khronos Overview. Taiwan, February 2012 Copyright Khronos Group, 2012 - Page 1 Khronos Overview Taiwan, February 2012 Copyright Khronos Group, 2012 - Page 2 Khronos - Connecting Software to Silicon Creating open, royalty-free API standards -

More information

Copyright Khronos Group Page 1. Vulkan Overview. June 2015

Copyright Khronos Group Page 1. Vulkan Overview. June 2015 Copyright Khronos Group 2015 - Page 1 Vulkan Overview June 2015 Copyright Khronos Group 2015 - Page 2 Khronos Connects Software to Silicon Open Consortium creating OPEN STANDARD APIs for hardware acceleration

More information

Khronos and the Mobile Ecosystem

Khronos and the Mobile Ecosystem Copyright Khronos Group, 2011 - Page 1 Khronos and the Mobile Ecosystem Neil Trevett VP Mobile Content, NVIDIA President, Khronos Copyright Khronos Group, 2011 - Page 2 Topics It s not just about individual

More information

POWERVR MBX & SGX OpenVG Support and Resources

POWERVR MBX & SGX OpenVG Support and Resources POWERVR MBX & SGX OpenVG Support and Resources Kristof Beets 3 rd Party Relations Manager - Imagination Technologies kristof.beets@imgtec.com Copyright Khronos Group, 2006 - Page 1 Copyright Khronos Group,

More information

Neil Trevett Vice President Mobile Ecosystem, NVIDIA President, Khronos Group. Copyright Khronos Group Page 1

Neil Trevett Vice President Mobile Ecosystem, NVIDIA President, Khronos Group. Copyright Khronos Group Page 1 Neil Trevett Vice President Mobile Ecosystem, NVIDIA President, Khronos Group Copyright Khronos Group 2014 - Page 1 Khronos Standards 3D Asset Handling - 3D authoring asset interchange - 3D asset transmission

More information

Bringing it all together: The challenge in delivering a complete graphics system architecture. Chris Porthouse

Bringing it all together: The challenge in delivering a complete graphics system architecture. Chris Porthouse Bringing it all together: The challenge in delivering a complete graphics system architecture Chris Porthouse System Integration & the role of standards Content Ecosystem Java Execution Environment Native

More information

Applications and Implementations

Applications and Implementations Copyright Khronos Group, 2010 - Page 1 Applications and Implementations Hwanyong LEE CTO and Technical Marketing Director HUONE System Integration Application Acceleration Authoring and accessibility Khronos

More information

Hardware Accelerated Graphics for High Performance JavaFX Mobile Applications

Hardware Accelerated Graphics for High Performance JavaFX Mobile Applications Hardware Accelerated Graphics for High Performance JavaFX Mobile Applications Pavel Petroshenko, Sun Microsystems Jan Valenta, Sun Microsystems Jerry Evans, Sun Microsystems Goal of this Session Demonstrate

More information

Mobile graphics API Overview

Mobile graphics API Overview Mobile graphics API Overview Michael Doggett Department of Computer Science Lund University 2009 Michael Doggett and Tomas Akenine-Möller 1 Register Please check to see if your name is on the list, if

More information

Copyright Khronos Group Page 1

Copyright Khronos Group Page 1 Open Standards and Open Source Together How Khronos APIs Accelerate Fast and Cool Applications Neil Trevett Khronos President NVIDIA Vice President Mobile Ecosystem Copyright Khronos Group 2015 - Page

More information

Copyright Khronos Group, Page 1. OpenCL. GDC, March 2010

Copyright Khronos Group, Page 1. OpenCL. GDC, March 2010 Copyright Khronos Group, 2011 - Page 1 OpenCL GDC, March 2010 Authoring and accessibility Application Acceleration System Integration Copyright Khronos Group, 2011 - Page 2 Khronos Family of Standards

More information

The Mobile Advantage. Erik Noreke Independent Standardization Consultant Chair, OpenSL ES. Copyright Khronos Group, Page 1

The Mobile Advantage. Erik Noreke Independent Standardization Consultant Chair, OpenSL ES. Copyright Khronos Group, Page 1 & The Mobile Advantage Erik Noreke Independent Standardization Consultant Chair, OpenSL ES Copyright Khronos Group, 2010 - Page 1 Focused on Creating an Open Market Open Standards Open Markets - Developed

More information

Streaming Media Portability

Streaming Media Portability Streaming Media Portability July 2006 Copyright Khronos Group, 2006 - Page 1 Copyright Khronos Group, 2006 - Page 2 Media Portability Problem Media infrastructure portability is a multi-level industry

More information

Adding Advanced Shader Features and Handling Fragmentation

Adding Advanced Shader Features and Handling Fragmentation Copyright Khronos Group, 2010 - Page 1 Adding Advanced Shader Features and Handling Fragmentation How to enable your application on a wide range of devices Imagination Technologies Copyright Khronos Group,

More information

Khronos Connects Software to Silicon

Khronos Connects Software to Silicon Press Pre-Briefing GDC 2015 Neil Trevett Khronos President NVIDIA Vice President Mobile Ecosystem All Materials Embargoed Until Tuesday 3 rd March, 12:01AM Pacific Time Copyright Khronos Group 2015 - Page

More information

Open Standards for Building Virtual and Augmented Realities. Neil Trevett Khronos President NVIDIA VP Developer Ecosystems

Open Standards for Building Virtual and Augmented Realities. Neil Trevett Khronos President NVIDIA VP Developer Ecosystems Open Standards for Building Virtual and Augmented Realities Neil Trevett Khronos President NVIDIA VP Developer Ecosystems Khronos Mission Asian Members Software Silicon Khronos is an International Industry

More information

Whiz-Bang Graphics and Media Performance for Java Platform, Micro Edition (JavaME)

Whiz-Bang Graphics and Media Performance for Java Platform, Micro Edition (JavaME) Whiz-Bang Graphics and Media Performance for Java Platform, Micro Edition (JavaME) Pavel Petroshenko, Sun Microsystems, Inc. Ashmi Bhanushali, NVIDIA Corporation Jerry Evans, Sun Microsystems, Inc. Nandini

More information

Introduction to OpenGL ES 3.0

Introduction to OpenGL ES 3.0 Introduction to OpenGL ES 3.0 Eisaku Ohbuchi Digital Media Professionals Inc. 2012 Digital Media Professionals Inc. All rights reserved. 12/Sep/2012 Page 1 Agenda DMP overview (quick!) OpenGL ES 3.0 update

More information

Open Standards for Vision and AI Peter McGuinness NNEF WG Chair CEO, Highwai, Inc May 2018

Open Standards for Vision and AI Peter McGuinness NNEF WG Chair CEO, Highwai, Inc May 2018 Copyright Khronos Group 2018 - Page 1 Open Standards for Vision and AI Peter McGuinness NNEF WG Chair CEO, Highwai, Inc peter.mcguinness@gobrach.com May 2018 Khronos Mission E.g. OpenGL ES provides 3D

More information

Mobile Graphics Ecosystem. Tom Olson OpenGL ES working group chair

Mobile Graphics Ecosystem. Tom Olson OpenGL ES working group chair OpenGL ES in the Mobile Graphics Ecosystem Tom Olson OpenGL ES working group chair Director, Graphics Research, ARM Ltd 1 Outline Why Mobile Graphics? OpenGL ES Overview Getting Started with OpenGL ES

More information

Applications and Implementations

Applications and Implementations Copyright Khronos Group, 2010 - Page 1 Applications and Implementations Hwanyong LEE CTO and Technical Marketing Director HUONE OpenVG Royalty-free open standard API Low-level 2D vector graphics rendering

More information

Standards for WebVR. Neil Trevett. Khronos President Vice President Mobile Content,

Standards for WebVR. Neil Trevett. Khronos President Vice President Mobile Content, Standards for WebVR Neil Trevett Khronos President Vice President Mobile Content, NVIDIA ntrevett@nvidia.com, @neilt3d October 2016 Copyright Khronos Group 2016 - Page 1 Khronos Open Standards Software

More information

OpenCL Overview. Shanghai March Neil Trevett Vice President Mobile Content, NVIDIA President, The Khronos Group

OpenCL Overview. Shanghai March Neil Trevett Vice President Mobile Content, NVIDIA President, The Khronos Group Copyright Khronos Group, 2012 - Page 1 OpenCL Overview Shanghai March 2012 Neil Trevett Vice President Mobile Content, NVIDIA President, The Khronos Group Copyright Khronos Group, 2012 - Page 2 Processor

More information

SC24/WG9 Liaison Meeting

SC24/WG9 Liaison Meeting Copyright Khronos Group, 2011 - Page 1 SC24/WG9 Liaison Meeting Seoul, November 2011 Neil Trevett Vice President Mobile Content, NVIDIA President, The Khronos Group Copyright Khronos Group, 2011 - Page

More information

Overview and AR/VR Roadmap

Overview and AR/VR Roadmap Khronos Group Inc. 2018 - Page 1 Overview and AR/ Roadmap Neil Trevett Khronos President NVIDIA VP Developer Ecosystems ntrevett@nvidia.com @neilt3d Khronos Group Inc. 2018 - Page 2 Khronos Connects Software

More information

Vulkan 1.1 March Copyright Khronos Group Page 1

Vulkan 1.1 March Copyright Khronos Group Page 1 Vulkan 1.1 March 2018 Copyright Khronos Group 2018 - Page 1 Vulkan 1.1 Launch and Ongoing Momentum Strengthening the Ecosystem Improved developer tools (SDK, validation/debug layers) More rigorous conformance

More information

OpenCL Press Conference

OpenCL Press Conference Copyright Khronos Group, 2011 - Page 1 OpenCL Press Conference Tokyo, November 2011 Neil Trevett Vice President Mobile Content, NVIDIA President, The Khronos Group Copyright Khronos Group, 2011 - Page

More information

Our Technology Expertise for Software Engineering Services. AceThought Services Your Partner in Innovation

Our Technology Expertise for Software Engineering Services. AceThought Services Your Partner in Innovation Our Technology Expertise for Software Engineering Services High Performance Computing MultiCore CPU AceThought experts will re-design your sequential algorithms or applications to execute in parallel by

More information

Copyright Khronos Group 2012 Page 1. OpenCL 1.2. August 2012

Copyright Khronos Group 2012 Page 1. OpenCL 1.2. August 2012 Copyright Khronos Group 2012 Page 1 OpenCL 1.2 August 2012 Copyright Khronos Group 2012 Page 2 Khronos - Connecting Software to Silicon Khronos defines open, royalty-free standards to access graphics,

More information

The OpenVX Computer Vision and Neural Network Inference

The OpenVX Computer Vision and Neural Network Inference The OpenVX Computer and Neural Network Inference Standard for Portable, Efficient Code Radhakrishna Giduthuri Editor, OpenVX Khronos Group radha.giduthuri@amd.com @RadhaGiduthuri Copyright 2018 Khronos

More information

Accelerating Vision Processing

Accelerating Vision Processing Accelerating Vision Processing Neil Trevett Vice President Mobile Ecosystem at NVIDIA President of Khronos and Chair of the OpenCL Working Group SIGGRAPH, July 2016 Copyright Khronos Group 2016 - Page

More information

Open Standards for AR and VR Neil Trevett Khronos President NVIDIA VP Developer January 2018

Open Standards for AR and VR Neil Trevett Khronos President NVIDIA VP Developer January 2018 Copyright Khronos Group 2018 - Page 1 Open Standards for AR and Neil Trevett Khronos President NVIDIA VP Developer Ecosystem ntrevett@nvidia.com @neilt3d January 2018 Khronos Mission E.g. OpenGL ES provides

More information

Introduction to Shaders.

Introduction to Shaders. Introduction to Shaders Marco Benvegnù hiforce@gmx.it www.benve.org Summer 2005 Overview Rendering pipeline Shaders concepts Shading Languages Shading Tools Effects showcase Setup of a Shader in OpenGL

More information

WebGL, WebCL and Beyond!

WebGL, WebCL and Beyond! Copyright Khronos Group, 2011 - Page 1 WebGL, WebCL and Beyond! Neil Trevett Vice President Mobile Content, NVIDIA President, The Khronos Group Copyright Khronos Group, 2011 - Page 2 Topics in this Session

More information

Visual HTML5. Human Information Interaction for Knowledge Extraction, Interaction, Utilization, Decision making HI-I-KEIUD

Visual HTML5. Human Information Interaction for Knowledge Extraction, Interaction, Utilization, Decision making HI-I-KEIUD Visual HTML5 1 Overview HTML5 Building apps with HTML5 Visual HTML5 Canvas SVG Scalable Vector Graphics WebGL 2D + 3D libraries 2 HTML5 HTML5 to Mobile + Cloud = Java to desktop computing: cross-platform

More information

Open Standards for Today s Gaming Industry

Open Standards for Today s Gaming Industry Copyright Khronos Group 2013 - Page 1 Open Standards for Today s Gaming Industry Erik Noreke VP of Business Development, Khronos Group Gaming Evolution Copyright Khronos Group 2013 - Page 3 DESKTOP MOBILE

More information

PowerVR: Getting Great Graphics Performance with the PowerVR Insider SDK. PowerVR Developer Technology

PowerVR: Getting Great Graphics Performance with the PowerVR Insider SDK. PowerVR Developer Technology PowerVR: Getting Great Graphics Performance with the PowerVR Insider SDK PowerVR Developer Technology Company Overview Leading silicon, software & cloud IP supplier Graphics, video, comms, processor, cloud

More information

Building scalable 3D applications. Ville Miettinen Hybrid Graphics

Building scalable 3D applications. Ville Miettinen Hybrid Graphics Building scalable 3D applications Ville Miettinen Hybrid Graphics What s going to happen... (1/2) Mass market: 3D apps will become a huge success on low-end and mid-tier cell phones Retro-gaming New game

More information

Open API Standards for Mobile Graphics, Compute and Vision Processing GTC, March 2014

Open API Standards for Mobile Graphics, Compute and Vision Processing GTC, March 2014 Open API Standards for Mobile Graphics, Compute and Vision Processing GTC, March 2014 Neil Trevett Vice President Mobile Ecosystem, NVIDIA President Khronos Copyright Khronos Group 2014 - Page 1 Khronos

More information

Tools To Get Great Graphics Performance

Tools To Get Great Graphics Performance PowerVR SDK Overview Tools To Get Great Graphics Performance August 2012 www.imgtec.com Imagination Technologies PowerVR Graphics The Embedded Graphics IP Experts Imagination Technologies - multi-media

More information

Accelerating Realism with the (NVIDIA Scene Graph)

Accelerating Realism with the (NVIDIA Scene Graph) Accelerating Realism with the (NVIDIA Scene Graph) Holger Kunz Manager, Workstation Middleware Development Phillip Miller Director, Workstation Middleware Product Management NVIDIA application acceleration

More information

The PowerVR Insider SDK. PowerVR Developer Technology

The PowerVR Insider SDK. PowerVR Developer Technology The PowerVR Insider SDK PowerVR Developer Technology Nov 2012 First, An Introduction! Who Am I? Who? Guillem Vinals Developer Technology Engineer, PowerVR Graphics What? An introduction to our PowerVR

More information

Vulkan Launch Webinar 18 th February Copyright Khronos Group Page 1

Vulkan Launch Webinar 18 th February Copyright Khronos Group Page 1 Vulkan Launch Webinar 18 th February 2016 Copyright Khronos Group 2016 - Page 1 Copyright Khronos Group 2016 - Page 2 The Vulkan Launch Webinar Is About to Start! Kathleen Mattson - Webinar MC, Khronos

More information

Profiling and Debugging OpenCL Applications with ARM Development Tools. October 2014

Profiling and Debugging OpenCL Applications with ARM Development Tools. October 2014 Profiling and Debugging OpenCL Applications with ARM Development Tools October 2014 1 Agenda 1. Introduction to GPU Compute 2. ARM Development Solutions 3. Mali GPU Architecture 4. Using ARM DS-5 Streamline

More information

Update on Khronos Open Standard APIs for Vision Processing Neil Trevett Khronos President NVIDIA Vice President Mobile Ecosystem

Update on Khronos Open Standard APIs for Vision Processing Neil Trevett Khronos President NVIDIA Vice President Mobile Ecosystem Update on Khronos Open Standard APIs for Vision Processing Neil Trevett Khronos President NVIDIA Vice President Mobile Ecosystem Copyright Khronos Group 2015 - Page 1 Copyright Khronos Group 2015 - Page

More information

Open Standard APIs for Augmented Reality

Open Standard APIs for Augmented Reality Copyright Khronos Group 2014 - Page 1 Open Standard APIs for Augmented Reality Neil Trevett Vice President Mobile Ecosystem, NVIDIA President, Khronos Group Copyright Khronos Group 2014 - Page 2 Khronos

More information

OpenGL ES 2.0 : Start Developing Now. Dan Ginsburg Advanced Micro Devices, Inc.

OpenGL ES 2.0 : Start Developing Now. Dan Ginsburg Advanced Micro Devices, Inc. OpenGL ES 2.0 : Start Developing Now Dan Ginsburg Advanced Micro Devices, Inc. Agenda OpenGL ES 2.0 Brief Overview Tools OpenGL ES 2.0 Emulator RenderMonkey w/ OES 2.0 Support OpenGL ES 2.0 3D Engine Case

More information

The State of Gaming APIs

The State of Gaming APIs Copyright Khronos Group, 2011 - Page 1 The State of Gaming APIs Neil Trevett Vice President Mobile Content, NVIDIA President, The Khronos Group Copyright Khronos Group, 2011 - Page 2 State of Gaming APIs

More information

WHAT IS BFA NEW MEDIA?

WHAT IS BFA NEW MEDIA? VISUAL & TYPE WEB & INTERACTIVE MOTION GRAPHICS DIGITAL IMAGING VIDEO DIGITAL PHOTO VECTOR DRAWING AUDIO To learn more and see three years of our best student work, please visit: webdesignnewmedia.com

More information

More performance options

More performance options More performance options OpenCL, streaming media, and native coding options with INDE April 8, 2014 2014, Intel Corporation. All rights reserved. Intel, the Intel logo, Intel Inside, Intel Xeon, and Intel

More information

Mali Developer Resources. Kevin Ho ARM Taiwan FAE

Mali Developer Resources. Kevin Ho ARM Taiwan FAE Mali Developer Resources Kevin Ho ARM Taiwan FAE ARM Mali Developer Tools Software Development SDKs for OpenGL ES & OpenCL OpenGL ES Emulators Shader Development Studio Shader Library Asset Creation Texture

More information

INTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY

INTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY INTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY A PATH FOR HORIZING YOUR INNOVATIVE WORK A REVIEW ON THE ARCHITECTURE OF ANDROID IN SMART PHONES RAVNEET KAUR T. BAGGA 1,

More information

Multimedia Platform. Mainstream wireless multimedia expands globally with the industry s first single-chipset solution

Multimedia Platform. Mainstream wireless multimedia expands globally with the industry s first single-chipset solution CONVERGENCE ENHANCED MULTIMEDIA MULTIMEDIA VALUE Multimedia Platform Mainstream wireless multimedia expands globally with the industry s first single-chipset solution F I N D A R E S T A U R A N T S E

More information

The Mobile Internet: The Potential of Handhelds to Bring Internet to the Masses. April 2008

The Mobile Internet: The Potential of Handhelds to Bring Internet to the Masses. April 2008 The Mobile Internet: The Potential of Handhelds to Bring Internet to the Masses April 2008 Agenda Today s Mobile Internet Market Mobile Convergence Products Internet Browsing on a Handheld Separating Fact

More information

gltf Briefing September 2016 Copyright Khronos Group Page 1

gltf Briefing September 2016 Copyright Khronos Group Page 1 gltf Briefing September 2016 Copyright Khronos Group 2016 - Page 1 Copyright Khronos Group 2016 - Page 2 Background and Motivation OpenGL ES and WebGL have led to a proliferation of Web 3D but no standard

More information

Next Generation Visual Computing

Next Generation Visual Computing Next Generation Visual Computing (Making GPU Computing a Reality with Mali ) Taipei, 18 June 2013 Roberto Mijat ARM Addressing Computational Challenges Trends Growing display sizes and resolutions Increasing

More information

Craig Peeper Software Architect Windows Graphics & Gaming Technologies Microsoft Corporation

Craig Peeper Software Architect Windows Graphics & Gaming Technologies Microsoft Corporation Gaming Technologies Craig Peeper Software Architect Windows Graphics & Gaming Technologies Microsoft Corporation Overview Games Yesterday & Today Game Components PC Platform & WGF 2.0 Game Trends Big Challenges

More information

Khronos Updates GDC 2017 Neil Trevett Vice President Developer Ecosystem, NVIDIA President,

Khronos Updates GDC 2017 Neil Trevett Vice President Developer Ecosystem, NVIDIA President, Copyright Khronos Group 2017 - Page 1 Khronos Updates GDC 2017 Neil Trevett Vice President Developer Ecosystem, NVIDIA President, Khronos ntrevett@nvidia.com @neilt3d Copyright Khronos Group 2017 - Page

More information

Developing the Roadmap - Director Next Survey

Developing the Roadmap - Director Next Survey Developing the Roadmap - Director Next Survey Section 1: How do you use Director? 1. My primary use of Director is (select one only): Desktop Application Development Rich Internet Application (RIA) Development

More information

Real - Time Rendering. Graphics pipeline. Michal Červeňanský Juraj Starinský

Real - Time Rendering. Graphics pipeline. Michal Červeňanský Juraj Starinský Real - Time Rendering Graphics pipeline Michal Červeňanský Juraj Starinský Overview History of Graphics HW Rendering pipeline Shaders Debugging 2 History of Graphics HW First generation Second generation

More information

WebGL (Web Graphics Library) is the new standard for 3D graphics on the Web, designed for rendering 2D graphics and interactive 3D graphics.

WebGL (Web Graphics Library) is the new standard for 3D graphics on the Web, designed for rendering 2D graphics and interactive 3D graphics. About the Tutorial WebGL (Web Graphics Library) is the new standard for 3D graphics on the Web, designed for rendering 2D graphics and interactive 3D graphics. This tutorial starts with a basic introduction

More information

Grafica Computazionale: Lezione 30. Grafica Computazionale. Hiding complexity... ;) Introduction to OpenGL. lezione30 Introduction to OpenGL

Grafica Computazionale: Lezione 30. Grafica Computazionale. Hiding complexity... ;) Introduction to OpenGL. lezione30 Introduction to OpenGL Grafica Computazionale: Lezione 30 Grafica Computazionale lezione30 Introduction to OpenGL Informatica e Automazione, "Roma Tre" May 20, 2010 OpenGL Shading Language Introduction to OpenGL OpenGL (Open

More information

Enabling a Richer Multimedia Experience with GPU Compute. Roberto Mijat Visual Computing Marketing Manager

Enabling a Richer Multimedia Experience with GPU Compute. Roberto Mijat Visual Computing Marketing Manager Enabling a Richer Multimedia Experience with GPU Compute Roberto Mijat Visual Computing Marketing Manager 1 What is GPU Compute Operating System and most application processing continue to reside on the

More information

What was removed? (1) OpenGL ES vs. OpenGL

What was removed? (1) OpenGL ES vs. OpenGL SLIDE 2 Outline What is? vs. OpenGL Profiles and versions EGL Surfaces on Windows CE and Symbian Implementations SLIDE 3 SLIDE 4 What is? Small-footprint subset of OpenGL OpenGL is too large for embedded

More information

Hands-On Workshop: 3D Automotive Graphics on Connected Radios Using Rayleigh and OpenGL ES 2.0

Hands-On Workshop: 3D Automotive Graphics on Connected Radios Using Rayleigh and OpenGL ES 2.0 Hands-On Workshop: 3D Automotive Graphics on Connected Radios Using Rayleigh and OpenGL ES 2.0 FTF-AUT-F0348 Hugo Osornio Luis Olea A P R. 2 0 1 4 TM External Use Agenda Back to the Basics! What is a GPU?

More information

NVSG NVIDIA Scene Graph

NVSG NVIDIA Scene Graph NVSG NVIDIA Scene Graph Leveraging the World's Fastest Scene Graph Agenda Overview NVSG Shader integration Interactive ray tracing Multi-GPU support NVIDIA Scene Graph (NVSG) The first cross-platform scene

More information

Module Introduction. Content 15 pages 2 questions. Learning Time 25 minutes

Module Introduction. Content 15 pages 2 questions. Learning Time 25 minutes Purpose The intent of this module is to introduce you to the multimedia features and functions of the i.mx31. You will learn about the Imagination PowerVR MBX- Lite hardware core, graphics rendering, video

More information

Copyright Khronos Group Page 1

Copyright Khronos Group Page 1 OpenCL A State of the Union Neil Trevett Khronos President NVIDIA Vice President Developer Ecosystem OpenCL Working Group Chair ntrevett@nvidia.com @neilt3d Vienna, April 2016 Copyright Khronos Group 2016

More information

OpenGL ES update. Eisaku Ohbuchi Digital Media Professionals Inc.

OpenGL ES update. Eisaku Ohbuchi Digital Media Professionals Inc. OpenGL ES update Eisaku Ohbuchi Digital Media Professionals Inc. What is OpenGL ES? OpenGL for mobile devices Gets rid of redundant / legacy features Extensions to make it mobile-friendly All the functionality

More information

3D Graphics in Future Mobile Devices. Steve Steele, ARM

3D Graphics in Future Mobile Devices. Steve Steele, ARM 3D Graphics in Future Mobile Devices Steve Steele, ARM Market Trends Mobile Computing Market Growth Volume in millions Mobile Computing Market Trends 1600 Smart Mobile Device Shipments (Smartphones and

More information

Overview. Technology Details. D/AVE NX Preliminary Product Brief

Overview. Technology Details. D/AVE NX Preliminary Product Brief Overview D/AVE NX is the latest and most powerful addition to the D/AVE family of rendering cores. It is the first IP to bring full OpenGL ES 2.0/3.1 rendering to the FPGA and SoC world. Targeted for graphics

More information

Bringing AAA graphics to mobile platforms. Niklas Smedberg Senior Engine Programmer, Epic Games

Bringing AAA graphics to mobile platforms. Niklas Smedberg Senior Engine Programmer, Epic Games Bringing AAA graphics to mobile platforms Niklas Smedberg Senior Engine Programmer, Epic Games Who Am I A.k.a. Smedis Platform team at Epic Games Unreal Engine 15 years in the industry 30 years of programming

More information

Shaders : the sky is the limit Sébastien Dominé NVIDIA Richard Stenson SCEA

Shaders : the sky is the limit Sébastien Dominé NVIDIA Richard Stenson SCEA Shaders : the sky is the limit Sébastien Dominé NVIDIA Richard Stenson SCEA Agenda FX Composer 2.0 Introductions Cross-Platform Shader Authoring FX Composer 2.0 and Production Pipelines PLAYSTATION 3 Production

More information

The Benefits of GPU Compute on ARM Mali GPUs

The Benefits of GPU Compute on ARM Mali GPUs The Benefits of GPU Compute on ARM Mali GPUs Tim Hartley 1 SEMICON Europa 2014 ARM Introduction World leading semiconductor IP Founded in 1990 1060 processor licenses sold to more than 350 companies >

More information

Using the PowerVR SDK to Optimize your Renderer

Using the PowerVR SDK to Optimize your Renderer Using the PowerVR SDK to Optimize your Renderer March, 2013 www.imgtec.com Imagination Technologies p1 First, an Introduction www.imgtec.com Imagination Technologies p2 Who are we? Who? Joe Davis, Developer

More information

PowerVR Hardware. Architecture Overview for Developers

PowerVR Hardware. Architecture Overview for Developers Public Imagination Technologies PowerVR Hardware Public. This publication contains proprietary information which is subject to change without notice and is supplied 'as is' without warranty of any kind.

More information

<Insert Picture Here> JavaFX 2.0

<Insert Picture Here> JavaFX 2.0 1 JavaFX 2.0 Dr. Stefan Schneider Chief Technologist ISV Engineering The following is intended to outline our general product direction. It is intended for information purposes only,

More information

Introduction. What s New in This Edition

Introduction. What s New in This Edition Introduction Welcome to the fourth edition of the OpenGL SuperBible. For more than ten years, we have striven to provide the world s best introduction to not only OpenGL, but 3D graphics programming in

More information

The Handheld Graphics. Market. Size, needs, and opportunities. Jon Peddie Research

The Handheld Graphics. Market. Size, needs, and opportunities. Jon Peddie Research The Handheld Graphics Market Size, needs, and opportunities Founded in 2001 - our 24th year Focus and emphasis on Digital Technology, Multi Media, and Graphics Consulting and market research - Advisor

More information

The Ultimate Developers Toolkit. Jonathan Zarge Dan Ginsburg

The Ultimate Developers Toolkit. Jonathan Zarge Dan Ginsburg The Ultimate Developers Toolkit Jonathan Zarge Dan Ginsburg February 20, 2008 Agenda GPU PerfStudio GPU ShaderAnalyzer RenderMonkey Additional Tools Tootle GPU MeshMapper CubeMapGen The Compressonator

More information

Real-Time Rendering (Echtzeitgraphik) Michael Wimmer

Real-Time Rendering (Echtzeitgraphik) Michael Wimmer Real-Time Rendering (Echtzeitgraphik) Michael Wimmer wimmer@cg.tuwien.ac.at Walking down the graphics pipeline Application Geometry Rasterizer What for? Understanding the rendering pipeline is the key

More information

PowerVR Series5. Architecture Guide for Developers

PowerVR Series5. Architecture Guide for Developers Public Imagination Technologies PowerVR Series5 Public. This publication contains proprietary information which is subject to change without notice and is supplied 'as is' without warranty of any kind.

More information

Acceleration Standards for Mobile Augmented Reality

Acceleration Standards for Mobile Augmented Reality Acceleration Standards for Mobile Augmented Reality Neil Trevett Khronos President Vice President Mobile Content, NVIDIA November 2012 Copyright Khronos Group 2012 Page 1 Copyright Khronos Group 2012 Page

More information