Imagination Technologies OpenGL ES 2.0 SDK - Kristof Beets

Transcription

1 2SHQ*/(6%2) 'HPRVDQG $QQRXQFHPHQWV Copyright Khronos Group, Page 1

2 'HPRVDQG$QQRXQFHPHQWV Imagination Technologies OpenGL ES 2.0 SDK - Kristof Beets Ericsson Texture Compression - Jacob Ström AMD Imageon SDK - Jonathan Feldstein FutureMark 3DMarkMobile ES Petri Talala SPEC OpenGL ES Benchmarking - Ian Williams GLBenchmark for OpenGL ES Laszlo Kishonti Ardites - Jarkko Kemppainen Copyright Khronos Group, Page 2

3 32:(5950%; 6*; 2SHQ*/(66XSSRUWDQG 5HVRXUFHV.ULVWRI%HHWV UG3DUW\5HODWLRQV0DQDJHU,PDJLQDWLRQ7HFKQRORJLHV NULVWRIEHHWV#LPJWHFFRP Copyright Khronos Group, Page 3

4 ,PDJLQDWLRQ7HFKQRORJLHV Our Mission: Deliver complementary, flexible, high performance silicon Intellectual property (IP) cores that are cost-effective for high volume System On Chip (SoC) applications, and enable industry-leading product innovation Key Facts: Founded: 1985 Listed: 1994 (London Stock Exchange) Employees: more than 400 worldwide of which >80% are engineers Revenues: 48.1M ($94.8M) (FY 2006/07) Offices: HQ: UK Sales: Japan, US, Taiwan, Korea, China R&D: UK, India Our goal is to be one of the top 3 global semiconductor Design IP providers Copyright Khronos Group, Page 4

5 32:(5950%;)DPLO\ OpenGL ES 1.x Compliant OpenVG 1.0 Support Family Members - POWERVR MBX - POWERVR MBX Lite Tile Based Deferred Rendering - Market Proven Advanced Tiling Algorithms - Order-independent Hidden Surface Removal - Lowest silicon area, bandwidth and power - Excellent system latency tolerance High Quality Performance Texture Filtering POWERVR Texture Compression: 2bpp and 4bpp High Quality, High Performance Anti-Aliasing Internal True Color DOT3 Per-pixel Lighting Optional POWERVR VGP - Dedicated programmable Vertex Processing Unit - Allows high polygon throughput - Advanced features: Skinning, Curved Surfaces, Lighting POWERVR MBX: The de-facto standard for mobile graphics acceleration >50 POWERVR 3D-enabled phones shipping OpenGL Direct3D OpenVG Triangles/Sec Pixels/Sec POWERVR MBX Family ES1.1 Mobile M 3.7M 135M 300M Performance quoted at 100MHz for MBX, MBX Lite. SoC achievable performance quoted, Performance scales with clock speeds up to 200MHz and beyond. Planned future cores will offer higher performance levels. Copyright Khronos Group, Page 5

6 32:(5956*;)DPLO\ POWERVR SGX: OpenGL ES 2.0 in Silicon Now Optimised for OpenVG 1.x 5th Generation Tile Based Deferred Rendering - Market Proven Advanced Tiling Algorithms - Order-independent Hidden Surface Removal - Lowest silicon area, bandwidth and power - Excellent system latency tolerance Universal Scalable Shader Engine (USSE) - Scalable from 1 to 8 pipelines and beyond - Programmable multi-threaded multimedia GPU - Optimal load balancing scheduling hardware - Vertex, Pixel, Geometry shaders + image processing Advanced Geometry and Pixel Processing - Procedural Geometry, Higher Order Surfaces, etc. - Advanced Vertex Shaders - Advanced Pixel Shaders such as Parallax bump mapping - Advanced Shadow Techniques such as Shadow maps Programmable Anti-Aliasing IEEE 32 Bit Floating Point Internal Accuracy Already licensed by TI, Intel, Renesas, NEC & others unannounced Copyright Khronos Group, Page 6 OpenGL Direct3D OpenVG Triangles/Sec Pixels/Sec POWERVR SGX Family 2.0, ES1.1 and ES2.0 Mobile, 9L and and 1.1 2M 31M 100M 1000M Performance quoted at 100MHz for SGX510 to SGX545. SoC achievable performance quoted, Performance scales with clock speeds up to 200MHz and beyond. Planned future cores will offer higher performance levels.

7 32:(5956*;7RRO)ORZ Industry Standard Content Creation Tools Imagination s OpenGL ES 2.0 Toolchain is recognised as one of the leading solutions available to developers today and generating growing demand PVR GeoPOD PVR TexTool PVR UniSCo PVR UniSCo Editor Shader Library Shader Code Textures Geometry PVR Shaman Shader Development Environment PVR POD Viewer Performance Data PVR Tune PC Emulation Environment PowerVR SGX Target H/W PVR Scope Integrated Development Environment (IDE) PVR DemoWorks Custom Application Copyright Khronos Group, Page 7

8 395*HR32' PowerVR Geometry Export Plug-in Versions Plug-In for 3D Studio Max and Maya Features Optimises Data Order for PowerVR MBX or SGX Exports to PowerVR Object Data Format (POD Files) Supports Binary and C Header Formats Multiple Sorting Algorithms Supports all Data Types including Float, Fixed, Bytes, Shorts, Etc. Support for Bump Mapping Tangent coordinate system Optimised Data Storage including Instancing Key Frame & Skinning Animation Support Matrix Palette Batching Camera & Light Information and Animation Loader source code provided in SDK Autodesk 3D Studio Max Version 6, 7, 8 & Above Direct3D Direct3D Mobile Khronos Collada Autodesk Maya Version 7 & Above Khronos OpenGL ES Version 1.1 & 2.0 Copyright Khronos Group, Page 8

9 3957H[7RRO PowerVR Texture Export Tool Versions Export Plug-In for Adobe Photoshop, Autodesk 3D Studio Max and Maya Graphical User Interface Stand-alone Tool for Windows & Linux Command Line Stand-alone Tool for Windows & Linux DLL / LIB Version allows Custom Developer Tools Autodesk Autodesk Adobe Photoshop 3D Studio Max Maya Version CS1 & Above Version 6, 7, 8 & Above Version 7 & Above Features Optimised export to all texture formats support by PowerVR MBX and SGX Import Plug-in allows PVR formats to be previewed in leading DCC Tools Stand-alone tool supports loading of BMP, TGA, GIF, PCX, JPG and PNG Supports all OpenGL ES 1.1 & 2.0 Standard Formats Supports all Direct3D Mobile Standard Formats Supports PowerVR Texture Compression Formats (PVRTC I & II) and Ericsson Texture Compression (OpenGL ES 2.0) Detailed analysis for Compression Results MIPMap visualisation Pre-processing support includes: - Normal Map Generation, Colour Bleeding, Borders, High Quality Scaling Algorithms and Sky Box Optimisation Direct3D Direct3D Mobile Khronos Collada Khronos OpenGL ES Version 1.1 & 2.0 Copyright Khronos Group, Page 9

10 3959)UDPH 9)UDPH PowerVR Emulator Allows OpenGL ES 1.1/ 2.0 and Direct3D Mobile applications to run on PC facilitating development and debug Versions DLL/LIB available for Linux (OGLES) & Windows (OGLES/D3DM) Features Full Support for OpenGL ES 1.1 Requires PC with OpenGL 1.3 Support Full Support for OpenGL ES 2.0 Requires PC with OpenGL 2.0 Support Full Support for Direct3D Mobile Requires PC with DirectX 9.0 Support Full Support for all MBX and SGX Extensions Performance Information (not available yet): - Geometry Complexity per Frame - Batching and API Statistics - Allows Scene Analysis: - Overdraw Complexity - Estimate of Memory Usage Direct3D Direct3D Mobile Khronos OpenGL ES Version 1.1 & 2.0 Copyright Khronos Group, Page 10

11 3957XQH PowerVR Remote Performance Analyser Versions Remote Analysis Tool available for Windows & Linux Features Performance Analysis Driver combined with remote analysis tool Uses Network Connection to transfer information between Host & Client PC Display of Performance Statistics: - Performance in FPS - Vertex & Pixel Throughput - Batching & Render State Information - Parameter Buffer & Texture Memory Usage - Bandwidth Usage - USSE Utilisation & Cache Utilisation - Performance Stats based on: - Driver Level counters - Hardware Debug Registers (if available) Performance Analysis Modes controlled dynamically: - Disable Pixel Shader - Disable Blending - Debug Texture (2x2 Size) - Direct3D Direct3D Mobile Khronos OpenGL ES Version 1.x & 2.x Copyright Khronos Group, Page 11

12 3956KDPDQ An IDE which allows rapid prototyping of Shader Effects for 3D Applications by combining all PowerVR Utilities Uses PowerVR PFX format to encapsulate GLSL code Versions Shader Development Environment available for Windows & Linux Features Geometry input from POD files generated using PVRGeoPOD Support for PowerVR FX files (PFX). Direct Geometry and shader input from Collada file format Texture input from PVR files generated using PVRTexTool and standard bitmap formats Integrated version of UniSCo Editor Support skinning POD Viewer - Scene Navigation - Animation & Free Camera - Object Selection - WYSIWYG Concept allows rapid prototyping of new shaders Khronos Collada Khronos OpenGL ES Version 1.1 & 2.0 Copyright Khronos Group, Page 12

13 $YDLODEOHIRU)UHHZLWK(DV\,QWHJUDWLRQ POWERVR SDKs are available for free download from POWERVR Insider - Imagination Technologies Technical Support and Co-Marketing Program - More than 30 Different Configurations Supported - Multi-OS, Multi-API, Multi-Platform - Specific SDKs for available handheld products: - Nokia, Sony Ericsson and soon Motorola Phones - POWERVR SDKs in action - IdeaWorks3D Airplay SDK - Futuremark 3DMarkMobile ES2.0 - Elements Interactive s EDGELIB SDK - Khronos conformance tests - Notorious Solutions' Mobex3D game engine - NetDimension s MatrixEngine - Sony Ericsson s UIQ 3.0 SDK - Texas Instruments SDKs - and other leading middleware and SDK offerings Copyright Khronos Group, Page 13

14 4XLFN'HPRQVWUDWLRQ Not a lot of time so please come by the Khronos Booth (#227) - See the tools in action on POWERVR SGX Hardware - See the results on shipping Mobile Phones Copyright Khronos Group, Page 14

15 -RLQWKH 32:(595,QVLGHU 32:(595,QVLGHUµ 3URJUDP POWERVR Technical Support & Co-Marketing Programme - Direct Technical Support through , phone & on-site - Assure Optimal Compatibility - Highest Possible Performance - Leading Image Quality - Extensive Support for Key Partners - Including Middleware Vendors, JAVA VM & JSR Vendors, Benchmarks - Free SDKs including sample code, documentation and extensive toolset - Joint Marketing Activities - Press Releases, Joint Event Participation, Website presence, etc. POWERVR Insider brings the whole ecosystem around Graphics together - From Software Developers to Mobile Phone OEMs - Provide introductions between POWERVR Insiders - Assure co-operation between POWERVR Insiders To join send to: insider@powervr.com More details: Copyright Khronos Group, Page 15

16 (ULFVVRQ7H[WXUH &RPSUHVVLRQ (7& -DFRE6WURP(ULFVVRQ5HVHDUFK Copyright Khronos Group, Page 16

17 7H[WXUH&RPSUHVVLRQ ZK\LVLWQHHGHG" RAM %86 7H[HOV *38 Copyright Khronos Group, Page 17

18 7H[WXUH&RPSUHVVLRQ ZK\LVLWQHHGHG" RAM 7H[HOV %86 *38 Many memory accesses - limits performance - burns battery Copyright Khronos Group, Page 18

19 7H[WXUH&RPSUHVVLRQ ZK\LVLWQHHGHG" RAM %86 FRPSUHVVHGGDWD *38 Copyright Khronos Group, Page 19

20 7H[WXUH&RPSUHVVLRQ ZK\LVLWQHHGHG" RAM %86 *38 Fewer memory accesses - increases performance, and/or - increases battery life FRPSUHVVHGGDWD Copyright Khronos Group, Page 20

21 (ULFVVRQ7H[WXUH&RPSUHVVLRQ Works by modulating the intensity of a base color base color per-pixel luminance resulting image Copyright Khronos Group, Page 21

22 6WUHQJWKV The strengths can most easily be seen in areas with fine variations in luminance. original S3TC/DXTC ETC Copyright Khronos Group, Page 22

23 :HDNQHVVHV When there are more than two colors of different chrominance in a 2x4 block, block artifacts can arise. Such artifacts are especially visible when the two colors have similar luminance. original Copyright Khronos Group, Page 23

24 :HDNQHVVHV When there are more than two colors of different chrominance in a 2x4 block, block artifacts can arise. Such artifacts are especially visible when the two colors have similar luminance. original S3TC/DXTC Copyright Khronos Group, Page 24

25 :HDNQHVVHV When there are more than two colors of different chrominance in a 2x4 block, block artifacts can arise. Such artifacts are especially visible when the two colors have similar luminance. original S3TC/DXTC ETC Copyright Khronos Group, Page 25

26 (ULFVVRQ7H[WXUH&RPSUHVVLRQ /LFHQVLQJDQG$YDLODELOLW\ Any usage of the Ericsson Texture Compression technology (ETC 1.0) is subject to the relevant license terms and conditions and the terms and conditions of the Khronos membership agreement. In brief, and subject to the relevant terms and conditions: - ETC 1.0 may be used free of charge for usage with Khronos APIs - Game developers may compress textures - Silicon vendors may include decompression hardware in their solutions - ETC 1.0 software for compression/decompression - Available free of charge from Subject to the terms and conditions of the relevant click-through software license agreement - Both source code and windows binaries are available to the licensee - The licensee may include source code in its own tools in order to compress textures for use with Khronos APIs Copyright Khronos Group, Page 26

27 Copyright Khronos Group, Page 27

28 $0',PDJHRQ6'. -RQDWKDQ)HOGVWHLQ $0'(QJLQHHU Copyright Khronos Group, Page 28

29 $0',PDJHRQ6'. Installer Browser RenderMonkey 1.71 The Compressonator ATI_Compress OpenGL ES 2.0 emulator OpenGL ES 2.0 samples Sample framework Documentation Copyright Khronos Group, Page 29

30 &RPLQJ6RRQ«Additional OpenGL ES 2.0 samples / tutorials OpenVG 1.0 samples / tutorials Performance throttling Improved Browser Tools available at: Copyright Khronos Group, Page 30

31 2SHQ*/(6'HPRV 3HWUL7DODOD 9LFH3UHVLGHQW0RELOH%XVLQHVV)XWXUHPDUN&RUS Copyright Khronos Group, Page 31

32 Futuremark is the global standard of performance analysis software and services for mobile devices and PCs Benchmarks for PC and Mobile YouGamers.com Demos and Games Today s Demos: OpenGL ES 2.0 Benchmark: Content Creation Tool Chain for OpenGL ES 2.0 Leading Benchmarking Solutions to: OpenGL ES 1.0, 1.1 and NOW ES 2.0 OpenVG 1.0 OpenKODE 1.0 Mobile Java 3D (JSR184 & JSR239) Symbian OS Copyright Khronos Group, Page 32

33 OpenGL ES 2.0 Performance Analysis Testing Suite for premium mobile gaming HW: - 2 x 3D Game Content test - Theoretical tests measuring vertex and fragment shader processing plus post processing Copyright Khronos Group, Page 33

34 7RGD\ V1HZ$QQRXQFHPHQW Futuremark CCTC: Content Creation Tool Chain for OpenGL ES 2.0 Real-time content creation pipeline for application and game development to next-gen mobile devices supporting OpenGL ES Effects - Render passes - Render to texture - Post processing - Shadow maps Copyright Khronos Group, Page 34

35 63(&JSF Ian Williams, Chair NVIDIA Copyright Khronos Group, Page 35

36 63(&*UDSKLFV3HUIRUPDQFH &KDUDFWHUL]DWLRQ3URMHFW*URXS Formerly SPEC OpenGL Performance Characterization (SPECopc) Creates unbiased benchmarks that characterize performance based on popular applications New charter enables group to pursue benchmarks for APIs other than OpenGL (DirectX) Developer of SPECviewperf Copyright Khronos Group, Page 36

37 63(&YLHZSHUI An accurate predictor of graphics subsystem performance for actual applications Common source, open and available to the public Easy to use and self-contained - Quick setup and test time - Easy to license and distribute - Does not require application license Copyright Khronos Group, Page 37

38 63(&YLHZSHUIIRU2SHQ*/(6" First public demos in Khronos booth, #227 SPECviewperf provides framework to capture traces for benchmarking - Shader benchmarks for games running on PDAs? - Benchmarks for CAD viewers running on PDAs? Would probably be a separate project group within SPEC Looking for interested parties to form a working group to explore OpenGL ES benchmarks Copyright Khronos Group, Page 38

39 SPECviewperf on OpenGL ES Demo & Questions Copyright Khronos Group, Page 39

40 $XWRPDWLFDGDSWLYH*/6/VRXUFHFRGH JHQHUDWLRQLQ*/%HQFKPDUN Laszlo Kishonti General Manager Kishonti Informatics Siggraph /24/2007 Copyright 2005, All rights reserved 40

41 */%HQFKPDUN Next generation benchmark for OpenGL ES 2.0 Highly advanced rendering engine with automatically generated GLSL shaders Limited functionality backport to OpenGL 1.x will be available soon Supports every known platform with OpenGL ES: Brew, Linux, Windows Mobile, DoJa GL, JSR 239, etc. 8/24/2007 Copyright 2005, All rights reserved 41

42 :K\DXWRPDWLF */6/VKDGHU JHQHUDWLRQ" Advantages to developers: More manageable code Relieves developers of error-prone, repetitive tasks Write the effect once, use everywhere Unlimited number of effects can be combined Application scales without recompiling from the low budget device to the high end Automatic variable declarations, bindings and cleanup Names always match between application, vertex and fragment shaders Very dense code: uses only the needed variables Adapts to every scene, every object Can be used as source code generator for binary shader pipeline 8/24/2007 Copyright 2005, All rights reserved 42

43 :K\DXWRPDWLF */6/VKDGHU JHQHUDWLRQ" Advantages for performance testers: Everything can be changed real-time Helps find bottlenecks easily: switch on or off certain features and you ll see which effects costs the most (or least) Fully automated testing with unlimited number of quality setups possible Precision qualifiers can be changed run-time Certain hot-spot frames can be rerun with different effects enabled without recompiling the code Switch between per-vertex and per-fragment calculation modes (is it vertex or fragment limited?) Switch to discard mode and check CPU bottlenecks Textual output possible on screen through special console shader 8/24/2007 Copyright 2005, All rights reserved 43

44 $ERXWXV Kishonti Informatics is the world wide leader in mobile performance measurement. Our performance database contains devices. We measure Java Me and OpenGL ES performance with our JBenchmark and GLBenchmark benchmark series benchmarks. Major network operators require successful performance results with our benchmarks to distribute devices. Our partners include: AMD, ARM, Ericsson, Motorola, Nokia, NVidia, Sony- Ericsson, Sun Microsystems, Vodafone See more at: 8/24/ Copyright 2005, All rights or 44 reserved

45 */%HQFKPDUN'HPR 8/24/2007 Copyright 2005, All rights reserved 45

46 2SHQ*/(6%2) 6,**5$3+ &RS\ULJKW$OOULJKWVUHVHUYHG&RS\ULJKW $UGLWHV/WGZZZDUGLWHVFRP

47 7RGD\$W6,**5$3+$UGLWHV/WGZLWKWKHVXSSRUWRI.KURQRV *URXSDQQRXQFHGDVRIWZDUHFRQVXOWDQF\DQGVHUYLFHPRGHOWR VXSSRUWKDUGZDUHYHQGRUVGHYLFHPDQXIDFWXUHUVDQGDSSOLFDWLRQ GHYHORSHUVWRHIIHFWLYHO\XWLOL]HWKH.KURQRV$3,V 7KURXJKWKHVHVHUYLFHV$UGLWHVFRPSOHPHQWVDQGVWUHQJWKHQVWKH.KURQRVHFRV\VWHPDQGDFFHOHUDWHVWKH.KURQRV$3,DGDSWDWLRQ &RS\ULJKW $UGLWHV/WGZZZDUGLWHVFRP

48 $UGLWHV/WG $UGLWHVLVDWHDPRIVSHFLDOL]HGSURIHVVLRQDOVWKDWDUHFRQVXOWLQJWRWKHZLGHU EXVLQHVVFRPPXQLW\$UGLWHVKDVDVROLGDQGH[WHQVLYHKLVWRU\LQ VHUYLQJ YDULRXVFRPSDQLHVRSHUDWLQJZLWKLQWKHPRELOH,7LQGXVWU\ 7HFKQRORJLHV6SHFLDOL]HGLQ 6\PELDQ /LQX[ -DYD 0RELOH0XOWLPHGLD &URVVSODWIRUP &RS\ULJKW $UGLWHV/WGZZZDUGLWHVFRP

49 $UGLWHV/WG 7RS4XDOLW\VRIWZDUHDQGGLYHUVHH[SHUWLVHµ 'HOLYHUDEOHV (QGXVHUIHDWXUHV (QGWRHQG$SSOLFDWLRQV8,,QWHJUDWLRQVHUYLFHV $GDSWDWLRQ3RUWLQJ &XVWRPL]DWLRQ 9DULDWLRQ 6HUYLFHV &RQVXOWDWLRQ 7UDLQLQJ 6XEFRQWUDFWLQJ 7HVWLQJ &RS\ULJKW $UGLWHV/WGZZZDUGLWHVFRP

50 &RS\ULJKW$OOULJKWVUHVHUYHG&RS\ULJKW $UGLWHV/WGZZZDUGLWHVFRP

51 $UGLWHV/WG $UGLWHVKDVDUHSXWDWLRQIRUSURYLGLQJKLJKTXDOLW\KDUGZDUHDGDSWDWLRQVDQG PXOWLSODWIRUPHQGWRHQGVROXWLRQVIRUPRELOHGHYLFHV $UGLWHVLVDQLGHDOSDUWQHUIRUDGDSWLQJ\RXUFRUHWHFKQRORJ\WR PXOWLSOH RSHUDWLQJV\VWHPVDQGLQWRDSURGXFWUHDG\SKDVHµ &RS\ULJKW$OOULJKWVUHVHUYHG&RS\ULJKW $UGLWHV/WGZZZDUGLWHVFRP

52 6HULRXV DERXW 6RIWZDUH &RS\ULJKW$OOULJKWVUHVHUYHG&RS\ULJKW $UGLWHV/WGZZZDUGLWHVFRP