ARM Technology Forum. Multimedia Technology From ARM September Dennis Laudick VP Partner Marketing

Transcription

1 ARM Technology Forum Multimedia Technology From ARM September 2015 Dennis Laudick VP Partner Marketing 1

2 Accelerating the Pace of Innovation Display Camera Connectivity Sensors Video CPU GPU Memory Bandwidth 5x 4x 20x 3x 34x 17x 40x 16x By Creative Tools. Watermark removed by User:Ainali [CC BY 2.0 ( via Wikimedia Commons By GalaxyOptimus (Own work) [CC BY-SA 3.0 ( via Wikimedia Commons 2

3 Anything, Anywhere, Anytime Microsoft Office for Android, 2015 Autodesk Autocad360 for Android,

4 Anything, Anywhere, Anytime Rich user experiences Multi-casting, UHD and 4K video streams Epic Games using Enlighten Technology from Geomerics, an ARM Company "Arsenal vs Chelsea" by Wonker at Flickr. Licensed under CC BY 2.0 via Wikimedia Commons. 4

5 Expanding Complexity of Content 760M Mobile game users in APAC 1 53% of mobile data was video in Immersive Gaming Media Capture and Sharing 73% of mobile device resolutions are HD or more 3 User Interfaces Computer Vision & Image Processing 69% Mobile video CAGR Sources: 1: Global Mobile Game Confederation (GMGC) 2: CISCO VNI report 3: Android Developer Dashboards 4: CISCO VNI report

6 Mobile Gaming in 2015 High End Titles with Console Quality Araha Inilogs Nitro Nation Stories Creative Mobile République Camouflaj, LLC Godfire: Rise of Prometheus Vivid Games S.A. Injustice: Gods Among Us Warner Bros. Modern Combat 5: Blackout Gameloft Joe Dever's Lone Wolf BulkyPix telltale tool Game of Thrones Telltale Games World of Tanks Blitz Wargaming World Oddworld: Stranger's Wrath Oddworld Inhabitants Inc 6

7 7

8 Complexity of Device Requirements Balancing performance, power and price to address consumer needs Higher Energy Efficiency Higher Performance Higher Cost Efficiency Faster Time to Market Deliver extra performance in same thermal budget Handle more complex content and higher resolutions Bring highquality, affordable technology to the mainstream Remain competitive in a fastpaced market 8

9 Delivery Requires Innovation Throughout the SoC and Device Performance Slimmer and sleeker form factors Capabilities Thermal design Battery life Features Cost 9

10 ARM IP Suite Delivering 2016 Premium Mobile Experiences Enabling innovation on the most advanced process nodes Highest performance and most energy-efficient ARM Mali GPU Highest performance ARM Cortex CPU Next generation ARM CoreLink Cache Coherent Interconnect Complements ARM big.little enhancing energy efficiency Premium configurations of Mali video and display processors 10

11 ARM Mali -T880: New Horizon for Mobile Visuals 1.8x more performance of 2014 Mali-T760 based devices Delivering advanced gaming and console-like experiences Most energy-efficient Mali GPU 40% energy reduction for same workloads Enabling superior system level benefits Complemented by Mali-V550 video and Mali-DP550 display processors TrustZone secure video path for premium 4K content 11

12 Mali-T880 & Mali-T860 Overview Mali-T880/T860 builds on top of the technical advances of Mali-T760 Significant improvements in energy efficiency up to 40% improvement over Mali-T760 Incorporates proven bandwidth reduction technologies : ASTC, AFBC, Smart Composition, TE Increased Performance Improved performance across real 3D, causal 2D and UI use cases Increased arithmetic performance for compute heavy applications Support for high fidelity content for 4K and beyond Native 10-bit YUV input and output support Gamma correct filtering for maximum color fidelity High performance full speed implementation no shader conversion 12

13 Improved Performance for High-End and Casual content Quad prioritization 2D blitting +40% 2D-like content +12% Also benefits advanced content 3x ALUs Increased arithmetic performance Up to 33% Manhattan uplift from HW Up to 50% Peak compute performance increase Improved Early Z test throughput Eliminating work earlier in the pipeline GFXBench Manhattan GFXBench T-Rex BasemarkX 2D Blit Casual Gaming Performance Improvement vs. Mali-760 Cache size tuning, improved thread management User Interface CLBenchmark Quaternion Rotation Increase size of L1 and L0 instruction caches 10% 20% 30% 40% 13

14 Mali GPU Roadmap Energy Efficient GPU Roadmap Mali -T604 First OpenGL ES 3.1 and OpenCL Full Profile mobile GPU Mali-T624 50% performance uplift Full ASTC support Mali-T628 Extending scalability to 8 cores Mali-T760 Increased SoC energy efficiency Scalability to 16 cores Mali-T860 & T880 Energy efficiency and performance gains UI performance uplift Cost Efficient GPU Roadmap Mali-400 MP First OpenGL ES 2 multicore GPU Leading area efficiency Mali-450 MP Double the performance of Mali-400 MP Mali-T622 Enabling Full Profile Compute and OpenGL ES 3.1 in mid-range Mali-T720 Optimised area efficiency and decreased cost and time-to-market Mali-T820 & T830 Performance density increases Bandwidth efficiency with AFBC and other features 14

15 Million units ARM Mali Success 73 licensees Total 114 licenses 25 new Mali licenses in FY M Mali based GPUs shipped in Mali is in 75% of DTVs >50% of Android tablets >35% of smartphones

16 Important Mali Design Values Tile-Based Multi-Core Real Performance 11 Tile-based rendering gives the best start for an energy efficient GPU architecture. But more than a technology it s a way of thinking to keep working data close and bandwidth to minimum Building multi-core capability into the core of the architecture allows ultimate scalability and partner flexibility. A valuable and unrivaled extra dimension Paper specs are far less important than real world performance. Delivering sustained performance in real devices with real constraints is what matters 16

17 Mali Scalability True Partner Value Mali is the only GPU IP with true scalability Multi-core from ground up allows partner configurability A Mali MP product covers a full roadmap of competing monolithic products Unrivaled ability to match to markets Perfect for hitting the right product position Fine tune balance of PPA and cost Ranging from super-efficient performance champions to cost optimized mass-market products Core hardening can be reused in all configs Utilize hardening resource efficiency Reduce Time-To-Market 17

18 Real World Performance Mali prioritizes real performance over specs A key example is peak architectural fill-rate I.e. pixel throughput per clock Nominal fill-rate has not changed Same for Mali-400 as for the latest, Mali-T880 Effective actual fill-rate is close to double A true benefit for UI, browsing and casual uses Achieved through Innovation focus on real applications and use cases Architectural tuning for real SoC environments Mali-400 Mali-T880 18

19 Real World Performance Another example is peak architectural GFLOPS Comparing between Mali-T604 and Mali-T760 Nominal GFLOPS has not changed Effective performance more than doubled Achieved through Innovation focus on real applications and use cases Architectural tuning for real SoC environments Mali-T604 Mali-T760 19

20 Console Class Gaming Right in your Hands ARM acquired Geomerics in 2013 Enlighten Physically based Dynamic Lighting Enlighten reproduces console experiences on all platforms ARM and Enlighten powerful ecosystems Available in Unity

21 21

22 Geomerics/Enlighten Demonstration Geomerics Subway demo Unreal Engine 4 from Epic Games Global Illumination using Enlighten by Geomerics Fully dynamic lighting Player controller lighting 22 See and experience it live during the break

23 Mali Video and Display Roadmap Video Processor Roadmap Mali-V500 Scalable to 4K120 encode/decode ARM Frame Buffer Compression (AFBC) Trustzone technology enabled Mali-V bit HEVC decode HEVC encode Motion Elimination Display Processor Roadmap Mali-DP500 Up to 4k2K display Secure display layer AFBC Mali-DP550 7 layer composition Co-processor interface Motion elimination 23

24 Mali-V550 Overview HEVC H.264 First video IP with multi-standard codec including HEVC ( H.265) for both encode and decode in a single core Optimal area solution enables HEVC in the mainstream Scalable performance and multi-stream video 1080p 60 on a single core up to 4K120 on 8 cores Multiple simultaneous encode/decode streams 10-bit YUV support Optimized for lowest power More than 50% system bandwidth saving with AFBC Up to 35% extra system bandwidth saving for WiFi Display/Miracast with Motion Search Elimination Robust to bus latency JPEG MPEG2 H.263 Real MPEG4 VP8 VC-1 Design lower cost memory system without dropping frames 24

25 Mali-DP550 Overview Energy efficient processing all the way to the glass Low power and low memory bandwidth usage Composition, rotation, scaling, post-processing and display output in a single pass Supports system-wide AFBC and Motion Search Elimination Efficient composition of up to 7 layers Scales to 4K resolution Enable 3 rd party display differentiation Co-processor interface enables 3 rd party / SoC vendor IP in Mali display pipeline Feature rich IP Wide range of pre-processing and post-processing features Wide range of YUV/RGB pixel formats including 10-bit YUV Single or dual display output Compatible with all major display standards 25

26 ARM Mali and Future Trends Resolution race continues, but slowing down Peak around 4k for most handheld devices Better fidelity must come from better pixels Increased use of complex shading algorithms Growing complexity in geometry More innovation in middleware and apps Requires open but robust APIs and GPUs Real time graphics will continue to be tricks Every correct effect can be faked, cheaper The cheaper the effects, the more can be used More effects looks better Drive innovation in standards Move the limits of architecture Increase value to customers 26

27 27

28 Ice Cave Demonstration Reflections, refraction, soft shadows and other advanced effects Real-time Global Illumination with Enlighten in Unity 5 on mobile ASTC Texture Compression Download ARM guide to Unity at: 28 See and experience it live during the break

29 Leverage Mali Ecosystem Partnerships 29

30 Mali Developer Center A full range of resources on one, easy-access portal: Tools SDKs Drivers Tutorials & Developer Guides Sample Code 30

31 Mali GPU Software Tools Performance Analysis, Debug, and Software Development Mali Graphics Debugger ARM DS-5 Streamline Mali Offline Compiler API Trace & Debug OpenGL ES, OpenCL Debug and improve performance at frame level Mali GPU - Timeline - HW Counters - OpenCL visualizer Analyze shader performance Generates binary shaders Command line tool OpenGL ES Emulator Texture Compression Tool Third Party Tools Emulate OpenGL ES 2.0 and 3.0 Windows and Linux Khronos Conformant Command line and GUI ETC, ETC2, ASTC 3D textures Integration with partners tools 31

32 Unleashing the Capabilities on Mali Demos Here Today Tessellation on Mali ES Android Ext. Pack View Distance, View Angle, Screen Space, Displacement Mapping Optimization for tessellation; Frustum, Occlusion, Min-Max levels, Culling 32 OpenCL in Mobile In production today Image processing in OpenCL Advanced (flexible) de-noise algorithm Using the right processor for the right task Geomerics Subway Unreal Engine 4 from Epic Global Illumination using Enlighten by Geomerics Dynamic lighting Player controller lighting Translucency Emissive materials Ice Cave Virtual Reality Native Unity VR Engine Global Illumination (Enlighten) Reflections, refraction Soft shadows Other high end effects

33 Thank You malideveloper.arm.com 33