Optimizing Android in the ARM Ecosystem. ARM Strategic Software Alliances

Transcription

1 Optimizing Android in the ARM Ecosystem ARM Strategic Software Alliances 1

2 ARM Engineering Global Coverage 2

3 ARM Android Ecosystem Strategy Deliver value throughout the growing Ecosystem Make it easy for ARM Silicon Partners to Deliver Android Off-the-shelf ARM Processor/Board ports and recipes Make Android better on ARM for OEM s Optimize Key Open Source ingredients Engage Developers in use of advanced ARM Tech Blog Posts, Webinars Tools, Libraries Developer Knowledge Sites Developer Relations 3

4 ARM Android Ecosystem Strategy Deliver value throughout the growing Ecosystem Make it easy for ARM Silicon Partners to Deliver Android Off-the-shelf ARM Processor/Board ports and recipes Make Android better on ARM for OEM s Optimize Key Open Source ingredients Engage Developers in use of advanced ARM Tech Blog Posts, Webinars Tools, Libraries Developer Knowledge Sites Developer Relations 4

5 Android Boot Recipe for new ARM SoC s ARM brings the latest Android releases up on latest SoC s From Zero to Boot Recipe Blog Post ARM Partners can easily apply recipe to their SoC Typical bring-up times are in the order of a few days! 5

6 Android Bring-Up on ARM SoC s Info From Zero to Boot recipe Building Android for ARM Boards - Existing ports description Git repos - existing ports Linux Kernel and Android Filesystem Patches for ARM Boards Android Kernel for ARM Boards source tree Google s 6

7 ARM Android Ecosystem Strategy Deliver value throughout the growing Ecosystem Make it easy for ARM Silicon Partners to Deliver Android Off-the-shelf ARM Processor/Board ports and recipes Make Android better on ARM for OEM s Optimize Key Open Source ingredients Engage Developers in use of advanced ARM Tech Blog Posts, Webinars Tools, Libraries Developer Knowledge Sites Developer Relations 7

8 Key Ingredient Technologies In Google Platforms Mobile Tablet Google TV Chrome OS Chrome Browser Chrome Browser Chrome Browser Chrome Browser VP8 Flash AIR Webkit V8 JavaScript Engine Android Middleware Dalvik Linux Kernel LLVM LLVM VP8 Flash Webkit V8 JavaScript Engine Android Middleware Dalvik Linux Kernel LLVM LLVM Flash Webkit V8 JavaScript Engine SKIA 2D SKIA 2D SKIA 2D VP8 Android Middleware Dalvik Linux Kernel LLVM LLVM VP8 Flash Webkit V8 JavaScript Engine SKIA 2D Graphics Linux Middleware X Windows Linux Kernel LLVM ARM and Partners focus on optimizing Common Ingredient Technologies across Google OS GCC, Kernel, V8 JavaScript Engine, Webkit, LLVM, Chromium Browser, VP8 Ongoing contributions to many upstream open source projects Deep technical engagements with many industry shaping companies including Google 8

9 Linaro is a not for profit engineering company that delivers core Linux technology for the benefit of members Key goals: Use shared investment to provide high ROI to members Accelerate time to market for member products Reduce fragmentation and resulting costs Work closely with ARM to deliver Linux software and tools for new ARM technology big.little, server, ARMv8 Make ARM a leading architecture in open source 9

10 ARM and Linaro Deliver significant Goodness Upstream ARM GCC Patches for new CPU Cores Kernel Patches for new CPU Cores Linaro Upstream latest Kernel & GCC patches Transfer advanced ARM tech to world Deliver customized tools and platforms for membership 10

11 Linaro Android Performance Improvements PandaBoard 4430 running Android (ICS) from Linaro twice as fast as stock Android Linaro Android Stock Android 11

12 Linaro Android Jelly Bean Available 10 Jul: Jelly Bean on AOSP 13 Jul: Linaro initial build for Galaxy Nexus 26 Jul: Linaro experimental builds Origen and PandaBoard 30 Aug: Linaro Jelly Bean builds in regular release Links:

13 Linaro Core Roadmap Platform Tools Kernel DMA-BUF 13 Ubuntu AArch64 toolchain bootstrap OpenEmbedded NEON optimizations meta-linaro layer GDB for Android for libraries LAVA power/ video probes Windows hosted LAVA FastModels LAVA full SD card images toolchain GCC performance and optimizations DeviceTree baseline and pin control framework Common struct clock KVM Big.LITTLE in-kernel switcher OpenEmbedded AArch64 OpenEmbedded bootstrap hard-float bootstrap Optimized AArch64 libs Android JellyBean Android debug, performance and tracing UFS Swap on flash QEMU LPAE OpenGL ES test suite Struct clk for other SoCs emmc 4.5 extended features Ubuntu uprobes KVM zimage w/mult. USBs AArch64 kernel bootstrap Android upstreaming Kernel driver validation Kernel stress testing Per-CPU latency (runtime PM, pmqos, CPUIDLE) Android K Android AArch64 Power-aware scheduler (big.little MP) TrustZone/TEE 2012 H H H H2 Future LLVM Version 1.0, November 2012 Concept Adv. Planning Development Released Upstream

14 Linaro AArch64 Roadmap LEG Core AArch64 support: - pre-built kernel - pre-built GNU tools - File system support LEG Bottom-up AArch64 support: - pre-built kernel - pre-built GNU tools Concept Adv. Planning Development Released Upstream AArch64 LAVA Integration: - Community AEM model - LTP tests running AArch64 LAVA Integration: - Member platform readiness - Directed Member LAVA testing Upstreaming Community Support AArch64 Libraries - Basic Libraries - Performance Libraries AArch64 Cross build platform: - Initial platform bootstrapping - based on OpenEmbedded Upstreaming Community Support Member Landing Team: - Readiness for early Si - Model à FPGA à Si - Pulls from WGs 2012 H H H H H1 Future 14 AArch64 Private code review: - Invitation only - F2F at Connect - Review against ARM specification AArch64 GNU Tool Chain: - Upstreaming to OSS projects static compiler, assembler linker, loader, and AArch64 C library Kernel Debugger/Profiler Review: - Public set of patches available - Linaro support for public review Upstreaming Community Support Version 1.0, November 2012 big.little: - 64-bit support - In-kernel migration path - MP Focus Summary Focus on 64-bit bootstrap for members Integration directly into LAVA Core support for server big.little enablement

15 Key Ingredient Technologies In Google Platforms Mobile Tablet Google TV Chrome OS Chrome Browser Chrome Browser Chrome Browser Chrome Browser VP8 Flash AIR Webkit V8 JavaScript Engine Android Middleware Dalvik Linux Kernel LLVM LLVM VP8 Flash Webkit V8 JavaScript Engine Android Middleware Dalvik Linux Kernel LLVM LLVM Flash Webkit V8 JavaScript Engine SKIA 2D SKIA 2D SKIA 2D VP8 Android Middleware Dalvik Linux Kernel LLVM LLVM VP8 Flash Webkit V8 JavaScript Engine SKIA 2D Graphics Linux Middleware X Windows Linux Kernel LLVM Webkit is a common key component across all Google Client Platforms Underlying Framework for high performance HTML5 15

16 Optimizing HTML5 with NEON ARM and partners optimizing HTML5 tags <canvas> 2D bitmap graphics NEON optimized- SKIA <svg> 2D vector graphics NEON optimized- SKIA fefilters optimized using SMP and NEON Up to 4X improvement <video><audio> NEON optimized- TheorARM NEON optimized- WebM VP8 NEON optimized- Theora and ffmpeg 16

17 Improving HTML5 with CSS3 Animation (Accelerated Compositing) HTML5 2D Canvas (Accelerated 2D Canvas) Evidence of improvement in Webkit using a GPU 17

18 Key Ingredient Technologies In Google Platforms Mobile Tablet Google TV Chrome OS Chrome Browser Chrome Browser Chrome Browser Chrome Browser VP8 Flash AIR Webkit V8 JavaScript Engine Android Middleware Dalvik Linux Kernel LLVM LLVM VP8 Flash Webkit V8 JavaScript Engine Android Middleware Dalvik Linux Kernel LLVM LLVM Flash Webkit V8 JavaScript Engine SKIA 2D SKIA 2D SKIA 2D VP8 Android Middleware Dalvik Linux Kernel LLVM LLVM VP8 Flash Webkit V8 JavaScript Engine SKIA 2D Graphics Linux Middleware X Windows Linux Kernel LLVM The V8 JavaScript Engine is a common key component in high performance HTML5 18

19 JavaScript Acceleration on ARM JavaScript accelerated by compiling to native code using JIT ARM performance increased 5X in 1 year ARM has worked on Multiple JITs Google V8 TraceMonkey JaegerMonkey IonMonkey Squirrel Fish Nitro Tamarin Android Chrome Google V8 Chrome OS GoogleTV ARM contributions to upstream projects result in performance optimizations across the ecosystem Example: ARM and Google continually optimizing V8 together Optimizations released into public: More info at: 19

20 Renderscript: High Performance GP/GPU Compute Android s Renderscript Compute is the first computation platform ported to run directly on a mobile device GPU Renderscript Code (C99 Like Language) Compute API LLVM Renderscript binary (LLVM Intermediary) SW parallelization across all cores ARM directly sponsoring LLVM activity ARM LLVM CPU code-generation ARM optimizing LLVM code Gen All work delivered upstream Nexus 10 supports Renderscript Compute directly on ARM Mali-T604 OpenGL ES 2.0 Driver & (Native) Mali GPU Compute (Native Code) ARMv7 CPU (VFP, NEON) 20

21 LLVM for future Native Web Apps C/C++ Code NaCl SDK PNaCL Cross Compiler NaCl Native Client enables native compiled code in the browser Current support for C/C++ HTML5 pexe portable executable (LLVM Bitcode) Internet Browser LLVM Backend Translator ARMv7 CPU (VFP, NEON) PNaCl Portable Native Client compiles NaCl applications to LLVM bitcode 21

22 ARM Android Ecosystem Strategy Deliver value throughout the growing Ecosystem Make it easy for ARM Silicon Partners to Deliver Android Off-the-shelf ARM Processor/Board ports and recipes Make Android better on ARM for OEM s Optimize Key Open Source ingredients Engage Developers in use of advanced ARM Tech Blog Posts, Webinars Tools, Libraries Developer Knowledge Sites Developer Relations 22

23 ARM Engaging with Android Developers DS-5 Advanced Native Development Tools Detailed Profiling of ARM CPU and GPU Free Community Edition androidtools.org site Aggregate website showing Android App development methodologies Test and review of available Android tools Blogs NEON Coding Tools Setup V8 JavaScript Activity projectne10.org open source library project Lets developers get the most out of ARMv7/NEON coding Open Source Project suggestions/contributions welcome Mali Dev Resources 23

24 DS-5 Streamline Profiler for Android Find hotspots, system glitches, critical conditions at a glance Select from 40+ CPU counters, OS level and custom metrics Select one or more processes to visualize their instant load on CPU Accumulate counters, measure time and find instant hotspots Combined task switch trace and sampled profile for all threads 24

25 Mali GPU Graphics Analysis CPU, and GPU fragment and vertex processing activity OpenGL API events Frame buffer filmstrip Hardware and Software counters Visualize application activity per processor or processor activity per application 25

26 NEON - Enhancing User Experiences Watch any video in any format Game processing Edit & Enhance captured videos Video stabilization Antialiased rendering & compositing Advanced User Interfaces Process megapixel photos quickly Voice recognition Powerful multichannel hi-fi audio processing 26

27 NEON in Open Source Today Google WebM 11,000 lines NEON assembler! Bluez official Linux Bluetooth protocol stack Pixman (part of cairo 2D graphics library) ffmpeg (libav) libavcodec LGPL media player used in many Linux distros and products Extensive NEON optimizations x264 Google Summer Of Code 2009 GPL H.264 encoder e.g. for video conferencing Android NEON optimizations Skia library, S32A_D565_Opaque 5x faster using NEON Available in Google Skia tree from 03-Aug-2009 LLVM code generation backend used by Android RenderScript Eigen2 C++ vector math / linear algebra template library TheorARM libtheora NEON version (optimized by Google) libjpeg / libjpeg-turbo optimized JPEG decode libpng optimized PNG decode FFTW NEON enabled FFT library Liboil / liborc runtime compiler for SIMD processing webkit used by Chrome Browser 27

28 NEON and Project Ne10 NEON is a wide SIMD data processing architecture Extension of the ARM instruction set 32 registers, 64-bits wide (dual view as 16 registers, 128-bits wide) Dozens of Android subsystems & thousands of applications use NEON NEON optimizations improve execution and battery performance VP8 codec contains >11K lines of NEON code Some Skia routines >500% improvement HTML5 SVG filters improved by up to 400% Ne10 is a library of highly optimized common functions callable from C Lets you get the most out of ARMv7/NEON without arduous coding Free as in both beer and speech (Apache License) Easy to use out-of-the-box Project Ne10 is an open source project hosted by ARM Hosted on github, suggestions/contributions welcome github.com/projectne10 28

29 Additional NEON Technical Resources NEON blog posts Coding Examples NEON simulator Web App Nevada Project on github Joint project with Szeged Open Source NEON Best Practices In Cortex-A Programmers Guide When and how to use NEON 29

30 HTML5 The Converging OS Websites become the App Store Apps become the Web! Open architecture enables many stores Ability to monetize remains Do you sign off on this App? Many leading Apps already are in HTML5 Standards Enable Convergence Unified Content Delivery 30

31 Profiling JavaScript HTML5 Execution ARM created an extension to Mozilla and Webkit Browsers Developers see hotspot analysis while specific JavaScript executing Zero in on key areas to optimize in browser engine for web Apps Find bottlenecks in specific web Apps 31

32 Firefox Mobile OS: A True Web-based Platform Firefox Mobile OS uses Android Kernel ARM & Thundersoft are collaborating to integrate Streamline Full profiling of Firefox Mobile OS from Web Apps to Kernel User#Interface##&#APPS# Mozilla#Gecko#Web#Engine# Standard#API s#(javascript)# Contacts# NFC# Camera# Bluetooth# SMS# Telephony# Audio# LocaLon# SeBngs# } OS#Kernel#(e.g.,#Android#Linux,#etc.)# Android Kernel & Device Driver Framework Device#Hardware# 32

33 ARM growing the Android Ecosystem Creating and growing an Ecosystem requires: Correct Technology Investment Processor Architecture for 21 st Century Web-centric computing Tools to get the best from Processor Architecture Optimization of Open SW Technologies for the present and future Ready availability of Tools and Hardware Reference Designs An Ecosystem nucleus- partners and customers can orbit around Access the latest technology Collaborate Compete on a level playing field Partner with each other Deliver solutions Attain Success! 33

34 34