Adobe Flash 10 on i.mx Applications Processors

Transcription

1 June, 2010 Adobe Flash 10 on i.mx Applications Processors FTF-CON-F0581 Sridharan Subramanian - Freescale Japjot Sethi Movial Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc.

2 Session Introduction Gives an overview of Adobe Flash and why is it relevant to the consumer industry Describes the difference between Flashlite and Flash Player 10.1 Attendees will understand the positioning of Freescale i.mx SoCs for Consumer Attendees will get details of our work with Movial on the Flash Player 10.1 porting effort Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc. 2

3 Agenda Adobe Flash Introduction Flashlite and Flash Player 10.1 i.mx Roadmap Movial as porting partner Freescale Flash 10.1 status and next steps Review and Q&A Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc. 3

4 Agenda Adobe Flash Introduction Flashlite and Flash Player 10.1 i.mx Roadmap Movial as porting partner Freescale Flash 10.1 status and next steps Review and Q&A Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc. 4

5 Flash Usage on the Web Continues to Grow 85% 70% 75% Of Alexa top 100 websites use Flash Of web games use Flash of all video on the web is Flash 98% 95% 95% of Internet connected PCs worldwide have installed Flash Player of Internet connected PCs worldwide have installed Flash Player 10 of top 20 phone OEMS committed to delivering Flash 2009 Adobe Systems Incorporated. All Rights Reserved. Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc. 5

6 Flash Platform Usage is Diverse Video YouTube, DailyMotion, Facebook, BBC, CNN, Fox, Yahoo!, Fandango, Moviefone, Sony Pictures, Dreamworks, etc. Rich Internet Applications Mint.com, Picnik, Sumopaint, Noteflight, TimeGlider, etc. Marketing + Commerce Amazon, Bloomingdales, Barnes & Noble, BMW, Porsche, Neiman Marcus, etc. Games Addictinggames, Miniclip, WebKinz, Kongregate, Armorgames, Zynga (Farmville), Club Penguin, etc. Data Presentation New York Times, Zillow, Google Finance, National Geographic, etc. Audio Finetune, Amazon MP3, BBC iplayer, NPR Online, etc. Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc. 6

7 Industry Wide Collaboration Lead by Adobe One Web, Any Device Enable consumers to engage with rich Internet experiences seamlessly across any device, anywhere Adobe Systems Incorporated. All Rights Reserved. Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc. 7

8 Adobe Offers a Complete Solution for Web Development Applications, Content and Video Tools to Design and Develop Framework Clients Services Servers Adobe Flash CS4 Professional Adobe Flash Catalyst Adobe Flex Adobe AIR Adobe Flash Platform Services Adobe Flash Media Server Family Adobe Flash Builder Adobe Flash Player Adobe LiveCycle Data Services Integrating with 2009 the Adobe Flash Systems Platform Incorporated. All Rights Reserved. Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc. 8

9 Flash Platform serves two key use cases Web Content Inside the browser Standalone applications Outside the browser Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc. 9

10 Agenda Adobe Flash Introduction Flashlite and Flash Player 10.1 i.mx Roadmap Movial as porting partner Freescale Flash 10.1 status and next steps Review and Q&A Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc. 10

11 Target Market: Mobile Devices Overview: Adobe Flash Lite Flash Lite is a mobile development platform that can either be used in place of Java ME or run on top of Java ME in a Flash Lite Player Recent changes to ActionScript allow Flash Lite to better integrate with and even compete with device-layer technologies like Java ME and BREW. Flash Lite supports H.264, which brings closer the gap between mobile and desktop content. Flash Lite 4.0 will be a browser plugin, not a standalone player. Usage: Covers 80% of web content including YouTube, CNN, ESPN, etc Flash Lite also has user interface capabilities Implementation: Can take advantage of OpenVG acceleration Uses HW acceleration for video playback (non standard MM framework) Uses a smaller memory footprint Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc. 11

12 Adobe Flash 10 Target Market: Full web browsing Overview: Flash uses vector and raster graphics, a native scripting language called ActionScript and bidirectional streaming of video and audio Supported video codecs are Sorenson Spark, H.264 and On2 VP6 Supported audio codecs are ADPCM, AAC, and MP3 Usage: Web sites that use 3D rendering and rotations (AS3) Used on sites like toyota.com, nike.com, sprint.com, etc. Implementation: Takes advantage of Open GL ES acceleration Uses HW acceleration for video playback (OpenMax framework) Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc. 12

13 Agenda Adobe Flash Introduction Flashlite and Flash Player 10.1 i.mx Roadmap Movial as porting partner Freescale Flash 10.1 status and next steps Review and Q&A Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc. 13

14 The Fourth Screen: Learning, Reading, Entertainment, Education, Communication and Beyond Smartbooks Portable Media Players ereaders Advanced Smartphones Trends driving need for a intuitive, rich user experience with seamless connectivity. See it and touch it Proliferation of tablet centric devices Tablets Display Centric Connected Devices Auto. Mobile. Home. Infotainment/ Telematics Content consumption vs content creation Instant on and always connected Great user experience HMI and multimedia Requirements: Optimized performance at lowest power Price and performance scalability Photo Frames Industrial. Factory HMI Open OS support with complete solution Strong ecosystem Tightly integrated graphics and multimedia Media Phones Home. Mobile Internet Device Touch Screen Printers Energy Gateways Enabling the Connected Multimedia Experience Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc. 14 Smart processing solutions for the connected world

15 Example of Consumer usage: Applications Processors (i.mx) Roadmap High tier smartbook i.mx53 Next Gen family Cortex-A8, 1 GHz 1080p video 2D/3D graphics DDR2/3 800 MHz Smartbook Smartphone i.mx51 Next Gen family Cortex-A8, 800MHz Video (720p dec) Graphics 512MB DDR2 i.mx508 Next Gen ereader i.mx31 Next Gen family ARM1136, 532MHz Graphics mddr i.mx27 family i.mx35 family ARM1136, 532 MHz Graphics DDR2 Cortex-A8, 800 MHz Graphics E INK display Controller 512MB LP-DDR2 i.mx27 Next Gen family i.mx35 i.mx25 family PMP ARM926, 400MHz Video SP37xx Next Gen ARM926, MHz Integrated PMIC <2008 ARM926, 400MHz Next i.mx233 Gen ARM926, 454 MHz Integrated PMIC C90 i.mx Platform Right Edge = Consumer Qualification Left Edge has no meaning C90/C85 SP Platform Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc. 15 C65 A8 Platform

16 i.mx Value Proposition i.mx silicon and software solution that enables world-class smartbook/tablet products with real-world consumer benefits Complete hardware and software package provided to enable faster time to market and lower R&D investment BSP s available for all major smartbook/tablet OS s Full-featured media framework, including HW-accelerated Flash 10 Significant investment in HW-acceleration for Linux and Android UI framework Partners in place to provide UI and application customizations if needed Design collateral up to and including complete form-factor reference design Extensive tablet and smartbook consumer market research and thought leadership Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc. 16

17 Adobe partner (Member of the Open Screen Project) Freescale and Flash 10 Working on Linux (Firefox), Android and Chromium optimized ports Porting partner Adobe assigned Movial as porting and certification agent Movial has experience with Adobe porting and certification Freescale and Flash 10 Working closely with Adobe and Movial to ensure a fully optimized port on i.mx51 and follow on processors Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc. 17

18 Agenda Adobe Flash Introduction Flashlite and Flash Player 10.1 i.mx Roadmap Movial as porting partner Freescale Flash 10.1 status and next steps Review and Q&A Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc. 18

19 About Movial: Consumate Systems Integrators of Embedded Devices Headquartered in Helsinki, Finland 140 employees Offices in the US, Asia and Eastern Europe Customers: 3 out of top 10 carriers, 4 out of the top 5 mobile device manufacturers, #1, 2, and 3 infrastructure vendors 15 + fixed, mobile, fixed-mobile carrier customers on 3 continents Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc. 19 Copyright 2009 Movial Corporation

20 Flash Integration Movial Practice Areas Porting and optimizing Flash since version 9 for Linux ARM devices, beginning with Nokia Responsible for making it compile/run on ARMv6, ARM 7 and ARM 9. Today Movial is the referred partner to port, integrate, optimize and certify Flash 10 on ARM based devices. Firefox Optimization Selected by ARM for Gecko optimizations Optimizations ranged from c library optimizations to browser specific engine optimizations. Today work on a number of Firefox implementations on embedded devices Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc. 20

21 Flash 10 components NSS Browser NDAPI Freetype NSPR cryptography platform services embedding Flash 10 font handling HTTP requests curl ALSA audio events gfx* setup rendering video decoding OMX IL X1 1 GTK EGL GL ES 2 gfx* = graphics or graphics content Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc. 21

22 Project Roadmap EGL/OpenGL enabled for HW accelerated screen rendering OpenMAX enabled for HW accelerated video decoding (affects video playback) Component detailed integration and processing synchronization Performance optimizations and behavior correction DCTS Testing Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc. 22

23 Universal Test Plan published by Adobe Roughly 2500 test cases Device Certification Test Suite (DCTS) Test cases are in.htmls format each containing one Flash object (.swf) that produces either FAIL or PASS DTC (device testing console) can import these results from the device and somewhat process Almost automated 2 Test Runs - for static and dynamic baselines that we run one after the other Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc. 23

24 Agenda Adobe Flash Introduction Flashlite and Flash Player 10.1 i.mx Roadmap Movial as porting partner Freescale Flash 10.1 status and next steps Review and Q&A Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc. 24

25 i.mx5x Flash 10.1 support Porting platform i.mx5x platform with graphics and video h/w acceleration Supports standard OpenMax and OpenGL ES APIs Linux Firefox Chromium Android Froyo (Requirement for Flash 10) i.mx5x Flash 10 Linux In progress Demos available now Contact for exact schedules (NDA) i.mx5x Flash 10 Chromium In progress Demos available now Contact for exact schedules (NDA) i.mx51 Flash 10 Android Schedule Available on Android 2.2 FroYo release Contact for exact schedules (NDA) Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc. 25

26 Flash10 release/certification process Customers can obtain Flash10 binaries from Freescale for demo/eval purposes through a click-through agreement Customers intending to ship with Flash10 MUST have an agreement with Adobe A precondition for certification is that the SoC should have the Flash10 port available and certified (Freescale will have it, so this is not a problem) Movial can do the certification i.e. run the Adobe DCTS. To enable this, the customer needs to have an agreement with Movial If the device passes the tests, then the test results are sent to Adobe for verification. Generally, the full DCTS takes about 3 weeks and Adobe's verification about one week or so. Pricing of Movial s Flash10 services depends on the deviation between the customer s solution and SoC's certified solution and how much work need to be done - such as how many tests must run to get the certification process complete. There are three kinds of costs: 1. DCTS and Adobe verification (the certification process), this is a must. Every device must pass the DCTS. 2. Optional integration work if the standard plugin doesn't work (NRE) 3. Royalties for non-osp partners Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc. 26

27 Agenda Adobe Flash Introduction Flashlite and Flash Player 10.1 i.mx Roadmap Movial as porting partner Freescale Flash 10.1 status and next steps Review and Q&A Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc. 27

28 Session summary Flash usage on the web continues to grow Flash10, FlashLite and Flash AIR are used in different applications Freescale is committed to providing a well-optimized Flash implementation Movial is a scaling partner of Adobe and Freescale for Flash 10 Freescale, along with Movial, will work with our customers on Flash Player 10.1 certification enabling fast device T Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc. 28

29 A Freescale supported open web community of developers sharing common interest in transforming i.mx applications processors into practically anything imaginable. i.mx Community Serves all component enablement peripherals including basic to complex software i.mx Forums, Groups and Blogs Posts News, Photos and Videos Training, Events and Promotions Check it out! Become a member today and you will be entered to win a i.mx development system of your choice. Drawing will be held on June 30 th. Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMAROS, TurboLink and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners Freescale Semiconductor, Inc. 29

30