Overview of the OpenVG, a vector graphics API and Introduction to IWAYAG, an native OpenVG accelerator

Transcription

1 Overview of the OpenVG, a vector graphics API and Introduction to IWAYAG, an native OpenVG accelerator December 18, 2009 Hiroshi Fujiwara NEC System Technologies, Ltd.

2 Agenda Overview of the OpenVG, a vector graphics API Graphics models. Summary and Comparison OpenVG Key features, Eco-System and Market OpenVG Pipeline Design OpenVG Implementations OpenVG1.1 Introduction to IWAYAG, a native OpenVG accelerator IWAYAG Features Implementation Examples of IWAYAG IWAYAG Performance IWAYAG Eco-System Loadmap Demonstration at Khronos booth Page 2

3 Overview of the OpenVG, a vector graphics API Page 3

4 Summary of typical graphics models Presentation Quality Text Drawing Shape Drawing Image Drawing 3D Graphics Vector font (Outline font) Convert Bezier curve to polygons Polygons with Anti-Alias Realistic Expression Textures Realistic Expression Vector font (Outline font) Vector Graphics Direct Bezier Curve drawing Bezier Curves with Anti-Alias Animation-type Expression Perspective Transformation Semi-3D Expression 2D Graphics Bitmap font Lines, Circles Bitmaps Page 4

5 Cost-Performance comparison between models Cost to realize rich graphics by each approach Function and Performance of Graphics hardware 3D 3D Graphics Output Quality Realistic VG Vector Graphics Animation 2D 2D Graphics Primitive + Heavy CPU Processing ~500Kgate 1Mgate Cost (gate size, power consumption) Approach 2D Vector 3D Graphics HW Cost Small footprint Low Power Medium footprint Low Power Large footprint High Power Required CPU High Performance Expensive, High Power Low Performance, Low cost, Low power Low Performance, Low cost, Low power Suitability Poor Good overall balance Over spec? Page 5

6 OpenVG Accelerated Vector Graphics OpenVG is the industry s first native Bezier rendering API Enables a new class of hardware acceleration Bezier primitives not polygons Smaller command/data list and no tesselation required, allowing such devices that have limited CPU/memory resources to enjoy rich graphics Primarily used to accelerate higher-level engines such as Flash and SVG OpenVG is an OpenGL-style, low-level API but many artists prefer tools over programming Support set of primitives to realize high quality graphics Gradation (A) Alpha Blending (B) Projective Transformation (C) Vector font (D) Anti-Alias (E) Applications SVG, Flash, Font Package etc.. 2D Hardware Acceleration Page 6

7 OpenVG Eco Systems FlashLite is the most popular Open-VG app (middle ware) as well as vector fonts 2D graphics library like Cario can be ported on OpenVG, allowing WebKit to be accelerated XAML player can also take advantage of OpenVG Applications Rich UI Rich Contents Document Viewer Web browser Animation Middle Ware Flash XAML Cairo Webkit SVG Font OS Linux WindowsCE ITRON Android Symbian OpenVG Page 7

8 RichUI is becoming a MUST in Embedded Devices. OpenVG is widespreading to these devices Apple introduced iphone featuring touch screen based rich user interface to mobile phone User interface was recognized as one of key success factors Printer Digital TV Many mobile phone venders followed apple, introducing the touch screen based UI Mobile Phone Digital Camera Rich UI market is extending to car navigation devices, digital cameras, TVs, etc OpenVG is getting widely accepted as a graphics API for the embedded devices Page 8

9 OpenVG pipeline design Like other Khronos APIs, OpenVG has been designed to enable software to effectively use silicon Pipeline has also been architected as silicon-ready design Page 9

10 OpenVG Implementations There are a wide range of OpenVG implementations possible Depending on the price point and target device architecture 3D GPUs can accelerate both OpenVG and OpenGL ES APIs Good approach for those devices requiring true 3D and VG Dedicated VG accelerator allows higher performance rendering in lower cost than 3D GPUs Good approach for those devices that do NOT require true 3D 100% Software 2D Graphics (2D blit and Image) Dedicated Vector Graphics engines (Fully accelerate ) 3D GPUs (Accelerate Bezier Renderer using shader language ) Very low cost Low cost High performance Best C/P for VG only High performance for both of VG and 3D Page 10

11 OpenVG 1.1 OpenVG 1.1 specification publicly released at SIGGRAPH Asia 2008 Together with open source sample implementation and full Conformance Test Suite OpenVG 1.1 Conformance Test Comprehensive set of tests (~900 test cases) Conformant implementation has to pass all of them Major features Adobe Flash 7 / Flash Lite 3 support Glyph API for hardware accelerated text rendering Multi-sampled anti-aliasing Page 11

12 Introduction to IWAYAG, a native OpenVG accelerator Page 12

13 History of Graphics products at NEC System Technologies GCONRCON DGCGCON2 GCONMAGSDRCSPOCK2 TTL/PAL TTL/PAL Standard Graphics ECA3 EMA SSK SSP2 ICE USK3 Fast2D Graphics Standard 2D Graphics ELI Lowend 2D Graphics VEC KOUMEI2 TPL LIGHT Video accelerator LCD support 2D Graphics Products WIN Notebook GA400-3 WBA EXB PEC APEC GRAPE CCE ZBC CDCNGPC COA2COA3 TADARET GPC JABFIREROE3A WILL WAVE PEAR TE1 TE2 TE3 TE3VTE3A TE4TE4Pro TE5 3D Graphics Products GA88 Series :LSI :Board products Graphics IP Products Page 13

14 What is IWAYAG? IWAYAG is a graphics accelerator dedicated for vector graphics, consisting of -Hardware IP core to be incorporated to the customer s SoC -OpenVG driver IWAYAG design and features -Native OpenVG accelerator -Architecture of IWAYAG is based on the OpenVG pipeline stage design -Path generation to Blending/Anti-alias stages are implemented by hardware -No CPU tessellation. Fill is done by hardware using outline buffer -Hardware bezeir rasterizer -Extensive cache control mechanism for fast filling -Support fast FSAA Path generation to Blending/Antialias stages are implemented by hardware Page 14

15 Why IWAYAG? Requirements from the consumer devices market -Flash support -Many consumer device manufacturers plan to incorporate richer UI -Flash support is a MUST to efficiently develop the rich UI -Smooth playback of Flash contents while using low-end CPUs -Cost and/or battery power limits CPU selection -100Mhz CPU without FPU is common for Digital cameras. -Long battery life -Flash acceleration by 3D engine consumes too much battery powers Native OpenVG graphics accelerators best meet the requirements -Good Flash performance while using low-end CPUs -Much lower power and die size than 3D engine Page 15

16 Implementation Example of IWAYAG (1) Xilinx ML510 (PowerPC440 based FPGA board) -CPU is 300MHz -Though IWAYAG has been designed to run at 200MHz clock, this implementation drives IWAYAG at 50MHz due to the limitation of the board Xilinx ML510 FPGA Evaluation Board Virtex5-FX130T FPGA PowerPC Crossbar Switch 128bit 200MHz 128bit 100MHz 128bit 100MHz Memory Controller GA88 Display Controller RS232C RS232C Flash I/F DDR2 400 DIMM Compact Flash Display Monitor Performance data demonstrated in the following pages were measured by executing Flash contents both in software renderer (disabling IWAYAG) and hardware renderer (enabling IWAYAG) on the same ML510 board Control Console Software version Flash Contents FlashLite (Software Rendering) Linux PPC440@300Mhz Hardware version FlashLite (OpenVG version) Linux OpenVG 1.1 Driver PPC440 Flash Contents IWAYAG HW Page 16

17 Performance Improvements on Flash Contents by IWAYAG (1) Update (1)002_motionTweenLine.swf FlashPlayer IWAYAG Driver IWAYAG Hardware Software IWAYAG 50MHz IWAYAG 200MHz (Estimated) Acceleration ratio = 3.0 Acceleration Ratio = (2)003_motionTweenGradient.swf Software Average execution time per frame (ms) fast IWAYAG 50MHz IWAYAG 200MHz (Estimated) Acceleration ratio = 3.8 Acceleration Ratio = (3)004_motionTweenBMP.swf Average execution time per frame (ms) fast Software IWAYAG 50MHz IWAYAG 200MHz (Estimated) Acceleration ratio = 3.5 Acceleration Ratio = Average execution time per frame (ms) fast Page 17

18 Performance Improvements on Flash Contents by IWAYAG (1) Update (4)005_motionTweenText.swf FlashPlayer IWAYAG Driver IWAYAG Hardware Software IWAYAG 50MHz IWAYAG 200MHz (Estimated) Acceleration ratio = 2.9 Acceleration Ratio = (5)006_motionTweenMC.swf Software Average execution time per frame (ms) fast IWAYAG 50MHz IWAYAG 200MHz (Estimated) Acceleration ratio = 2.4 Acceleration Ratio = (6)007_shapeTween.swf Average execution time per frame (ms) fast Software IWAYAG 50MHz IWAYAG 200MHz (Estimated) Acceleration ratio = 3.4 Acceleration Ratio = Average execution time per frame (ms) fast Page 18

19 Performance Improvements and CPU Usage analysis Software Rendering CPU Video Network I/Os CPU Video Network I/Os Application Application Graphics - CMD/DATA Setup - Path generation - Coordinates Transformation - Rasterize - Paint - Image - Bledning CPU+IWAYAG Graphics - CMD/DATA Setup Graphics processing Offloaded to IWAYAG 3.3 times better Performance by 55% CPU Usage IWAYAG Rasterizer Vector (w/cache Graphics control) Engine Coordinate transformation Path Generation Bus controller Clipping Masking Paint Image fill (w/image cache) Alpha blending Performance 13fps CPU Usage 94% X % 43fps 39% Measured by Adobe FlashLite With Motion_Tween_BMP.swf Page 19

20 Performance versus CPU clock CPU 300MHz CPU 200MHz CPU 125MHz 004_motionTweenBMP.swf Software CPU 300MHz CPU 200MHz CPU 125MHz Software renderer performs in direct proportion to CPU clock Average execution time per frame (ms) fast IWAYAG 50MHz CPU 300MHz CPU 200MHz CPU 125MHz Hardware renderer is almost independent to CPU clock Enables high FPS rate with Low power CPU devices Average execution time per frame (ms) fast Page 20

21 Implementation Example of IWAYAG (2) NEC EP-3 SiP (System in a Package) IWAYAG in EP-3 is a solution for the customers to develop OpenVG-ready custom micro controllers in much lower development cost and time than SOC. The EP-3 from NEC Electronics is a latest SiP (System in a Package) device, which features a 32-bit CPU and a user logic (gate array) in single package. With EP-3, the customer can create custom microcomputers mounted with a CPU core and custom logic, by designing and developing only a Gate Array. Therefore the development cost and time can be drastically reduced compared with SoC design. IWAYAG in EP-3 allows the customers to develop OpenVG-ready custom micro controllers in low development cost and time. IWAYAG in EP-3 is ideal solution for those brown goods, industrial devices and OA devices that the production volume is relatively small and life cycle is relatively short. Technology FPGA SiP SoC Device Cost High Fair Low Development Cost Low Fair High Device Cost FPGA SiP SoC Volume Page 21

22 Implementation Example of IWAYAG (2) NEC EP-3 SiP (System in a Package) In this prototype implementation, EP-3 evaluation board which consists of CPU and FPGA is used. IWAYAG is installed in the FPGA. Block Diagram V850 GateArray V850E2M (266MHz) FPGA IWAYAG Internal MEMC Bridge RAM External MEMC SDRAM 32MB Display Controller To LCD Peripheral V850EP3 SRAM 4MB Flash 8MB EP-3 Evaluation Board Page 22

23 IWAYAG Eco-System The user interface design is becoming a key success factor in many devices. We are supporting these demands extending the eco-system of IWAYAG to meet various needs from the customers. - FlashLite and Outline font are already available - Planning to support XAML player, 2D graphics library like Cairo and HTML renderer like Webkit - Gesture UI engine is under planning as a companion IP for the next generation UI Application Design Services Board Design/Manufacturing Services IWAYAG Porting/Customization Services Outline font, drivers FlashLite Player Middleware XAML Player (Planning) 2D graphics library (Planning) HTML renderer (Planning) Other Middleware Products Browser (Planning) Hardware Driver IWAYAG Graphics IP Gesture UI Engine(Planning) Other IPs Page 23

24 Loadmap 2007 OpenVG OpenVG Lowend products - Smaller gate size - Lower power consumption - Lower IP cost Highend products - Improved OpenVG acceleration Coming Soon! - Support future versions of OpenVG - 3D support (OpenVG+3D hybrid) - Support variety of display devices - Easier customization Extends the rich UI by OpenVG to wider range of the devices Page 24

25 Demonstration at Khronos booth Demonstration Environment LCD NEC V i C rtua l on A tro r l e a Booth: C12-5 PC ML510 demo board Page 25

26 All product names are trademarks or registered trademarks of their respective holders