The Development and Applications of Multi-core Multimedia Platform. Jefferey Chiu Ph.D. DSP System Senior FAE Texas Instruments

Transcription

1 The Development and Applications of Multi-core Multimedia Platform Jefferey Chiu Ph.D. DSP System Senior FAE Texas Instruments

2 Outline Multi-core Multimedia Platform TI Roadmap Update DaVinci - DM6446 DaVinci HD - DM6467 DaVinci Low Cost - DM355 OMAP Platform

3 Multi-core Multimedia Platform ARM GPU DSP VICP VPSS Peripherals Multi-core SoC ARM: Cortex A8 or A9 up to 1GHz DSP: C64x+ up to 1 GHz GPU: SGX530 up to 10M polygons/sec VICP: MPEG1/2/4, WMV, H.264 Encode/Decode up to dual 1080P VPSS: Video Process Front End CCDC/LVDS/ISP/3A/Resizer Video Process Back End RGB888/HDMI/SD&HD-DAC Peripherals: NOR/NAND/DDR1&2&3 USB-OTG/S-ATA/G-EMAC/PCIe SD/MMC/UART/I2C/McASP/SPDIF/ etc

4 DaVinci Software Architecture Example GUI Application Layer (APL) Song mysong.mp3 Volume Bass Treble Mux/Demux Network RTP/RTSP User Space Linux API w/epsi Kernel Space Video Audio ARM Master thread AV Sync File/ATA VISA API USB 2.0 Codec Engine stub Local Instance xdm Audio Codec API Link Signal Processing Layer (SPL) skeletons DMAN, ACPY Codec Engine Resource Server Instance BIOS TSK xdm Video Codec API Instance BIOS TSK xdm Speech Codec API DSP Instance BIOS TSK xdm Imaging Codec API Instance BIOS TSK xdm Audio Codec API DSP Link DSP/BIOS DSKT MEM, TSK API UART EMAC DSP/Link MMC/SD I2C SPI 2 Timers 2 W dogs I/O I/O Buffers Buffers Shared Memory

5 Outline Multi-core Multimedia Platform TI Roadmap Update DaVinci - DM6446 DaVinci HD - DM6467 DaVinci Low Cost - DM355 OMAP Platform

6 DaVinci Products Combine Flexibility and Completeness Flexibility for Innovation FPGA CPU DSP ASIC ASSP Completeness for Efficiency

7 First Complete Offering to Enable Digital Video Innovation Processors: Digital video system-on-chips DM6443 TMS320DM6443 Video decode TMS320DM6446 Video encode/decode DM6446 Software: Open, optimized and production tested Platform-optimized, multimedia codecs Platform support package Linux support package Industry-recognized APIs Multimedia frameworks Tools: Validated software and hardware development DVEVM Digital Video Evaluation Module

8 New DaVinci Products Drastically Simplify Digital Video Innovation Product Innovation Enable OEM product differentiation with flexible, complete solution Development Efficiency Leverage integrated, production-tested, software and hardware components Save months of development time Performance Value Lower system cost and leverage IP across multiple products Lower system cost up to 50%

9 TMS320DM644x Processors DM6443/6 ARM Subsystem ARM926EJ-S 300 MHz CPU Peripherals EDMA Audio Serial Port Video-Imaging Coprocessor (VICP) USB 2.0 PHY Serial Interfaces I 2 C SPI DSP Subsystem C64x+ TM DSP 600 MHz Core Video Processing Subsystem CCD Controller Video Interface Front End Video Processing Subsystem Preview On-Screen Display (OSD) Switched Central Resource (SCR) Connectivity VLYNQ UART UART UART EMAC With MDIO DDR2 Controller (16b/32b) General- Purpose Timer Back End Video Enc (VENC) System Async EMIF/ NAND/ SmartMedia Resizer Histogram/3A Watchdog Timer Program/Data Storage 10b DAC 10b DAC 10b DAC 10b DAC ATA/ Compact Flash PWM PWM PWM MMC/ SD Video-Optimized TMS320C64x+ 600MHz Up to 720p MPEG-4 SP Encode H.264 MP@L3, 30fps SD Decoding VC1/WMV9 Full D1 SD Decoding MPEG-2 MP@ML SD Decoding Up to 1080i MPEG-2 Decode Simultaneous H.264 BP CIF Coding Dedicated video processing subsystem Back end - Integrated OSD, four video DACs, 24-bit digital RGB output Front end Resizer, Image processing engine, 16-bit digital input

10 DaVinci Software Optimized for Simplified and Efficient Innovation Operating Systems & Device Drivers Multimedia Codecs MontaVista Linux LSP Open Source Linux Multimedia Application Programming Interfaces (APIs) Industry-recognized APIs DaVinci APIs Middleware Codec abstraction Interprocessor communication Audio/Video frameworks H.264 MPEG4 H.263 WMV9 VC1 MPEG2 JPEG AAC+ AAC WMA9 WMA8 MP3 G.711 G.728 G G.729ab

11 Open Programming Environment DaVinci TM Digital Video SoCs Open Development Code Composer Studio IDE Frameworks and IPC Mgmt. Multimedia Codec Library Industry- Recognized Multimedia APIs DM6443 Video DM6446 Audio Image DM644x Board/Platform Support Package MontaVista Linux Voice

12 DaVinci Development Tools Software Codec evaluation and demos including: H.264, MPEG-4, MPEG-2, AAC+, G.711 Multimedia APIs & frameworks MontaVista Linux support package Hardware Based on the DM6446 Additional including hardware components: NTSC/PAL video camera 5.6-inch LCD screen Speakers and microphone IR remote Hard disk drive (2.5-inch 40G) Digital Video Evaluation Module (DV-EVM) Development tools and support Linux development tools Reference guidelines for high-speed video board design, DDR2 layout, etc. Connectivity Connectivity capabilities: USB 2.0, 10/100 EMAC Multiple on-board memory types: CompactFlash, ATA, SD, DDR Video input via NTSC/PAL Video output via NTSC/PAL & YPbPr/RGB CD-quality audio input and output Daughter-card connections to peripheral interfaces DVEVM TMDXEVM6446 Order entry open Pricing: $2495

13 Value: DaVinci Processors Reduced Overall BOM with System Integration CMOS Camera I/F Analog Video In ATA Hard Disk Video Encoder (A/D) GLUE Logic (FPGA IDE controller) PLUTO 3.0 Single Channel, Micro Video Processing Platform USB 2.0 ITU656 RAW GLUE Logic (CPLD for I/F) USB Controller Ethernet PHY Digital Media Processor 10/100MBit Ethernet ITU656 GLUE Logic (FPGA for MMC/SD Controller) MMC/SD Socket Video Decoder (D/A) Analog Video Out GLUE Logic (CPLD for GPIO addition) Peripheral Hardware Interfaces TI s new TMS320DM6446 processor integrates the correct combination of video peripherals and accelerators, resulting in a BOM savings of 30%. With a reduced BOM and less time spent on system integration, YMagic anticipates hitting the market earlier and at unprecedented price points. -Menashe Haskin CEO, YMagic

14 Value: DaVinci Processors Reduced Overall BOM with System Integration PLUTO 3.0 New Generation Single Channel, Micro Networked Video Security Processing Platform CMOS Camera I/F Analog Video In ATA Hard Disk Video Encoder (A/D) GLUE Logic (FPGA IDE controller) USB 2.0 ITU656 RAW GLUE Logic (CPLD for I/F) USB Controller Ethernet PHY DM6446 Digital Media Processor 10/100MBit Ethernet ITU656 GLUE Logic (FPGA for MMC/SD Controller) MMC/SD Socket Video Encoder (D/A) Analog Video Out GLUE Logic (CPLD for GPIO addition) Peripheral Hardware Interfaces TI s new TMS320DM6446 processor integrates the correct combination of video peripherals and accelerators, resulting in a BOM savings of 30%. With a reduced BOM and less time spent on system integration, YMagic anticipates hitting the market earlier and at unprecedented price points. -Menashe Haskin CEO, YMagic

15 First Complete Technology for Multiple Video Products G.729ab G G.711 G.728 JPEG Digital Camera WMV WMA Portable Media Player MPEG2 IP Video Phone Future Innovation AAC+ Video Security H.263 IP Set-Top Box Automotive Infotainment AAC VC1 Low-Cost High Definition

16 Outline Multi-core Multimedia Platform TI Roadmap Update DaVinci - DM6446 DaVinci HD - DM6467 DaVinci Low Cost - DM355 OMAP Platform

17 DM6467 Delivers Multi-format, HD Transcoding in a Single Chip Video codec control Proprietary codecs Custom algorithms Audio processing Video content analysis Samples Available Today Up to 1080p 30 fps / 1080i 60 fps / 720p 60 fps H.264 HP, MPEG-4, VC1, MPEG-2, encode/decode Optimized for multi-format transcoding DM6467 C64x+ TM DSP Core 600 MHz ARM 926EJ-S CPU 300 MHz Switched Central Resource Program/Data Storage Serial Interfaces Acceleration High Definition Video/ Imaging Co-Processors (HD-VICP) Video Data Conversion Engine Video Port Interfaces Standard Connectivity System Control Chroma sampling Down scaling Menu overlay Serial and parallel transport stream processing capture/display BT656 dualchannel capture/display BT1120 capture/ display Raw RGB capture Industry standard PCI bus Gigabit Ethernet

18 DM6467: HD Video Transcode, Encode & Decode Processing Features Core ARM926EJ-S (MPU) at 300 MHz TMS320C64x+ DSP Core at 600 MHz Memory ARM: 16K I-Cache, 8K D-Cache, 32K TCM RAM, 8K Boot ROM DSP: 32K L1 I-Cache, 32K L1 D-Cache, 128K L2 Cache, 64K Boot ROM HD Coprocessors Real-Time HD-HD Transcoding Up to 1080p Multi-format (mf) HD to mf HD or mf SD Up to 2 real time for HD-to-SD transcode Real-time HD-HD transcoding for PVR Video Encode and Decode HD 720p H.264 BP encode HD 1080i/p H.264 HP@L4, decoding; HD 1080i/p VC1/WMV9, decoding; HD 1080i/p MPEG-2 MP@HL, decoding; HD 1080i/p MPEG-4 ASP, decoding; DivX Simultaneous SD H.264 BP 30 fps encode and decode Peripheral Highlights Video ports Two 8-bit BT.656 or one 16-bit BT 1120 capture Two 8-bit BT.656 or one 16-bit BT 1120 display Samples Dec. 07; TMS Qual 2Q08 RTM December 3rd Benefits Scalable video engine building on high-performance C64x+ media DSP, low-cost local controllers, and rich suite of multiformat video accelerators Applications Transcoding (HD-HD, HD-SD), HD-video conferencing, HD-IP set-top boxes, video surveillance, video phones digital media adaptors and medical imaging ARM Subsystem ARM 926EJ-S CPU 300 MHz Peripherals EDMA McASP 4 ch Serial Interfaces McASP 1 ch DSP Subsystem C64x+ TM DSP Core 600 MHz HD VICP 0 TCM RAM ME IPDE MC LF CALC ECD HD VICP 1 TCM RAM MC LF CALC ECD Switched Central Resource (SCR) I 2 C PCI UHPI UART 3 Connectivity USB 2.0 PHY VLYNQ G- EMAC With MDIO DDR2 Controller (16b/32b) Async EMIF/ NAND Digital Video Interfaces Capture 2x BT.656 1x BT.1120 Display 2x BT.656 1x BT.1120 Timer 2 Stream I/O V ideo Data Conversion Engine DownScaler Chroma HW Menu Sampler Overlay System WD Timer Program/Data Storage ATA PWM 3

19 DM6467 Drives Video Market Evolution Consumer Digital Media Adaptor IP Video Phone Commercial Video Broadcast Transcoding Media Gateways MultiConferencing Units HD Videoconferencing IP Netcam Advanced Set-Top Boxes Medical Imaging Video Surveillance DVRs, DVS, Decoders

20 Typical Set-top Box Today MPEG-2

21 DM6467 Enabled Set-top Box Digital Media Adaptor for Tomorrow JPEG, MJPEG MPEG-4 WMV9 H.264 DM6467 H.264 MP QVGA All Media MPEG-2 Formats H.264 BP VGA WMV9 MP D1

22 DM6467 Delivers Multi-format, Video Transcoding at 1/10 the Cost Today With DM6467 PCI Bridge Power Supply PCI Bridge Power Supply Smaller power supply Smaller board area MCU C6415T 1 GHz C6415T 1 GHz C6415T 1 GHz DM6467 SDRAM SDRAM SDRAM DDR2 DDR2, higher performance and lower cost FLASH FLASH FLASH FLASH Reduced flash count FPGA FPGA Smaller FPGA All 50 ku

23 DM6467 Flexibility and Efficiency Provide Multi-channel Video Encoding 4-Channel D1 DVR w/ DM Channel D1 DVR Today Video Security DVR SDRAM IP Network Host Processor (GPP) Integrated host processor IP Network HDD Lower power Smaller board area HDD DM642 DM642 DM642 DM6467 DM642 DDR2 SDRAM SDRAM SDRAM SDRAM FPGA H.264 BP 30fps D1 per DM642 with no secondary CIF channels DDR2, higher performance and lower cost 4 H.264 MP 30fps channels 4 CIF H.264 BP 30fps secondary channels Room for analytics Proprietary codecs

24 Outline Multi-core Multimedia Platform TI Roadmap Update DaVinci - DM6446 DaVinci HD - DM6467 DaVinci Low Cost - DM355 OMAP Platform

25 TMS320DM355 Processors Available Now High Definition Video Performance HD MPEG-4 Encode or 720p, 30 fps JPEG encode or decode at 50 MPixels/second MPEG-4 and JPEG codecs included, no royalties or license fees to TI Features Core ARM926EJ-S Core, 216 MHz or 270 MHz MPEG-4 & JPEG Coprocessor (MJCP) Video Processing Subsystem Memory ARM: 16KB I-Cache; 8KB D-Cache; 8KB ROM; 32KB program/data Peripheral Highlights USB 2.0 HS OTG device and mini-host w/ PHY External memory interface (EMIF) Mobile DDR/DDR2 ARM Subsystem ARM926 EJ-S CPU Peripherals MJCP Co- Processor MPEG-4 JPEG DMA Data & Configuration Bus Connectivity Video Processing Subsystem Front End CCD Controller Video Interface Back End Enhanced On-Screen Display Video Enc Preview Histogram/3A Resizer 10b DAC System Package: 13 x 13 mm BGA, 329 pin, 0.65mm pitch Availability Commercial Temp (0 to 85C) Production Now Extended Temp (-45 to 85C) Production Now TMS320DM355ZCEA216 (only 216 Mhz) Serial Interfaces ASP x2 EDMA I 2 C SPI x3 UART x3 USB 2.0HS OTG Program/Data Storage mddr/ DDR2 EMIF NAND/ ECC EMIF Timer x6 WDT MMC/ SDIO x2 PWM x4

26 DM355 Target Markets Surveillance (IPNC, Multi-Ch DVR, CCTV, etc.) Home (Video Door bell, Video Baby Monitor, etc.) Medical (ECG Monitor, etc.) High Tech Toy, Robotics Portable Infotaintment (PND, Portable DTV, PMP, etc) Digital Photo Frame, Digital Still Camera, Smart Projector TV (HMI, Games, Web-browsing) PVR (Time-shift, audio/video playback, etc.) Audio (Sat Radio, Inet Radio, VoIP, DECT) Many More..

27 Low Cost HD IP Network Camera Audio ADC PCM1870 Clocking CDCE949 DDR Memory CMOS Sensor Temp Sensor TMP100 Video Engine DM355 Transient Suppressor TPD2E001 I/F PWR TPS /100 MAC & PHY SD Card 1.3V 1.8V 3.3V Core Power TPS62050 Memory Power TPS62200 I/O & System Power TPS V

28 Multi-Channel DVR Audio ADC PCM1870 Clocking CDCE949 Authentication IC BQ26100 Memory Video Amp FPGA Video Amp OPA361 Video Out Video Amp Video Amp Video Amp OPA361 Video Decoder TVP5154 Level Shifter PGA9306 Temp Sensor TMP100 Video Engine DM355 Transient Suppressor TPD2E001 RS232 TRS3221 I/F PWR TPS2065 SD Card RTC MSP430 Control 1.3V Core Pwr 1.8V Mem Pwr 3.3V I/O Pwr HDD Power Management Unit TPS /100 MAC & PHY

29 Video Door Bell - Capture Temp Sensor TMP100 Clocking CDCE949 DDR Memory CMOS Sensor Audio CODEC TLV320AIC33 Video Engine DM355 Video Amp OPA361 WLAN 10/100 MAC & PHY 1.3V 1.8V 3.3V Core Power TPS62050 Memory Power TPS62200 I/O & System Power TPS V PoE Controller TPS23750

30 Video Door Bell - Display DDR Memory HDD Clocking CDCE949 WLAN Video Engine DM355 Audio CODEC TLV320AIC33 Video Amp OPA361 10/100 MAC & PHY 1.3V 1.8V 3.3V PoE Controller TPS23750 Core Power TPS62050 Memory Power TPS62050 I/O & System Power TPS V

31 High Tech Toy / Robotics CMOS Camera (Eyes) LCD Display DDR2 or mddr SDRAM CMOS/CMOS Sensor Life Form s/robot s Face NAND/NOR Flash MMC/SD MLC SOC DM355 Audio DSC C2000 Motors Servos Steppers DC, BLDC Codec USB USB 2.0 HS OTG Keypad / Keyboard Audio

32 TV HMI / Games CMOS Camera (Option) Display LCD on Product or to TV DDR2 or mddr SDRAM NAND/NOR Flash MLC SOC Avatar Image On Display MMC/SD DM355 Audio Codec USB USB 2.0 HS OTG Keypad / Keyboard Audio

33 Outline Multi-core Multimedia Platform TI Roadmap Update DaVinci - DM6446 DaVinci HD - DM6467 DaVinci Low Cost - DM355 OMAP Platform

34 Drive for smarter devices reaches across product categories to improve effectiveness Simultaneous: Advanced user interfaces Enhanced productivity Full web browsing Multimedia Green Connectivity

35 OMAP 35x Scalable Generation of Single-Chip Devices for Complete Portfolio $ Ku Available Sampling 2H08 Now OMAP OMAP3525 OMAP3530 OMAP3515 OMAP3503 Applications Software Compatibility ARM Cortex-A8 600 MHz Shared Peripheral Set Peripherals 2D/3D Graphics Compatibility Graphics OpenGL ES ES DSP Processing & Multimedia Software Compatibility C64x+ DSP & video accelerator $ Ku Sampling Now OMAP OMAP3525 OMAP3515 OMAP3503 ARM Cortex-A8 600 MHz Peripherals Graphics Open GL ES 2.0 C64x+ DSP & video accelerator $ Ku Sampling Now OMAP OMAP3515 OMAP3503 ARM Cortex-A8 600 MHz Peripherals Graphics OpenGL ES 2.0 Sampling Now OMAP OMAP3503 ARM Cortex-A8 600 MHz Peripherals Pin-for-pin compatible

36 Comprehensive software and tools OMAP35x EVM Hardware Evaluates all four OMAP35x devices OS OMAP35x Linux BSP (MontaVista support coming soon) Windows CE 6.0 BSP coming soon TMDXEVM3503* $1495 * Software upgradeable to OMAP3530 Digital Video Software Development Kit (DVSDK) Included/download and run on current OMAP35x EVM Speed development with proven DaVinci technology multimedia framework & codecs API & software architecture compatible with DM644x & DM3x processors Reduce development cost with integrated codecs (waived fees with accepted terms) Demonstrate multimedia content Save months of design time by eliminating the need to directly manage & develop codecs More information available at

37 Open source ecosystem options simplify development for embedded Linux innovators Beagle Board Cogent Gumstix Low cost open source development board Based on OMAP3530 processor USB-powered Creative application implementation by utilizing standard PC peripherals Digi-Key $149 Based on OMAP3530 processor 600 MHz System on Module Small (2 X 2.6 ) and powerful with all GPIO & peripherals available Multiple serial interfaces, 10/100 Ethernet and onboard 3.3V 128 MB memory Logic Zoom Medical OMAP35x Development Kit and companion System on Modules

38 Beagle Board Delivering laptop-like performance with USB and standard PC expansion Laptop-like performance TI OMAP MHz superscaler ARM Cortex -A8 More than 1200 Dhrystone MIPS Up to 10 million polygons per sec graphics HD video capable C64x+ DSP core Memory 128MB LPDDR RAM 256MB NAND flash 3 USB & standard expansion I 2 C, I 2 S, SPI, MMC/SD DVI-D JTAG S-Video SD/MMC+ Stereo out Stereo in USB 2.0 HS OTG Alternate power RS-232 serial

39 TI announces growing software and development tool ecosystem for TI s three new OMAP35x processors Scalable processors provide best general purpose, multimedia & graphics processing in any combination All available now OMAP OMAP3503 OMAP OMAP3515 OMAP OMAP3525 OMAP OMAP3530 DaVinci technology enabled DVSDK for fast video application development Available now Save months of development time Comprehensive open source ecosystem options simplify development for embedded Linux innovators Community endorsement

40 Thank you!

41 The Development and Applications of Multi-core Multimedia Platform Jefferey Chiu Ph.D. DSP System Senior FAE Texas Instruments