Advanced IP solutions enabling the autonomous driving revolution Chris Turner Director, Emerging Technology & Strategy, Embedded & Automotive Arm Shanghai, Beijing, Shenzhen Arm Tech Symposia 2017
Agenda Autonomous vehicles Heterogeneous processing Arm IP in driving systems Safety and security 2
Connected autonomous vehicles Cloud Communication Processing Sensing & Actuation Machine Intelligence Big data 5G cellular V2X System on Chip Software Computer Vision Radar, Lidar 3
Autonomous driving Level 4 Level 5 Level 3 Level 2 Level 1 Level 0 No Automation Driver Assistance Human Monitoring Partial Automation Conditional Automation High Automation Machine Monitoring Full Automation Full-time human driver for all aspects driving, even with warning systems Mode-specific driver assistance of either steering or acceleration/deceleration with human driver for remaining task Mode-specific driver assistance of both steering and acceleration/deceleration with human driver for remaining task Mode-specific Automated Driving of all dynamic driving task with human driver responding to a request to intervene Mode-specific Automated Driving of all driving task, even if a human driver does not respond Full-time Automated Driving under all roadway and environmental conditions 4
Where are the challenges? Complex and demanding compute requirements High-integrity functional safety requirements Multiple security issues and data privacy 5
Total automotive computing from Arm Computer Vision Sensing and perceiving the driving scene Sensor fusion with radar, lidar etc. Mapping 360 degree mapping Precision navigation Machine Learning Cognition Mission objective Decision & Actuation Course of action Real-time control Arm Compute Library for fast deployment of CV & ML 6
Arm processors for automotive Vision ADAS Cortex-A55 + Cortex-R52 Heterogeneous multi-core Computer Vision Control Powertrain Cortex-R52 Real time Homogeneous multi-core Navigation & Infotainment Cortex-A75 + Cortex-A55 + Mali G51 Energy-aware scheduling Rich OS Security Other modules V2X Chassis Security Radar Sensor Audio Networks 7 Autonomous driving Cortex-A75 + Mali G72 + Mali-C71 + Cortex-R52 High performance multi-cluster Machine Learning Functional safety Central body control Cortex-M7, Cortex-M0+ Low power Efficient performance Scalable
Safety and security Safety and security are intimately related and some languages don t differentiate: 安全, sécurité, Sicherheit, säkerhet, turvallisuus, Security Protects things and defends from malicious attack Security Environment System Safety Safety Limits uncontrolled system behaviour to prevent harm Data Both guard against undesirable situations and together form a barrier that protects us and our things 8
Functional Safety throughout Arm CPUs Cortex-R52 Cortex-M3/M4 Cortex-M0+ Exception handling MPU SW test library Cortex-A Armv8-A Cache parity / ECC Exception handling MMU Cortex-A55 & future Cortex-A Cache parity / ECC Exception handling MMU RAS features Cortex-M33 Cortex-M23 Dual core lockstep ECC interface Exception handling MPU Stack limit check SW test library Cortex-M7 TCM ECC interface MBIST interface Dual core lockstep Cache ECC Exception handling MPU Cortex-R5 Bus ECC Error management TCM ECC MBIST interface Dual core lockstep Cache ECC Exception handling MPU Virtualization Bus protection SW test library System error Bus ECC Error management TCM ECC MBIST interface Dual core lockstep Cache ECC Exception handling Two-stage MPU SIL2/ASIL B systematic capability SIL3/ASIL D systematic capability 9 availability dependent on processor
Complete Arm solution for automotive SoC development Solutions built from Arm IP Computing capability meets requirements Within power and thermal constraints Accelerators Task-specific processing complements mainstream computing System IP Interconnect system IP delivering coherency and quality of service required for optimum memory bandwidth Software programming environment Managing complexity, ease of use, task separation Sub-systems Efficient integration and communication, vehicle-wide 10
Mali-GPUs: Enabling tomorrow s technology today Mali-G72 is Arm s latest high-performance GPU, Mali-G51 provides mid-range efficiency Optimised machine learning and computer vision Performance and efficiency for autonomous drive Face tracking and speech recognition for IVI Advanced capabilities Arm Mali is #1 for GPUs shipped High fidelity graphics for latest displays Augmented reality for applications such as mirror replacement Strong ecosystem Arm Compute Library for CV & ML QNX OS, graphics libraries and Linux drivers for IVI 11
Image Signal Processing from Arm Autonomous drive Ultra-wide dynamic range for lighting extremes Simultaneous support for human display and computer vision Every pixel reliable with real-time diagnostic capability Quad camera capability for cost efficiency Mali-C71 designed for automotive vision Cockpit Mirror replacement 360 surround view Road sign recognition Driver alertness 12
Arm compiler support for functional safety Compiler safety package for software development in safety markets Industrial control, automotive, medical, transportation, military and others Qualification Kit Development process docs Safety manual Defect report Test report Extended Maintenance Five year commitment Technical support Critical defect fixes Functional Safety Certified TÜV SÜ D certification ISO 26262 (ASIL D) IEC 61508 (SIL 3) Access to the safety package provided with DS-5 Ultimate and Keil MDK Pro Valid DS-5 or MDK support and maintenance entitlement enables extended maintenance Compiler installation is an add-on to the standard product installation 13
Arm TrustZone and Platform Security Architecture (PSA) Arm security throughout the SoC Shifting the economics of security Easy and affordable Throughout the life-cycle Endpoint-to-ecosystems security Sensors to cloud Making security deployable at scale Throughout the vehicle Across the market 14
Arm solutions for automotive Architecture and performance leadership for the car of the future Best performance in tight thermal and space constraints Safe and secure with ISO 26262, PSA and Arm TrustZone Diverse and competitive supply chain to the automotive industry supported by a rich ecosystem Comprehensive economic solutions throughout the vehicle 15
Thank You! Danke! Merci! 谢谢! ありがとう! Gracias! Kiitos! 16
The Arm trademarks featured in this presentation are registered trademarks or trademarks of Arm Limited (or its subsidiaries) in the US and/or elsewhere. All rights reserved. All other marks featured may be trademarks of their respective owners. www.arm.com/company/policies/trademarks 17