Dan Henderlong July 27, 2017

Transcription

1 Smart User Interfaces for Connected Cars Dan Henderlong July 27, 2017

2 Agenda User interfaces - Challenges EB s Complete UI Package The In-Car User Platform (ICUP) EB GUIDE Tool Augmented Reality Creator Summary 2

3 Gradual Evolution Purely mechanical, rudimentary Infotainment First phones Geoffrey C. Fors 2005; Partially automated, touchscreens

4 Increasing Complexity of User Interfaces Connected cars Autonomous driving Multiple technologies, disparate systems Product development cycles Usability and personalization OEM brand image 4

5 Demand for New Technologies Extendable Hybrid Adaptive Personalized Smart Digital cluster instrument + navigation + speech Augmented reality + predictive navigation 3D cluster instrument + system alerts Multiple displays + infotainment

6 Our Solution: The Complete Package PLATFORM Reference UI & apps Navigation Self-learning HMI Smart Voice Assistant TOOLS EB GUIDE Studio EB GUIDE Speech Extension FRAMEWORKS EB GUIDE GTF EB GUIDE STF AR Creator 6

7 In-Car User Platform (ICUP) Base platform for in-car infotainment and information displays Customizable Shorter implementation cycles 7

8 In-Car User Platform Architecture HMI layer Application layer Service layer Libraries & framework (e.g. GTF) HMI layer Application layer Service layer Libraries & framework (e.g. GTF) RTOS (e.g. Integrity, QNX) OS (Android) Hypervisor or multiple SoCs 8

9 FWK & libraries Service layer App layer HMI layer Smart User Interfaces for Connected Cars Detailed Architecture for One Partition Navigation Media Phone Tuner XYZ OpenGL ES Web kit Navigation Media Phone Tuner XYZ GTF STF Destination Entry POI Traffic MP3 Connectivity ABC Display mgmt. Map Route Calculator Guidance Spotify TTS XYZ Notification mgmt. Service Broker Service Discovery IPC OSAL Persistency Device abstraction Layout mgmt. 9

10 Reference User Interfaces Holistic HMI Supports multiple displays and modalities Seamless content synchronization between displays Customization 10

11 Multimodal Tool Graphic user interfaces 2D 3D Composition Interaction Animation Voice user interfaces Natural Language Understanding (NLU) Connected Speech Recognition Hybrid Speech

12 EB GUIDE 6 Multimodal HMI (haptic, touch, speech, gesture) development Complex user interfaces One tool for cross-team collaboration WYSIWYG 3D graphics, animations, effects Platform agnostic 12

13 Multiple Display Support Across multiple displays Model user interfaces Synchronize content Modeling of modality, resolution, and aspect ratio changes Apps & HMI Apps & HMI RTOS OS Hypervisor SoC Apps & HMI Apps & HMI RTOS OS SoC 1 SoC 2 Cluster Infotainment Single SoC Multi SoC Single toolchain (EB GUIDE 6) Single and distributed multi System on Chip (SoC) solutions 13

14 Today One GTF instance/process monolithic HMI using a single model Main display state machine Main display Second display state machine Data pool & Events Second display Speech (in/out) Speech state machine 14

15 Today One GTF instance/process monolithic HMI using a single model State machine State machine State machine State machine HMI model Core 15

16 Next step Multiple GTF instances/process non-monolithic HMI using multiple models HMI model HMI model HMI model HMI model UI Data Execution Extensions UI Data Execution Extensions UI Data Execution Extensions UI Data Execution Extensions Model service Model service Model service Core Core Core 16

17 Goal Multiple GTF instances/process non-monolithic HMI using multiple models Main display state machine Data pool & Events Main display IPC Second display state machine Data pool & Events IPC Second display Speech (in/out) Speech state machine Data pool & Events 17

18 EB GUIDE 6 Speech Extension Single toolchain approach Intuitive system responses and interactive dialogues Test directly on the tool Cloud-based Customizable Platform agnostic 18

19 Smart Voice Assistant Hello EB GUIDE! Hello and welcome! The personal assistant in the car the new travel companion Driver and passenger centric Navigation Alerts and updates 19

20 Self-Learning HMI Automatically executes non-driving related tasks: Usage-sensitive HMI User-sensitive HMI Context-sensitive HMI Minimizes user distraction Increases user trust in vehicle 20

21 Predictive Navigation Real-time guidance and enhanced vehicle control Self-learning navigation frequently used routes and destinations Multiple driver profiles, map data providers, data encryption 21

22 Augmented Reality Creator Cruise control Route guidance Manual takeover Lane guidance 22

23 Augmented Reality Creator Architecture Sensors Data Fusion EB GUIDE GTF Camera EB GUIDE Studio Radar Lane Fusion Lane departure view Gyro Odometer Object Fusion Prediction ACC view Navigation view Accelerometer HD Positioning GPS 3D Rendering Electronic Horizon (ADASIS, PSD ) Guidance Information Head Up Display 23

24 Summary From human machine interfaces to human machine relationships User experience Intelligent UI Safety and trust Deliver personalized user experiences with multimodal HMI Offer holistic HMI experience and OEM branding Learn about user in context Adapt to user preferences Offer user context-specific information Minimize user distraction Increase user trust in vehicle Provide the required functional safety levels 24

25 Get your free copy of EB GUIDE 6 at EB-GUIDE.com eb-guide.com automotive.elektrobit.com

26 Get in touch!