Dragon TV Overview. TIF Workshop 24. Sept Reimund Schmald mob:

Reinventing the relationship between people and technology Defining the next generation of humancomputer interaction: Intelligent Systems Deeply invested in creating effortless and natural user experiences Best known for rapidly advancing voice-recognition technology 2002-2013 Nuance Communications, Inc. All rights reserved. Page 2

Fundamentally rethinking how technology adapts to people, not the other way around. People expect technology that understands natural input, and demand the shortest distance between want and get. Applications across enterprises and healthcare include radically effective customer service, clinical documentation and document management. 2002-2013 Nuance Communications, Inc. All rights reserved. Page 5

5 billion mobile cloud transactions annually 3,900 patents & applications 65+ countries 12 billion customer calls served annually 12,000 employees 70+ languages 800 million mobile keyboards shipped annually 13,000 mobile app developers 1,200 voice and language scientists and engineers 5 billion lines of medical data transcribed annually 25 million voice-enabled cars sold annually 2002-2013 Nuance Communications, Inc. All rights reserved. Page 7

Healthcare Driving a revolution in patient care We take clinical documentation, coding and compliance to the next level Industry-leading speech and clinical understanding technologies Disruptive solutions bridge documentation, CDI, coding, compliance, and analytics; the only end-to-end solution Easing transition for regulatory change of ICD-10 and Meaningful Use Deep customer and partner relationships, from large IDNs to practices Strong growth and operating model in large addressable markets Upsides Automates medical coding Creates detailed patient records for meaningful use Improve patient care Increase the quality of documentation Streamline medical coding and billing processes Achieve ICD-10 reimbursement through high specificity Reduce burden on clinicians by increasing efficiency 2002-2013 Nuance Communications, Inc. All rights reserved. Page 8

Customer Care Customer service, intelligently delivered Automation meets extraordinary user experiences Consumers can quickly and easily get what they need from your business anytime, anywhere Seamless experiences across IVR, mobile and web Easy, powerful self-service Identity verification Cloud-based service delivery Customer experience expertise 2002-2013 Nuance Communications, Inc. All rights reserved. Page 9

Imaging + Managed Print Services Take control of your content More intuitive, powerful and meaningful interactions between people and the technology they use for creating and managing documents. A fully integrated set of compatible and interoperable solutions Strong foundation in automating document processes A complete portfolio of Capture, Convert and Print Management solutions Deep industry and OEM expertise Rapid growth fueled by cloud and scan-to-enterprise services Upsides Smooth workflows Powerful security features Waste reduction Access from any source, on any device Instantly convertible formats Collaboration, sharing, editing, printing 2002-2013 Nuance Communications, Inc. All rights reserved. Page 10

Mobile + Applications Intelligent interfaces for intuitive, personal experiences. Nuance is driving mainstream demand for simpler devices that make life easier With mobile solutions that are revolutionizing life for on-the-go users Voice assistant-powered devices that are aware, listening, understanding Using touch, gesture, and ambient information Across all mobile platforms, channels and devices Deployed by leading global brands in consumer electronics Giving personality to the entire category 2002-2013 Nuance Communications, Inc. All rights reserved. Page 11

Dragon Drive Noise Robustness Eyes & Hands Free Messaging Content Accessibility Command & Control Automotive Stability Standards Confidential. 2002-2013 Nuance Communications, Inc. All rights reserved. Page 12

Dragon Assistant Semantic Web Customizable Device Control & Communications Languages Assistant-to-Assistant Connections Conversational Human-like TTS Personalities 2002-2013 Nuance Communications, Inc. All rights reserved. Page 13

Dragon TV Changing the way we interact with devices and content in the living room Premium User experience Intuitively control your TV or STB with your voice Directly search for content across VoD, EPG, web Flexible integration concepts Embedded integration into TV or STB devices Cloud-based solutions for companion apps Leading Technology Solution Nuance is the leading supplier for voice technology Dragon TV solution is optimized for the living room 2002-2013 Nuance Communications, Inc. All rights reserved. Page 14

Nuance Server Client Application Natural Language Content Search How it works SPEECH RECOGNITION I want to see dramas with Judy Foster. SEARCH & DISPLAY LISTINGS UNDERSTANDING INTENT [filler] i want to [/filler] [IntentPlay] see [/IntentPlay] [Genre] dramas [/Genre] [filler] with [/filler] [Actor] jodie foster[/actor] CONTENT LOOKUP <Carnage> <The Beaver> <Inside> <Flightplan> <Abby Singer> <Waking the Dead> <Contact ><Nell> <Sommersby ><Shadows and Fog> <Little Man Tate> <The Silence of the Lambs> <Catchfire> <The Accused> <Stealing Home> JSON results 2002-2013 Nuance Communications, Inc. All rights reserved. Page 21

Dragon TV Technology components Ready-to-Integrate Solution Packages Automatic Speech Recognition - Optimized television language models for turning spoken words into text Natural Language Understanding - Natural language framework for deep meaning extraction and enhanced discovery and control Text-To-Speech Dialog-driven speech output for robust auditory feedback and guidance Voice Biometrics Seamless user authentication enabling multiple profiles on a single, shared device Close and Distant Talk Support close-talk audio via a remote or companion app and/or distant-talk with a microphone array in the TV bezel or external accessory 2002-2013 Nuance Communications, Inc. All rights reserved. Page 22

Dragon TV Integration Scenarios 2nd screen Smart Device 1st screen TV or Set-Top-Box Close-talk audio Microphone on Phone/Tablet Close-talk audio Microphone on Remote Distant-talk audio Microphone array in TV bezel or external accessory 2002-2013 Nuance Communications, Inc. All rights reserved. Page 23

Dragon TV for 2nd-screen App Voice interaction for companion apps SDK supports ios and Android phones and tablets Simple integration allows for quick time-to-market Application domains Command & control of TV or STB EPG Navigation Content Search Integration options: Thin client via cloud based search Simple embedded command & control 2002-2013 Nuance Communications, Inc. All rights reserved. Page 25

2 nd screen Integration: Thin client for cloud NLU Nuance Cloud Solutions Client Solution: Dragon TV Cloud SDK Small footprint local client (ios, Android) Provides access to Nuance Speech Servers with powerful speech recognition and NLU Reference: major US cable operators Use Cases Benefit Flexible Command & Control of TV or STB EPG Navigation Natural Language Movie Search (VoD, TV,...) Simple integration of powerful server-based voice technology allows for fast time-to market 2002-2013 Nuance Communications, Inc. All rights reserved. Page 26

2 nd screen Integration: Embedded Control Client Solution: VoCon Add voice enabled command & control through integration of VoCon embedded speech recognition Use Cases Channel switching Device control and menu shortcuts EPG Navigation Reference: Benefit Low latency command & control Available for all VoCon languages (30+) Full flexibility of supported commands and domains 2002-2013 Nuance Communications, Inc. All rights reserved. Page 27

Dragon TV solution for TV or Set-Top Box Nuance Cloud Solutions Combination of local and remote technologies Embedded speech recognizer (VoCon) Connection to full cloud-based solution (NCS) Adaptive Speech Recognition Natural Language Understanding Option to integrate premium features Text-To-Speech (Vocalizer Expressive) Speaker identification (Voice Biometrics) Voice input via microphone on remote control Hybrid approach provides the best of both worlds Low latency local recognition for command&control Powerful cloud technology for flexible search Local use cases are possible offline 2002-2013 Nuance Communications, Inc. All rights reserved. Page 29

Distant Talk for Hands-Free interaction Nuance Speech Signal Enhancement (SSE) enables distant-talk speech recognition in the living room Hands-free interaction No need to find remote control SSE battles key acoustic challenges TV sound Disturbance from other speakers Background Noise Sources Distant Talk audio input via Microphone Array Option for integration with camera solution Visual beam-steering Combined user identification by voice + face Combination of speech & gestures 2002-2013 Nuance Communications, Inc. All rights reserved. Page 30

Nuance Cloud Server Speech Recognition cloud NLU TV / STB Dragon TV Hybrid SDK Phone / Tablet device High-Level Architecture Hybrid Solution for TV or Set-Top Box Thin-client for phone or tablet TV (1st screen) app Speech Signal Enhancement Client TTS 2nd screen app Hybrid Recognition Network Local Interface Recognition Voice Biometrics Dragon TV Cloud SDK Network Interface Client EPG data Network Interface ADK Dialog TV NLU Server TTS Entertainment domain data nightly update TV Search LM Internet Search LM Dictation LM Distant-Talk Acoustics Close-Talk Acoustics 2002-2013 Nuance Communications, Inc. All rights reserved. Page 31