Dragon TV Overview. TIF Workshop 24. Sept Reimund Schmald mob:

Size: px

Start display at page:

Download "Dragon TV Overview. TIF Workshop 24. Sept Reimund Schmald mob:"

Myles White
5 years ago
Views:

Reinventing the relationship between people and technology Defining the next generation of humancomputer interaction: Intelligent Systems Deeply invested in creating

2 Reinventing the relationship between people and technology Defining the next generation of humancomputer interaction: Intelligent Systems Deeply invested in creating effortless and natural user experiences Best known for rapidly advancing voice-recognition technology Nuance Communications, Inc. All rights reserved. Page 2

Fundamentally rethinking how technology adapts to people, not the other way around. People expect technology that understands natural input, and demand the shortest distance between want and get.

5 Fundamentally rethinking how technology adapts to people, not the other way around. People expect technology that understands natural input, and demand the shortest distance between want and get. Applications across enterprises and healthcare include radically effective customer service, clinical documentation and document management Nuance Communications, Inc. All rights reserved. Page 5

7 5 billion mobile cloud transactions annually 3,900 patents & applications 65+ countries 12 billion customer calls served annually 12,000 employees 70+ languages 800 million mobile keyboards shipped annually 13,000 mobile app developers 1,200 voice and language scientists and engineers 5 billion lines of medical data transcribed annually 25 million voice-enabled cars sold annually Nuance Communications, Inc. All rights reserved. Page 7

Healthcare Driving a revolution in patient care We take clinical documentation, coding and compliance to the next level Industry-leading speech and clinical understanding technologies Disruptive

8 Healthcare Driving a revolution in patient care We take clinical documentation, coding and compliance to the next level Industry-leading speech and clinical understanding technologies Disruptive solutions bridge documentation, CDI, coding, compliance, and analytics; the only end-to-end solution Easing transition for regulatory change of ICD-10 and Meaningful Use Deep customer and partner relationships, from large IDNs to practices Strong growth and operating model in large addressable markets Upsides Automates medical coding Creates detailed patient records for meaningful use Improve patient care Increase the quality of documentation Streamline medical coding and billing processes Achieve ICD-10 reimbursement through high specificity Reduce burden on clinicians by increasing efficiency Nuance Communications, Inc. All rights reserved. Page 8

Customer Care Customer service, intelligently delivered Automation meets extraordinary user experiences Consumers can quickly and easily get what they need from your business anytime, anywhere

9 Customer Care Customer service, intelligently delivered Automation meets extraordinary user experiences Consumers can quickly and easily get what they need from your business anytime, anywhere Seamless experiences across IVR, mobile and web Easy, powerful self-service Identity verification Cloud-based service delivery Customer experience expertise Nuance Communications, Inc. All rights reserved. Page 9

Imaging + Managed Print Services Take control of your content More intuitive, powerful and meaningful interactions between people and the technology they use for creating and managing documents.

10 Imaging + Managed Print Services Take control of your content More intuitive, powerful and meaningful interactions between people and the technology they use for creating and managing documents. A fully integrated set of compatible and interoperable solutions Strong foundation in automating document processes A complete portfolio of Capture, Convert and Print Management solutions Deep industry and OEM expertise Rapid growth fueled by cloud and scan-to-enterprise services Upsides Smooth workflows Powerful security features Waste reduction Access from any source, on any device Instantly convertible formats Collaboration, sharing, editing, printing Nuance Communications, Inc. All rights reserved. Page 10

on-the-go users Voice assistant-powered devices that are aware, listening, understanding Using touch, gesture, and ambient information Across

11 Mobile + Applications Intelligent interfaces for intuitive, personal experiences. Nuance is driving mainstream demand for simpler devices that make life easier With mobile solutions that are revolutionizing life for on-the-go users Voice assistant-powered devices that are aware, listening, understanding Using touch, gesture, and ambient information Across all mobile platforms, channels and devices Deployed by leading global brands in consumer electronics Giving personality to the entire category Nuance Communications, Inc. All rights reserved. Page 11

12 Dragon Drive Noise Robustness Eyes & Hands Free Messaging Content Accessibility Command & Control Automotive Stability Standards Confidential Nuance Communications, Inc. All rights reserved. Page 12

13 Dragon Assistant Semantic Web Customizable Device Control & Communications Languages Assistant-to-Assistant Connections Conversational Human-like TTS Personalities Nuance Communications, Inc. All rights reserved. Page 13

14 Dragon TV Changing the way we interact with devices and content in the living room Premium User experience Intuitively control your TV or STB with your voice Directly search for content across VoD, EPG, web Flexible integration concepts Embedded integration into TV or STB devices Cloud-based solutions for companion apps Leading Technology Solution Nuance is the leading supplier for voice technology Dragon TV solution is optimized for the living room Nuance Communications, Inc. All rights reserved. Page 14

The TV Ecosystem is Evolving 2002-2013 Nuance

Remotes are not fit for the challenge In

With Dragon TV you simply tell your TV what you want What s on Sky this evening? Sure.

Nuance Server Client Application Natural Language Content Search How it works SPEECH RECOGNITION I want

SEARCH & DISPLAY LISTINGS UNDERSTANDING INTENT [filler] i want to [/filler] [IntentPlay] see

LOOKUP <Carnage> <The Beaver> <Inside> <Flightplan> <Abby Singer> <Waking the Dead> <Contact ><Nell>

20 Nuance Server Client Application Natural Language Content Search How it works SPEECH RECOGNITION I want to see dramas with Judy Foster. SEARCH & DISPLAY LISTINGS UNDERSTANDING INTENT [filler] i want to [/filler] [IntentPlay] see [/IntentPlay] [Genre] dramas [/Genre] [filler] with [/filler] [Actor] jodie foster[/actor] CONTENT LOOKUP <Carnage> <The Beaver> <Inside> <Flightplan> <Abby Singer> <Waking the Dead> <Contact ><Nell> <Sommersby ><Shadows and Fog> <Little Man Tate> <The Silence of the Lambs> <Catchfire> <The Accused> <Stealing Home> JSON results Nuance Communications, Inc. All rights reserved. Page 21

Dragon TV Technology components Ready-to-Integrate Solution Packages Automatic Speech Recognition - Optimized television language models for turning spoken words into text Natural Language

21 Dragon TV Technology components Ready-to-Integrate Solution Packages Automatic Speech Recognition - Optimized television language models for turning spoken words into text Natural Language Understanding - Natural language framework for deep meaning extraction and enhanced discovery and control Text-To-Speech Dialog-driven speech output for robust auditory feedback and guidance Voice Biometrics Seamless user authentication enabling multiple profiles on a single, shared device Close and Distant Talk Support close-talk audio via a remote or companion app and/or distant-talk with a microphone array in the TV bezel or external accessory Nuance Communications, Inc. All rights reserved. Page 22

22 Dragon TV Integration Scenarios 2nd screen Smart Device 1st screen TV or Set-Top-Box Close-talk audio Microphone on Phone/Tablet Close-talk audio Microphone on Remote Distant-talk audio Microphone array in TV bezel or external accessory Nuance Communications, Inc. All rights reserved. Page 23

24 Dragon TV for 2nd-screen App Voice interaction for companion apps SDK supports ios and Android phones and tablets Simple integration allows for quick time-to-market Application domains Command & control of TV or STB EPG Navigation Content Search Integration options: Thin client via cloud based search Simple embedded command & control Nuance Communications, Inc. All rights reserved. Page 25

2 nd screen Integration: Thin client for cloud NLU Nuance Cloud Solutions Client Solution: Dragon TV Cloud SDK Small footprint local client (ios, Android) Provides access to Nuance Speech Servers

25 2 nd screen Integration: Thin client for cloud NLU Nuance Cloud Solutions Client Solution: Dragon TV Cloud SDK Small footprint local client (ios, Android) Provides access to Nuance Speech Servers with powerful speech recognition and NLU Reference: major US cable operators Use Cases Benefit Flexible Command & Control of TV or STB EPG Navigation Natural Language Movie Search (VoD, TV,...) Simple integration of powerful server-based voice technology allows for fast time-to market Nuance Communications, Inc. All rights reserved. Page 26

2 nd screen Integration: Embedded Control Client Solution: VoCon Add voice enabled command & control through integration of VoCon embedded speech recognition Use Cases Channel switching Device

26 2 nd screen Integration: Embedded Control Client Solution: VoCon Add voice enabled command & control through integration of VoCon embedded speech recognition Use Cases Channel switching Device control and menu shortcuts EPG Navigation Reference: Benefit Low latency command & control Available for all VoCon languages (30+) Full flexibility of supported commands and domains Nuance Communications, Inc. All rights reserved. Page 27

Dragon TV solutions for TV and STB 2002-2013

Dragon TV solution for TV or Set-Top Box Nuance Cloud Solutions Combination of local and remote technologies Embedded speech recognizer (VoCon) Connection to full

Speaker identification (Voice Biometrics) Voice input via microphone on remote control Hybrid approach provides the best of both worlds Low latency local

28 Dragon TV solution for TV or Set-Top Box Nuance Cloud Solutions Combination of local and remote technologies Embedded speech recognizer (VoCon) Connection to full cloud-based solution (NCS) Adaptive Speech Recognition Natural Language Understanding Option to integrate premium features Text-To-Speech (Vocalizer Expressive) Speaker identification (Voice Biometrics) Voice input via microphone on remote control Hybrid approach provides the best of both worlds Low latency local recognition for command&control Powerful cloud technology for flexible search Local use cases are possible offline Nuance Communications, Inc. All rights reserved. Page 29

29 Distant Talk for Hands-Free interaction Nuance Speech Signal Enhancement (SSE) enables distant-talk speech recognition in the living room Hands-free interaction No need to find remote control SSE battles key acoustic challenges TV sound Disturbance from other speakers Background Noise Sources Distant Talk audio input via Microphone Array Option for integration with camera solution Visual beam-steering Combined user identification by voice + face Combination of speech & gestures Nuance Communications, Inc. All rights reserved. Page 30

Nuance Cloud Server Speech Recognition cloud NLU TV / STB Dragon TV Hybrid SDK Phone / Tablet device High-Level Architecture Hybrid Solution for TV or Set-Top

Recognition Voice Biometrics Dragon TV Cloud SDK Network Interface Client EPG data Network Interface ADK Dialog TV NLU Server TTS Entertainment domain data

30 Nuance Cloud Server Speech Recognition cloud NLU TV / STB Dragon TV Hybrid SDK Phone / Tablet device High-Level Architecture Hybrid Solution for TV or Set-Top Box Thin-client for phone or tablet TV (1st screen) app Speech Signal Enhancement Client TTS 2nd screen app Hybrid Recognition Network Local Interface Recognition Voice Biometrics Dragon TV Cloud SDK Network Interface Client EPG data Network Interface ADK Dialog TV NLU Server TTS Entertainment domain data nightly update TV Search LM Internet Search LM Dictation LM Distant-Talk Acoustics Close-Talk Acoustics Nuance Communications, Inc. All rights reserved. Page 31

The Connected World and Speech Technologies: It s About Effortless

The Connected World and Speech Technologies: It s About Effortless Jay Wilpon Executive Director, Natural Language Processing and Multimodal Interactions Research IEEE Fellow, AT&T Fellow In the Beginning