Voice, Image, Video : AI in action with AWS. 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Transcription

1 Voice, Image, Video : AI in action with AWS

2 A long heritage of machine learning at Amazon Personalized recommendations Fulfillment automation and inventory management Drones Voice driven interactions Inventing entirely new customer experiences

3 Running ML in Production on AWS Today

4 AWS: Our mission Put machine learning in the hands of every developer and data scientist

5 DEMO!

6 The Amazon ML Stack: API-driven AI Services APPLICATION SERVICES Rekognition Transcribe Translate Polly Comprehend Lex PLATFORM SERVICES Amazon SageMaker AWS DeepLens Caffe2 CNTK Apache MXNet FRAMEWORKS & INTERFACES AWS Deep Learning AMIs PyTorch TensorFlow Torch Keras Gluon INFRASTRUCTURE GPU (P3) CPU IoT & Edge Mobile

7 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

8 Sky News uses Amazon Rekognition to perform real-time identification of guests as they enter St. George s Chapel. 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

9 Amazon Rekognition Deep learning-based image and video analysis Object, Scene & Activity Recognition Unsafe Content Detection Facial Recognition Facial Analysis Celebrity Recognition Text in Images

10 RingDNA RingDNA is an end-to-end communications platform for sales teams. A critical component of RingDNA s Conversation AI requires best of breed speech-to-text to deliver transcriptions of every phone call. RingDNA is excited about Amazon Transcribe since it provides highquality speech recognition at scale, helping us to better transcribe every call to text. Howard Brown CEO & Founder, RingDNA

11 Amazon Transcribe Automatic conversion of speech into accurate, grammatically correct text Multiple languages Intelligent punctuation and formatting Timestamp generation Support for telephony audio Recognize multiple speakers Custom vocabulary

12 High-quality language education using Amazon Polly Textto-Speech (TTS) With more than 170M users, Duolingo is the most popular language-learning platform Each lesson targets different linguistic skills and concepts Amazon Polly was the winner against their previous TTS providers in all six voice A/B tests they use to evaluate impact to their business

13 Amazon Polly Turn text into lifelike speech using deep learning Wide Selection of Voices and Languages Synchronize Speech Fine-grained Control Unlimited Replay

14 Hotels.com Hotels.com is a leading online accommodation booking website with all the information needed to book the perfect stay. They operate 90 localized websites in 41 languages with more than 25M Customer reviews. We want to take advantage of the latest advances in machine learning to further personalize and localize our reviews, and generally improve our customer experience. Amazon Translate is a step forward in that direction. Matthew Fryer - VP and Chief Data Science Officer, Hotels.com

15 Amazon Translate Natural and fluent language translation Real-time translation Batch analysis Automatic language recognition Low cost

16 ClearView Social ClearView Social enable a company s employees to share approved content on LinkedIn, Twitter and other social networks To eliminate the reliance on manual tagging, ClearView Social turned to Amazon Comprehend to find insights and relationships in text Amazon Comprehend tags entities with the highest confidence and enables us to make more accurate earned media estimates to really determine ROI from social. Bill Boulden, CTO ClearView Social

17 Amazon Comprehend Discover insights and relationships in text Entities Key Phrases Amazon Comprehend Language Sentiment

18 Amazon Comprehend Discover insights and relationships in text STORM STOCK MARKET LIBRARY OF NEWS ARTICLES Amazon Comprehend WORLD SERIES WASHINGTON

19 OhioHealth Lex Integration Amazon Lex represents a great opportunity for us to deliver a better experience to our patients. Everything we do at OhioHealth is ultimately about providing the right care to our patients at the right time and in the right place. Delivers Personalized Care Recommendations Makes Customer Appointments Drives Urgent Care Referrals Michael Krouse Senior Vice President and CIO Ohio Health

20 Amazon Lex Building conversational interfaces into any application using voice and text Integrated development in the AWS console Trigger Lambda functions Multi-step conversations One-click deployment Enterprise connectors Fully managed

21 DEMO! (Again)

22

23 Machine Learning Platforms APPLICATION SERVICES Rekognition Transcribe Translate Polly Comprehend Lex PLATFORM SERVICES Amazon SageMaker AWS DeepLens Caffe2 CNTK Apache MXNet FRAMEWORKS & INTERFACES AWS Deep Learning AMIs PyTorch TensorFlow Torch Keras Gluon INFRASTRUCTURE GPU (P3) CPU IoT & Edge Mobile

24 ML was too complicated for everyday developers Collect and prepare training data Choose and optimize your ML algorithm Set up and manage environments for training Train and tune model (trial and error) Deploy model in production Scale and manage the production environment

25 Amazon SageMaker ALGORITHMS K-Means Clustering Principal Component Analysis Neural Topic Modelling Factorization Machines Linear Learner - Regression XGBoost Latent Dirichlet Allocation Image Classification Seq2Seq Linear Learner - Classification Pre-built notebooks for common problems Built-in, high performance algorithms FRAMEWORKS Apache MXNet TensorFlow Caffe2, CNTK, PyTorch, Torch Set up and manage environments for training Train and tune model (trial and error) Deploy model in production Scale and manage the production environment BUILD

26 Amazon SageMaker Pre-built notebooks for common problems Built-in, high performance algorithms One-click training Hyperparameter optimization Deploy model in production Scale and manage the production environment BUILD TRAIN

27 Amazon SageMaker Pre-built notebooks for common problems Built-in, high performance algorithms One-click training Hyperparameter optimization One-click deployment Fully managed hosting with autoscaling BUILD TRAIN DEPLOY

28

29

30 How does it work?

31 AWS DeepLens HD video camera Micro-SD HD video camera with on-board compute optimized for deep learning Integrates with Amazon SageMaker and AWS Lambda Mini-HDMI Custom-designed deep learning inference engine USB USB Reset 10 MIN Audio out Power From unboxing to first inference in <10 minutes Tutorials, examples, demos, and pre-built models

32 Frameworks & Interfaces APPLICATION SERVICES Rekognition Transcribe Translate Polly Comprehend Lex PLATFORM SERVICES Amazon SageMaker AWS DeepLens Caffe2 CNTK Apache MXNet FRAMEWORKS & INTERFACES AWS Deep Learning AMIs PyTorch TensorFlow Torch Keras Gluon INFRASTRUCTURE GPU (P3) CPU IoT & Edge Mobile

33 Bottom Layer: Frameworks & interfaces P3 NVIDIA Tesla V100 GPUs AWS Deep Learning AMI 5,120 Tensor cores 128GB of memory 1 Petaflop of compute NVLink 2.0 ~14X faster than P2

34 Amazon EC2 P3 Instances The fastest, most powerful GPU instances in the cloud Purpose built for AI/ML Massive amounts of parallel processing power Enables data scientists to cut down ML training times from weeks to days Supported by a wide range of AI/ML packages

35 Autonomous Driving Systems M X N e t U s e r Tu S i m p l e

36 Thank You! Demo #1 (Randall Hunt): Demo #2 (Julien Simon): Marc Cabocel, Solutions Architect