Advancing State-of-the-Art of Autonomous Vehicles and Robotics Research using AWS GPU Instances
|
|
- Brice Watson
- 5 years ago
- Views:
Transcription
1 Advancing State-of-the-Art of Autonomous Vehicles and Robotics Research using AWS GPU Instances Adrien Gaidon - Machine Learning Lead, Toyota Research Institute Mike Garrison - Senior Systems Engineer, Toyota Research Institute Chetan Kapoor - Senior Product Manager - EC2, Amazon Web Services 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
2 AWS: Our mission Put machine learning in the hands of every developer and data scientist 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
3 AWS ML Stack Application Services Rekognition Polly Lex Comprehend Transcribe Translate Platform Services SageMaker DL AMI Spark & EMR Mechanical Turk AWS Deep Learning AMI Frameworks & Infrastructure TensorFlow Apache MXNet Cognitive Toolkit Caffe2 & Caffe PyTorch Keras Gluon GPU CPU IoT (Greengrass) Mobile 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
4 Note Update Slide AWS ML Stack Application Services Rekognition Polly Lex Comprehend Transcribe Translate Platform Services SageMaker DL AMI Spark & EMR Mechanical Turk AWS Deep Learning AMI Frameworks & Infrastructure TensorFlow Apache MXNet Cognitive Toolkit Caffe2 & Caffe PyTorch Keras Gluon GPU CPU IoT (Greengrass) Mobile 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
5 EC2 Compute Instance Types General Purpose Compute Optimized Storage and IO Optimized Memory Optimized Accelerated Computing M5 C5 I3 X1e G3 F1 T2 C4 D2 R4 P3 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
6 EC2 Accelerated Computing Instances P3 GPU Compute Instance Up to 8 NVIDIA V100 GPUs in a single instance, with NVLink for peer-to-peer GPU communication Supporting a wide variety of use cases including deep learning, HPC simulations, financial computing, and batch rendering G3: GPU Graphics Instance Up to 4 NVIDIA M60 GPUs, with GRID Virtual Workstation features and licenses Designed for workloads such as 3D rendering, 3D visualizations, graphics-intensive remote workstations, video encoding, and virtual reality applications F1: FPGA instance Up to 8 Xilinx Virtex UltraScale+ VU9P FPGAs in a single instance. Programmable via VHDL, Verilog, or OpenCL. Growing marketplace of pre-built application accelerations. Designed for hardware-accelerated applications including financial computing, genomics, accelerated search, and image processing P3 G3 F1 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
7 Amazon EC2 P3 Instances (October 2017) O n e o f t h e f a s t e s t, m o s t p o w e r f u l G P U i n s t a n c e s i n t h e c l o u d Up to eight NVIDIA Tesla V100 GPUs 1 PetaFLOPs of computational performance Up to 14x better than P2 300 GB/s GPU-to-GPU communication (NVLink) 9X better than P2 16GB GPU memory with 900 GB/sec peak GPU memory bandwidth 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
8 P3 Instances Details Instance Size GPUs GPU Peer to Peer vcpus Memory (GB) Network Bandwidth EBS Bandwidth On-Demand Price/hr* 1-yr RI Effective Hourly* 3-yr RI Effective Hourly* P3.2xlarge 1 No 8 61 Up to 10Gbps 1.7Gbps $3.06 $1.99 (35% Disc.) $1.23 (60% Disc.) P3.8xlarge 4 NVLink Gbps 7Gbps $12.24 P3.16xlarge 8 NVLink Gbps 14Gbps $24.48 $7.96 (35% Disc.) $15.91 (35% Disc.) $4.93 (60% Disc.) $9.87 (60% Disc.) Regional Availability P3 instances are generally available in AWS US East (Northern Virginia), US East (Ohio), US West (Oregon), EU (Ireland), Asia Pacific (Seoul), Asia Pacific (Tokyo), AWS GovCloud (US) and China (Beijing) Regions. Framework Support P3 instances and their V100 GPUs supported across all major frameworks (such as TensorFlow, MXNet, PyTorch, Caffe2 and CNTK) 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
9 AWS P3 vs P2 Instance G P U P e r f o r m a n c e C o m p a r i s o n P2 Instances use K80 Accelerator (Kepler Architecture) P3 Instances use V100 Accelerator (Volta Architecture) Mixed/FP16 Perf (TFLOPS) FP32 Perf (TFLOPS) 1.7X FP64 Perf (TFLOPS) 2.6X Resnet-50 8 GPU (Images/sec) X over K80 s max perf X 20 0 FP32 K80 P100 V K80 P100 V K80 P100 V K80 P100 V , Amazon Web Services, Inc. or its Affiliates. All rights reserved.
10 AWS Storage Options EFS EC2+EBS Amazon S3 Amazon Glacier Highly available, multi-az, fully managed networkattached elastic file system. For near-line, highlyavailable storage of files in a traditional NFS format (NFSv4). Create a single-az shared file system using EC2 and EBS, with third-party or open source software (e.g., ZFS, Intel Lustre, etc). For near-line storage of files optimized for high I/O performance. Secure, durable, highly-scalable object storage. Fast access, low cost. For long-term durable storage of data, in a readily accessible get/put access format. Secure, durable, long term, highly costeffective object storage. For long-term storage and archival of data that is infrequently accessed. Use for read-often, temporary working storage Use for high-iops, temporary working storage Primary durable and scalable storage for data Use for long-term, lower-cost archival of data
11 AWS Deep Learning AMI Get started quickly with easy-to-launch tutorials Hassle-free setup and configuration Pay only for what you use no additional charge for the AMI Accelerate your model training and deployment Support for popular deep learning frameworks 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
12 Agenda TRI s Mission The Data Problem The ML Bleeding Edge Infrastructure at TRI 12
13 TRI: Mission Our mission is to improve the quality of human life through advances in artificial intelligence, automated driving, and robotics. 13
14 l Source: New York Times
15 TRI s Automated Driving Vision Create a safe, robust, and versatile automated driving system that supports both series and parallel operating modes. 15
16 TRI Autonomy Software: One System, Two Modes 16
17 SAE s Levels of Automated Driving LEVEL Name Control Monitoring Vigilance Fallback Handoff Operating Conditions 0 Unassisted Human 1 Driver Assist Human and AD System Human Human Some 2 Partial Automation AD System Human Human (0 warning) Some 3 Conditional Automation AD System AD System Human (adequate warning) (assumed 15 sec) Some 4 High Automation AD System AD System AD System Some 5 Full Automation AD System AD System AD System All 17
18 SAE s Levels of Automated Driving LEVEL Name Control Monitoring Vigilance Fallback Handoff Operating Conditions 0 Unassisted Human 1 Driver Assist Human and AD System Human Human Some 2 Partial Automation AD System Human Human (0 warning) Some 3 Conditional Automation AD System AD System Human (adequate warning) (assumed 15 sec) Some 4 High Automation AD System AD System AD System Some 5 Full Automation AD System AD System AD System All 18
19 Paths to Automated Driving Emilio Frazzoli, CTO, nutonomy, MIT self-driving cars course 19
20 But There s a Different Way F-16 F-22 20
21 TRI: How We Differentiate 1. Guardian 1. Data See our YouTube channel for Cool Progress Reports! 21
22 Agenda TRI s Mission The Data Problem The ML Bleeding Edge Infrastructure at TRI 22
23 How Much Data is Enough? Goal: Machine Learning for robust 3P's (Perception, Prediction, Planning) Need: lots of labeled data ("the drug of Deep Learning") Why? YMYD: Your Model is (as good as) Your Data Both for Training (cf. Data Processing Inequality, Information Bottleneck) and of course for Validation/Testing 23
24 24
25 It takes time to find corner cases
26 "Crowdsourced steering doesn't sound quite as appealing as self driving" 26
27 The Trillion Mile Challenge: Simulation Data Gathering from Ordinary Drivers environment behavior Cloud Simulator validation Test Cars with Professional Drivers millions of miles low-res maps billions of miles high-res maps millions of miles 27
28 Agenda TRI s Mission The Data Problem The ML Bleeding Edge Infrastructure at TRI 28
29 Example Deep KoiNet 29
30 DL on AWS EC2 instances ImageNet (AI's Nürburgring) in the Cloud? - <15h on a single p3.16xlarge (cf. DAWNBench) - <1h on ~12 instances (more on that later in ) 30
31 DL on AWS EC2 instances ImageNet (AI's Nürburgring) in the Cloud? - <15h on a single p3.16xlarge (cf. DAWNBench) - <1h on ~12 instances (more on that later in ) No rusty metal: TRI Scales Up on the Bleeding Edge - p3 instances: V100! - latest CUDA, PyTorch,... 31
32 Bleeding Edge DL on AWS The Deep Stack changes fast! - 1st layer: new GPUs, OS, drivers - 2nd layer: Docker, CUDA9, AMI - 3rd layer: PyTorch, AWS Services - 4th layer: DL algorithms 32
33 Bleeding Edge DL on AWS The Deep Stack changes fast! - 1st layer: new GPUs, OS, drivers - 2nd layer: Docker, CUDA9, AMI - 3rd layer: PyTorch, AWS Services - 4th layer: DL algorithms You will be cut: med support is critical! - Continuous Integration (yes, for ML!) - Benchmarking & Dashboards - Good Docs & Customer Support - Osmosis between External and Internal Infra Ninjas 33
34 Agenda TRI s Mission The Data Problem The ML Bleeding Edge Infrastructure at TRI 34
35 Infrastructure Engineering Team Developers & Researchers Infrastructure 35
36 Vehicle Data 36
37 Data Pipeline 37
38 Fleet Operations Dashboard 38
39 TRI Toolbox 39
40 TRI Toolbox AWS 40
41 TRI Toolbox Frameworks 41
42 TRI Toolbox Open Source 42
43 Conclusion TRI s Mission + Aim to Provide: Safety, Robustness, Versatility Chauffeur & Guardian The Data Problem: How much is enough? The Trillion Mile Challenge and the Need for Sim The Infrastructure Challenge: Scaling AI Up in the Cloud We are hiring! 43
Amazon Web Services. Foundational Services for Research Computing. April Mike Kuentz, WWPS Solutions Architect
Amazon Web Services Foundational Services for Research Computing Mike Kuentz, WWPS Solutions Architect April 2017 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS Global Infrastructure
More informationDeep Learning on AWS with TensorFlow and Apache MXNet
Deep Learning on AWS with TensorFlow and Apache MXNet Julien Simon Global Evangelist, AI & Machine Learning @julsimon Renaud ALLIOUX CTO, Earthcube The Amazon ML Stack: Broadest & Deepest Set of Capabilities
More informationManaging Deep Learning Workflows
Managing Deep Learning Workflows Deep Learning on AWS Batch treske@amazon.de September 2017 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Business Understanding Data Understanding
More informationVoice, Image, Video : AI in action with AWS. 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Voice, Image, Video : AI in action with AWS A long heritage of machine learning at Amazon Personalized recommendations Fulfillment automation and inventory management Drones Voice driven interactions Inventing
More informationPractical Applications of Machine Learning for Image and Video in the Cloud
Practical Applications of Machine Learning for Image and Video in the Cloud Shawn Przybilla, AWS Solutions Architect M&E @shawnprzybilla 2/27/18 There were 3.7 Billion internet users in 2017 1.2 Trillion
More informationCloud and Storage. Transforming IT with AWS and Zadara. Doug Cliche, Storage Solutions Architect June 5, 2018
Cloud and Storage Transforming IT with AWS and Zadara Doug Cliche, Storage Solutions Architect June 5, 2018 What sets AWS apart? Security Fine-grained control Service Breadth & Depth; pace of innovation
More informationDGX SYSTEMS: DEEP LEARNING FROM DESK TO DATA CENTER. Markus Weber and Haiduong Vo
DGX SYSTEMS: DEEP LEARNING FROM DESK TO DATA CENTER Markus Weber and Haiduong Vo NVIDIA DGX SYSTEMS Agenda NVIDIA DGX-1 NVIDIA DGX STATION 2 ONE YEAR LATER NVIDIA DGX-1 Barriers Toppled, the Unsolvable
More informationXilinx ML Suite Overview
Xilinx ML Suite Overview Yao Fu System Architect Data Center Acceleration Xilinx Accelerated Computing Workloads Machine Learning Inference Image classification and object detection Video Streaming Frame
More informationS8765 Performance Optimization for Deep- Learning on the Latest POWER Systems
S8765 Performance Optimization for Deep- Learning on the Latest POWER Systems Khoa Huynh Senior Technical Staff Member (STSM), IBM Jonathan Samn Software Engineer, IBM Evolving from compute systems to
More informationExpected Learning Outcomes Introduction To AWS
Introduction To AWS Expected Learning Outcomes Introduction To AWS Understand What Cloud Computing Is Discover Why Companies Are Adopting AWS Understand How AWS Can Help Your Explore AWS Services Apply
More informationAWS DeepLens Workshop: Building a Computer Vision App
AWS DeepLens Workshop: Building a Computer Vision App Jyothi Nookula - Senior Product Manager, Amazon Web Services May 23 rd 2018 AWS DeepLens is not a video camera I t s t h e w o r l d s f i r s t d
More informationAI & Machine Learning at Amazon
DevDay Berlin AI & Machine Learning at Amazon Ian Massingham IanMmmm Developer Technology Evangelism, Amazon Web Services ianm@amazon.com 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
More informationBuilding the Most Efficient Machine Learning System
Building the Most Efficient Machine Learning System Mellanox The Artificial Intelligence Interconnect Company June 2017 Mellanox Overview Company Headquarters Yokneam, Israel Sunnyvale, California Worldwide
More informationIntroducing Amazon Elastic File System (EFS)
Introducing Amazon Elastic File System (EFS) Danilo Poccia, Technical Evangelist, AWS @danilop 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved Goals and expectations for this session
More informationS INSIDE NVIDIA GPU CLOUD DEEP LEARNING FRAMEWORK CONTAINERS
S8497 - INSIDE NVIDIA GPU CLOUD DEEP LEARNING FRAMEWORK CONTAINERS Chris Lamb CUDA and NGC Engineering, NVIDIA John Barco NGC Product Management, NVIDIA NVIDIA GPU Cloud (NGC) overview AGENDA Using NGC
More informationCisco UCS C480 ML M5 Rack Server Performance Characterization
White Paper Cisco UCS C480 ML M5 Rack Server Performance Characterization The Cisco UCS C480 ML M5 Rack Server platform is designed for artificial intelligence and machine-learning workloads. 2018 Cisco
More informationScalable Distributed Training with Parameter Hub: a whirlwind tour
Scalable Distributed Training with Parameter Hub: a whirlwind tour TVM Stack Optimization High-Level Differentiable IR Tensor Expression IR AutoTVM LLVM, CUDA, Metal VTA AutoVTA Edge FPGA Cloud FPGA ASIC
More informationBuilding the Most Efficient Machine Learning System
Building the Most Efficient Machine Learning System Mellanox The Artificial Intelligence Interconnect Company June 2017 Mellanox Overview Company Headquarters Yokneam, Israel Sunnyvale, California Worldwide
More informationDGX UPDATE. Customer Presentation Deck May 8, 2017
DGX UPDATE Customer Presentation Deck May 8, 2017 NVIDIA DGX-1: The World s Fastest AI Supercomputer FASTEST PATH TO DEEP LEARNING EFFORTLESS PRODUCTIVITY REVOLUTIONARY AI PERFORMANCE Fully-integrated
More informationNVIDIA DLI HANDS-ON TRAINING COURSE CATALOG
NVIDIA DLI HANDS-ON TRAINING COURSE CATALOG Valid Through July 31, 2018 INTRODUCTION The NVIDIA Deep Learning Institute (DLI) trains developers, data scientists, and researchers on how to use artificial
More informationHPE Deep Learning Cookbook: Recipes to Run Deep Learning Workloads. Natalia Vassilieva, Sergey Serebryakov
HPE Deep Learning Cookbook: Recipes to Run Deep Learning Workloads Natalia Vassilieva, Sergey Serebryakov Deep learning ecosystem today Software Hardware 2 HPE s portfolio for deep learning Government,
More informationBERLIN. 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved
BERLIN 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved Building Multi-Region Applications Jan Metzner, Solutions Architect Brian Wagner, Solutions Architect 2015, Amazon Web Services,
More informationAWS Machine Learning Transformation Day - Munich. 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Machine Learning Transformation Day - Munich ML at Amazon Search & Discovery Fulfilment & Logistics Existing Products New Initiatives Investments in ML for more than 20 years. Thousands of engineers
More informationFast Hardware For AI
Fast Hardware For AI Karl Freund karl@moorinsightsstrategy.com Sr. Analyst, AI and HPC Moor Insights & Strategy Follow my blogs covering Machine Learning Hardware on Forbes: http://www.forbes.com/sites/moorinsights
More informationNVIDIA GPU CLOUD DEEP LEARNING FRAMEWORKS
TECHNICAL OVERVIEW NVIDIA GPU CLOUD DEEP LEARNING FRAMEWORKS A Guide to the Optimized Framework Containers on NVIDIA GPU Cloud Introduction Artificial intelligence is helping to solve some of the most
More informationMarkLogic Cloud Service Pricing & Billing Effective: October 1, 2018
MarkLogic Cloud Service Pricing & Billing Effective: October 1, 2018 MARKLOGIC DATA HUB SERVICE PRICING COMPUTE AND QUERY CAPACITY MarkLogic Data Hub Service capacity is measured in MarkLogic Capacity
More informationAutonomous Driving Solutions
Autonomous Driving Solutions Oct, 2017 DrivePX2 & DriveWorks Marcus Oh (moh@nvidia.com) Sr. Solution Architect, NVIDIA This work is licensed under a Creative Commons Attribution-Share Alike 4.0 (CC BY-SA
More informationBig Data on AWS. Big Data Agility and Performance Delivered in the Cloud. 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Big Data on AWS Big Data Agility and Performance Delivered in the Cloud 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Big Data Technologies and techniques for working productively
More informationIntroduction to Amazon Cloud & EC2 Overview
Introduction to Amazon Cloud & EC2 Overview 2015 Amazon Web Services, Inc. and its affiliates. All rights served. May not be copied, modified, or distributed in whole or in part without the express consent
More informationTESLA V100 PERFORMANCE GUIDE. Life Sciences Applications
TESLA V100 PERFORMANCE GUIDE Life Sciences Applications NOVEMBER 2017 TESLA V100 PERFORMANCE GUIDE Modern high performance computing (HPC) data centers are key to solving some of the world s most important
More informationDeep Learning mit PowerAI - Ein Überblick
Stephen Lutz Deep Learning mit PowerAI - Open Group Master Certified IT Specialist Technical Sales IBM Cognitive Infrastructure IBM Germany Ein Überblick Stephen.Lutz@de.ibm.com What s that? and what s
More informationMachine Learning. Bridging the OT IT Gap for Machine Learning with Ignition and AWS Greengrass
Machine Learning with Ignition and AWS Greengrass Bridging B the OT IT Gap for Machine Learning Simply Connect Ignition & AWS Greengrass for Machine Learning! Bridging the OT IT gaps is now easier using
More informationIBM Deep Learning Solutions
IBM Deep Learning Solutions Reference Architecture for Deep Learning on POWER8, P100, and NVLink October, 2016 How do you teach a computer to Perceive? 2 Deep Learning: teaching Siri to recognize a bicycle
More informationSUPERCHARGE DEEP LEARNING WITH DGX-1. Markus Weber SC16 - November 2016
SUPERCHARGE DEEP LEARNING WITH DGX-1 Markus Weber SC16 - November 2016 NVIDIA Pioneered GPU Computing Founded 1993 $7B 9,500 Employees 100M NVIDIA GeForce Gamers The world s largest gaming platform Pioneering
More informationIn partnership with. VelocityAI REFERENCE ARCHITECTURE WHITE PAPER
In partnership with VelocityAI REFERENCE JULY // 2018 Contents Introduction 01 Challenges with Existing AI/ML/DL Solutions 01 Accelerate AI/ML/DL Workloads with Vexata VelocityAI 02 VelocityAI Reference
More informationHOW TO PLAN & EXECUTE A SUCCESSFUL CLOUD MIGRATION
HOW TO PLAN & EXECUTE A SUCCESSFUL CLOUD MIGRATION Steve Bertoldi, Solutions Director, MarkLogic Agenda Cloud computing and on premise issues Comparison of traditional vs cloud architecture Review of use
More informationS8901 Quadro for AI, VR and Simulation
S8901 Quadro for AI, VR and Simulation Carl Flygare, PNY Quadro Product Marketing Manager Allen Bourgoyne, NVIDIA Senior Product Marketing Manager The question of whether a computer can think is no more
More informationBERLIN. 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved
BERLIN 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved Introduction to Amazon EC2 Danilo Poccia Technical Evangelist @danilop 2015, Amazon Web Services, Inc. or its affiliates. All
More informationDeep Learning Frameworks with Spark and GPUs
Deep Learning Frameworks with Spark and GPUs Abstract Spark is a powerful, scalable, real-time data analytics engine that is fast becoming the de facto hub for data science and big data. However, in parallel,
More informationBeyond Training The next steps of Machine Learning. Chris /in/chrisparsonsdev
Beyond Training The next steps of Machine Learning Chris Parsons chrisparsons@uk.ibm.com @chrisparsonsdev /in/chrisparsonsdev What is this talk? Part 1 What is Machine Learning? AI Infrastructure PowerAI
More informationPOWERING THE AI REVOLUTION JENSEN HUANG, FOUNDER & CEO GTC 2017
POWERING THE AI REVOLUTION JENSEN HUANG, FOUNDER & CEO GTC 2017 LIFE AFTER MOORE S LAW 10 7 40 Years of Microprocessor Trend Data 10 6 10 5 Transistors (thousands) 1.1X per year 10 4 10 3 1.5X per year
More informationCharacterization and Benchmarking of Deep Learning. Natalia Vassilieva, PhD Sr. Research Manager
Characterization and Benchmarking of Deep Learning Natalia Vassilieva, PhD Sr. Research Manager Deep learning applications Vision Speech Text Other Search & information extraction Security/Video surveillance
More informationSrinath Vaddepally.
Cloud Computing Srinath Vaddepally CEO & Founder Srinath.Vaddepally@ristcall.com Cell : (816) 728 2134 www.ristcall.com Agenda Automation testing Cloud Computing Motivation factors from Distributed systems
More informationA NEW COMPUTING ERA. Shanker Trivedi Senior Vice President Enterprise Business at NVIDIA
A NEW COMPUTING ERA Shanker Trivedi Senior Vice President Enterprise Business at NVIDIA THE ERA OF AI AI CLOUD MOBILE PC 2 TWO FORCES DRIVING THE FUTURE OF COMPUTING 10 7 Transistors (thousands) 10 5 1.1X
More informationEngage with ESRI in the AWS Cloud. Teresa Carlson, VP of Global Public Sector
Engage with ESRI in the AWS Cloud Teresa Carlson, VP of Global Public Sector On Premise Infrastructure is Costly & Complex Large Capital Expenditures Patching Software Scaling down as needed Contract negotiation
More informationDeep Dive on Amazon Elastic File System
Deep Dive on Amazon Elastic File System Yong S. Kim AWS Business Development Manager, Amazon EFS Paul Moran Technical Account Manager, Enterprise Support 28 th of June 2017 2015, Amazon Web Services, Inc.
More informationINTRODUCING THE DGX FAMILY. Marc Domenech May 8, 2017
INTRODUCING THE DGX FAMILY Marc Domenech May 8, 2017 NVIDIA Pioneered GPU Computing Founded 1993 $7B 9,500 Employees 100M NVIDIA GeForce Gamers The world s largest gaming platform Pioneering AI computing
More informationIntroduction to Amazon Web Services. Jeff Barr Senior AWS /
Introduction to Amazon Web Services Jeff Barr Senior AWS Evangelist @jeffbarr / jbarr@amazon.com What Does It Take to be a Global Online Retailer? The Obvious Part And the Not-So Obvious Part How Did
More informationCS15-319: Cloud Computing. Lecture 3 Course Project and Amazon AWS Majd Sakr and Mohammad Hammoud
CS15-319: Cloud Computing Lecture 3 Course Project and Amazon AWS Majd Sakr and Mohammad Hammoud Lecture Outline Discussion On Course Project Amazon Web Services 2 Course Project Course Project Phase I-A
More informationSYNERGIE VON HPC UND DEEP LEARNING MIT NVIDIA GPUS
SYNERGIE VON HPC UND DEEP LEARNING MIT NVIDIA S Axel Koehler, Principal Solution Architect HPCN%Workshop%Goettingen,%14.%Mai%2018 NVIDIA - AI COMPUTING COMPANY Computer Graphics Computing Artificial Intelligence
More informationDeep learning prevalence. first neuroscience department. Spiking Neuron Operant conditioning First 1 Billion transistor processor
WELCOME TO Operant conditioning 1938 Spiking Neuron 1952 first neuroscience department 1964 Deep learning prevalence mid 2000s The Turing Machine 1936 Transistor 1947 First computer science department
More informationNVIDIA DGX SYSTEMS PURPOSE-BUILT FOR AI
NVIDIA DGX SYSTEMS PURPOSE-BUILT FOR AI Overview Unparalleled Value Product Portfolio Software Platform From Desk to Data Center to Cloud Summary AI researchers depend on computing performance to gain
More informationDemocratizing Machine Learning on Kubernetes
Democratizing Machine Learning on Kubernetes Joy Qiao, Senior Solution Architect - AI and Research Group, Microsoft Lachlan Evenson - Principal Program Manager AKS/ACS, Microsoft Who are we? The Data Scientist
More informationBERLIN. 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved
BERLIN 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved Amazon Aurora: Amazon s New Relational Database Engine Carlos Conde Technology Evangelist @caarlco 2015, Amazon Web Services,
More informationACCELERATED COMPUTING: THE PATH FORWARD. Jen-Hsun Huang, Co-Founder and CEO, NVIDIA SC15 Nov. 16, 2015
ACCELERATED COMPUTING: THE PATH FORWARD Jen-Hsun Huang, Co-Founder and CEO, NVIDIA SC15 Nov. 16, 2015 COMMODITY DISRUPTS CUSTOM SOURCE: Top500 ACCELERATED COMPUTING: THE PATH FORWARD It s time to start
More informationEFFICIENT INFERENCE WITH TENSORRT. Han Vanholder
EFFICIENT INFERENCE WITH TENSORRT Han Vanholder AI INFERENCING IS EXPLODING 2 Trillion Messages Per Day On LinkedIn 500M Daily active users of iflytek 140 Billion Words Per Day Translated by Google 60
More informationSecurity: Michael South Americas Regional Leader, Public Sector Security & Compliance Business Acceleration
Security: A Driving Force Behind Moving to the Cloud Michael South Americas Regional Leader, Public Sector Security & Compliance Business Acceleration 2017, Amazon Web Services, Inc. or its affiliates.
More informationMid-Atlantic CIO Forum
Mid-Atlantic CIO Forum Agenda Security of the Cloud Security In the Cloud Your Product and Services Roadmap (innovation) AWS and Cloud Services Growth and Expansion at AWS Questions & Discussion Shared
More informationWHITEPAPER AMAZON ELB: Your Master Key to a Secure, Cost-Efficient and Scalable Cloud.
WHITEPAPER AMAZON ELB: Your Master Key to a Secure, Cost-Efficient and Scalable Cloud www.cloudcheckr.com TABLE OF CONTENTS Overview 3 What Is ELB? 3 How ELB Works 4 Classic Load Balancer 5 Application
More informationXilinx ML Suite Overview
Xilinx ML Suite Overview Jim Heaton Sr. FAE Deep Learning explores the study of algorithms that can learn from and make predictions on data Deep Learning is Re-defining Many Applications Cloud Acceleration
More informationMACHINE LEARNING WITH NVIDIA AND IBM POWER AI
MACHINE LEARNING WITH NVIDIA AND IBM POWER AI July 2017 Joerg Krall Sr. Business Ddevelopment Manager MFG EMEA jkrall@nvidia.com A NEW ERA OF COMPUTING AI & IOT Deep Learning, GPU 100s of billions of devices
More informationDeep Learning Inferencing on IBM Cloud with NVIDIA TensorRT
Deep Learning Inferencing on IBM Cloud with NVIDIA TensorRT Khoa Huynh Senior Technical Staff Member (STSM), IBM Larry Brown Senior Software Engineer, IBM Agenda Introduction Inferencing with PyCaffe TensorRT
More informationSharing High-Performance Devices Across Multiple Virtual Machines
Sharing High-Performance Devices Across Multiple Virtual Machines Preamble What does sharing devices across multiple virtual machines in our title mean? How is it different from virtual networking / NSX,
More informationIntroduction to Amazon Lumberyard and GameLift
Introduction to Amazon Lumberyard and GameLift Peter Chapman, Solutions Architect chappete@amazon.com 3/7/2017 A Free AAA Game Engine Deeply Integrated with AWS and Twitch Lumberyard Vision A free, AAA
More informationHOW TO BUILD A MODERN AI
HOW TO BUILD A MODERN AI FOR THE UNKNOWN IN MODERN DATA 1 2016 PURE STORAGE INC. 2 Official Languages Act (1969/1988) 3 Translation Bureau 4 5 DAWN OF 4 TH INDUSTRIAL REVOLUTION BIG DATA, AI DRIVING CHANGE
More informationNVIDIA DEEP LEARNING INSTITUTE
NVIDIA DEEP LEARNING INSTITUTE TRAINING CATALOG Valid Through July 31, 2018 INTRODUCTION The NVIDIA Deep Learning Institute (DLI) trains developers, data scientists, and researchers on how to use artificial
More informationAmazon Web Services and Feb 28 outage. Overview presented by Divya
Amazon Web Services and Feb 28 outage Overview presented by Divya Amazon S3 Amazon S3 : store and retrieve any amount of data, at any time, from anywhere on web. Amazon S3 service: Create Buckets Create
More informationInfrastructure Innovation Opportunities Y Combinator 2013
Infrastructure Innovation Opportunities Y Combinator 2013 James Hamilton, 2013/1/22 VP & Distinguished Engineer, Amazon Web Services email: James@amazon.com web: mvdirona.com/jrh/work blog: perspectives.mvdirona.com
More informationTESLA P100 PERFORMANCE GUIDE. HPC and Deep Learning Applications
TESLA P PERFORMANCE GUIDE HPC and Deep Learning Applications MAY 217 TESLA P PERFORMANCE GUIDE Modern high performance computing (HPC) data centers are key to solving some of the world s most important
More informationMachine Learning In A Snap. Thomas Parnell Research Staff Member IBM Research - Zurich
Machine Learning In A Snap Thomas Parnell Research Staff Member IBM Research - Zurich What are GLMs? Ridge Regression Support Vector Machines Regression Generalized Linear Models Classification Lasso Regression
More informationCloud Computing with FPGA-based NVMe SSDs
Cloud Computing with FPGA-based NVMe SSDs Bharadwaj Pudipeddi, CTO NVXL Santa Clara, CA 1 Choice of NVMe Controllers ASIC NVMe: Fully off-loaded, consistent performance, M.2 or U.2 form factor ASIC OpenChannel:
More informationAn introduction to Machine Learning silicon
An introduction to Machine Learning silicon November 28 2017 Insight for Technology Investors AI/ML terminology Artificial Intelligence Machine Learning Deep Learning Algorithms: CNNs, RNNs, etc. Additional
More informationIBM SpectrumAI with NVIDIA Converged Infrastructure Solutions for AI workloads
IBM SpectrumAI with NVIDIA Converged Infrastructure Solutions for AI workloads The engine to power your AI data pipeline Introduction: Artificial intelligence (AI) including deep learning (DL) and machine
More informationDesigning Fault-Tolerant Applications
Designing Fault-Tolerant Applications Miles Ward Enterprise Solutions Architect Building Fault-Tolerant Applications on AWS White paper published last year Sharing best practices We d like to hear your
More informationDeep Learning Compiler
Deep Learning Compiler AWS AI Acknowledgement Amazon Sagemaker Neo Enables developers to train machine learning models once and run them anywhere in the cloud and at the edge Hardware targets Intel CPU,
More informationHigh-Performance Training for Deep Learning and Computer Vision HPC
High-Performance Training for Deep Learning and Computer Vision HPC Panel at CVPR-ECV 18 by Dhabaleswar K. (DK) Panda The Ohio State University E-mail: panda@cse.ohio-state.edu http://www.cse.ohio-state.edu/~panda
More informationRECENT TRENDS IN GPU ARCHITECTURES. Perspectives of GPU computing in Science, 26 th Sept 2016
RECENT TRENDS IN GPU ARCHITECTURES Perspectives of GPU computing in Science, 26 th Sept 2016 NVIDIA THE AI COMPUTING COMPANY GPU Computing Computer Graphics Artificial Intelligence 2 NVIDIA POWERS WORLD
More informationSecurity on AWS(overview) Bertram Dorn EMEA Specialized Solutions Architect Security and Compliance
Security on AWS(overview) Bertram Dorn EMEA Specialized Solutions Architect Security and Compliance Agenda: Overview AWS Regions Availability Zones Shared Responsibility Security Features Best Practices
More informationIBM Power AC922 Server
IBM Power AC922 Server The Best Server for Enterprise AI Highlights More accuracy - GPUs access system RAM for larger models Faster insights - significant deep learning speedups Rapid deployment - integrated
More informationIntroduction to Amazon Cloud & EC2 Overview
Introduction to Amazon Cloud & EC2 Overview 2017 Amazon Web Services, Inc. and its affiliates. All rights served. May not be copied, modified, or distributed in whole or in part without the express consent
More informationACCELERATED COMPUTING: THE PATH FORWARD. Jensen Huang, Founder & CEO SC17 Nov. 13, 2017
ACCELERATED COMPUTING: THE PATH FORWARD Jensen Huang, Founder & CEO SC17 Nov. 13, 2017 COMPUTING AFTER MOORE S LAW Tech Walker 40 Years of CPU Trend Data 10 7 GPU-Accelerated Computing 10 5 1.1X per year
More informationCERN openlab & IBM Research Workshop Trip Report
CERN openlab & IBM Research Workshop Trip Report Jakob Blomer, Javier Cervantes, Pere Mato, Radu Popescu 2018-12-03 Workshop Organization 1 full day at IBM Research Zürich ~25 participants from CERN ~10
More information2013 AWS Worldwide Public Sector Summit Washington, D.C.
2013 AWS Worldwide Public Sector Summit Washington, D.C. EMR for Fun and for Profit Ben Butler Sr. Manager, Big Data butlerb@amazon.com @bensbutler Overview 1. What is big data? 2. What is AWS Elastic
More informationNVIDIA PLATFORM FOR AI
NVIDIA PLATFORM FOR AI João Paulo Navarro, Solutions Architect - Linkedin i am ai HTTPS://WWW.YOUTUBE.COM/WATCH?V=GIZ7KYRWZGQ 2 NVIDIA Gaming VR AI & HPC Self-Driving Cars GPU Computing 3 GPU COMPUTING
More informationPouya Kousha Fall 2018 CSE 5194 Prof. DK Panda
Pouya Kousha Fall 2018 CSE 5194 Prof. DK Panda 1 Motivation And Intro Programming Model Spark Data Transformation Model Construction Model Training Model Inference Execution Model Data Parallel Training
More informationTowards Fully-automated Driving. tue-mps.org. Challenges and Potential Solutions. Dr. Gijs Dubbelman Mobile Perception Systems EE-SPS/VCA
Towards Fully-automated Driving Challenges and Potential Solutions Dr. Gijs Dubbelman Mobile Perception Systems EE-SPS/VCA Mobile Perception Systems 6 PhDs, 1 postdoc, 1 project manager, 2 software engineers
More informationDisclaimer This presentation may contain product features that are currently under development. This overview of new technology represents no commitme
LHC2384BU VMware Cloud on AWS A Technical Deep Dive Ray Budavari @rbudavari Frank Denneman - @frankdenneman #VMworld #LHC2384BU Disclaimer This presentation may contain product features that are currently
More informationScaling on AWS. From 1 to 10 Million Users. Matthias Jung, Solutions Architect
Berlin 2015 Scaling on AWS From 1 to 10 Million Users Matthias Jung, Solutions Architect AWS @jungmats How to Scale? lot of results not the right starting point What is the right starting point? First
More informationWhat s New at AWS? A selection of some new stuff. Constantin Gonzalez, Principal Solutions Architect, Amazon Web Services
What s New at AWS? A selection of some new stuff Constantin Gonzalez, Principal Solutions Architect, Amazon Web Services Speed of Innovation AWS Pace of Innovation AWS has been continually expanding its
More informationPredicting Service Outage Using Machine Learning Techniques. HPE Innovation Center
Predicting Service Outage Using Machine Learning Techniques HPE Innovation Center HPE Innovation Center - Our AI Expertise Sense Learn Comprehend Act Computer Vision Machine Learning Natural Language Processing
More informationWhat s New at AWS? looking at just a few new things for Enterprise. Philipp Behre, Enterprise Solutions Architect, Amazon Web Services
What s New at AWS? looking at just a few new things for Enterprise Philipp Behre, Enterprise Solutions Architect, Amazon Web Services 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
More informationDemystifying the Cloud With a Look at Hybrid Hosting and OpenStack
Demystifying the Cloud With a Look at Hybrid Hosting and OpenStack Robert Collazo Systems Engineer Rackspace Hosting The Rackspace Vision Agenda Truly a New Era of Computing 70 s 80 s Mainframe Era 90
More informationEdge-to-Cloud Compute with MxNet
Presented @ GTC 2017 & Edge-to-Cloud Compute with MxNet AWS & NVIDIA Aran Khanna, Software Developer, AWS Miro Enev, Solutions Architect, NVIDIA 2017, Amazon Web Services, Inc. or its Affiliates. All rights
More informationGPU ACCELERATED DATABASE MANAGEMENT SYSTEMS
CIS 601 - Graduate Seminar Presentation 1 GPU ACCELERATED DATABASE MANAGEMENT SYSTEMS PRESENTED BY HARINATH AMASA CSU ID: 2697292 What we will talk about.. Current problems GPU What are GPU Databases GPU
More informationSecurity & Compliance in the AWS Cloud. Vijay Rangarajan Senior Cloud Architect, ASEAN Amazon Web
Security & Compliance in the AWS Cloud Vijay Rangarajan Senior Cloud Architect, ASEAN Amazon Web Services @awscloud www.cloudsec.com #CLOUDSEC Security & Compliance in the AWS Cloud TECHNICAL & BUSINESS
More informationCLOUD ECONOMICS: HOW TO QUANTIFY THE BENEFITS OF MOVING TO THE CLOUD
CLOUD ECONOMICS: HOW TO QUANTIFY THE BENEFITS OF MOVING TO THE CLOUD Matt Johnson, Solutions Architect, Amazon Web Services 30 October 2017 2017, Amazon Web Services, Inc. or its Affiliates. All rights
More informationMICROWAY S NVIDIA TESLA V100 GPU SOLUTIONS GUIDE
MICROWAY S NVIDIA TESLA V100 GPU SOLUTIONS GUIDE LEVERAGE OUR EXPERTISE sales@microway.com http://microway.com/tesla NUMBERSMASHER TESLA 4-GPU SERVER/WORKSTATION Flexible form factor 4 PCI-E GPUs + 3 additional
More informationMachine Learning on VMware vsphere with NVIDIA GPUs
Machine Learning on VMware vsphere with NVIDIA GPUs Uday Kurkure, Hari Sivaraman, Lan Vu GPU Technology Conference 2017 2016 VMware Inc. All rights reserved. Gartner Hype Cycle for Emerging Technology
More informationCloud Storage with AWS: EFS vs EBS vs S3 AHMAD KARAWASH
Cloud Storage with AWS: EFS vs EBS vs S3 AHMAD KARAWASH Cloud Storage with AWS Cloud storage is a critical component of cloud computing, holding the information used by applications. Big data analytics,
More informationVMware Cloud on AWS Adoption in the Enterprise
HYP3920BUS VMware Cloud on AWS Adoption in the Enterprise Kit Colbert, VMware, Inc. Sandy Carter, Amazon Web Services Chuck Hoppenrath, Discovery Communications #vmworld #HYP3920BUS Disclaimer This presentation
More information