Is your IT Infrastructure Ready for Machine Learning & Artificial Intelligence?

Transcription

1

2 BRKPAR-2955 Is your IT Infrastructure Ready for Machine Learning & Artificial Intelligence? Hoseb Dermanilian, EMEA BDM, NetApp Arnaud BASSALER, CSE, Cisco Systems

3 Agenda Introduction AI, Machine Learning and Big Data What Makes your IT Infrastructure AI Ready? The Data Management Challenge The Compute Power Challenge Why NetApp & Cisco Conclusion

4 AI, Machine Learning and Big Data

5 A Very Quick Overview: AI, ML and Deep Learning The explosion of AI due to: Infinite storage, flood of data and flexible data management features Availability of GPUs for parallel processing Artificial Intelligence: Machine exhibited human intelligence Machine Learning: State of the art AI Deep Learning: Enabling advanced ML BRKPAR Cisco and/or its affiliates. All rights reserved. Cisco Public 5

6 Big Data and the Rise of Deep Learning The convergence of big data with AI The availability of large datasets provide meaningful learning and results Three critical ways in which big data is now empowering AI: Big Data Technology: processing and storing large quantities of data efficiently Availability of large data sets Scale up algorithms (deep learning) BRKPAR Cisco and/or its affiliates. All rights reserved. Cisco Public 6

7 Is your IT Infrastructure AI Ready?

8 What Makes your IT Infrastructure AI Ready? Different stages with different infrastructure requirements: Flexible and Agile Able to Manage Data Efficiently Accommodate large and varying volumes and types of Data Processing Power / Time Accept data from different data sources Manage data lifecycle (Cloud and On-Premise) Scale non-disruptively BRKPAR Cisco and/or its affiliates. All rights reserved. Cisco Public 8

9 The Data Management Challenge

10 The Flow of Data in a Deep Learning Pipeline BRKPAR Cisco and/or its affiliates. All rights reserved. Cisco Public 10

11 Step1: Eliminate Challenges at the Edge Large number of ingestion points Amount of data generated Apply edge level analytics and pass on selective data To do this: We require high-performance, ultra-low-latency storage at the edge Deploy NetApp ONTAP Select near the edge to: Edge analytics and reduce the amount of data needs to be sent to core Replicate data efficiently reducing bandwidth Utilize Storage Efficiency features to further reduce amount of data sent over BRKPAR Cisco and/or its affiliates. All rights reserved. Cisco Public 11

12 Step2: Eliminate Challenges at the Core Data Lakes Performance, number of copies, small-file workloads Training Cluster: Feeding data from the lake to the training cluster Deployment: Ultra-low latency Overall: Separate clusters for each stage Copy data from one stage to another BRKPAR Cisco and/or its affiliates. All rights reserved. Cisco Public 12

13 Step3: Eliminate Challenges in the Cloud BRKPAR Cisco and/or its affiliates. All rights reserved. Cisco Public 13

14 One More Look into The Data Lake On-demand analytics with hybrid cloud and multi-cloud deployments Rapid provisioning of clusters for test/dev environments Efficient backup and replication of Hadoop data Automated data tiering to the cloud BRKPAR Cisco and/or its affiliates. All rights reserved. Cisco Public 14

15 The Compute Power Challenge

16 AI Sweeping Across Industries Internet Services Healthcare Media & Entertainment Security & Defense Retail Image/Video classification Cancer cell detection Video captioning Face recognition Theft detection Speech recognition Diabetic grading Content based search Video surveillance Auto checkout Virtual and augmented reality Drug discovery Medical research Natural language processing Virtual and augmented reality Cyber security Targeted marketing BRKPAR Cisco and/or its affiliates. All rights reserved. Cisco Public 16

17 NVME SSD NVME SSD UCS C240 M5 AI : Consumption vs Enablement S 800 GB NVMEHWH GB NVMEHWH800 BRKPAR Cisco and/or its affiliates. All rights reserved. Cisco Public 17

18 Cisco GPU Accelerated Data Center Virtualization GPU-Accelerated DV Artificial Intelligence Accelerated Compute Accelerated Analytics & Databases Windows 10 Virtual Workstations Deep Learning Machine Learning Real-Time and Location Analytics Unified Computing Systems BRKPAR Cisco and/or its affiliates. All rights reserved. Cisco Public 18

19 What is Accelerated Compute? GPU-accelerated computing is the use of a graphics processing unit (GPU) together with a CPU to accelerate deep learning, analytics, and engineering applications.... They play a huge role in accelerating applications in platforms ranging from artificial intelligence to cars, drones, and robots. For Cisco it encompasses two categories: 1. Artificial Intelligence - Deep Learning 2. Accelerated Analytics - Databases BRKPAR Cisco and/or its affiliates. All rights reserved. Cisco Public 19

20 Cisco GPUs for AI BRKPAR Cisco and/or its affiliates. All rights reserved. Cisco Public 20

21 Training and Inference BRKPAR Cisco and/or its affiliates. All rights reserved. Cisco Public 21

22 Cisco UCS AI Offerings Training S S 800 GB 800 GB NVMEHWH800 NVMEHWH800 NVME SSD NVME SSD UCS C240 M5 MU L T I RECORDER DVD+ReWritable C240 M5 + OSS EB3600 (PCIe) 800 GB 800 GB 800 GB 800 GB 800 GB 800 GB 800 GB 800 GB NVMEHWH800 NVMEHWH800 NVMEHWH800 NVMEHWH800 NVMEHWH800 NVMEHWH800 NVMEHWH800 NVMEHWH800 NVME SSD NVME SSD NVME SSD NVME SSD NVME SSD NVME SSD NVME SSD NVME SSD ReW ritabl e UCS C480 M5 UCS C480 M5 (PCIe) 9 x P100/V100 GPU s 6 x P100/V100 GPU s S C220 M5 UCS S BT 2 D D H AT A S NG6 LK7T2DH BT 2 BT 2 D D H AT A S NG6 LK7T2DH 5 D D H AT A S 10 NG6 LK7T2DH BT 2 BT 2 D D H AT A S NG6 LK7T2DH 4 D D H AT A S 9 NG6 LK7T2DH BT 2 BG 0 08 D S S E M VN 008HWHE MVN 3 D D H AT A S 8 NG6 LK7T2DH BT 2 BG 0 08 D S S E M VN 008HWHE MVN 2 D D H AT A S 7 NG6 LK7T2DH BT 2 D D H AT A S 1 NG6 LK7T2DH Inferencing 6 C xP4 UCS Inferencing appliance for Edge 800 GB 800 GB NVMEHWH800 NVMEHWH800 NVME SSD NVME SSD UCS C240 M5 C xP4 or 2xP40 More inferencing GPU with more storage (DC) BRKPAR Cisco and/or its affiliates. All rights reserved. Cisco Public 22

23 Why NetApp and Cisco

24 Because of Flexpod! A pre-validated, flexible platform that features: Cisco Unified Computing System Cisco Nexus Networking NetApp Storage Centralized Management with Automation 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

25 Please complete your Online Session Evaluations after each session Complete 4 Session Evaluations & the Overall Conference Evaluation (available from Thursday) to receive your Cisco Live T-shirt All surveys can be completed via the Cisco Live Mobile App or the Communication Stations Complete Your Online Session Evaluation Don t forget: Cisco Live sessions will be available for viewing on-demand after the event at CiscoLive.com/Online Cisco and/or its affiliates. All rights reserved. Cisco Public

26 Continue Your Education Demos in the Cisco campus Walk-in Self-Paced Labs Tech Circle Meet the Engineer 1:1 meetings Related sessions BRKPAR Cisco and/or its affiliates. All rights reserved. Cisco Public 26

27 Thank you

28