SER3052BU How VMware vsphere and NVIDIA s Accelerate Your Organization Raj Rao, NVIDIA GRID Product Management Ziv Kalmanovich, vsphere ESXi Product Management #VMworld #SER3052BU
Disclaimer This presentation may contain product features that are currently under development. This overview of new technology represents no commitment from VMware to deliver these features in any generally available product. Features are subject to change, and must not be included in contracts, purchase orders, or sales agreements of any kind. Technical feasibility and market demand will affect final delivery. Pricing and packaging for any new technologies or features discussed or presented have not been determined. CONFIDENTIAL 2
Aligning To Your Strategic Priorities Your Strategic IT Priorities Transform Security Empower Digital Workspaces Integrate Public Clouds Modernize Data Centers Modernize Data Centers Any Device Any Application VMworld 2017 Any Cloud Your Strategic IT Priorities VMware s Vision Integrate Empower VMware Workspace ONE Transform Public Digital Desktop Mobile Identity Security Clouds Workspaces Traditional Apps Cloud-Native Apps SaaS Apps VMware Cross-Cloud Architecture Private Cloud Hybrid Cloud Public Cloud VMware vrealize Cloud Management Software-Defined Data Center F Content: Not for publication VMware Cross-Cloud Services VMware Cloud Foundation VMware Cloud Provider Partners 3
Universal App Platform Test / Dev / Tier 2/3 Business-Critical Apps Desktop Virtualization 3D Graphics Deep Learning with VMworld 2017 Content: Not for Big Data SAP HANA vsphere Integrated Containers Cloud-Native Applications publication 4
Virtualizing HPC, Big Data and ML Workloads with s Traditional Enterprise Applications Efficiency Agility High Performance Computing AI and Deep Learning Application Compatibility Near Native Performance Efficiency Agility Big Data & Analytics Resiliency Security Resiliency Security CONFIDENTIAL 5
Compute on vsphere with DirectPath IO Benefits VM vsphere VM level QoS Workload Isolation Reproducibility vsphere Near Bare Metal Performance HW Isolation CONFIDENTIAL 6
Compute on vsphere with DirectPath IO Machine Learning CUDA Developer VM vsphere CUDA Developer 1:1 Data Scientist Data Scientist vsphere X:1 CONFIDENTIAL 7
Compute on vsphere with DirectPath IO HPC and Big Data VM Worker vsphere Worker Worker Worker Worker vsphere Researchers Master node Worker CONFIDENTIAL 8
Compute on vsphere with DirectPath IO Benefits VM vsphere VM level QoS Workload Isolation Reproducibility vsphere What s Missing? sharing acc VM Resiliency QoS Resource Scheduling Near Bare Metal Performance HW Isolation CONFIDENTIAL 9
AGENDA Why Compute Workloads important to your DataCenter What are the key requirements that Compute Workloads bring How does NVIDIA Virtualization enable you to host these Workloads 10
WHY IS SUPPORT FOR COMPUTE WORKLOADS IMPORTANT 11
ACCELRATED APPLICATIONS BROAD RANGE OF INDUSTRIES TRANSFORMED Visual Computing Computational Fluid Dynamics Computational Chemistry Computational Structural Mechanics Electric Design Automation Data Science Medical Imaging Computational Finance Defense Weather and Climate Numerical Analytics Machine Learning For a complete list go to: http://www.nvidia.com/object/gpu-applications.html 12
THE EVOLUTION OF MODERN WORKFLOWS VISUAL WORKSPACE MOBILITY COLLABORATION LARGE DATA INTERACTIVE HPC VMworld 2017 Content: Not for VR PHOTOREALISM AI publication Information Workers/Students VISUAL COMPUTING SPECTRUM Designers/Scientists 13
WHAT ARE THE KEY REQUIREMENTS TO CONSIDER VMworld 2017 Content: Not for publication 14
Virtual Machine Guest OS NVIDIA Driver Hypervisor VIRTUALIZING MIXED WORKLOADS Virtual Machine Guest OS NVIDIA Driver Virtual Machine Guest OS Apps Apps Apps NVIDIA Driver v v v NVIDIA v manager Requirements Performance Guaranteed QoS Insight Fully Accelerate every Application CPUs Server NVIDIA 15
GRID AUGUST 2017 RELEASE 16
NVIDIA VIRTUAL SW - AUGUST 2017 RELEASE VMworld 2017 PASCAL HW SUPPORT END TO END MANAGEMENT Content: Not for publication SCHEDULER ADVANCEMENTS COMPUTE IN ALL vdws PROFILES 17
UNDERSTANDING HARDWARE SPECS Planning for Performance Video Memory Frame Buffer Size Scalability & Flexibility Graphics Performance 3DMark 11 - DX SPECviewperf 12 - OGL Decoding/Encoding Compute Performance Peak TFLOPS DP/SP Memory Bandwidth 18
for Virtual Data Center Workstations GRID PERFORMANCE OPTIMIZED TESLA M60 TESLA P40 s Dual GM204 Single GP102 CUDA Cores 4,096 (2,048 per ) 3,840 Memory Size 16 GB GDDR5 (8 GB per ) 24 GB GDDR5 Form Factor PCIe 3.0 Dual Slot PCIe 3.0 Dual Slot Thermal passive / active passive Power 300W / 240W 250W Max Concurrent Users 32 (0.5GB FB) 24 (1GB FB) Profile Options 0Q, 1Q, 2Q, 4Q, 8Q 0B, 1B 0A, 1A, 2A, 4A, 8A 1Q, 2Q, 3Q, 4Q, 6Q, 8Q, 12Q, 24Q 1B 1A, 2A, 3A, 4A, 6A, 8A, 12A, 24A H.264 1080p30 Streams 36 24* 3DMark 11 13,732 25,000* ~2x SPECviewperf 12 62 110* SGEMM TFLOPS 2x 3.8 10.6 Memory Bandwidth 2x 160 GB/s 347 GB/s * estimate 19
VM 1 VM 2 VM 3 6 4 3 2 1 STANDARD SCHEDULER Round Robin Scheduler 8 7 5 8 7 6 5 4 3 2 1 SHARE OF CYCLES VM3 BEST EFFORT SCHEDULING Engine Timesliced Round Robin Scheduler Tasks generally execute within a timeslice Best Effort Scheduling VM2 VM1 20
VM 1 VM 2 VM 3 SCHEDULING LONG RUNNING TASKS 3 1 ROOT-CAUSE FOR QoS ISSUES Round Robin Scheduler 8 6 4 2 1 7 5 SHARE OF CYCLES Engine VMworld 2017 Content: Not for Compute Tasks can be long running Round Robin Scheduler fails when a single task does not complete within a reasonable time publication Starves other VMs Injects the noisy neighbor symptom VM1 21
VM 1 VM 2 VM 3 INTRODUCING : EQUAL SHARE SCHEDULER 8 6 4 2 7 5 3 1 GUARENTEE DETERMISINSTIC QoS Equal Share Round Robin Scheduler SHARE OF VM3 VM1 8 1 7 6 1 5 4 1 Engine 3 2 1 New Advanced Scheduling mode : Equal Share Scheduler (Available on Pascal HW) Long Running Tasks are preempted and context saved to be resumed when rescheduled Deterministic share of cycles per VM VM2 All running v enabled VMs get equal share of cycles 22
Guest monitoring Host monitoring END-TO-END MANAGEMENT Taking visibility to a new level with application monitoring Session monitoring or distribution Performance troubleshooting End user experience monitoring Accurate sizing New App monitoring 23
CUDA enabled app ACCELERATED APPLICATIONS - CUDA 9.0 - OCL 2.0 - Quadro Value-Add - Vulkan 1.0 - Shader Model 5.0 or - OGL 4.5 - DX 9, 10, 11, 12 distribution Quadro Virtual Data Center Workstation GRID Virtual PC 24
NVIDIA GRID VIRTUALIZATION PLATFORM Industry standard virtualization platform vpc Quadro virtual Data Center Workstation Rendering v Monitoring, Insight and Management Data Center and/or Cloud Accessible Hypervisor NVIDIA Virtualization Software NVIDIA Tesla CUDA Compute Support M60, M6, M10 (graphics/sharing only) P40, P6, P100, P4 HPC (Workstation Apps, Rendering, HPC, DL, AI) AI 25
WRAP UP - Accelerated Apps is transforming a Broad Range of Industries - Virtualizing Mixed Workloads in a multi-tenant environment requires - Performance - Deterministic QoS - Insight - Full Acceleration for every Application - NVIDIA Virtualization Platform delivers key requirements to host mixed workloads 26
Roadmap Vision Extend all vsphere Benefits to NVIDIA GRID v Suspend &Resume vsphere CPU Snapshots Shared Resources Mem vmotion DRS v v v v NVIDIA GRID tm See @booths vsphere Cloud Platform - New Workloads EUC 3D Experience NVIDIA GRID The information in this presentation is intended to outline our general product direction and should not be relied on in making a purchasing decision. It is for informational purposes only and may not be incorporated into any contract. 27
Considered Milestones for VMware vsphere with NVIDIA GRID Virtual PC Suspend&Resume Snapshots vsphere vmotion vsphere DRS Tech Preview See @booths VMW Cloud Platform - New Workloads Virtual Workstation Roadmap High Performance Computing Roadmap See @booths VMW Cloud Platform - New Workloads Machine Learning Roadmap VMW EUC 3D Experience NVIDIA GRID VMW EUC 3D Experience NVIDIA GRID The information in this presentation is intended to outline our general product direction and should not be relied on in making a purchasing decision. It is for informational purposes only and may not be incorporated into any contract. 28
Roadmap vsphere with NVIDIA GRID Simplified Maintenance CUDA Developer VM v CUDA Developer v Data Scientist v VMware vsphere Data Scientist v CUDA Developer VM v CUDA Developer v Data Scientist v Data Scientist VMworld 2017 Content: Not for Remediate NVIDIA GRID v VMware vsphere v v NVIDIA GRID See @booths VMW Cloud Platform - New Workloads VMW EUC 3D Experience NVIDIA GRID publication The information in this presentation is intended to outline our general product direction and should not be relied on in making a purchasing decision. It is for informational purposes only and may not be incorporated into any contract. 29
Tech Preview vsphere with NVIDIA GRID 24h Utilization CUDA Developer VM v CUDA Developer VM v CUDA Developer VM v CUDA Developer v CUDA Developer v CUDA Developer v Data Scientist v Data Scientist v Data Scientist v Data Scientist v Data Scientist v Data Scientist v Develop/VDI/ Inference by day ML Training by night Same Infrastructure v v v v See @Booths VMW Cloud Platform- New Workloads VMW EUC VMware vsphere NVIDIA GRID NVIDIA The information in this presentation is intended to outline our general product direction and should not be relied on in making a purchasing decision. It is for informational purposes only and may not be incorporated into any contract. 30
Vision - Extend vsphere Benefits to NVIDIA s with DirectPath IO (passthrough) workloads Suspend &Resume vsphere Snapshots Shared Resources vmotion DRS CPU Mem vsphere HA DRS Placement Roadmap The information in this presentation is intended to outline our general product direction and should not be relied on in making a purchasing CONFIDENTIAL decision. It is 31 for informational purposes only and may not be incorporated into any contract.
Overview - Considered Milestones for all NVIDIA Enablement Virtual PC (VDI) Suspend&Resume For NVIDIA GRID Tech Preview See @booths VMW Cloud Platform - New Workloads Snapshots for NVIDIA GRID Roadmap Virtual Workstation vsphere vmotion for NVIDIA GRID Roadmap See @booths VMW Cloud Platform - New Workloads High Performance Computing vsphere DRS for NVIDIA GRID Roadmap vsphere HA for DirectPath IO Roadmap Machine Learning vsphere DRS for DirectPath IO Roadmap VMW EUC 3D Experience NVIDIA GRID VMW EUC 3D Experience NVIDIA GRID The information in this presentation is intended to outline our general product direction and should not be relied on in making a purchasing decision. It is for informational purposes only and may not be incorporated into any contract. 32
Introducing vsphere Scale-Out for Big Data and HPC Workloads New package that provides all the core features required for scale-out workloads at an attractive price point Features Packaging Hypervisor, vmotion, vshield Endpoint, Storage vmotion, Storage APIs, Distributed Switch, I/O Controls & SR-IOV, Host Profiles / Auto Deploy and more Sold in Packs of 8 CPU at a cost-effective price point Licensing EULA enforced for use w/ Big Data/HPC/ML workloads only 33
Value of vsphere Scale-Out for Big Data and HPC Flexibility & Agility Infrastructure on demand Iterate faster Scale out more rapidly Multi-tenancy enables different multiple distros on the same set of server Operational Efficiency CapEx and OpEx Saving Cluster Consolidation Increase Server Utilization Reduced Complexity Simple operations using tools that IT is familiar with Live workload mobility for Master nodes Reference architecture and best practices Data Governance and Control of Sensitive Data Host and VM security for your customer data Security isolation Hypervisor Guests have low privileges by default Faster time to results and insights at a lower cost 34
Key Takeaways NVIDIA GRID and VMware vsphere provide the operational benefits of virtualization with near native performance (95%) for accelerated HPC, Big Data and Machine Learning VMware's vision is seamless integration of NVIDIA technologies as native resources of VM infrastructure New vsphere Scale-Out SKU; new package with attractive price point for Big Data/HPC/ML dedicated infrastructure virtualization. http://blogs.vmware.com/vsphere/2017/09/vsphere-scale-now-available.html VMworld 2017 Content: Not for publication
Contact us! We d like to learn about your use cases and challenges. Raj Rao, NVIDIA GRID Product Management rrao@nvidia.com Ziv Kalmanovich, vsphere Product Management kalmanovichz@vmware.com VMworld 2017 Content: Not for publication
Recommended Additional Resources at VMWorld Expo Booths VMware Cloud Platform New Workloads VMware End User Computing 3D Experience NVIDIA Sessions @VMworld Enabled Linux VDI [VMTN6636U] Machine Learning and Deep Learning on VMware vsphere: s Are Invading the Software-Defined Data Center [VIRT1997BU] Empowering the digital workspace: balancing tomorrow s trends with today s needs [UEM3332PUS] Wringing Maximum Performance from vsphere for Extremely Demanding Workloads and Customers [FUT2020BU] CONFIDENTIAL 37