STO1794BE Evolution of vsan Vijay Ramachandran Sr.Director, Product Management Christos Karamanolis VMware Fellow & CTO of Storage & Availability #VMworld #STO1794BE
Disclaimer This presentation may contain product features that are currently under development. This overview of new technology represents no commitment from VMware to deliver these features in any generally available product. Features are subject to change, and must not be included in contracts, purchase orders, or sales agreements of any kind. Technical feasibility and market demand will affect final delivery. Pricing and packaging for any new technologies or features discussed or presented have not been determined. #STO1794BE CONFIDENTIAL 2
DIGITAL BUSINESSES FACE ECONOMIC STRESS UNPREDICTABLE DEMANDS LIMITED IT SKILLS TIGHT BUDGETS TOO MANY SILOS #STO1794BE CONFIDENTIAL 3
A New Approach: Hyper-Convergence Integrates Servers and Storage Traditional 3-Tiered Architecture Complex and Separate Silos Virtualization Servers and Blades External Storage Networking Hardware Hyper-Converged Infrastructure Unified Management Virtualization Compute Storage Network Server + Storage Network Built on Industry-Standard Servers and Switches Lower total costs Greater agility and scale Simplified management #STO1794BE CONFIDENTIAL 4
VMware Delivers the Industry-Leading Software for HCI vsphere Industry-Standard Hypervisor VMworld 2017 vsan Native Storage Broadest Deployment Choices vcenter Unified Management Content: Not for publication vsan ReadyNodes VxRail Appliances VMware Cloud Foundation Public Clouds Managed Service Providers #STO1794BE CONFIDENTIAL 5
Why HCI Powered by vsan? Evolve without Risk Extend don t replace Lower TCO Decrease HW spend Scale to Tomorrow Use latest HW, Apps Native security Simplify operations Enable multi-cloud 2017 VMware Inc. All rights reserved. 6
vsan Architecture Makes HCI More Affordable Build on the virtualization foundation and expertise you already have Typical HCI Storage VM ( per server) vsphere VMworld 2017 Content: Not for vsan In-Kernel HCI publication vsphere / vsan Storage VM consumes resources Data paths are inefficient Management must be bolted on 2x CPU and 3x memory efficiency Native vmotion, HA and DRS Simple, single management through vcenter Choice of eco-system 7
Modern Infrastructure for Modern Workloads Business-Critical Apps Databases (SQL/Oracle) DR / DA Management Clusters vsan Virtual Desktops (VDI) ROBO Cloud-Native Apps Containers #STO1794BE CONFIDENTIAL 8
vsan Is Moving Into the Data Center What use cases are you currently using vsan for? Business critical applications and databases (SAP, MS SQL, Oracle, MySQL, etc.) Management infrastructure Business continuity and disaster recovery infrastructure Virtual desktop infrastructure (VDI) 28% 32% 44% 65% Intelligent edge and remote office/branch office (ROBO) 21% Source: TechValidate survey of 316 users of VMware vsan #STO1794BE CONFIDENTIAL 9
vsan Is Used For Mixed Workloads What applications do you run on vsan today? VDI Databases Microsoft Applications VMware Horizon Citrix Xen Desktop Microsoft SQL Server MySQL Databases Oracle Databases SAP Microsoft SharePoint Microsoft Exchange Server 7% 10% 18% 15% 21% 26% 38% 67% New Use Cases NoSQL databases (Cassandra, etc.) Hadoop and other big data applications 3% 9% Source: TechValidate survey of 316 users of VMware vsan #STO1794BE CONFIDENTIAL 10
vsan A Diverse Set of Customers Across Industries #STO1794BE CONFIDENTIAL 11
Majority Says that vsan Performance Was Better than SAN VMworld 2017 Content: Not for VMware vsan Customer Statistic 55% of surveyed IT organizations vsan performances are 25% faster or more compared with their existing SAN array. publication Source: TechValidate survey of 127 users of VMware vsan #STO1794BE CONFIDENTIAL 12
60% Better Performance, 40% Lower Latency than vsan 6.5 4 Node Cluster 2 Disk Groups/ Node with Checksum, RAID-5, Deduplication & Compression Enabled Improvements are greater as more data services are used 60% improvement with Checksum, RAID5 and data services enabled 40% improvement with checksum, Raid5 and data services enabled #STO1794BE CONFIDENTIAL 13
Your Company Can Deploy HCI in the Manner That Best Suits its Needs Dell EMC VxRail Appliances VMware vsan ReadyNodes All-in-one HCI Appliance Dell EMC best-in-breed data protection Rapid time-to-value with multiple configurations Single, pro-active vendor support for software and hardware Fully Customizable HCI Choose from 15 different server vendors Software and support flexibility Backup agnostic to minimize change #STO1794BE CONFIDENTIAL 14
vsan Adoption: 3x Faster Than The Market 10,000 Customers More than top 3 competitors combined Q114 Q214 Q314 Q414 Q115 Q215 Q315 Q415 Q116 Q216 Q316 Q416 Q118 Q218 vsan Customer Adoption 150% YoY bookings growth VMworld Speakers #STO1794BE CONFIDENTIAL 15
Accelerating HCI Innovation Hybrid 5.5 All Flash 6.2 H1 2016 Compression Deduplication Erasure Coding Quality of Service Cross Cloud 6.5 H2 2016 AWS Announcement Container Support Cloud Native Apps Modern Infrastructure 6.6.x Native Security Always-On Protection Enhanced Stretched Clusters Cloud Analytics Intelligent Operations Higher Performance VUM Integration #STO1794BE CONFIDENTIAL 16
Architectural shift to HCI implies need for tightly integrated data and management services HW Management Storage and Cluster Management DP/DR and File Services Health and Performance monitoring Upgrades Integrated Services Customer requirements Customers expect an HCI solution to have integrated set of services HCI Requirements Holistic HCI Management (Lifecycle mgmt, Monitoring and pro-active support) Integrated Data Protection, File services Decouple compute vs storage scale #STO1794BE CONFIDENTIAL 17
Three Key Industry Trends Disruptive Storage Tech. NVMe NVDIMM Growth of Public Cloud Cloud Native Applications Drastically different performance, size & endurance SSD for Persistent characteristics. Storage Favor HCI architectures. Enterprises adopting public cloud (economics). Customers care about data, not storage. New application architectures. Developers rule. New operational models. #STO1794BE CONFIDENTIAL 18
Disruptive Storage Technologies
Storage Devices Becoming Faster with Better Endurance IOPS 1M 750K 500K NVDIMM DRAM DRAM VMworld 2017 Content: Not for Today Low latency devices too expensive for persistent storage publication Device latency >> Network latency Future SSD is the new Capacity Disk High capacity NVMe 250K Byte-addressable NVDIMMs $1 $5 $10 $15 $20 $/Gig Network latency >> Device Latency #STO1794BE CONFIDENTIAL 20
vsan Vision: Next-Generation Hardware SSD NVMe Caching Tier Capacity Tier NVDIMM NVMe NVMe NVMe Current vsan Future vsan #STO1794BE CONFIDENTIAL 21
Scalable Infrastructure Management
Infrastructure Management with vsphere and vsan Day 0 Auto-Config VUM: Complete stack lifecycle for ESXi, vcenter, vsan Guided HCI cluster creation, extension Cluster Health PowerCLI, S.M.A.R.T for hardware monitoring Cluster Health analysis Day 2 Performance Service Cloud Analytics on Phone Home data Performance troubleshooting vrealize Operations Capacity trends for dedupe Topology view for Stretched Cluster, and unified alerts DC-wide vrealize Automation Integration through SPBM #STO1794BE CONFIDENTIAL 23
Cloud-based analytics for performance analysis
#STO1794BE CONFIDENTIAL 25
Growth of Public Cloud
VMware Hybrid Clouds vsphere Private Cloud Management and Automation vsan Cross-Cloud Management and Visibility NSX VM Public Cloud VMware vcloud Air Network Software defined Enterprise ready Elastically scalable Extensible to public cloud Ready for traditional and cloud native apps Unified Software-Defined Platform Powered by vsan Automated #STO1794BE CONFIDENTIAL 27
VMware Cloud on AWS Datacenter vcenter AWS Global Infrastructure AWS Global Infrastructure VMware Cloud on AWS Powered by VMware Cloud Foundation vcenter vsphere vsan NSX Native AWS Services Amazon EC2 AWS IoT Amazon S3 AWS Direct Connect Amazon RDS AWS IAM Primary Storage for VMs #STO1794BE CONFIDENTIAL 28
Making HCI In the Cloud Elastic: Compute vs. Storage Scaling Today: Compute and Storage Tightly Coupled VM VM VM VM VM VM vsan Future: Compute and Storage Decoupled with independent scaling VM VM VM VM VM VM vsan #STO1794BE CONFIDENTIAL 29
VMware Cloud on AWS Datacenter vcenter AWS Global Infrastructure AWS Global Infrastructure VMware Cloud on AWS Powered by VMware Cloud Foundation vcenter vsphere vsan NSX Native AWS Services Amazon EC2 AWS IoT Amazon S3 AWS Direct Connect Amazon RDS AWS IAM VMC Primary Storage for VMs DR to VMC #STO1794BE CONFIDENTIAL 30
DR to VMware Managed Cloud VR snapshots VR Snapshots 5 minutes RPO VMworld 2017 Content: Not for publication DR Snapshots 5 minutes RPO Primary Cluster DR Site vsphere vsan vsphere vsan 31
Data Lifecycle Management in a Hybrid Cloud Local Snapshots Local Snapshots 5 minutes RPO 1 Day retention Archive Snapshots 3 months DR Snapshots 5 minutes RPO Primary Cluster NAS Object DR Site vsphere vsan Secondary Storage vsphere vsan 32
Data Lifecycle Management in a Hybrid Cloud Local Snapshots Local Snapshots 5 minutes RPO 1 Day retention Archive Snapshots 3 months Archive / DR Snapshots Local Snapshots vsphere Primary Cluster vsan NAS Object Secondary Storage AWS S3 vsphere DR Site vsan 33
VMware Cloud on AWS Datacenter vcenter AWS Global Infrastructure AWS Global Infrastructure VMware Cloud on AWS Powered by VMware Cloud Foundation vcenter vsphere vsan NSX Native AWS Services Amazon EC2 AWS IoT Amazon S3 AWS Direct Connect Amazon RDS AWS IAM VMC VMC Primary Storage for VMs DR to VMC Ecosystem #STO1794BE CONFIDENTIAL 34
Cloud Native Applications
The Changing Architecture for Cloud Native Applications Monolithic Applications Application Primary Cluster Application VMworld 2017 Content: Not for Scale-out, Microservice Based Applications (Microservices) publication vsphere vsan #STO1794BE CONFIDENTIAL 36
Key Considerations for Cloud-Native Applications Developer Focus Operations by developers Solely via APIs At large scale Integration with Cluster Managers Persistence layer for KPS Support Kubernetes, Docker Swarm Persistent Storage Manage volume lifecycle Independent of container instance #STO1794BE CONFIDENTIAL 37
Project Hatchway: enterprise-grade storage for Cloud-Native Apps VMware ESX vsan Docker Swarm/ Datacenter Docker stack deploy Docker service create Docker API/ Compose VMware ESX VMFS Kubernetes Kubectl create Kubectl get pods Kubernetes API VMware ESX NFS Stateful Containers with Orchestrator of choice: Docker, Kubernetes Infrastructure of choice: vsphere with vsan/vmfs/nfs Docker{swarm} - vsphere Docker Volume Service (vdvs) Kubernetes - vsphere Cloud Provider(VCP) for Kubernetes and PKS #STO1794BE CONFIDENTIAL 38
vsan optimizations for share-nothing applications New VM policy: Host Affinity VMworld 2017 vsphere VM not allowed to move vsan Content: Not for publication vsan Datastore #STO1794BE CONFIDENTIAL 39
Future: A File System Abstraction for CNA Photon Machine Photon Machine Photon Machine Photon Machine Photon Machine vsphere Primary Cluster Distributed File System VMworld 2017 vsphere vsan vsphere vsan vsan vsphere Primary Cluster vsan Efficient image distribution Scalable data volume sharing Content: Not for publication Consistent snapshots / clones multi-container stateful applications #STO1794BE CONFIDENTIAL 40
Summary: This is the Beginning of the Journey Ride the cost curve of the disruptive flash technology Extend data management platform to public cloud VMworld 2017 Content: Not for Run any workload or cloud native app publication #STO1794BE CONFIDENTIAL 41
3 Easy Ways to Learn More about vsan Storage Hub Technical Library StorageHub.vmware.com Reference architectures, off-line demos and more Easy search function And More! VMworld 2017 New vsan Tools vsan Sizer vsan Assessment Hands-On Lab Test drive vsan for free today! Content: Not for publication Live at VMworld Practical learning of vsan, VxRail and more 24x7 availability online for free! #STO1794BE CONFIDENTIAL 42