VMware Virtual SAN High Performance Scalable Storage Architecture 2014 VMware Inc. All rights reserved.
Agenda Importance of Software Defined approach for Storage Introduction VMware Virtual SAN Key Properties for a Good Storage Investment Call to Action 2
Customers Face Several Challenges with Storage Today Specialized Expensive HW Device-centric Silos Complex Processes App Admin VI Admin Storage Admin Not commodity Low utilization Overprovisioning Static classes of service Rigid provisioning Lack of granular control Frequent data migrations Time consuming processes Lack of automation Slow reaction to request 3
A New Approach is Needed: Software-Defined Storage Storage Today Software-Defined Storage New Control Plane From Hardware-centric to App-centric Policy-driven automation Common across arrays Dynamic control New Data Plane From Specialized to Industry Standard Hardware Server SAN Flash accelerated Distributed 4
The Hypervisor is Best Positioned to Deliver the Software-Defined Storage Transformation Why the Hypervisor: Over 70% of x86 server workloads are virtualized 1 vsphere It s inherently app-aware Sits directly in the I/O path Has global view of underlying storage resources It s hardware agnostic (1) Gartner Market Trends: x86 Server Virtualization, Worldwide, 2013 5
The VMware Software-Defined Storage Vision Transforming Storage the Way Server Virtualization Transformed Compute VMware vsphere Storage Policy-Based Mgmt App-centric storage automation Common mgmt across heterogeneous arrays vsphere VMware Virtual SAN Hyper-converged architecture Data persistence delivered from the hypervisor 6
The DNA of VMware Software-Defined Storage Policydriven automation Abstract VM-centric pools Runs on commodity servers Extends Common to external control storage plane Common control plane Virtual SAN 6.0 Radically Simple, Hypervisor-Converged Storage for VMs vsphere + Virtual SAN All-Flash architecture 2x greater scalability 2x performance with Hybrid; 4x greater with All-Flash Virtual SAN Snapshots and Clones 7
VMware Virtual SAN
VMware Virtual SAN 6.0 Radically Simple Hypervisor-Converged Storage for VMs Overview Software-defined storage optimized for VMs vsphere + Virtual SAN Hypervisor-converged architecture Runs on any standard x86 server Pools HDD/SSD into a shared datastore SSD Hard disks SSD Hard disks SSD Hard disks Delivers enterprise-level scalability and performance Managed through per-vm storage policies Deeply integrated with the VMware stack Virtual SAN Datastore 9
Virtual SAN Can Be Deployed With A Tiered Hybrid Or All-Flash Architecture Hybrid All-Flash New! SSD PCIe Ultra DIMM Caching SSD PCIe Ultra DIMM Read and Write Cache Writes cached first, Reads go direct to capacity tier Virtual SAN Capacity Tier SAS/NL SAS/SATA/Direct-attached JBOD Data Persistence Capacity Tier Flash Devices Reads go directly to capacity tier 40K IOPS per Host 90K IOPS per Host + sub-millisecond latency 10
Virtual SAN Is Hypervisor-converged Virtual Storage Appliance Virtual SAN is embedded in the vsphere Kernel Consumes <10% CPU Virtual SAN is Embedded inside VM Kernel vsphere... Simple to manage No need to install and manage separate virtual appliances No single point of failure Provides the shortest path for I/O Seamless integration with vsphere and VMware stack 11
What s New in Virtual SAN 6.0 All Flash Architecture 4x Performance 2x Scale Enterprise Data Services Broader Hardware Support Data persistence on SSD Intelligent caching and twotier architecture 90K IOPS/host (4.5x more) Scale to 64 nodes (2x more) 200 VMs/host (2x more) 62 TB max. virtual disk size New high performance snapshots & clones Rack awareness to tolerate rack failures HW-based checksum & Expand scalability for blades with direct-attached JBODs Expanded HCL and more ready nodes encryption 12
Virtual SAN 6.0 Now Ready For Business-Critical Apps Virtual Infrastructure Best storage for VMs Optimized for Virtual Infrastructure Enterprise-class Business Critical Apps VDI DR Test/Dev Ready for business critical apps 13
Virtual SAN Trophy Room! Best of Interop Storage Winner (2014) Best of Interop Audience Choice Winner (2014) Best of TechEd Winner North America 2014 InfoWorld Technology of the Year (2015) InfoWorld Editors Choice Award (2014) By 2017 one-third of midmarket organizations will deploy Virtual SAN for at least 30% of their total storage capacity... 14
Unprecedented Customer Momentum 1000+ Customers in the first 9 months In my experience VMware solutions are rock solid we re ready to nearly double our VSAN deployment. It really did work as advertised the fact that I have been able to set it and forget it is huge!
Why Customers Love Virtual SAN? Radically Simple High, Predictable Performance with Elastic Scalability Lower TCO Two click install Single pane of glass Policy-driven Self-tuning Integrated with VMware stack Flash-acceleration and SSD persistence Consistent IOPS with submillisecond response times Linear, non-disruptive scaling Embedded in vsphere kernel Server-side economics No large upfront investments Grow-as-you-go Easy to operate with powerful automation No specialized skillset needed 16
What Virtual SAN Customers Were Able to Achieve TIME TO MANAGE STORAGE REDUCED STORAGE LATENCY REDUCED STORAGE COST -90% <1 ms -60% 17
Key Properties for A Good Storage Investment Reliability Low TCO Best storage for VMs Built for virtual infrastructure Enterprise-class Ready for business-critical apps High Performance Scalability Manageability 18
Reliability
Virtual SAN Architecture Zero Point of Failure Minimum of 3 hosts in a cluster configuration All 3 host MUST!!! contribute storage VSAN datastore Recommended that hosts are configured with similar hardware Hosts: Scales up to 64 REPLICA-1 REPLICA-2 vsphere Cluster esxi-01 esxi-02 esxi-03 Disks: Locally attached disks o o Network o o Hybrid: Magnetic disks and flash devices All-Flash: Flash devices only 1GB Ethernet OR 10GB Ethernet (preferred) Witness component (only metadata) acts as tie-breaker during availability decisions VSAN network 20
Capacity Device Failure Instant mirror copy Degraded The process for resynchronizing all impacted components on the failed capacity device is instantaneously in order to re-created the data onto other disk, disk groups, or hosts. Resynchronization can take time depending on the amount of data. Disk failure, instant mirror copy of impacted component esxi-01 esxi-02 esxi-03 esxi-04 raid-1 vsan network vmdk vmdk vmdk witness Instant! new mirror copy
Cache Device Failure Instant mirror copy Degraded - The process for resynchronizing all impacted components on the failed cache device is instantaneously. Data is re-created the data onto other disk, disk groups, or hosts. Cache device failures introduce greater impact on the cluster overall storage capacity. Disk failure, instant mirror copy of impacted component esxi-01 esxi-02 esxi-03 esxi-04 raid-1 vsan network vmdk vmdk vmdk witness Instant! new mirror copy
Host Failure 60 Minute Delay Absent will wait the default time setting of 60 minutes before starting the copy of objects and components onto other disk, disk groups, or hosts. Greater impact on the cluster overall compute and storage capacity. Host failure, 60 minutes wait copy of impacted component esxi-01 esxi-02 esxi-03 esxi-04 raid-1 vsan network vmdk vmdk vmdk witness 60 minute wait new mirror copy
Network Failure 60 Minute Delay Absent will wait the default time setting of 60 minutes before starting the copy of objects and components onto other disk, disk groups, or hosts. NIC failures, physical network failures can lead to network partitions. Multiple hosts could be impacted in the cluster. Network failure, 60 minutes wait copy of impacted component esxi-01 esxi-02 esxi-03 esxi-04 raid-1 vsan network vmdk vmdk vmdk witness 60 minute wait new mirror copy
Fault Domains Fault Domains provide the ability to group hosts within a cluster and define Fault Domains. Virtual SAN Fault Domains ensures replicas of VM data is spread across the defined Fault Domains. Fault Domains primarily targeted at the ability to tolerate: Rack failures Flash & magnetic devices failures Network device failures Power Failures raid-1 raid-1 Fault Domain A Fault Domain B Fault Domain C vmdk vmdk witness vmdk witness vmdk Rack A Rack B Virtual SAN Cluster Rack C
Virtual SAN Is Resilient To Rack, Host, Network or Disk Failures Automated and controlled through VM-level policy Virtual SAN Datastore Zero data loss and zero downtime despite hardware failures: Disk Host Network Rack Interoperable with vsphere HA and Maintenance Mode Rack A Rack B Rack C 26
High Performance
Virtual SAN Leveraging the Server Economics SSD Virtual SAN uses the concept of disk groups to pool together cache devices and capacity devices as single management constructs. Virtual SAN disk groups configurations are composed of at least 1 cache device (PCI-e or SSD) and 1 capacity device (HDD or SSD) Cache devices are use for performance (Read cache + Write buffer). Capacity devices are used for storage capacity. Disk groups cannot be created without a cache device. disk group disk group disk group disk group disk group cache device cache device cache device cache device cache device capacity devices capacity devices capacity devices capacity devices capacity devices Each host: 5 disk groups max. Each disk group: 1 cache device + 1 to 7 capacity devices 28
Virtual SAN I/O flow Write Acknowledgement esxi-01 esxi-02 esxi-03 esxi-04 raid-1 vsan network vmdk vmdk witness Destaging to HDD is done independently between hosts. VSAN mirrors write IOs to all active mirrors, these are acknowledged when they hit the flash buffer!
Virtual SAN I/O flow 1MB increment striping esxi-01 esxi-02 esxi-03 esxi-04 raid-1 raid-0 raid-0 vsan network stripe-1a 1MB (1) stripe-1b 1MB (3) 1MB (5) 1MB (2) 1MB (4) (x) indicates stripe segment. witness VSAN is thin provisioned by default, stripes grow in increments of 1MB
Virtual SAN Distributed Cache: Better Than Data Locality Virtual SAN I/O Flow: VM reads & writes are distributed to all hosts holding replicas If one host is busy, the others can still service I/O requests vmotion, DRS, HA, etc. cause NO change to I/O flow and no additional overhead Key facts: 1. VSAN I/O delivered from more than one location 2. 10 GbE network is much faster than even SSDs Distributed I/O
Orders per minute VSAN Delivers Consistent Performance Regardless of Locality Workload began on host with no local disk replicas 5 minutes later, migrated to 2 nd host, again with no local replicas 5 minutes more, migrated to a host with local replica Orders per minute 5-minute moving average vmotion vmotion Consistent performance throughout Time (seconds) CONFIDENTIAL 32
% Degradation Virtual SAN 6 Delivers New High Performance Snapshots And Clones 10 9 8 7 6 5 4 3 2 1 0 Snapshot Performance <2% impact (1) 1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 Snapshot Depth New redirect-on-write snapshot Greater snapshot depth (up to 32 snapshots per object) Minimal performance degradation As low as 2% from base (1) (1) Note: Depends on type of workload 33
Virtual SAN for Virtual Desktop Infrastructure 4 nodes setup, based on the following simple configuration delivers Enterprise Level Storage Performance - 1 x 200GB Intel S3700 SSD - 4 x 300GB 15K 6Gbps - 1 x LSI 9207-8i - 1 x 10GB 2P X520 CONFIDENTIAL 34
Virtual SAN 6.0 Ready for Enterprise-Class Applications Virtual SAN 5.5 Virtual SAN 6.0 Hybrid Virtual SAN 6.0 All-Flash Hosts per Cluster 32 64 64 VMs per Host 100 200 200 IOPS per Host 20K 40K 90K Snapshot depth per VM 2 32 32 Virtual Disk size 2TB 62TB 62TB 2x 2x 4.5x 16x 31x 35
Manageability
Virtual SAN Simplifies Storage If You Know vsphere, You Know Virtual SAN Two clicks to deploy! 37
Virtual SAN Simplifies And Automates Storage Management Per-VM Storage Service Levels From a Single Self-tuning Datastore Per VM Storage Policies Policies Set Based on Application Needs Software Automates Control of Service Levels Capacity Performance Storage Policy-Based Management vsphere + Virtual SAN SLAs Availability Virtual SAN Shared Datastore No more LUNs/Volumes! 38
Disks Serviceability Virtual SAN 6.0 introduces a new disk serviceability feature to easily map the location of magnetic disks and flash based devices from the vsphere Web Client.
vrealize Operations vrealize Operations complements VMware Virtual SAN with a management pack for storage monitoring: Virtual SAN Object and component limits Disk/Disk Groups. Virtual SAN datastore
Scalability
Virtual SAN Enables Elastic Scaling of Performance and Capacity No More Complex Forecasting & Large Upfront Investments Scale OUT Add more nodes Scale UP Add more Disks Elastic Grow or shrink on demand Granular Add single nodes or disks Non-disruptive No app downtime 8.8 PB 100 TB 10 TB Capacity IOPS Virtual SAN lets us buy what we need when we need it. With non-disruptive scaling we can add capacity or increase performance at any time without interrupting our operations. Chris Reynolds Senior Systems Engineer 42
IOPS High Performance with Elastic and Linear Scalability Up to 5.8M IOPS in 64 Node Cluster VSAN Hybrid 5.5 VSAN Hybrid 6.0 VSAN All-Flash 6.0 80K 360K 160K 160K 720K 320K 320K 1.4M 640K 1M 5.8M 2.9M 2.6M 1.3M 4 8 16 32 64 Number of Hosts In Virtual SAN Cluster We now have an environment that we can grow organically or shrink organically depending on what our needs are very linear scaling. It allows to scale our deployments the way we want to and not get locked in. This is the right way to do storage, it really is! Alan Sprague System Administrator Oregon State University, College of Business Notes: based on IOMeter 70/30 Read/Write benchmark 43
Virtual SAN Delivers Enterprise-Grade Scale Maximum Scalability per Virtual SAN Cluster 64 Hosts 7M IOPS 6,400 VMs 8.8 Petabytes I am looking for cost-savings, efficiency and the ability to expand when we need to, quickly. And that s something the Virtual SAN lets us do in every case. For the Doe Fund, you know, it is the holy grail of storage. Ryan Hoenle Director of IT, The DOE Fund, Inc. Notes: based on IOMeter 100% Read benchmark 44
Lower TCO
Why Virtual SAN Lowers TCO CAPEX Server-side economics Low Upfront Investment Granular Scaling Leverage Storage Hardware Cost Trend Higher Resource Utilization Linear & Predictable Cost Curve OPEX Higher Admin Productivity Simpler Budgeting No Specialized Skillset As Low as $0.25/IOPS As Low as $50/Desktop 1 As Low as $0.50/GB 2 2X-5X Lower OPEX 4 Up to 50% TCO Reduction 5 1. Full clones 2. Usable capacity 3. Estimated based on 2013 street pricing, Capex (includes storage hardware + Software License costs) 4. Source: Taneja Group 5. Compared to conventional shared storage solution 46
Storage Cost Per Desktop Predictable Linear Cost Example : Offers lowest cost for VDI Storage $240 $190 $/VDI Storage Cost Virtual SAN Midrange Hybrid Array Spikes correspond to scaling out due to IOPs requirements $140 $90 VSAN enables predictable linear scaling $40 500 1000 1500 2000 2500 3000 Number of Desktops Compared to external storage at scale Estimated based on 2013 street pricing, Capex (includes storage hardware + Software License costs) Additional savings come from reduced Opex through automation Virtual SAN configuration: 9 VMs per core, with 40GB per VM, 2 copies for availability and 10% SSD for performance 47
Call to Action
Seeing is Believing!!! Coming Up Next. Live VSAN 6 Demonstration Test it Yourself Secure your POC unit Today!! Test VSAN within Your Environment with Your Workload Discover the Value of Software Defined Storage for your Datacenter 49
Thank You