VMware: Server Virtualization and Storage Dr. Stephen Herrod, CTO VMware, Inc.
Agenda The storage stack in Virtual Infrastructure VMware and the storage ecosystem Storage I/O and platform certification Customer trends VMware technology: storage direction partner opportunities
VMware Virtualization Basics Hardware Independence Encapsulation Isolation
Initial Benefits: Consolidation BEFORE VMware AFTER VMware Servers Storage Network Facilities 1,000 Direct attach 3000 cables/ports 200 racks 400 power whips Servers Storage Network Facilities 80 Tiered SAN and NAS 400 cables/ports 10 racks 20 power whips
For Every Reduced Server 3-Year Cost Savings/Application Server Hardware $5,816 Power Costs $759 Data Center Real Estate $949 Network Infrastructure $296 TOTAL $8,251
Environmental Impact = 55 Trees 1.5 Cars 4t 700 CO 2 Dollars 7000 kwh
Pools of Shared Resources Traditional View Virtualized View Exchange Operating VMware Infrastructure System File/Print Operating VMware Infrastructure System VMware Infrastructure VPN Operating VMware Infrastructure System CRM Operating VMware Infrastructure System CPU Pool Memory Pool Storage Pool Interconnect Pool
Pools of Shared Resources Virtualized View VMware Infrastructure CPU Pool Memory Pool Storage Pool Interconnect Pool
From Consolidation to a Strategic Computing Architecture Software Lifecycle Resource Management Provisioning Service Level Management Business Continuity Change Management VMware Infrastructure Desktop Management Application Availability While we initially chose VMware virtual infrastructure to address development hardware problems by reducing hardware costs and decreasing server deployment time, we soon discovered additional benefits to adopting the technology, including server portability, protection, and availability. -- Keith Leahy, Vice President, Merrill Lynch
VMware Storage Stack
The Storage Stack in VI3 ESX 1 VM1 VM2 VM3 VM4 VM5 ESX 2 Selectively presents logical containers to VMs VD1 VD2 VSCSI Disklib ESX Storage VMFS Stack LVM VD3 VD4 VD5 VSCSI Disklib ESX Storage VMFS Stack LVM Provides services such as snapshots Provisions logical containers Aggregates physical volumes SAN switch LUN 1 LUN 2 LUN 3 Clustered host-based VM and file system Analogous to how VI3 virtualizes servers Looks like a SAN to VMs A network of LUNs Presented to a network of VMs
Big Focus on I/O Performance One ESX 3.5 box drives: 3 FC Arrays 500 spindles 77 TB of disk space Enough I/O horsepower for: 200,000 Exchange Mailboxes 150 medium databases
ESX Storage Connectivity Choices Shared Storage (Clustered) Local Storage (Stand Alone) VMFS (Formatted) NAS/NFS (File Based) VMFS (on iscsi) VMFS (on FC SAN) RDMs (On FC SAN or iscsi) iscsi HBA SW initiator Physical Mode Pass-Thru Virtual Mode Persistent Undoable
VMware and the Storage Ecosystem
VMware Goals: Partner Enablement Maintain vendor neutrality In conjunction with partners, drive innovation to deliver superior customer experience Create opportunities for partners Accelerate time to market for storage I/O certification Extend and leverage value of partners existing products Build new offerings
Storage I/O and VMware Certification
Storage I/O Certification CVA 1.0 released in Oct 07 CVA 1.0.1 (Dec 07) and 1.1 (Feb 08) VMTN forums Communications (70+) Change in MSCS policy Direct connect FC VMware Accredited Testing Labs Cognizant AppLabs
vhct Program Storage Partner Ecosystem is growing Select Partner Program ~35 (20+ are Storage partners) Select Partner Program Program guide Email support system Monthly newsletter (started in April) VMware Certified Logo Future Enhancements ESX debugging and troubleshooting guides
VI4 and vhct VMware will require a re-certification for all Server and Storage devices A new version of CVA will be available (2.0) Updated to VI4 feature set CVA 1.1.1 will not be compatible with VI4 Partner Beta planned Partner training planned Partner communications will announce availability to Global/Premier Partners and Testing Labs
VI3 Customer Storage Trends
Shared Storage Dominates Current (as of 10/07) Future (end of 08) Q: What proportions of your current VMs running on ESX Server are on the following types of storage? (N=7320) Trend is to move from DAS (or internal disk) to shared storage within the year.
Software iscsi Preferred In-guest vs. Hypervisor level If at hypervisor level, then s/w or h/w? Q: For the majority of your current and planned VMs stored on iscsi arrays, where is the iscsi initiator placed? (N=7320)
Storage Presentation: VMFS Where do customers store their VM s?...on raw devices (RDMs, iscsi in-guest) 11%...in a filesystem (VMFS, NFS) Are customers 100% filesystem, 100% raw device, or some mix? Mix of both Only use filesystem 89% Only use raw device 5% 29% 66%
VMware Storage Functionality: Directions and Partner Opportunities
Key VI Initiatives VDI Improve desktop security and manageability Business Continuity Reduce cost & complexity of backup, D.R. Branch office & SMB Deliver availability at lower cost & complexity Server Consolidation & Containment Power, cooling, space, server sprawl
Managed Desktops Virtual Desktop Infrastructure (VDI) Full desktops run in the data center Connect to desktop from anywhere Centralized management More efficient resource usage Higher availability Online and offline mode VMware Infrastructure 3 Centralized Virtual Desktops VMware Virtual Desktop Manager Thick or Thin Clients
VDI The VDI market VDI s special storage needs Opportunities for partners
VDI Market Opportunity Server revenue opportunity ($B) Revenue ($B) $1.2 $1.0 $0.8 $0.6 $0.4 $0.2 Source: IDC March 2007 Today: 500M total business PCs IDC projects 5% go VDI by 2011. That s 250PB of new storage opportunity $1.1B $0.0 2006 2007 2008 2009 2010 2011
VDI Challenges Challenges VDI Impact PC Management is time consuming & inefficient Desktop Operating Costs are High Low End User Service Level Agreement (SLA) levels Security and Compliance Risks Streamlined & simplified desktop management Reduced Desktop maintenance & support costs Improved End User SLAs & Desktop Business Continuity Improved Security and Compliance
VDI The VDI market VDI s special storage needs Opportunities for partners
Storage and VDI Reduce the required storage while maximizing performance Enable the provisioning of large numbers of virtual machines in real time Enable laptops to run disconnected, and resync upon reconnecting
Scalable Virtual Images Separate the user data from the OS & app image Then, leverage lightweight clones to handle the OS & app disk. Dramatically reduce the amount of storage consumed 25 MB Clone 25 MB Clone 25 MB Clone 10 GB OS Ratio % Savings 1:50 85%+ 1:100 90%+ 1:100 0 95%+
VDI The VDI market VDI s special storage needs Opportunities for partners
VDI: Partner Opportunities De-dupe Integrate array-based lightweight clones (aka writeable snapshots) with VMware s linked clones / SVI approach Speed the creation of light-weight clones Explicitly keep base disks in cache to speed access Replication to laptops and resyncing
Key VI Initiatives VDI Improve desktop security and manageability Business Continuity Reduce cost & complexity of backup, D.R. Branch office & SMB Deliver availability at lower cost & complexity Server Consolidation & Containment Power, cooling, space, server sprawl
Business Continuity/DR Customer behaviors What VMware is doing Opportunities for partners
Customers: Virtualization==BC/DR More than half of customers deploy virtualization for business continuity and disaster recovery purposes N=2265, Winter 2006 VMware customer survey
Customer DR Example Primary Datacenter Recovery Site Virtual Infrastructure Replication Virtual Infrastructure 30 miles FC SAN RPO of 15 minutes and RTO of 24 hours Reduced TCO by 50% Saw ROI of 600% in four months FC SAN
Storage for VI Business Continuity Backup and replication Offload it, make it fast On a per-vm basis Capable of non-disruptive audit Resilience for all sorts of failures Handle: site, campus bldg, single array, etc. While keeping that failover hardware usefully used
Partner Opportunities: BC/DR Backup and replication Offload it, make it fast On a per-vm basis Capable of non-disruptive audit Write replication adapters for Site Recovery manager Directional: enable VCB to leverage array-based snapshots Directional: storage services on a per-vm basis Resilience for all sorts of failures Handle: site, campus bldg, single array, etc. While keeping that failover HW usefully used Implement array-based mirroring with both arrays allowing writes (i.e. fully activeactive). for both LAN/MAN and WAN.
Key VI Initiatives VDI Improve desktop security and manageability Business Continuity Reduce cost & complexity of backup, D.R. Branch office & SMB Deliver availability at lower cost & complexity Server Consolidation & Containment Power, cooling, space, server sprawl
SMB Challenges + Investments VMware SMB Market Survey, June, 2007 n = 501 Q. The following is a list of potential problems that your company could have with its computing environment. Please rate how serious of a problem each one is for your company. (On a 1-8 scale, 8=extremely serious problem). Q. Please indicate the relative amount of investment your company is likely to put into addressing these issues in the next 12 months. (On a 1-8 scale, 8=very high investment in addressing this). Top spending areas are DR, backup, security and availability
Deployment Issues What VMware is doing What partners can do Simplify ease-of-setup Integrate UI Simplify training needs iscsi ease-of-use improvements Auto-configure for VI, simplify set up & monitoring Write VC and VI Client plug-ins Deliver self-paced training or zero-administration storage
Purchasing Issues What VMware s doing What partners can do Lower cost barriers Storage virtual appliances HCL All in one bundles SATA Certify everything. NFS. (See next slide for details.)
Purchasing: VI Editions Resource Management Power Management Live VM Migration Live VM Disk File Migration Availability High Availability DRS DPM VMotion Storage VMotion High Availability Backup Patch Management Central Mgmt Storage Virt. Enterprise VMs Next Generation Hypervisor VMFS Virtual SMP ESX Server 3i ESX Server 3i Consolidated Backup Update Manager VC Agent VMFS Virtual SMP ESX Server 3i OR ESX Server Consolidated Backup Update Manager VC Agent VMFS Virtual SMP ESX Server 3i OR ESX Server Consolidated Backup Update Manager VC Agent VMFS Virtual SMP ESX Server 3i OR ESX Server VI Foundation VI Standard VI Enterprise License Free $995 $2,995 $5,750 SnS (Gold/Plat) Free $545 / $645 $629 / $749 $1,208 / $1,438
Key VI Initiatives VDI Improve desktop security and manageability Business Continuity Reduce cost & complexity of backup, D.R. Branch office & SMB Deliver availability at lower cost & complexity Server Consolidation & Containment Power, cooling, space, server sprawl
Platform Level Requirements Leverage array capabilities (e.g. snapshots, thin provisioning, de-dupe) Deliver highest performance Day 0 support support new array releases on arrays time schedules, and not ESX s Storage management
Partner Opportunities What VMware s doing What partners can do Leverage array capabilities (e.g. snapshots, thin provisioning, de-dupe) GUI simplification of mounting snapshots & clones Consideration for or triggering upon relevant array info Provide appropriate data or triggers to VC via a plug-in provider Deliver highest performance Pluggble Storage Architecture (PSA) framework for multipathing Write a PSA plug-in Day 0 support support new array releases on arrays time schedules, and not ESX s PSA framework Write a PSA plug-in Storage management VI4: new per-vm and per- LUN capacity, i/o reports Create an end-to-end from physical through virtual Auto-optimize w/ Storage VMotion
Concluding Remarks Shared storage plays a huge role in realizing the full benefits of virtual infrastructure There are substantial opportunities for storage vendors to integrate and differentiate with VMware Infrastructure in several areas: Virtual Desktops Business Continuity SMB and Branch Office Consolidation and Containment
Backup slides