Directions in Data Centre Virtualization and Management Peter West Product Marketing Manager, Product Marketing EMEA, VMware, Inc.
New Approach To Data Centre Scalability Simplify the containers Add Hardware Nodes on Demand Automate service provisioning Standardize for all Apps and OSs 2
Virtualization: Transformational Change in IT Virtualization Decouples software from underlying hardware Encapsulates Operating Systems and applications into Virtual Machines A Virtual Machine 3
The Data Centre Operating System Automated Resource Assurance Dynamic Balancing Continuous Optimization Increased Availability + Automated Across Applications + Flexible, On Demand Capacity Non-disruptive Scaling Reconfigurable X 4
Key Initial Virtualization Benefits: Consolidation Customer Example: Leading North American Utility Impact of VMware BEFORE AFTER Hard cost savings Servers 1,000 80 70-80% reduction in datacenter space, power Storage 270 TB DAS 140 TB SAN & NAS and cooling Network 3,000 cables/ports 300 cables/ports $8mm savings in 2 years Facilities 200 server racks 400 power whips 10 server racks 20 power whips Operational efficiency Server rebuild and app load from 20-40 hrs to 15-30 minutes 10,000 man hours saved per year 5
From Consolidation to Strategic Architecture Software Lifecycle Resource Management Provisioning Service Level Management Business Continuity Change Management VMware Infrastructure Desktop Management Application Availability While we initially chose VMware virtual infrastructure to address development hardware problems by reducing hardware costs and decreasing server deployment time, we soon discovered additional benefits to adopting the technology, including server portability, protection, and availability. -- Keith Leahy, Vice President, Merrill Lynch 6
IT Management in a Virtual World Delegated Administration Developers QA Application Owners Desktop Managers Test/Dev Pre-Production Desktop Process Automation/Control Distributed Virtualization Distributed Management DRS HA DR Hypervisor Physical 7
Hypervisor Evolution The hypervisor is very far from being a commodity Reliability, security, and performance will vary dramatically However, price of single-machine partitioning will move towards zero In a phase of tremendous innovation driven by: Proliferation of cores and potential inefficiencies Intel and AMD launches make 16+ core systems mainstream Technology makes even more workloads virtualization candidates 2nd generation CPU and memory HW assist, Paravirtualization Rapidly growing move to pervasive, mission-critical use Requires huge focus on reliability, security, and manageability 8
Traditional ESX Server 98% 2% Agent Agent RPM RHEL3-based Service Console Helpers VMM VMM VMM Storage Networking VMkernel Resource Management HAL and Device Drivers Disk Footprint: 2 GB Percent of Patches >50% Disk Footprint: 32 MB 9
ESX Server 3i: Thin Virtualization! 98% 2% Agent Agent RPM RHEL3-based Service Console Helpers VMM VMM VMM Storage Networking VMkernel Resource Management HAL and Device Drivers Disk Footprint: 2 GB Percent of Patches >50% Disk Footprint: 32 MB 10
ESX Server 3i Hardware-based Hypervisor Small footprint w OS-independence Virtualization should have the reliability, security, and performance of hardware Less code and fewer interfaces: Compact 32MB footprint CIM- and remote CLI-based management Aids both security and reliability (no legacy) Integrated in server systems: Hardware is certified and ready-to-run Simple start up experience Launched with IBM, HP, Dell, FSC, NEC. First systems ship by end of the year 11
Contrast with Other Virtualization Architectures Virtual Machine Drivers Virtual Machine Drivers Dom0 General (Linux) Purpose or OS Parent VM (Windows) Virtual Machine Drivers Virtual Machine Drivers Virtual Machine Drivers Drivers Competitive Hypervisors Xen/Viridian ESX Server 3i Drivers Other Architectures Large general purpose OS in parent partition opens security and reliability risks All I/O driver traffic going thru parent OS is a bottleneck ESX Server 3i Ultra small, virtualization centric kernel Direct driver model optimized for VMs Management VMs Remote CLI, CIM, VI API 12
IT Management in a Virtual World Delegated Administration Developers QA Application Owners Desktop Managers Test/Dev Pre-Production Desktop Process Automation/Control Distributed Virtualization Distributed Management DRS HA DR Hypervisor Physical 13
Distributed Virtualization Single-machine partitioning is great, but virtual infrastructure arrives with a collection of machines Aggregate volume hardware into virtual computing, storage, and networking resource pools Key enablers are VMotion, Virtual Center, and VMFS Similar to grid- or cluster-based computing, but available for general-purpose operating systems and applications Resource Management Availability Security Mobility 14
Enabling the Plug-and-Play Data Centre Plug: Power on a new server with VMware Infrastructure. The new server joins a DRS cluster. Play: All VMs in the cluster are automatically rebalanced taking in consideration the newly available resources. On-demand capacity Easy scalability 15
Storage VMotion Storage independent migration of virtual machine disks Zero downtime to virtual machines LUN independent Supported for Fibre channel SANs Minimizes planned downtime due to storage Complete planned downtime management solution across servers and storage with VMotion and Storage VMotion 16
VMware Update Manager OFFLINE Automates patch management for ESX Server hosts and select Microsoft and RHEL virtual machines Scans and remedies online as well as offline virtual machines* and online ESX Server hosts Snapshots virtual machines prior to patching and allows rollback to snapshot Update Manager * Note: RHEL guests can only be scanned, not remediated Eliminates manual tracking of patch levels of ESX Server hosts and virtual machines Automates enforcement of patch standards Reduces risk through snapshots and offline virtual machine patching 17
Non-disruptive ESX Server Patching Update Manager server VMotion VMotion Update Manager patches entire DRS clusters Each host in the cluster enters DRS maintenance mode, one at a time VMs are migrated off, host is patched & rebooted if required VMs are migrated back on Next host is selected Automates patching of large number of hosts with zero downtime to virtual machines 18
Distributed Power Management (experimental) Power Off Business Demand Resource Pool Consolidates workloads onto fewer servers when the cluster needs fewer resources Places unneeded servers in standby mode Brings servers back online as workload needs increase Minimizes power consumption while guaranteeing service levels No disruption or downtime to virtual machines 19
VMware Site Recovery Manager: DR Automation Site Recovery Manager leverages VMware Infrastructure to transform disaster recovery Simplifies and automates disaster recovery workflows: Setup, testing, failover, failback Provides central management of recovery plans from VirtualCenter Turns manual recovery processes into automated recovery plans Simplifies integration with 3 rd -party storage replication Makes disaster recovery rapid, reliable, manageable, affordable 20
Site Recovery Manager Key Components Production Disaster Recovery VirtualCenter VMware Infrastructure Servers Site Recovery Manager service Protected virtual machines VirtualCenter VMware Infrastructure Servers Storage 3 rd -party Replication Storage 21
Summary of Benefits Site Recovery Manager Leverages VMware Infrastructure to Make Disaster Recovery Rapid Automate disaster recovery setup, failover, failback, and testing Eliminate complexities of traditional recovery Reliable Ensure proper execution of recovery plan Enable easier, more frequent tests Manageable Centrally manage recovery plans Make plans dynamic to match environment Affordable Utilize recovery site infrastructure Reduce management costs These features are representative of feature areas under development. Feature commitments must not be included in contracts, purchase orders, or sales agreements of any kind. Technical feasibility and market demand will affect final delivery. 22
VMware Infrastructure : Failover Scenarios Dunes VSO - Process Orchestration Un-Planned Downtime Planned Downtime NIC Teaming HBA Multi-Path VMotion VMware DRS Maintenance VMware HA (server, OS) VMotion VMotion Storage VMotion VMware Consolidated Backup (Files, Image) 1 Snap Snap 2 Mount Backup 3 Site Recovery Manager Pre-program DR Setup, Failover & Test Component Server/os Data Storage Distant Site Failure Types 23
IT Management in a Virtual World Delegated Administration Developers QA Application Owners Desktop Managers Test/Dev Pre-Production Desktop Process Automation/Control Distributed Virtualization Distributed Management DRS HA DR Hypervisor Physical 24
Sources of Business Process Inefficiency Waste Variability Inflexibility Too many process steps and loops Long waiting times between process steps Hardware, OS and application specific technologies Lack of standards Siloed infrastructure Change requires significant downtime Source: McKinsey & Company 25
Data Centre Management Processes Virtualization is changing IT management Much greater flexibility! However Increasing layers of moving parts Managing both physical and virtual Understanding system performance, availability, monitoring, and capacity Operational Readiness Adapting DC processes and procedures for VI Provisioning Deployment Consumption Operations Security Change Management Configuration Capacity and Availability Incident and Problem 26
Standardized & Automated ITIL Processes Capacity Management Availability Management Change Management Business Continuity Planning Service Level Management Configuration/ Incident Management Capacity On Demand VI3 High Availability Template-based Provisioning VM-based Recovery Template-based Config. Mgt VI3 DRS VI3 Universal DR Lab Automation Storage backup Recovery Prob. Replication Resolution Virtual Infrastructure 27
Infrastructure Management As Content / Document Management Retain Create Approve Publish or Retract Audit Usage Request Document Dispose Archive Deploy from Template Route for Audit/ Approval Power-On or Suspend Monitor & Adjust Resources Request for VM Provisioning Delete 28
Affects All Levels of Process Improvement Waste Eliminated Variability Reduced Inflexibility Reduced Automate processes and eliminate process step Systems services migrated outside OS Implement once, inherit for all OS and applications Add/remove virtual hardware Change resource allocations Standardized Software Container 29
IT Management in a Virtual World Delegated Administration Developers QA Application Owners Desktop Managers Test/Dev Pre-Production Desktop IT Groups/App Owners Process Automation/Control Infrastructure Admins Distributed Virtualization Distributed Management DRS HA DR Hypervisor Physical 30
Delegated VM Management Delegated Administration Developers QA Application Owners Desktop Managers Test/Dev Pre-Production Desktop IT Groups/App Owners Provide delegated control of select operations to specific IT groups for certain use cases Workflow layer automates the specific use cases Leverages key VI concepts such as resource pools Enforced by policy control Why do it? Empowers other IT groups to manage their VMs - but in a safe way Frees VI admin from many repetitive tasks 31
Concluding Remarks VMs will become standardised components in the data centre, dramatically simplifying business processes and infrastructure management Virtualization of Servers, Storage and Network enables a Shared Services Architecture allowing IT to Scale and respond to Business Units at their rate of change Deliver the Always On, Capacity-On-Demand Infrastructure Standardize and Automate key IT Processes Virtual Infrastructure is driving an industry wide refresh Virtualization will be pervasive Enables the Next Generation Data Centre 32
Thank You petewest@vmware.com Tel +44 (0) 787 267 5883