The Virtualization Transformation

Size: px

Start display at page:

Download "The Virtualization Transformation"

Anne Joseph
6 years ago
Views:

1 1 The Virtualization Transformation Integrate, Extend, Accelerate

2 NUMBER OF VIRTUAL SERVERS Replication and Protection are Critical to Accelerating VMware adoption Disaster Recovery 24 x 7 x Forever Virtualization Standard Virtual server standard deployment for all applications Deliver uncompromising service levels and always on availability High Availability Heavy-Use Phase Critical applications Define and maintain service levels Provide business continuity and disaster recovery Five-nines Light-Use Phase Non-critical applications Evaluate for critical application usage Basic backup and recovery Pilot Phase Test and development environments Learn management tools Move DAS to shared storage DEPLOYMENT OVER TIME Copyright 2009 EMC Corporation. All rights reserved. 2

3 3 Business Challenge Managing Tier 1 Applications in Separate Physical Environments Separate Infrastructure Business Challenges SQL Server Oracle Exchange Separate infrastructures lead to higher costs, lower ROI and increased environment complexity: Lower server and storage utilization Difficulty meeting service levels Maintaining and managing separate environments Provisioning inefficiencies Inconsistent data protection strategies

environment and increases ROI Increase storage utilization Simplify management Decrease maintenance costs Reduce

4 4 Business Solution Efficient, Consolidated, Virtualized Infrastructure Consolidated Infrastructure VMware VMware VMware SQL Server Oracle Exchange Business Solution Consolidated, virtual infrastructure simplifies the environment and increases ROI Increase storage utilization Simplify management Decrease maintenance costs Reduce provisioning time Unify data protection strategy Consistent support of Service Level Agreements across the infrastructure

5 % of Applications vsphere Ready for 100% Virtualization Requirements of ESX 3.5 vsphere 95% of Performance Performance Applications 1 Capabilities Capabilities IOPS: < 100 IOPS peak 100,000 IOPS 200,000 IOPS Network: < 300 MB/s 9 GB/s 40 GB/s Memory: < 4 MB at peak 64 GB per VM 256 GB per VM CPU: 1 to 2 CPUs 4 VCPUs 8 VCPUs 1. Source: VMware Capacity Planner assessments Copyright 2009 EMC Corporation. All rights reserved. Application s Performance Requirements 5

6 EMC IT: At a Glance USER PROFILES 48,000 internal users (employees & vendors) 250,000+ registered customers and partners on EMC websites > 80 countries ~ 400 offices worldwide IT ENVIRONMENT 5

BURA) 414 2,500 applications database instances / tools 150+ EMC, active RSA, initiatives and VMware solutions at work 8,500 230 PBX s annual enhancements (2008) 950,000 219,000 B2B data transactions

6 6 EMC IT: At a Glance USER PROFILES 48,000 internal users (employees & vendors) 250,000+ registered customers and partners on EMC websites > 80 countries ~ 400 offices worldwide IT ENVIRONMENT 5 datacenters 5,900+ servers & virtual machines 6.5 PB BUSINESS storage across APPLICATIONS 5 tiers (incl. BURA) 414 2,500 applications database instances / tools 150+ EMC, active RSA, initiatives and VMware solutions at work 8, PBX s annual enhancements (2008) 950, ,000 B2B data transactions ports / 87,000 (2008) voice ports 460 3rd parties connected (3,900 users) VIRTUALIZATION 1,600 servers to be consolidated down to ~40 33% eligible apps migrated to date 70% reduction in power and cooling 60% reduction in space requirements Reduced emissions by 60 million lbs. of CO 2 Equivalent to 67,000 trees over 27 years SUPPORTING THE BUSINESS End user support in 20 languages 39,000 monthly support requests 1,100 monthly system changes 23,000 devices monitored SOLUTIONS DEPLOYED BUSINESS APPLICATIONS 400+ applications / tools 150+ active initiatives 8,500 annual enhancements (2008) 950,000 B2B transactions (2008)

7 Virtualization Status as of 1/1/10 Statistics: Virtualized Applications: * = Mission Critical OS Images 5959 Physical Servers 2788 Total Raw Storage 6.5 PB Virtual Center Servers 5 ESX Servers 295 VM s 3171 (53.2%) Current Ratio 10.7:1 Powerlink* eservices eroom EMC.com* PlanIT Business Edge WebMethods Exchange OWA LCS Citrix* ECC Active Directory* Speed WindChill ClearQuest ELMS* SCBS (EDGE) Heat ReqPro DMS SYR* TASC CCA OCS 50% of OS images are virtual Consolidation ratio is 10:1 Physical server count shrinking quarter over quarter Copyright 2009 EMC Corporation. All rights reserved. 7 7

8 8 Fully Automated Storage Tiering: FAST Automates movement and placement of data-based changing needs FAST Enables the use of the latest drive technologies Optimizes both performance and cost Planned support across all EMC platforms Tier 1 Tier 2 Tier 3

9 9 Virtual Provisioning VMware VMware VMware ESX 1 10 TB 3 TB ESX 2 10 TB 4 TB Physical allocation 3 TB ESX 3 10 TB Space efficient, easy to manage capacity on demand Improves storage utilization Reduces storage provisioning complexity and overhead Available across all EMC storage platforms Common Storage Pool

10 Quick, Easy and Automated Provisioning Traditional Mapping and Masking HBA VMware HBA VMware Auto-provisioning Groups Symmetrix and CLARiiON HBA HBA VMware VMware HBA HBA HBA HBA Port A Port B Port C DEV DEV DEV DEV DEV DEV VMware VMware HBA HBA HBA HBA Port A Port B Port C DEV DEV DEV DEV DEV DEV VMware HBA HBA Port D DEV DEV DEV VMware HBA HBA Port D DEV DEV DEV VMware HBA HBA 40 Individual Masking Operations 5 ESX servers x 2 HBAs x 4 storage ports VMware HBA HBA Single Setup to Build and Associate Groups ~160 clicks to complete Includes initial configuration and repeated for every change or add 15 clicks to complete Simplifies initial configurations and all future changes and additions Copyright 2009 EMC Corporation. All rights reserved. 10

11 11 Path Management Challenge: Maintain Predictable Service Levels in Virtual Environments ESX Server ESX Server Multiple applications sharing common storage resources Unpredictable performance due to dynamic workloads that move across physical resources Storage Ports Automation required to keep pace with change in virtual environments at scale Active channels Standby channels

12 12 Solution: PowerPath/VE for Predictable Service Levels for Virtual Data Centers ESX Server ESX Server PowerPath PowerPath Maintain predictable performance even when: Workloads are dynamic and exhibit I/O bursts Virtual machines are moved, added and/or removed on the fly I/O Channels go offline (planned or unplanned) Storage Ports All channels are active and used to load balance

13 VMware and Storage Management Gap Effective

environments adds new levels of complexity VMware

but I don t know any server detail other than at the LUN

other than at the ESX level Need automated management

13 13 VMware and Storage Management Gap Effective management and reporting of virtual server and storage environments adds new levels of complexity VMware Administrator Storage Administrator VMware This is a VM, but I don t know any server detail other than at the LUN level This is a LUN, but I don t know any storage detail other than at the ESX level Need automated management tools to help easily manage and report on who is using what, when, and where

of storage use, configurations and checks for best

14 14 VMware Based Storage Management via EMC Storage Viewer Plug-in for vcenter Provides integrated views of storage use, configurations and checks for best practice settings Free download available on Powerlink

relationships Simplify the ability to monitor, provision, and report on virtual servers EMC ControlCenter 6.

15 15 EMC ControlCenter for Simplified Management of Virtual Server Environments Automated management for mixed storage environments End-to-end visibility and control for a single management screen Ability to discover, visualize, and manage storage to VM relationships Simplify the ability to monitor, provision, and report on virtual servers EMC ControlCenter 6.1 Virtual Servers VMware VMware VMware Thin Devices Thin Pool End-to-End Visibility and Control Automation reduces infrastructure reporting from hours to minutes

16 Virtualization Aware Navisphere Built in automated management for

screen Ability to discover, visualize, and manage storage to VM

discovery New Navisphere for CX4 Virtual Servers VMware VMware VMware

16 16 Virtualization Aware Navisphere Built in automated management for CLARiiON CX4 End-to-end visibility and control for a single management screen Ability to discover, visualize, and manage storage to VM relationships Includes Taskbar automation and search for instant VM discovery New Navisphere for CX4 Virtual Servers VMware VMware VMware CLARiiON CX4 End-to-End Visibility and Control Unique CLARiiON capability for the mid-tier

17 17 VDC-OS

18 18 Recovery Concepts Disaster Strikes Wks Days Hrs Mins Secs Secs Mins Hrs Days Wks Recovery Point Recovery Time Recovery Point Objective (RPO) Point in time to which data must be recovered (i.e. how old can the data be?) Recovery Time Objective (RTO) Time required to complete recovery of application data

19 19 Recovery Point Objective (RPO) Business needs drive the technology choice Disaster Strikes Wks Days Hrs Mins Secs Secs Mins Hrs Days Wks Recovery Point Recovery Time Tape Backup Backup to disk Asynchronous Replication Synchronous Replication

20 20 Recovery Time Objective (RTO) Business needs drive the technology choice Disaster Strikes Wks Days Hrs Mins Secs Secs Mins Hrs Days Wks Recovery Point Recovery Time Recovery Time includes: Fault detection Recovering data Bringing apps back online Automated Migration Manual Migration Tape Restore

21 VMware Backup Deployment Options VMware Guest Backup Backup application client

by way of a VCB proxy server VMware vsphere Virtual Image Proxy Deploy backup agent

ESX server allows SCSI hot-add mounting of vmdks to Virtual Proxy Server(s) for

21 21 VMware Backup Deployment Options VMware Guest Backup Backup application client on each virtual machine VMware Consolidated Backup (VCB) Off-ESX image level backup by way of a VCB proxy server VMware vsphere Virtual Image Proxy Deploy backup agent on a Virtual Proxy Server that is a VM on or off ESX server. ESX server allows SCSI hot-add mounting of vmdks to Virtual Proxy Server(s) for image level backup Array Snapshot Technology Leveraging array software to produce virtual machine level backups

22 CPU Utilization Copyright 2009 EMC Corporation. All rights reserved. CPU Utilization 22 Virtualization Backup and Recovery Challenges Virtualization changes the IT paradigm backup must evolve to deliver even greater consolidation and value Old Paradigm Physical Environment: Low overall server utilization and plenty of bandwidth for backup New Paradigm Virtual Environment: High overall server utilization and little bandwidth for backup 100% 100% 80 % 60% 40% 20% 0% Server A Server B Server C 80 % 60% 40% 20% 0% ESXServer Hardware Shared Physical Resources Virtual Server A Virtual Server B Virtual Server C 20 percent resource utilization 80 percent resource utilization

23 How Avamar Deduplication Works First instance Duplicate instance Modified instance March 2009 March 2009 April 2009 A B A B E B C D C D C D Only unique data segments are backed up A B C D Data already backed up, so only a unique ID pointer is stored (20 bytes) E New data segment identified and backed up A B C D E Unique data stored on disk, available for immediate recovery Copyright 2009 EMC Corporation. All rights reserved. 23

24 24 Backup for VMware Guest: Avamar vs. Traditional Backup CPU Usage Network Usage Disk Usage 1:20 p.m. 1:30 p.m.% 1:40 p.m. 1:20 p.m. 1:30 p.m.% 1:40 p.m. 1:20 p.m. 1:30 p.m.% 1:40 p.m. Traditional Avamar

in NIC usage Up to 80 percent reduction in CPU usage Up to 50 percent reduction in memory usage All backups are stored

25 25 Avamar Delivers Optimized Backup for VMware Traditional Backup Avamar Backup Up to 95 percent reduction in data moved Up to 90 percent reduction in backup times Up to 50 percent reduction in disk impact Up to 95 percent reduction in NIC usage Up to 80 percent reduction in CPU usage Up to 50 percent reduction in memory usage All backups are stored as virtual full backups, ready for immediate restore Maintains effective consolidation ratios without overtaxing CPU utilization

26 26 Avamar Backup for VMware Guest Resource Pool VMware Virtualization Layer x86 Architecture = Avamar Software Agent Avamar agent resides inside each virtual machine Easy to understand and implement Deduplicates data within the virtual machine, as if they were physical servers Moves minimal backup data Provides file-level restore for Windows, Linux, and Solaris Application consistency through specific application agents guest level will be the choice for those running transactional apps on Windows VMs

27 Avamar and vstorage APIs for Data Protection Virtual Machines

proxy server with Avamar agent Avamar agent resides on the proxy

(Windows only) and image-level backup Linux file level recovery

27 27 Avamar and vstorage APIs for Data Protection Virtual Machines Physical Server Centralized Data Mover Avamar server vstorage APIs proxy server with Avamar agent Avamar agent resides on the proxy server Deduplicates within and across VMDK files Supports both file (Windows only) and image-level backup Linux file level recovery forthcoming and subject to VMware enhnacements SAN Storage = Avamar Software Agent

Avamar vsphere 4 Image Level Backup and Recovery Steps Image Level Backup Set up Avamar policy to do an image level backup (schedule, retention policy, and vms in question) Backup work order sent to

28 Avamar vsphere 4 Image Level Backup and Recovery Steps Image Level Backup Set up Avamar policy to do an image level backup (schedule, retention policy, and vms in question) Backup work order sent to virtual proxy server by Avamar Utility Node Proxy sends command to quiesce disk that the vmdks reside on ESX snaps.vmdk Proxy sees the vmdk snapshot via SCSI hot-add Backup and dedup process begins Unique chunks sent to Avamar Server File Level Recovery from Image Backup During restore request, AVFS gets mounted via SAMBA to a Windows virtual proxy server Copyright 2009 EMC Corporation. All rights reserved. 28

29 Avamar Solutions for VMware Infrastructure Remote Offices with

(ENCRYPTED) ESX Server Hardware Resource Pool (ENCRYPTED) VMware

Virtualization Layer VMware Virtualization Layer x86 Architecture

Resource Pool x86 Architecture Resource Pool LAN/ SAN SAN Proxy

Center with vstorage APIs for Data Protection

29 29 Avamar Solutions for VMware Infrastructure Remote Offices with VMware Remote Offices without VMware Avamar VM (ENCRYPTED) WAN (ENCRYPTED) ESX Server Hardware Resource Pool (ENCRYPTED) VMware Virtualization Layer VMware Virtualization Layer VMware Virtualization Layer VMware Virtualization Layer VMware Virtualization Layer VMware Virtualization Layer x86 Architecture Resource Pool x86 Architecture Resource Pool x86 Architecture Resource Pool x86 Architecture Resource Pool x86 Architecture Resource Pool x86 Architecture Resource Pool LAN/ SAN SAN Proxy Server VMware Data Center with Guest-Level Backup VMware Data Center with vstorage APIs for Data Protection

30 30 Challenges of Disaster Recovery Minimize downtime Reduce risk Control cost Many manual processes for recovery Multiple steps to overcome hardware differences Incomplete or out-of-date runbooks Configuration Drift Testing requires additional hardware and infrastructure Usually only data is regularly and cleanly updated Frequent failures during recovery Multi-Tiered Applications Logical Inconsistency Simplest recovery requires identical hardware Idle recovery hardware is impossible to repurpose Multiple third-party products necessary for recovery Incorporating All Application Tiers

31 31 What We Hear Is This Familiar? We don t have a DR plan for mission critical x86 systems it would be too expensive and complex It is very difficult to test our DR plan because of all the extra hardware, configuration and special processes In our last disaster recovery test we missed our recovery objectives by days Only 31% of CIO s surveyed rate their plans as extremely or very effective (IDG) 40% of all companies that experience a major disaster will go out of business if they cannot gain access to their data within 24 hours (Gartner)

failover can be automated (minimizes human error) The need for idle

32 32 Advantages of Virtual Disaster Recovery Virtual machines are portable Virtual hardware can be automatically configured Test and failover can be automated (minimizes human error) The need for idle hardware is reduced Costs are lowered, and the quality of service is raised

33 33 Introducing Site Recovery Manager (SRM) Production Disaster Recovery VirtualCenter Virtual Machines VMware Infrastructure Servers Site Recovery Manager Site Recovery Manager Protected virtual machines Site Recovery Manager VirtualCenter Virtual Machines VMware Infrastructure Servers Storage EMC Replication Storage

recovery What it does: Simplifies and automates disaster recovery processes Setup Testing Failover

34 34 Introducing Site Recovery Manager (SRM) Site Recovery Manager leverages VMware Infrastructure to transform disaster recovery What it is: Site Recovery Manager is a new VMware product for disaster recovery What it does: Simplifies and automates disaster recovery processes Setup Testing Failover Failback Site Recovery Manager works with VMware Infrastructure to enable faster, more reliable, affordable disaster recovery

35 35 Introducing Site Recovery Manager (SRM) Site 1 Site 2 VC Server 1 VC Server 2 VCMS 1 DB VCMS 2 DB SRM Server 1 SRM Server 2 SRM 1 DB SRDF Storage Replication Adapter Storage Replication Adapter SRM 2 DB MirrorView Replicator Block Replication SW Array 1 Array 2 Block Replication SW RecoverPoint

36 36 Enabling Technology EMC Advanced Replication Technologies SRDF Family The ultimate business continuity and disaster recovery solution for the broadest range of use cases MirrorView Synchronous replication for flexible recovery-point and recovery-time objective requirements

HARDWARE SOFTWARE HARDWARE SOFTWARE 37 Enabling Technology EMC Advanced Replication Technologies Celerra Replicator IP replication with Quality of Service to optimize LAN/WAN bandwidth utilization

37 HARDWARE SOFTWARE HARDWARE SOFTWARE 37 Enabling Technology EMC Advanced Replication Technologies Celerra Replicator IP replication with Quality of Service to optimize LAN/WAN bandwidth utilization FS/LUN LAN FS/LUN Snaps Snaps RecoverPoint Host, array, fabric continuous data protection (CDP), continuous remote replication (CRR), concurrent local and remote (CLR) data protection; and compression Virtualization layer Intel architecture Windows Replica of Windows Linux Virtualization layer Intel architecture Production ESX Servers Replica of Linux Backup Server

38 38 SRM Concepts And Their Relationships LUN 1 LUN 2 LUN 3 LUN 4 LUN 5 Protected Site Recovery Site

39 VMFS 4 VMFS 3 VMFS 2 VMFS 1 39 SRM Concepts And Their Relationships LUN 1 LUN 2 LUN 3 LUN 4 LUN 5 Protected Site Recovery Site

40 VMFS 4 VMFS 3 VMFS 2 VMFS 1 SRM Concepts And Their Relationships LUN 1 Datastore Group 1 LUN 2 LUN 3 Datastore Group 2 LUN 4 LUN 5 Datastore Group 3 Protected Site Recovery Site Copyright 2009 EMC Corporation. All rights reserved. 40

41 VMFS 4 VMFS 3 VMFS 2 VMFS 1 SRM Concepts And Their Relationships LUN 1 Datastore Group 1 Protection Group 1 LUN 2 LUN 3 Datastore Group 2 Protection Group 2 LUN 4 LUN 5 Datastore Group 3 Protected Site Protection Group 3 Recovery Site Copyright 2009 EMC Corporation. All rights reserved. 41

42 VMFS 4 VMFS 3 VMFS 2 VMFS 1 SRM Concepts And Their Relationships LUN 1 Recovery Plan 1 (Whole Site) Datastore Group 1 LUN 2 Protection Group 1 Protection Groups: Protection Group 1 Protection Group 2 Protection Group 3 LUN 3 Datastore Group 2 Protection Group 2 LUN 4 LUN 5 Datastore Group 3 Protected Site Protection Group 3 Recovery Site Copyright 2009 EMC Corporation. All rights reserved. 42

43 VMFS 4 VMFS 3 VMFS 2 VMFS 1 SRM Concepts And Their Relationships LUN 1 Recovery Plan 1 (Whole Site) Datastore Group 1 LUN 2 Protection Group 1 Protection Groups: Protection Group 1 Protection Group 2 Protection Group 3 LUN 3 Datastore Group 2 LUN 4 LUN 5 Protection Group 2 Recovery Plan 2 (Subset) Protection Groups: Protection Group 1 Datastore Group 3 Protected Site Protection Group 3 Recovery Site Copyright 2009 EMC Corporation. All rights reserved. 43

44 44 SRM User Interface

45 45 SRM Recovery Plan VM Shutdown High Priority VM Shutdown Attach Virtual Disks High Priority VM Recovery Normal Priority VM Recovery

46 46 Testing a SRM Recovery Plan SRM enables you to Test a recovery plan by simulating a failover of protected VMs with zero downtime to the protected VMs in the protected site

47 47 Testing a SRM Recovery Plan Continued

48 48 Executing an actual failover in SRM Continued WARNING - Executing an actual failover with SRM will permanently alter virtual machines and infrastructure of both the protected and recovery sites

49 49 SRM Default Roles and Privileges

50 SRM Alarms and Site Status Monitoring SRM will support the following alarm notification actions: Send to specified address Send SNMP trap to VC trap receivers Execute specified command on VC host We recommend you complete setup of alarm notifications for: Remote Site Down Remote Site Ping Failed Replication Group Removed Recovery Plan Destroyed License Server Unreachable Copyright 2009 EMC Corporation. All rights reserved. 50

51 Summary Site Recovery Manager Leverages VMware Infrastructure to Make Disaster Recovery Rapid Automate disaster recovery process Eliminate complexities of traditional recovery Reliable Ensure

51 51 Summary Site Recovery Manager Leverages VMware Infrastructure to Make Disaster Recovery Rapid Automate disaster recovery process Eliminate complexities of traditional recovery Reliable Ensure proper execution of recovery plan Enable easier, more frequent tests Manageable Centrally manage recovery plans Make plans dynamic to match environment Affordable Utilize recovery site infrastructure Reduce management costs

52 Vblock Infrastructure Packages Core platform details Vblock 2 (3000 6000+ VMs) A high-end

enterprises or service providers Vblock 1 (800 3000 VMs) A mid-sized configuration to deliver a

configuration to meet the IT needs of small datacenters Test/development platform for Partners and

52 52 Vblock Infrastructure Packages Core platform details Vblock 2 ( VMs) A high-end configuration that is completely extensible to meet the most demanding IT needs of large enterprises or service providers Vblock 1 ( VMs) A mid-sized configuration to deliver a broad range of IT capabilities to organizations of all sizes Vblock 0 ( VMs) An entry-level configuration to meet the IT needs of small datacenters Test/development platform for Partners and customers Imagine the power of three Scaling virtualized datacenter infrastructure backed by single support model

53 ^

Virtualizing Mission Critical Applications with EMC/VMware VMware Cisco EMC. All rights reserved.

Virtualizing Mission Critical Applications with EMC/VMware 1 Different SLAs common infrastructure The Push to Virtualize More Reduce cap-ex - $$ Reduce op-ex - $$ Provide higher service levels Be more