EMC HYBRID CLOUD 2.5 WITH VMWARE

Transcription

1 Solution Guide EMC HYBRID CLOUD 2.5 WITH VMWARE EMC Solutions Abstract This Solution Guide provides an introduction to data protection through continuous availability. The guide enables you to begin the planning and design of continuous availability for an EMC Hybrid Cloud 2.5 solution. October 2014

2 Copyright 2014 EMC Corporation. All rights reserved. Published in the USA. Published October 2014 EMC believes the information in this publication is accurate as of its publication date. The information is subject to change without notice. The information in this publication is provided as is. EMC Corporation makes no representations or warranties of any kind with respect to the information in this publication, and specifically disclaims implied warranties of merchantability or fitness for a particular purpose. Use, copying, and distribution of any EMC software described in this publication requires an applicable software license. EMC 2, EMC, and the EMC logo are registered trademarks or trademarks of EMC Corporation in the United States and other countries. All other trademarks used herein are the property of their respective owners. For the most up-to-date listing of EMC product names, see EMC Corporation Trademarks on EMC.com. EMC Hybrid Cloud 2.5 with VMware Part Number H EMC Hybrid Cloud 2.5 with VMware

3 Contents Contents Chapter 1 Executive Summary 7 Document purpose... 8 Audience... 8 Solution purpose... 8 Business challenge... 9 Technology solution Chapter 2 Hybrid Cloud Overview 11 Introduction EMC Hybrid Cloud features and functionality Automation and self-service provisioning Multitenancy and secure separation Workload-optimized storage Elasticity and service assurance Operational monitoring and management Metering and chargeback Modular add-on components Chapter 3 Continuous Availability Architecture 19 Overview Key components for continuous availability with EMC Hybrid Cloud VMware vsphere EMC VPLEX Hybrid cloud data protection Solution architecture Software resources Chapter 4 Solution Design Considerations 29 Overview Network topology considerations Data Center Interconnect (DCI) General VPLEX considerations VPLEX Witness considerations vsphere HA considerations Total path failures EMC Hybrid Cloud 2.5 with VMware 3

4 Contents Datastore heartbeat Deployment considerations Uniform host access configuration with VPLEX Cross-Connect Chapter 5 VPLEX Automation with ViPR 43 Overview ViPR configuration Discovering VPLEX with ViPR ViPR virtual arrays ViPR virtual pools ViPR tenants ViPR projects ViPR consistency groups Use cases Use case 1: Storage provisioning Use case 2: Select virtual machine storage Chapter 6 Backup in a CA Environment 63 Overview Key backup components Backup architecture in a Continuous Availability environment Backing up with dual Avamar instances Avamar and Data Domain integration with VMware Avamar client registrations Avamar proxy server configuration Replication of Backup Data Avamar replication Policy-based replication Replication control CA Backup Use Cases Use Case 1: On-Demand Backup Use Case 2: On-Demand Restore Use Case 3: Toggling Avamar Designations Use Case 4: Remediate Secondary Avamar Policies Use Case 5: Triggering Avamar Replication Chapter 7 Conclusion 73 Conclusion Chapter 8 References 75 EMC documentation EMC Hybrid Cloud 2.5 with VMware

5 Contents Other documentation Figures Figure 1. Hybrid cloud solution stack... 9 Figure 2. EMC Hybrid Cloud key components Figure 3. EMC Hybrid Cloud self-service portal Figure 4. EMC ViPR Analytics with VMware vcenter Operations Manager Figure 5. IT Business Management Suite overview dashboard for hybrid cloud.. 16 Figure 6. Solution architecture Figure 7. Terminology interaction Figure 8. Cloud management platform Figure 9. Data center interconnections Figure 10. High-level deployment of EMC VPLEX Witness Figure 11. Edit cluster settings Figure 12. Example of APD advanced system settings Figure 13. Das.heartbeatDsPerHost setting Figure 14. Stretched cluster distributed volumes Figure 15. Consistency group properties Figure 16. Datastore heartbeat Figure 17. Deployment model with VPLEX Cross-Connect Figure 18. VPLEX storage views Figure 19. Datastore displayed in EMC Virtual Storage Integrator (VSI) Figure 20. Add storage system Figure 21. Discovered VPLEX clusters Figure 22. ViPR virtual data center Figure 23. Virtual arrays Figure 24. Details of VA-S Figure 25. Interactions between VPLEX local and VPLEX distributed pools Figure 26. Block virtual pools Figure 27. Create a virtual pool with VPLEX local high availability Figure 28. Create a virtual pool with VPLEX distributed high availability Figure 29. Authentication providers Figure 30. Tenant details Figure 31. Role assignments Figure 32. Storage Services: Provision cloud storage Figure 33. Provision cloud storage: Select vcenter cluster Figure 34. Storage provisioning: Select datastore type Figure 35. vcac storage provisioning: Choose ViPR storage pool EMC Hybrid Cloud 2.5 with VMware 5

6 Contents Figure 36. Storage provisioning: Enter storage size Figure 38. Set storage reservation policy for VMDKs Figure 39. Dual Avamar backup architecture Figure 40. Select on-demand backup for the virtual machine Figure 43. Remediating the secondary Avamar policies Tables Table 1. Solution software EMC Hybrid Cloud 2.5 with VMware

7 Chapter 1: Executive Summary Chapter 1 Executive Summary This chapter presents the following topics: Document purpose... 8 Audience... 8 Solution purpose... 8 Business challenge... 9 Technology solution EMC Hybrid Cloud 2.5 with VMware 7

8 Chapter 1: Executive Summary Document purpose Audience Solution purpose This Solution Guide describes a Continuous Availability for EMC Hybrid Cloud solution that builds on the EMC Hybrid Cloud solution. The Continuous Availability for EMC Hybrid Cloud solution is a modular add-on to the EMC Hybrid Cloud solution. EMC Hybrid Cloud 2.5 with VMware: Foundation Infrastructure Reference Architecture and EMC Hybrid Cloud 2.5 with VMware: Foundation Infrastructure Solution Guide describe the reference architecture and the foundation solution on which all the EMC Hybrid Cloud add-on solutions are built. The following guides provide further information about how to implement specific capabilities or enable specific use cases within the EMC Hybrid Cloud 2.5 with VMware: EMC Hybrid Cloud 2.5 with VMware: Data Protection Disaster Recovery Solution Guide EMC Hybrid Cloud 2.5 with VMware: Data Protection Backup Solution Guide EMC Hybrid Cloud 2.5 with VMware: Hadoop Applications Solution Guide EMC Hybrid Cloud 2.5 with VMware: Pivotal CF Platform as a Service Solution Guide EMC Hybrid Cloud 2.5 with VMware: Security Management Solution Guide EMC Hybrid Cloud 2.5 with VMware: Public Cloud Solution Guide This Solution Guide is intended for executives, managers, architects, cloud administrators, and technical administrators of IT environments who want to implement continuous availability for a hybrid cloud IaaS platform. Readers should be familiar with the VMware vcloud Suite, storage technologies, general IT functions and requirements, and how they fit into a hybrid cloud architecture. The Continuous Availability for EMC Hybrid Cloud solution enables EMC customers to build an enterprise-class, scalable, multitenant infrastructure that enables: Complete management of the infrastructure service lifecycle On-demand access to and control of network bandwidth, servers, storage, and security Provisioning, monitoring, protection, and management of the infrastructure services by the line of business users, without IT administrator involvement Maximum asset utilization Application services: Single platform for both business-critical and nextgeneration cloud applications 8 EMC Hybrid Cloud 2.5 with VMware

9 Chapter 1: Executive Summary This solution provides a reference architecture and the best practice guidance that is necessary to integrate continuous availability functionality for a hybrid cloud, as shown in Figure 1. Figure 1. Hybrid cloud solution stack Business challenge Business leaders typically demand that their organization addresses the following fundamental challenges: Providing shareholder value by increasing revenues Improving competitiveness by driving business agility Increasing investment by lowering operational costs Limited choice of availability and protection services The difficulty in overcoming these challenges has given rise to public cloud providers who have built technology and business models specifically catering to the requirements of end-user agility and control. Many organizations are under pressure to provide these same service levels within the secure and compliant confines of the on-premises data center. As a result, IT departments need to create cost-effective alternatives to public cloud services, alternatives that do not compromise enterprise features such as data protection, disaster recovery, and guaranteed service levels. As IT organizations implement a hybrid cloud, they must consider the following factors: The infrastructure must be quick to deploy so that business value can be recognized quickly. EMC Hybrid Cloud 2.5 with VMware 9

10 Chapter 1: Executive Summary Technology solution The hybrid cloud infrastructure and operations must be designed to reduce costs through higher utilization and higher staff productivity. Risk of downtime must be controlled through disaster-avoidance techniques such as continuous availability, disciplined change control, and careful management of component compatibility. All of these services (including continuous availability) need to be accessible on demand through a self-service portal with elasticity, financial transparency, and operational control. In other words, they need to be delivered as a cloud service. Support agreements must be established for all elements of the solution. The EMC Hybrid Cloud solution integrates the best of EMC and VMware products and services, and empowers IT organizations to accelerate implementation and adoption of the hybrid cloud while still enabling customer choice for the compute and networking infrastructure within the data center. The solution caters both to customers who want to further use their existing infrastructure and to those who want to build out new infrastructures dedicated to the hybrid cloud. The solution takes advantage of the strong integration between EMC technologies and the VMware vcloud Suite developed by EMC and VMware product and services teams. This includes using EMC scalable storage arrays and integrated EMC and VMware monitoring and data protection suites to ensure that the EMC Hybrid Cloud solution becomes the foundation for enabling IaaS. This Continuous Availability for EMC Hybrid Cloud solution uses EMC and VMware technologies (in particular, EMC VPLEX and VMware vsphere High Availability (HA)) to enable continuous availability as a service within the EMC Hybrid Cloud solution. The components for the Continuous Availability for EMC Hybrid Cloud solution are described in Key components for continuous availability with EMC Hybrid Cloud. 10 EMC Hybrid Cloud 2.5 with VMware

11 Chapter 2: Hybrid Cloud Overview Chapter 2 Hybrid Cloud Overview This chapter presents the following topics: Introduction EMC Hybrid Cloud features and functionality EMC Hybrid Cloud 2.5 with VMware 11

12 Chapter 2: Hybrid Cloud Overview Introduction The EMC Hybrid Cloud solution enables a well-run hybrid cloud by bringing new functionality not only to IT organizations, but also to developers, end users, and lineof-business owners. Beyond delivering baseline infrastructure as a service (IaaS), built on a software-defined data center architecture, the solution delivers feature-rich capabilities to expand from IaaS to business-enabling IT as a service (ITaaS). Backup as a service (BaaS) and disaster recovery as a service (DRaaS) are now policies that users can enable with just a few mouse clicks. End users and developers can quickly access a marketplace of resources for Microsoft, Oracle, SAP, EMC Syncplicity, and Pivotal applications, and can add third-party packages as required. All of these resources can be deployed on private cloud or public cloud services, including VMware vcloud Air, from EMC-powered cloud service providers. The EMC Hybrid Cloud solution uses the best of EMC and VMware products and services, and takes advantage of the strong integration between EMC and VMware technologies to provide the foundation for enabling IaaS on new and existing infrastructure for the hybrid cloud. Figure 2 shows the key components of the EMC Hybrid Cloud solution. Figure 2. EMC Hybrid Cloud key components For detailed information, refer to EMC Hybrid Cloud 2.5 with VMware: Foundation Infrastructure Solution Guide 2.5. For information on EMC Hybrid Cloud modular addon solutions, which provide functionality such as data protection, application services, and platform as a service, refer to Modular add-on components. For detailed information on the add-on solutions, refer to the individual Solution Guides for those solutions. 12 EMC Hybrid Cloud 2.5 with VMware

13 Chapter 2: Hybrid Cloud Overview EMC Hybrid Cloud features and functionality The EMC Hybrid Cloud solution incorporates the following features and functionality: Automation and self-service provisioning Multitenancy and secure separation Workload-optimized storage Elasticity and service assurance Operational monitoring and management Metering and chargeback Modular add-on components Automation and self-service provisioning The solution provides self-service provisioning of automated cloud services to both users and infrastructure administrators. It uses VMware vcloud Automation Center (vcac), integrated with EMC ViPR software-defined storage and VMware vcloud Networking and Security (vcns) or VMware NSX, to provide the compute, storage, network, and security virtualization platforms for the a software-defined data center. Cloud users can request and manage their own applications and compute resources within established operational policies. This can reduce IT service delivery times from days or weeks to minutes. Automation and self-service provisioning features include: Self-service portal Provides a cross-cloud storefront that delivers a catalog of custom-defined services for provisioning workloads based on business and IT policies, as shown in Figure 3 Role-based entitlements Ensure that the self-service portal presents only the virtual machine, application, or service blueprints appropriate to a user s role within the business Resource reservations Allocate resources for use by a specific group and ensure that those resources are inaccessible to other groups Service levels Define the amount and types of resources that a particular service can receive during initial provisioning or as part of configuration changes Blueprints Contain the build specifications and automation policies that define the process for building or reconfiguring compute resources EMC Hybrid Cloud 2.5 with VMware 13

14 Chapter 2: Hybrid Cloud Overview Figure 3. EMC Hybrid Cloud self-service portal Multitenancy and secure separation The solution provides the ability to enforce physical and virtual separation for multitenancy, as strongly as the administrator requires. This separation can encompass network, compute, and storage resources to ensure appropriate security and performance for each tenant. The solution supports secure multitenancy through vcac role-based access control (RBAC), which enables vcac roles to be mapped to Microsoft Active Directory groups. The self-service portal shows only the appropriate views, functions, and operations to cloud users, based on their role within the business. Workloadoptimized storage Elasticity and service assurance The solution enables customers to take advantage of the proven benefits of EMC storage in a hybrid cloud environment. Using ViPR storage services, which leverage the capabilities of EMC VNX and EMC Symmetrix VMAX storage systems, the solution provides software-defined, policy-based management of block- and filebased virtual storage. ViPR abstracts the storage configuration and presents it as a single storage control point, enabling cloud administrators to access all heterogeneous storage resources within a data center as if the resources were a single large array. The solution uses the capabilities of vcac and various EMC tools to provide the intelligence and visibility required to proactively ensure service levels in virtual and cloud environments. Infrastructure administrators can add storage, compute, and network resources to their resource pools as needed. Cloud users can select from a range of service levels for compute, storage, and data protection for their applications and can expand the resources of their virtual machines on demand to achieve the service levels they expect for their application workloads. 14 EMC Hybrid Cloud 2.5 with VMware

15 Chapter 2: Hybrid Cloud Overview Operational monitoring and management The solution features automated monitoring and management capabilities that provide IT administrators with a comprehensive view of the cloud environment to enable smart decision-making for resource provisioning and allocation. These automated capabilities are based on a combination of EMC ViPR Storage Resource Management (ViPR SRM), VMware vcenter Log Insight, and VMware vcenter Operations Manager (vc Ops), and use EMC plug-ins for ViPR, VNX, VMAX, and EMC Avamar systems to provide extensive additional storage detail. Cloud administrators can use ViPR SRM to understand and manage the impact that storage has on their applications and to view their storage topologies from application to disk, as shown in Figure 4. Figure 4. EMC ViPR Analytics with VMware vcenter Operations Manager Capacity analytics and what-if scenarios in vc Ops identify over-provisioned resources so they can be right-sized for the most efficient use of virtualized resources. In addition, for centralized logging, infrastructure components can be configured to forward their logs to vcenter Log Insight, which then aggregates the logs from all the disparate sources for analytics and reporting. Metering and chargeback The solution uses VMware IT Business Management (ITBM) Suite to provide cloud administrators with comprehensive metering and cost information across all business groups in the enterprise. ITBM is integrated into the cloud administrator s self-service portal and presents a dashboard overview of the hybrid cloud infrastructure, as shown in Figure 5. EMC Hybrid Cloud 2.5 with VMware 15

16 Chapter 2: Hybrid Cloud Overview Figure 5. IT Business Management Suite overview dashboard for hybrid cloud Modular add-on components The EMC Hybrid Cloud solution provides modular add-on components for the following services: Application services This add-on solution uses VMware vcloud Application Director to optimize application deployment and release management through logical application blueprints in vcac. Users can quickly and easily deploy blueprints for applications and databases such as Microsoft Exchange, Microsoft SQL Server, Microsoft SharePoint, Oracle, and SAP. Data protection services Avamar and EMC Data Domain systems provide a backup infrastructure that offers features such as deduplication, compression, and VMware integration. By using VMware vcenter Orchestrator (vco) workflows customized by EMC, administrators can quickly and easily set up multitier data protection policies and enable users to select an appropriate policy when they provision their virtual machines. Continuous availability A combination of EMC VPLEX virtual storage and VMware vsphere High Availability (HA) provides the ability to federate information across multiple data centers over synchronous distances. With virtual storage and virtual servers working together over distance, the infrastructure can transparently provide load balancing, realtime remote data access, and improved application protection. 16 EMC Hybrid Cloud 2.5 with VMware

17 Chapter 2: Hybrid Cloud Overview Disaster recovery This add-on solution enables cloud administrators to select disaster recovery (DR) protection for their applications and virtual machines when they provision their hybrid cloud environment. ViPR automatically places these systems on storage that is protected remotely by EMC RecoverPoint technology. VMware vcenter Site Recovery Manager automates the recovery of all virtual storage and virtual machines. Platform as a service The EMC Hybrid Cloud solution provides an elastic and scalable IaaS foundation for platform-as-a-service (PaaS) and software-as-a-service (SaaS) services. Pivotal CF provides a highly available platform that enables application owners to easily deliver and manage applications over the application lifecycle. The EMC Hybrid Cloud service offerings enable PaaS administrators to easily provision compute and storage resources on demand to support scalability and growth in their Pivotal CF enterprise PaaS environments. EMC Hybrid Cloud 2.5 with VMware 17

18 Chapter 2: Hybrid Cloud Overview 18 EMC Hybrid Cloud 2.5 with VMware

19 Chapter 3: Continuous Availability Architecture Chapter 3 Continuous Availability Architecture This chapter presents the following topics: Overview Key components for continuous availability with EMC Hybrid Cloud Solution architecture Software resources EMC Hybrid Cloud 2.5 with VMware 19

20 Chapter 3: Continuous Availability Architecture Overview The Continuous Availability for EMC Hybrid Cloud solution is built on the proven design of the VMware vsphere Metro storage cluster and VPLEX. Using the features and functionality of VPLEX Metro, this solution offers the following benefits: Workload mobility Disaster avoidance Locality independence Location optimized storage Increased uptime and utilization Storage automation Storage for the solution is provided by VMAX or VNX arrays located at both data center sites that host the infrastructure. The storage is presented to the VPLEX arrays, also located at both sites, and is used to form distributed storage that is kept synchronized and presented to the vsphere cluster as active/active LUNs. VMware vco is central to all the customizations and operations used in this solution and manages operations across several EMC and VMware products, including: VMware vcac VMware vcenter EMC ViPR This solution focuses on continuous availability in a hybrid cloud environment. The implementation that is described represents one possible way of meeting the requirements. Key components for continuous availability with EMC Hybrid Cloud The key components of the foundation EMC Hybrid Cloud solution are described in the EMC Hybrid Cloud 2.5 with VMware: Foundation Infrastructure Solution Guide 2.5. The following are the additional components required to implement the Continuous Availability for EMC Hybrid Cloud solution: VMware vsphere 5.5 VMware vsphere vmotion VMware vsphere High Availability EMC VPLEX EMC VPLEX Metro EMC VPLEX Witness EMC Avamar or EMC Data Domain data protection EMC Data Protection Advisor 20 EMC Hybrid Cloud 2.5 with VMware

21 Chapter 3: Continuous Availability Architecture VMware vsphere 5.5 VMware vsphere delivers uncompromised control over all IT resources with the highest efficiency in the industry. vsphere comprises a number of features that transform industry-standard hardware into a shared, mainframe-like resilient environment with built-in service level controls for all applications. vsphere makes it simpler and less expensive to provide higher levels of availability for important applications. With vsphere, organizations can easily increase the baseline level of availability provided for all applications. vsphere makes it possible to reduce both planned and unplanned downtime. VMware vsphere vmotion VMware vsphere vmotion a key feature of the enterprise virtual infrastructure enables live migration of a running virtual machine from one physical host to another. Migration of a virtual machine with vmotion preserves the precise execution state of the virtual machine. The execution state consists of physical memory, storage, network connections, and the virtual device state, including the state of the CPU, network and disk adaptors, and SVGA. The virtual machine continues to run throughout the migration process with minimal impact to the user workload and no disruption to network connectivity. VMware vsphere High Availability VMware vsphere High Availability (HA) provides easy-to-use, cost-effective high availability for applications running in virtual machines. In the event of physical server failure, affected virtual machines are automatically restarted on other production servers with spare capacity. In the case of operating system failure, vsphere HA restarts the affected virtual machine on the same physical server. The combination of VMware HA and the other availability features of the vsphere platform provides organizations with the ability to select and easily deliver the level of availability required for all of their important applications. EMC VPLEX The EMC VPLEX family removes physical barriers within, across, and between data centers. VPLEX Local provides simplified management and non-disruptive data mobility for heterogeneous arrays. VPLEX Metro and VPLEX Geo provide data access and mobility between two VPLEX clusters within synchronous and asynchronous distances respectively. With a unique scale-out architecture, VPLEX advanced data caching and distributed cache coherency provide: Workload resiliency Automatic sharing, balancing, and failover of storage domains Local and remote data access with predictable service levels EMC VPLEX Metro EMC VPLEX Metro brings mobility and access across two locations separated by an inter-site round trip time of up to 10 ms (host application permitting). VPLEX Metro uses two VPLEX clusters (one at each location) and includes the unique capability to support synchronous distributed volumes that mirror data between the two clusters using write-through caching. EMC Hybrid Cloud 2.5 with VMware 21

22 Chapter 3: Continuous Availability Architecture Since a VPLEX Metro distributed volume is under the control of the VPLEX Metro advanced cache coherency algorithms, active data I/O access to the distributed volume is possible at either VPLEX cluster. VPLEX Metro is a truly active/active solution that goes beyond traditional active/passive legacy replication solutions. EMC VPLEX Witness VPLEX Witness provides VPLEX with the capability for applications to survive any storage failures, including disaster-level scenarios affecting entire racks of storage equipment simultaneously. VPLEX Witness provides automatic restart in the event of any server failures and all failures are handled automatically without any human intervention or complicated failover processes. VPLEX Witness can distinguish between a site or link failure, and can enable hosts, servers, and applications to fail over in step with VPLEX while keeping applications online. For VPLEX Metro deployments, VPLEX Witness enables a high-availability solution with zero recovery point objective (RPO). For all VPLEX deployments over distance, VPLEX Witness provides a unique and robust enhancement for resiliency, high availability, and seamless failover. Hybrid cloud data protection EMC Avamar EMC Avamar is a fast, efficient backup and recovery system that is provided through a complete software and hardware solution. Equipped with integrated variable-length deduplication technology, Avamar backup and recovery software provides integrated source and global data deduplication, which facilitates fast, full daily backups for hybrid cloud environments. EMC Data Domain With Avamar, you can choose to direct backups to an EMC Data Domain system instead of the Avamar server. Data Domain deduplication storage systems deduplicate data inline so that data is written already deduplicated on the disk and requires less disk space than the original dataset. With Data Domain, you can retain backup and archive data on site longer to enable quick and reliable data restores from disk. EMC Data Protection Advisor With EMC Data Protection Advisor (DPA), you can automate and centralize the collection and analysis of all data across backup applications, replication technologies, the virtual environment, and supporting infrastructure. This provides a single, comprehensive view of your data protection environment and activities. In addition, when integrated with vco workflows, DPA can be used to provide ondemand reporting of backup statistics and status. 22 EMC Hybrid Cloud 2.5 with VMware

23 Chapter 3: Continuous Availability Architecture Solution architecture This solution describes the environment created for supporting the continuous availability of the EMC Hybrid Cloud infrastructure. Figure 6 shows the overall architecture of the continuous availability solution. The infrastructure is designed to be geographically dispersed across separate data centers with the use of two VPLEX clusters in a VPLEX Metro configuration. All the critical components that support the EMC Hybrid Cloud are placed on VPLEX distributed volumes so they are continuously available across both locations. The VPLEX Witness server is deployed as a virtual appliance running on a customer s VMware ESXi host that is deployed in a failure domain separate from both of the VPLEX clusters. This provides an additional level of protection in case of an intercluster network partition failure or a VPLEX cluster failure. EMC Hybrid Cloud 2.5 with VMware 23

24 Chapter 3: Continuous Availability Architecture Figure 6. Solution architecture A cloud management platform supports the entire management infrastructure for this solution. This platform includes several pods, consisting of ESXi clusters, which perform solution-specific functions, and are used to provide high availability and load balancing as appropriate. 24 EMC Hybrid Cloud 2.5 with VMware

25 Chapter 3: Continuous Availability Architecture The use of vsphere ESXi clusters with vsphere HA provides general virtual machine protection. Additional levels of availability can be provided by using nested clustering between the virtual machines themselves, such as Windows Failover Clustering, PostGresQL clustering, load balancer clustering, or farms of machines that work together natively, to provide a resilient architecture. Figure 7 shows how the terms platform, pod, and cluster are used in this guide. Figure 7. Terminology interaction The tenant resource pods supporting the various organizations within the enterprise are managed by a vcenter Server instance located on the cloud management platform. This server acts as the vsphere end-point for vcac. All server and virtual machine components for the EMC Hybrid Cloud Core Pod are managed by a separate, higher level vcenter Server instance that can also be located in the cloud management platform, but for highest possible availability, could be located on a separate system. Figure 8 shows the default configuration of two vcenters where the first vcenter supports the Core Pod and the second vcenter supports the remaining cloud management pods and tenant resources. EMC Hybrid Cloud 2.5 with VMware 25

26 Chapter 3: Continuous Availability Architecture Figure 8. Cloud management platform Software resources Table 1 lists the software used in this solution. Table 1. Solution software Software Version Notes VMware virtualization and cloud infrastructure VMware vcloud Automation Center VMware cloud management and infrastructure VMware vcenter Server 5.5.0c vsphere management server VMware vsphere ESXi 5.5 Update 2 Server hypervisor VMware vcenter Orchestrator vcenter orchestration engine VMware vcloud Automation Center plug-in for vcenter Orchestrator vcac plug-in for vco VMware vcenter Operations Manager Automated operations management VMware vcenter Log Insight 2.0 vcenter log analytics and management VMware IT Business Management Suite Standard Edition VMware NSX for vsphere Software-defined networking and security VMware vcloud Networking and Security Software-defined networking and security Microsoft SQL Server 2012 SP1 Database server for vcenter Server and vcac 26 EMC Hybrid Cloud 2.5 with VMware

27 Chapter 3: Continuous Availability Architecture Software Version Notes Microsoft Windows Server 2012 Operating system for the server environment EMC storage EMC ViPR 2.0 EMC ViPR software-defined storage supports the following EMC Enginuity code: (minimum) (maximum) EMC ViPR SRM 3.5 Storage resource management EMC Unisphere Management software for VNX and VMAX EMC Enginuity Operating environment for VMAX EMC VNX Operating Environment Release 33 Operating environment for VNX block EMC GeoSynchrony 5.2 Operating environment for VPLEX EMC Solutions Enabler CLI software for Symmetrix VMAX storage management EMC SMI-S Provider SMI-S provider for Solutions Enabler EMC PowerPath/VE 5.9 SP1 Multipathing and load balancing for block access EMC and VMware integration EMC Virtual Storage Integrator EMC storage plug-in for VMware vsphere client EMC ViPR plug-in for VMware vco EMC ViPR plug-in for vco workflows EMC Storage Analytics 2.1 EMC Storage Analytics adapter for VMware vc Ops (validated but optional component of the solution) EMC ViPR Analytics EMC ViPR Analytics Pack for VMware vc Ops EMC backup and recovery EMC Avamar 7.0 SP1 Avamar system software EMC Data Domain Operating System 5.4.x Operating system for Data Domain appliance EMC Data Protection Advisor 6.1 Data protection management software EMC Hybrid Cloud 2.5 with VMware 27

28 Chapter 3: Continuous Availability Architecture 28 EMC Hybrid Cloud 2.5 with VMware

29 Chapter 4: Solution Design Considerations Chapter 4 Solution Design Considerations This chapter presents the following topics: Overview Network topology considerations General VPLEX considerations VPLEX Witness considerations vsphere HA considerations Deployment considerations EMC Hybrid Cloud 2.5 with VMware 29

30 Chapter 4: Solution Design Considerations Overview This chapter focuses on general design and deployment considerations and options for the Continuous Availability for EMC Hybrid Cloud solution. Network topology considerations Data Center Interconnect (DCI) Data centers that are connected together over a metro link can use either Layer 2 bridged VLAN connectivity or Layer 3 routed IP connectivity. Both of these Data Center Interconnect (DCI) options have their advantages and disadvantages. However, new standards and technologies, such as Virtual Extensible LAN (VXLAN), address most of the disadvantages. Traditional disadvantages of Layer 2 DCI The risks related to Layer 2 extensions between data centers mirror some of the limitations faced in traditional Ethernet broadcast domains. The limiting factor is the scalability of a single broadcast domain. A large number of hosts and virtual machines within a broadcast domain, all contending for shared network resources, can result in broadcast storms. The results of broadcast storms are always to the detriment of network availability, adversely affecting application delivery and ultimately leading to a poor user experience. This can affect productivity. As the continuous availability architecture is stretched across both data centers, the broadcast storm can cause disruption in both the primary and secondary data centers. Multiple Layer 2 interconnects create additional challenges for stretched networks. If unknown broadcast frames are not controlled, loops in the Layer 2 extension can form. This can potentially also cause disruption across both data centers, resulting in network downtime and loss of productivity. The Spanning Tree Protocol (STP) needs to be run and carefully managed to control loops across the primary and secondary site interconnecting links. Loop avoidance and broadcast suppression mechanisms are available to the IT professional, but must be carefully configured and managed. Traditional advantages of Layer 2 DCI The greatest advantage of Layer 2 DCI is the IP address mobility of physical and virtual machines across both data centers. This simplifies disaster recovery in the event of a failure in the primary data center. Note: Layer 2 connectivity can often be an application necessity where heartbeats and clustering techniques are used across multiple hosts. In some cases, the technologies might not be able to span Layer 3 boundaries. 30 EMC Hybrid Cloud 2.5 with VMware

31 Traditional disadvantages of Layer 3 DCI Chapter 4: Solution Design Considerations In the event of an infrastructure failure at the primary site, a machine migrated to the secondary data center must be reconfigured to use alternate IP addressing schemes. This can be more time consuming and error prone than having a high-availability deployment across a single Layer 2 domain. Intersite machine clustering may not be supported over a Layer 3 boundary, which can either be multicast or broadcast based. Traditional advantages of Layer 3 DCI Layer 3 DCI does not use extended broadcast domains or require the use of STP. Therefore, there is greater stability of the production and services networks across both primary and secondary data centers. DCI networking solution The network topology used in the Continuous Availability for EMC Hybrid Cloud solution incorporates the advantages of both Layer 2 and Layer 3 DCI topologies. Layer 2 requirements such as resource and management traffic are handled by the VXLAN implementation enabled by VMware NSX. This offers the advantage of IP mobility across both sites by placing the resource and management traffic on spanned VXLAN segments. It also eliminates the complexity of STP and performance degradation that large broadcast domains can introduce. VXLANs can expand the number of Layer 2 domains or segments beyond the 802.1q limit of 4,096 VLANs to a theoretical limit of 16 million. VXLANs can also extend the Layer 2 environment over Layer 3 boundaries. An underlying Layer 3 data center interconnect runs a dynamic route distribution protocol with rapid convergence characteristics such as Open Shortest Path First (OSPF). OSPF routing metrics route the ingress traffic to the primary data center. If the primary data center is unavailable, the OSPF algorithm automatically converges routes to the secondary data center. This is an important advantage compared to using a traditional Layer 2 DCI and Layer 3 DCI solution in isolation. Note: NSX also supports Border Gateway Protocol (BGP) and Intermediate System to Intermediate System (IS-IS) route distribution protocols. EMC Hybrid Cloud 2.5 with VMware 31

32 Chapter 4: Solution Design Considerations Figure 9 shows two data centers connected with a routed Layer 3 IP link. Figure 9. Data center interconnections The primary data center extends three VXLANs across to the secondary data center, over a routed IP link. Figure 9 shows the internal management, external management, and resources segments. Note: vcns requires that the VTEP endpoints are able to use multicast to learn the location of all virtual machines on the VXLAN segment given that vcns does not have the ability to offload this to a controller function as per NSX. As a result, while vcns may be suitable for a continuous availability environment, it does depend on the ownership of the Layer 3 boundaries or whether multicast routing is permissible. 32 EMC Hybrid Cloud 2.5 with VMware

33 Chapter 4: Solution Design Considerations Each of the three management pods that make up the cloud management platform operate on ESXi clusters that are stretched across both sites, that is, there are nodes from every cluster on both sites. In normal production, the virtual machines that operate the platform are hosted by the ESXi cluster nodes that reside in the primary data center. vsphere HA, in combination with VPLEX and VPLEX Witness, enables the cloudmanagement platform virtual machines to restore the cloud-management service on the secondary site in the event of a total loss of the primary data center. In this scenario, the virtual machines automatically move to and operate from the ESXi nodes that reside in the secondary data center. Note: The data center interconnect physical link is subject to the availability of the local telecommunications service provider, and the business requirement of the enterprise. This solution has all the advantages of traditional Layer 2 and Layer 3 solutions. It provides increased flexibility and scalability by implementing VXLANs, and benefits from increased stability by not extending large broadcast domains across the Metro. General VPLEX considerations The auto-resume configuration option for VPLEX consistency groups must be set to True. This setting ensures that, after failure remediation, any data written to the device on the winning cluster during an outage is resynchronized to the mirror on the losing cluster. Also, as a minimum, EMC recommends that you set the detach timer to 5 seconds. Setting the detach delay lower than 5 seconds can result in unnecessary or numerous storage detaches during periods of network instability. Multiple detaches in a short period of time can result in many unnecessary data rebuilds and consequently reduced performance. VPLEX Witness considerations EMC VPLEX Witness is an optional component deployed in customer environments where the regular preference rule sets are insufficient to provide seamless zero or near-zero recovery time objective (RTO) storage availability in the event of site disasters or VPLEX cluster and inter-cluster failures. Without VPLEX Witness, all distributed volumes rely on configured rule sets to identify the preferred cluster in the event of a cluster partition or cluster/site failure. However, if the preferred cluster fails (for example, as a result of a disaster event), VPLEX is unable to automatically enable the surviving cluster to continue I/O operations to the affected distributed volumes. VPLEX Witness is designed specifically overcome this. The VPLEX Witness server is deployed as a virtual appliance running on a customer s VMware ESXi host that is deployed in a failure domain separate from both of the VPLEX clusters. This eliminates the possibility of a single fault affecting both the cluster and VPLEX Witness. VPLEX Witness connects to both VPLEX clusters over the management IP network. By reconciling its own observations with the information EMC Hybrid Cloud 2.5 with VMware 33

34 Chapter 4: Solution Design Considerations reported periodically by the clusters, VPLEX Witness enables the clusters to distinguish between inter-cluster network partition failures and cluster failures, and to automatically resume I/O operations in these situations. Figure 10 shows an example of a high-level deployment of VPLEX Witness and how it can augment an existing static preference solution. The VPLEX Witness server resides in a fault domain separate from the VPLEX clusters on site A and site B. Figure 10. High-level deployment of EMC VPLEX Witness vsphere HA considerations As of ESXi 5.0 Update 1, vsphere can recognize two types of total path failures: Permanent Device Loss (PDL) and All Paths Down (APD). The ESXi server can declare either of these conditions depending on the failure scenario. Total path failures Permanent Device Loss vsphere ESXi has two settings that control the behavior of vsphere HA in response to a SCSI PDL state command. While the suggested values in the following steps for these settings are the default values, it is worth validating that they are configured correctly or vsphere HA may not operate as required. To ensure that the virtual machine failover behaves correctly, validate the following settings within the vsphere clusters: 1. Enable the das.maskcleanshutdownenabled=true flag in the vsphere cluster HA advanced settings, as shown in Figure EMC Hybrid Cloud 2.5 with VMware

35 Chapter 4: Solution Design Considerations Figure 11. Edit cluster settings 2. On every ESXi server, enable VMkernel.Boot.terminateVMOnPDL, located within the host advanced system settings. 3. Reboot the ESXi server for the settings to take effect. These settings can be configured as part of a host profile. They can also be configured using a vsphere PowerCLI script (which can be run as part of a bare-metal provisioning vcac workflow). They can also be configured via the Preboot execution Environment (PXE) post-installation script. With vsphere 5.5, PDL AutoRemove automatically removes a device from a host when the device enters a PDL state. Because vsphere hosts have a limit of 255 disk devices per host, a device that is in a PDL state can no longer accept I/O, but can still occupy one of the available disk device spaces. Therefore, it is better to remove the device from the host. A PDL AutoRemove operation occurs only if there are no open handles left on the device. The auto-remove takes place when the last handle on the device closes. If the device recovers, or if it is re-added after having been inadvertently removed, it is treated as a new device. PDL AutoRemove is enabled by default in vsphere 5.5. For more information about PDL AutoRemove, refer to VMware KB Topic : PDL AutoRemove feature in vsphere 5.5. All Paths Down APD is a state where all the paths to a specific volume have disappeared, but no SCSI sense code can be sent by the array (for example, VPLEX) or, alternatively, the ESXi server receives nothing. An example of this is a dual-fabric failure that causes all of the paths to be down. In this case, no SCSI sense code is generated or sent by the underlying storage array. Even if it were, the host does not receive the signal because there is no connectivity. Another example of an APD condition is a full VPLEX cluster failure. While this is unlikely because there are no single points of failure, it represents a case where a SCSI sense code cannot be generated because the storage hardware is unavailable, and the ESXi server will detect the problem on its own resulting in an APD state. EMC Hybrid Cloud 2.5 with VMware 35

36 Chapter 4: Solution Design Considerations vsphere 5.0 Update 1 introduces two settings that alleviate the problems faced by APD scenarios: Misc.APDHandlingEnable and Misc.APDTimeout. When these settings are enabled, an ESXi server attempts to reestablish the connection to a lost device for 140 seconds, after which the connection times out. This prevents the hostd demon from waiting on I/O and in turn locking up the ESXi host. Figure 12 shows an example of these settings. Figure 12. Example of APD advanced system settings In this case, the ESXi does not power down the virtual machine, which leaves vsphere HA with no ability to perform a failover. Because there is no communication between the host and the storage system, any VPLEX Witness behavior will have no bearing. This case requires administrator intervention to either resolve the path loss conditions or bring up the virtual machines on the surviving site. For this reason, it is important to design your supporting infrastructure with EMC best practices in mind. For more information about PDL and APD, refer to VMware KB Topic : Permanent Device Loss (PDL) and All-Paths-Down (APD) in vsphere 5.x. Datastore heartbeat For vsphere HA datastore heartbeat functionality to operate correctly in any type of failure scenario, VMware recommends increasing the number of heartbeat datastores from two (the default) to four. The minimum number of heartbeat datastores is two and the maximum is five. This enables vsphere HA to detect a datastore s heartbeat even in the case of a connection failure between sites. Consequently, full redundancy enables vsphere HA to determine the state of a host in any scenario. Figure 13 shows the das.heartbeatdsperhost setting in the Advanced Options of vsphere HA. The value is set to 4. Figure 13. Das.heartbeatDsPerHost setting 36 EMC Hybrid Cloud 2.5 with VMware

37 Chapter 4: Solution Design Considerations Figure 14 displays the CorePod stretched cluster. The distributed volumes being shared by the hosts are highlighted. Figure 14. Stretched cluster distributed volumes Each management pod in this solution uses four dedicated VPLEX distributed volumes. We created separate VPLEX consistency groups for each vsphere cluster and assigned the winner for the volumes to VPLEX cluster-1, which is the primary cluster in the configuration. Figure 15 shows the CORE-CG consistency group configured with detach rule Winner:cluster -1. Figure 15. Consistency group properties VPLEX consistency groups are used in conjunction with VPLEX Witness, which intervenes and ensures that access to the surviving cluster is automatically maintained regardless of which site fails. Consistency groups also provide a convenient way to apply rule sets and other properties to a group of volumes, which simplifies configuration and administration on large systems. EMC Hybrid Cloud 2.5 with VMware 37

38 Chapter 4: Solution Design Considerations Figure 16 highlights the datastore heartbeat configuration used in this solution. The Select any of the cluster datastores taking into account my preferences setting is used. Figure 16. Datastore heartbeat Deployment considerations VMware classifies the stretched metro cluster configuration into the following categories: Uniform host access configuration with VPLEX Cross-Connect ESXi hosts in a distributed vsphere cluster have a connection to the local VPLEX system and paths to the remote VPLEX system. The remote paths presented to the ESXi hosts are stretched across distance. Non-uniform host access configuration without VPLEX Cross-Connect ESXi hosts in a distributed vsphere cluster have a connection only to the local VPLEX system. Note: At the time of publication of this guide, the Continuous Availability for EMC Hybrid Cloud solution does not support the non-uniform host access configuration. Uniform host access configuration with VPLEX Cross- Connect EMC GeoSynchrony 5.0 introduced the concept of a VPLEX Metro cluster with Cross- Connect. This configuration provides a perfect platform for a uniform vsphere stretched-cluster deployment. VPLEX Cross-Connect is designed to be deployed in a metropolitan-type topology with latency that does not exceed 1 ms round-trip time (RTT). ESXi hosts can access a distributed volume on the local VPLEX cluster and on the remote cluster in the event of a failure. When this configuration is used in conjunction with VPLEX Witness, ESXi hosts are able to survive through multiple types of failure scenarios. For example, in the event of a VPLEX cluster or back-end storage array 38 EMC Hybrid Cloud 2.5 with VMware

39 Chapter 4: Solution Design Considerations failure, the ESXi hosts can still access the second VPLEX cluster with no disruption in service. In the unlikely event that the preferred site fails, VPLEX Witness intervenes and ensures that access to the surviving cluster is automatically maintained. In this case, VMware vsphere HA automatically restarts all affected virtual machines. For more information about the different types of failure scenarios and their outcome, refer to: Using VPLEX Metro with VMWare High Availability and Fault Tolerance for Ultimate Availability VMware KB Topic : Implementing vsphere Metro Storage Cluster (vmsc) using EMC VPLEX Figure 17 shows a uniform deployment model with VPLEX Cross-Connect. Figure 17. Deployment model with VPLEX Cross-Connect This type of deployment is designed to provide the highest possible availability for an EMC Hybrid Cloud environment. It can withstand multiple failure scenarios including switch, VPLEX, and back-end storage at a single site with no disruption in service. Figure 17 also shows that all ESXi hosts are connected to the VPLEX clusters at both sites. This can be achieved in a number of ways: Merge switch fabrics by using Inter-Switch Link (ISL) technology used to connect local and remote SANs. Connect directly to the remote data center fabric without merging the SANs. For reasons of performance and availability, EMC recommends that separate host bus adapters be used for connecting to local and remote switch fabrics. Note: VPLEX Cross-Connect is configured at the host layer only and does not imply any cross connection of the back-end storage. The back-end storage arrays remain locally connected to their respective VPLEX clusters. EMC Hybrid Cloud 2.5 with VMware 39

40 Chapter 4: Solution Design Considerations From the host perspective, in the uniform deployment model with VPLEX Cross- Connect, the ESXi hosts are zoned to both the local and the remote VPLEX clusters. This is shown in Figure 18, which displays the VPLEX storage views for host DRM- ESXi088, physically located in Site 1 of our environment. Here the initiators for the host are registered and added to both storage views with the distributed device being presented from both VPLEX clusters. Figure 18. VPLEX storage views This configuration is transparent to the ESXi host. The remote distributed volume is presented as an additional set of paths. Figure 19 shows the eight available paths that are presented to host DRM-ESXi088, for access to the VPLEX distributed volume hosting datastore CC-Shared-M EMC Hybrid Cloud 2.5 with VMware

41 Chapter 4: Solution Design Considerations Figure 19. Datastore displayed in EMC Virtual Storage Integrator (VSI) The serial numbers of the arrays are different because four of the paths are presented from cluster-1; the remaining four are presented from cluster-2. By default, PowerPath/VE sets all VPLEX devices to the adaptive multipath policy. Neither the host nor the multipath software can by themselves distinguish between local and remote paths. This poses a potential impact on performance if remote paths are used for I/O in normal operations because of the cross-connect latency penalty. To prevent the host from accessing the remote paths during normal operation, EMC recommends that you enable the PowerPath/VE auto-standby mode. Figure 19 also shows auto-standby mode enabled on host DRM-ESXi088. PowerPath has automatically identified all remote paths and set them to standby (asb :prox). This level of automation would not be possible with the round-robin or fixed policies offered by the native multipathing software. PowerPath/VE groups paths internally by VPLEX cluster. The VPLEX cluster with the lowest minimum path latency is designated as the local/preferred VPLEX cluster, while the other VPLEX cluster within the VPLEX Metro system is designated as the remote/non-preferred cluster. A path associated with the local/preferred VPLEX cluster is put in active mode, while a path associated with the remote/non-preferred VPLEX cluster is put in auto-standby mode. This forces all I/O during normal operations to be directed towards the local VPLEX cluster. In the event of a failure where the paths to the local VPLEX cluster are lost, PowerPath activates the standby paths and the host remains up and running on the local site. EMC Hybrid Cloud 2.5 with VMware 41

42 Chapter 4: Solution Design Considerations 42 EMC Hybrid Cloud 2.5 with VMware

43 Chapter 5: VPLEX Automation with ViPR Chapter 5 VPLEX Automation with ViPR This chapter presents the following topics: Overview Discovering VPLEX with ViPR ViPR virtual arrays ViPR virtual pools ViPR tenants ViPR projects ViPR consistency groups Use cases EMC Hybrid Cloud 2.5 with VMware 43

44 Chapter 5: VPLEX Automation with ViPR Overview With the integration of ViPR with VPLEX Metro, the Continuous Availability for EMC Hybrid Cloud solution can orchestrate the on-demand provisioning of active/active storage across geographically dispersed sites. Using the ViPR plug-in for vco enables seamless integration between vcac and ViPR. A vsphere cluster spanning multiple sites is able to simultaneously run active workloads on both sites. This solution ensures that a highly resilient infrastructure is built that can withstand multiple disaster scenarios with little or no impact on business operations. With this functionality, the enterprise provides a simplified service to its end users while removing them from the underlying architecture. The integration of ViPR with VPLEX Metro for the solution requires that ViPR is configured and has discovered the following physical assets: Storage arrays EMC VPLEX VMware vcenter vsphere clusters ESXi hosts Fabric managers ViPR configuration This chapter does not discuss basic ViPR setup and discovery operations. This chapter focuses on the setup of the individual components needed for the creation of the Continuous Availability for EMC Hybrid Cloud solution. For detailed ViPR configuration information, refer to the EMC ViPR Installation and Configuration Guide. ViPR requires the following components: Physical devices Virtual arrays Virtual pools Consistency groups Tenant details Project details After ViPR is fully configured, VPLEX Local virtual storage and VPLEX Metro distributed storage can easily be provisioned to or removed from hosts. 44 EMC Hybrid Cloud 2.5 with VMware

45 Chapter 5: VPLEX Automation with ViPR To provision or remove VPLEX storage with ViPR, you can use the API, CLI, or built-in services under Block Storage Services and Block Protection Services from the ViPR Service Catalog GUI. You can perform the following operations from the ViPR Service Catalog: Create a block volume for a host Create block volumes Remove block volumes Expand a block volume Export a VPLEX volume Export a volume to a host Unexport a volume Change a virtual pool Change a virtual array The ViPR 2.0 suite has full support for VPLEX Metro clusters. ViPR is able to provision local and distributed storage in uniform deployments with VPLEX Cross-Connect. In a cross-connected environment, ViPR is able to zone host adapters and create distributed storage across both VPLEX clusters. Note: The new volume needs to be exported from both virtual arrays in order to be visible to all hosts in the ESXi stretched cluster. The dual export is automatically executed by the EMC Hybrid Cloud STaaS workflows. Discovering VPLEX with ViPR To use ViPR with VPLEX, you need to discover the back-end storage arrays, VPLEX clusters, hosts to which you intend to provision storage, and attached fabrics. For discovery and management activities, ViPR uses the VPLEX Element Manager API. ViPR treats the VPLEX systems as a storage system physical asset and, therefore, by default, automatically rediscovers them every 60 minutes. To discover a VPLEX system, you specify the following information in the ViPR UI, as shown in Figure 20: IP address of the VPLEX system s management server Port number for the API (443 by default) Credentials to access the system EMC Hybrid Cloud 2.5 with VMware 45

46 Chapter 5: VPLEX Automation with ViPR Figure 20. Add storage system After you save this information, ViPR automatically performs an initial discovery of both the VPLEX clusters. Figure 21 shows the discovered VPLEX clusters in our environment and the other storage arrays that are automatically discovered when you enter the SMI-S provider information into the storage providers. ViPR automatically discovers the remote system. The system name comprises the two VPLEX serial numbers. Figure 21. Discovered VPLEX clusters For more information about the ViPR discovery process, refer to the EMC ViPR Administrator Guide. 46 EMC Hybrid Cloud 2.5 with VMware

47 Chapter 5: VPLEX Automation with ViPR ViPR virtual arrays A virtual array is an abstract or logical array that you create to partition a virtual data center into a group of connected compute, network, and storage resources. A virtual data center is typically partitioned into virtual arrays for fault tolerance, network isolation, or tenant isolation. A virtual array can span multiple physical arrays; conversely, a physical array can be partitioned into multiple virtual arrays. Virtual arrays can also be connected through disaster recovery and high-availability links in environments using EMC RecoverPoint and VPLEX Metro configurations. As shown in Figure 22, a virtual array is defined by network connectivity and includes: SAN switches/fabric managers within the networks IP networks connecting the storage systems and hosts Host and storage ports connected to the networks ViPR virtual pools In addition to network connectivity, a virtual array is associated with one or more virtual pools. Figure 22. ViPR virtual data center EMC Hybrid Cloud 2.5 with VMware 47

48 Chapter 5: VPLEX Automation with ViPR After ViPR fully discovers the physical assets, you must then create virtual arrays and virtual pools. Each virtual array you create should contain both the VPLEX cluster and the block arrays that are local to it, that is, those to which it is physically connected and zoned. There must be at least one virtual array for each VPLEX cluster. By configuring the virtual array this way, ViPR knows where to get the back-end storage and which VPLEX cluster to use when block storage with VPLEX is requested. Note: Proper planning is essential because it is not possible to change the configuration after resources have been provisioned without first disruptively removing the provisioned volumes. Within the Continuous Availability for EMC Hybrid Cloud solution, we have defined two virtual arrays, as shown in Figure 23. We deployed two block virtual arrays, each abstracting a VPLEX cluster at a specific site. Figure 23. Virtual arrays The VA-S1 instance comprises storage networks, ports, and pools associated with the physical storage arrays on Site 1, as shown in Figure EMC Hybrid Cloud 2.5 with VMware

49 Chapter 5: VPLEX Automation with ViPR Figure 24. Details of VA-S1 You can configure ViPR to handle all zoning operations by setting it to automatic mode. Because this may not be suitable for all deployments, manual mode is also available. When a storage network is associated with the virtual array, ViPR automatically discovers all of the physical arrays and their associated ports and pools. When you create a virtual array, you must manually select individual storage and VPLEX ports and add them to the virtual array. This method must be used to select individual ports from the back-end array that have been specifically designated for use with VPLEX protected storage. Both the back-end and front-end ports from the VPLEX and the ports from the appropriate back-end array should be added to the virtual array. The same virtual array must not and cannot contain ports from both VPLEX clusters. This is required to differentiate each cluster in each site and ensure that the correct back-end storage array is used in conjunction with the VPLEX cluster in the same geographical location. EMC Hybrid Cloud 2.5 with VMware 49

50 Chapter 5: VPLEX Automation with ViPR ViPR virtual pools Virtual pools are sets of file and block storage capabilities used to abstract the physical storage layer. Virtual pools can be designed to meet various service levels, availability requirements, and cost requirements. Rather than provisioning storage on physical arrays, virtual pools are used to meet the storage requirements. This solution uses the ViPR API, which is integrated with the ViPR plug-in for vco and vcac. This enables you to provision local or distributed storage in a manner abstracted from the individual physical pools of storage, and based instead on the functionality of the virtual storage pool. You create and configure the virtual pools within a virtual data center. You define a set of storage service capabilities (such as type of storage (file or block), size of storage, availability, and performance characteristics), and then associate it with physical storage pools on the arrays managed by ViPR. You must properly set up the virtual pools because they are the drivers for all future provisioning tasks performed by end users. Note: After you provision storage from a particular virtual pool, changes permitted to that pool are limited. For example, a virtual pool can be modified by adding more storage pools. However, other options, such as hardware and SAN multipath, cannot be modified. Virtual pools for block storage offer two options under High Availability: VPLEX local and VPLEX distributed. When you specify local high availability for a virtual pool, the ViPR storage provisioning services create VPLEX local virtual volumes. If you specify VPLEX distributed high availability for a virtual pool, the ViPR storage provisioning services create VPLEX distributed virtual volumes. To configure a VPLEX distributed virtual storage pool through ViPR: 1. Ensure a virtual array exists for both sites, with the relevant physical arrays associated with those virtual arrays. Each VPLEX cluster must be a member of the virtual array at its own site only. 2. Before creating a VPLEX Metro Virtual Pool at the primary site, first create a VPLEX local pool at the secondary site. This is used as the target virtual pool when creating VPLEX Distributed virtual volumes. 3. When creating the VPLEX distributed volume on the source site, select the Storage Pool in the primary site, the remote virtual array, and the remote VPLEX local pool. This pool is used to create the remote mirror volume that makes up the remote portion of the VPLEX virtual volume. VPLEX Distributed ViPR Virtual Storage Pool 1, as shown in Figure 25, represents this configuration. 50 EMC Hybrid Cloud 2.5 with VMware

51 Chapter 5: VPLEX Automation with ViPR Figure 25. Interactions between VPLEX local and VPLEX distributed pools Figure 26 shows the ViPR virtual pools that we created in the ViPR instance. Not shown are details such as pools, pool assignment, protocols, and the number of resources provisioned. Figure 26. Block virtual pools For the Continuous Availability for EMC Hybrid Cloud solution, we implemented the following design: VPLEX Site 2 Local pool used for VPLEX Site 2 volume creation and as the HA pool in the distributed configuration. This is used as the target for the VPLEX METRO pool. VPLEX METRO Distributed pool used for distributed volume creation. This pool uses the VPLEX Site 2 pool as the HA site. Figure 26 also shows an additional pool labeled VPLEX Site 1. VPLEX is capable of either site being the primary leg of a distributed volume. If volumes were created where the remote site was the primary leg, this pool would be used to store the secondary legs of those volumes. In our example, this pool remains unused. To create a VPLEX local high availability virtual pool: 1. Select the virtual array with which the virtual pool will be associated. 2. Under Hardware, select Multi-Volume Consistency to ensure resources provisioned from this pool supports the use of consistency groups. (For more information, refer to ViPR consistency groups.) EMC Hybrid Cloud 2.5 with VMware 51

52 Chapter 5: VPLEX Automation with ViPR 3. Specify the required characteristics for the back-end storage volumes that ViPR creates and that serve as the VPLEX local virtual volumes. 4. Select VPLEX Local for High Availability as shown in Figure 27. Figure 27. Create a virtual pool with VPLEX local high availability 5. Within Storage Pools, select Manual under Pool Assignment if you want to manually manage the storage pools from which storage will be consumed. To have ViPR manage the storage pools, leave the setting as Automatic. 6. Click Save. To create a VPLEX distributed high availability virtual pool: 1. Select the virtual array with which the virtual pool will be associated. 2. Under Hardware, select Multi-Volume Consistency to ensure resources provisioned from this pool will support the use of consistency groups. 3. Specify the required characteristics for the back-end storage volumes that ViPR creates and that serve as the VPLEX distributed virtual volumes. 4. Select VPLEX Distributed for High Availability as shown in Figure EMC Hybrid Cloud 2.5 with VMware

53 Chapter 5: VPLEX Automation with ViPR Figure 28. Create a virtual pool with VPLEX distributed high availability 5. Within Storage Pools, select Manual under Pool Assignment if you want to manually manage the storage pools from which storage will be consumed. To have ViPR manage the storage pools, leave the setting as Automatic. 6. Click Save. ViPR tenants ViPR is designed to operate in a multitenant environment. A tenant represents an organization operating within the ViPR virtual data center. Tenants are created in the ViPR virtual data center to isolate organizations from each other in a cloud serviceprovider infrastructure. Each tenant is configured with its own list of mapped users, who are authenticated to perform provisioning operations within that tenant. When a tenant administrator creates a tenant, the administrator maps the users into the tenant by specifying the user domains, user attributes, or group memberships that exist in the ViPR virtual data center. These domains and user groups are available in the ViPR virtual data center because the security administrator adds users into the system by accessing existing Active Directory or Lightweight Directory Access Protocol (LDAP) accounts. These Active Directory or LDAP user groups, domains, and attributes are specified in the authentication provider s set up by the security administrator to bring users into the entire virtual data center. The tenant administrator uses the existing user domains and related user attributes to specify which groups of users the administrator wants to map into the tenant. The ViPR virtual data center is organized such that there is a root tenant called the provider tenant. The provider tenant would be the cloud service provider in a public cloud deployment or potentially an entire enterprise IT organization in a hybrid cloud deployment. The provider tenant could remain largely unused except for the actual creation of new distinct tenants for the applicable organization. EMC Hybrid Cloud 2.5 with VMware 53

54 Chapter 5: VPLEX Automation with ViPR A user with the tenant administrator role, may create tenants under the provider root tenant, where each tenant is configured with its own list of mapped users who are allowed to operate within the tenant. Note: In API and CLI, tenants are referred to as subtenants. A tenant has a maximum total storage capacity (quota) associated with it that cannot be exceeded. The used and maximum total capacity values for a tenant are included in ViPR metering records. Tenant access to virtual arrays and virtual pools can be controlled by an Access Control List (ACL). Virtual arrays and virtual pools are accessible to all tenants by default. However, a system or security administrator can assign an ACL to a virtual array or virtual pool to restrict their use to specified tenants only. To set up a tenant, ViPR needs the authentication provider to be set up first, followed by tenant creation and role assignments. Figure 29 shows the authentication provider we set up in the solution environment. Figure 29. Authentication providers Figure 30 and Figure 31 show the tenant details and role assignments for the authentication provider we set up in the solution environment. 54 EMC Hybrid Cloud 2.5 with VMware

55 Chapter 5: VPLEX Automation with ViPR Figure 30. Tenant details Figure 31. Role assignments ViPR projects A ViPR project is a logical grouping of resources mapped to applications, virtual data centers, departments, or other entities meaningful to the user. Users can create their own projects within their tenant, and they can provision multiple storage resources from different data services to their projects (for example, storage volumes, file systems, or objects such as files or images). Resources from one project can be shared between users under the same tenant. Examples of using projects include: A user creates a project for a photo-album application and provisions one block volume for a user account database and one datastore for storing the pictures. A user creates a project named VDC Datastores and provisions it into multiple volumes for use by the ESX cluster. A tenant administrator creates a project for use by a specific department. EMC Hybrid Cloud 2.5 with VMware 55

56 Chapter 5: VPLEX Automation with ViPR ViPR consistency groups Use cases Only tenant administrators and project administrators can create projects. One level of projects can be created under a tenant. A tenant administrator has full management access to all projects within the tenant. A project administrator can create projects but cannot manage the resources within the project. A project has a maximum total storage capacity (quota) associated with it that cannot be exceeded. The used and maximum total capacity values for a project are included in ViPR metering records. Consistency groups are an important component of the Continuous Availability for EMC Hybrid Cloud solution. Consistency groups aggregate volumes together to ensure a set of common properties is applied to the entire group of volumes during a fault event. This ensures that host-cluster or application-level consistency is achieved and no critical virtual volumes are left behind when a failover occurs. VPLEX Witness helps multi-cluster VPLEX configurations automate the response to cluster failures and inter-cluster link outages. VPLEX Witness connects to both VPLEX clusters over the management IP network and observes the state of the clusters. VPLEX Witness can distinguish between an outage of the inter-cluster link and a cluster failure and uses this information to guide the clusters to resume or suspend I/O operations. In this solution, ViPR uses VPLEX consistency groups created within the ViPR project associated with the tenant during VPLEX distributed virtual volume provisioning. The VPLEX cluster that is in the virtual array used for the provisioning task is configured to be the winning cluster that continues I/O operations in the event of an inter-cluster link failure. Use case 1: Storage provisioning This use case demonstrates how ViPR continuously available software-defined storage is provisioned for the hybrid cloud from the VMware vcac Self-Service Catalog. VMware vcac IaaS users can provision continuously available storage from the vcac Self-Service Portal, where they can select the storage provisioning item from the vcac Self-Service Catalog, as shown in Figure EMC Hybrid Cloud 2.5 with VMware

57 Chapter 5: VPLEX Automation with ViPR Figure 32. Storage Services: Provision cloud storage The storage service blueprint can be created using vcac anything-as-a-service (XaaS) functionality in the vcac Advanced Service Designer. EMC ViPR provisioning workflows, which are presented by vco to the vcac service catalog, support storage services. The storage provisioned by the IaaS user enables the fabric group administrator to make storage resources available to their business group. The storage provisioning request requires very little input from the vcac IaaS user. The main inputs required are: vcenter cluster (select the relevant CA-enabled ESXi cluster) Storage type: VMFS CA-Enabled Storage tier Datastore size Most of these inputs, except datastore size, are selected from lists whose items are determined by the cluster resources available through vcenter and the virtual pools available in ViPR. vcenter cluster After the user has entered a description and reason for the storage-provisioning request, the user is prompted to enter a password and presented with the Choose vcenter Cluster option, as shown in Figure 33. EMC Hybrid Cloud 2.5 with VMware 57

58 Chapter 5: VPLEX Automation with ViPR Figure 33. Provision cloud storage: Select vcenter cluster vcenter Server manages multiple ESXi clusters; therefore, the correct vcenter cluster must be selected to instruct the provisioning operation where to assign the storage device. Storage type The user can select which type of datastore is required from a list, based on the storage types in the underlying infrastructure. A datastore type of VMFS requires block storage, while NFS requires file storage. Other data services such as disaster recovery and continuous availability are displayed only if they are detected in the underlying infrastructure. In this case, only VMFS CA-Enabled is applicable as shown in Figure 34. Figure 34. Storage provisioning: Select datastore type Storage Tier On Storage Tier, the user must select the storage tier from which the new storage device should be provisioned. The list of available tiers is based on the storage type selected, such as VMFS or NFS, and what matching virtual pools are available from the ViPR virtual array. 58 EMC Hybrid Cloud 2.5 with VMware

59 Chapter 5: VPLEX Automation with ViPR In this example, a single VPLEX Metro-based ViPR virtual pool is available from which to provision storage, with the available capacity of the virtual pool also displayed to the user, as shown in Figure 35. Figure 35. vcac storage provisioning: Choose ViPR storage pool These storage tiers have been configured in the ViPR virtual array and their storage capabilities are associated with storage profiles created in vcenter. Datastore size On Datastore Size, the user must enter the size required for the new storage, which is measured in GB, as shown in Figure 36. Figure 36. Storage provisioning: Enter storage size Additional steps In this example, a number of required input variables, such as LUN or datastore name, have been masked from the user during the storage provisioning request process. Some of these values are locked in and managed by the orchestration process and logic to ensure consistency. Beyond the initial provisioning of storage to the ESXi cluster at the vsphere layer, this solution provides further automation and integration of the new storage into the vcac layer. The ViPR storage provider automatically tags the storage device with the appropriate storage profile based on its storage capabilities. EMC Hybrid Cloud 2.5 with VMware 59

60 Chapter 5: VPLEX Automation with ViPR The remaining automated steps in this solution are: vcac rediscovers the resources under the vcenter endpoint vcac storage reservation policy is assigned to the new datastore vcac fabric group administrator is notified of the availability of a new datastore In the last manual step, the fabric group administrator reserves the new storage for use by the business group, as shown in Figure 37. Figure 37. Storage provisioning: Storage reservation for vcac business group The automated process sends an notification to the fabric group administrator that the storage is ready and available in vcac. The administrator can then assign capacity reservations on the device for use by the business group. Use case 2: Select virtual machine storage This use case demonstrates how cloud users can consume the available storage service offerings. This use case is part of the broader virtual machine deployment use case, but it is highlighted here because it relates directly to how the business group manager and users can manage the storage service offerings available to them. VMware vcac business group managers and users can select the appropriate storage for their virtual machine through the VMware vcac user portal. For business group managers, the storage type for the VMDKs can be set during the creation of a virtual machine blueprint. As shown in Figure 38, the appropriate storage reservation policy can be applied to each of the virtual disks. 60 EMC Hybrid Cloud 2.5 with VMware

61 Chapter 5: VPLEX Automation with ViPR Figure 38. Set storage reservation policy for VMDKs When the storage reservation policy is set, the blueprint will always deploy this virtual machine and its virtual disks to that storage type. If more user control is required at deployment time, the business group manager can permit business group users to reconfigure the storage reservation policies at deployment time by selecting Allow users to see and change storage reservation policies. EMC Hybrid Cloud 2.5 with VMware 61

62 Chapter 5: VPLEX Automation with ViPR 62 EMC Hybrid Cloud 2.5 with VMware

63 Chapter 6: Backup in a CA Environment Chapter 6 Backup in a CA Environment This chapter presents the following topics: Overview Backup architecture in a Continuous Availability environment Replication of Backup Data CA Backup Use Cases EMC Hybrid Cloud 2.5 with VMware 63

64 Chapter 6: Backup in a CA Environment Overview This modular add-on for continuous availability extends the services documented in the EMC Hybrid Cloud 2.5 with VMware: Data Protection Backup Solution Guide, which discusses the general considerations for implementing data protection in an EMC Hybrid Cloud by using the features and functionality of Avamar, Data Domain, and Data Protection Advisor. This section focuses on the additional considerations that are relevant to doing the same thing in the context of a Continuous Availability environment Backup and recovery of a multitenant hybrid cloud is a complicated endeavor in which many factors must be considered, including: Backup type and frequency Impact and interaction with replication Recoverability methods and requirements Retention periods Implementation in an HA/DR-enabled environment Automation workflows Interface methods (workflows, APIs, GUI, CLI, scripts, and so on) VMware vco, which is central to all of the customizations and operations used in this solution, manages operations across several EMC and VMware products, including: VMware vcac VMware vcenter EMC Avamar and Data Protection Advisor This solution focuses on the management and automation aspects of a hybrid cloud, and the data protection implementation that is described represents one possible way of meeting the requirements. EMC strongly recommends that you engage an Avamar product specialist to design, size, and implement a solution specific to your environment and business needs. Key backup components EMC Avamar backup and recovery Avamar backup and recovery is a fast, efficient system that is provided through a complete software and hardware solution. Equipped with integrated variable-length deduplication technology, Avamar backup and recovery software provides integrated source and global data deduplication, which facilitates fast, daily full backups for hybrid cloud environments. EMC Data Domain system With Avamar backup and recovery, you can choose to direct backups to an Data Domain system instead of to the Avamar server. Data Domain deduplication storage systems deduplicate data inline, so that it lands already deduplicated on disk and requires less disk space than the original dataset. With the Data Domain system, you can retain backup and archived data onsite longer to enable quick and reliable data restores from disk. 64 EMC Hybrid Cloud 2.5 with VMware

65 EMC Data Protection Advisor software Chapter 6: Backup in a CA Environment With DPA software, you can automate and centralize the collection and analysis of all data across backup applications, replication technologies, the virtual environment, and supporting infrastructure. This provides a single, comprehensive view of your data protection environment and activities. DPA provides a REST API that is used to integrate with vco to provide on-demand reporting of backup statistics and performance. EMC data protection workflows for vcenter Orchestrator EMC has created data protection workflows for vco to automate Avamar and Data Domain protection of virtual machines. These workflows are added to the vcac virtual machine provisioning blueprints so that users can easily set up protection at provisioning time. In addition, workflows can be used to enable simple or point-intime restores for a specific virtual machine. Infrastructure administrators can also use the data protection workflows to carry out the complete protection policy setup on Avamar and vcenter systems, to facilitate quick and easy deployment of the infrastructure needed to support all of the end-user protection needs. Backup architecture in a Continuous Availability environment EMC Avamar is capable of bi-directional replication between multiple Avamar instances. This lends itself well to protecting backup data by replicating backups to the secondary data center in a continuous availability environment. Backup clients should ideally be backed up to a local target, which usually has better bandwidth and lower latency. Avamar deduplicates data during the initial backup process, making it an efficient model for subsequent replication of that data across a WAN connection. Backing up with dual Avamar instances This solution uses a dual Avamar configuration with replication of backup sets between sites controlled by Avamar replication technology. EMC Hybrid Cloud EMC Hybrid Cloud uses the concepts of primary and secondary Avamar instances, and the ability to reverse these personalities so that, in the event of a failure, backup and restore operations can continue. The primary Avamar instance is the instance where all scheduled backups are executed. It is also the instance that the EMC Hybrid Cloud on-demand backup and restore features communicate with in response to dynamic user requests. The primary Avamar instance also has all the currently active replication groups, making it responsible for replication of new backup sets to the secondary Avamar instance. The secondary Avamar instance has all the same configurations with respect to backup and replication policies. They are however initially configured in a disabled state by the EMC Hybrid Cloud workflows. Should the primary Avamar instance become unavailable, the policies on the secondary Avamar instance can be enabled to allow backup and replication operations to continue. Note: Replication operations do not catch up until the original primary Avamar instance (now designated as secondary) becomes available again, at which time replication automatically transmits newer backup sets to the secondary system. EMC Hybrid Cloud 2.5 with VMware 65

66 Chapter 6: Backup in a CA Environment In this solution, after a dual Avamar configuration is enabled, the EMC Hybrid Cloud workflows configure all subsequent backups with replication enabled. Figure 39 shows the architecture and data flows for a dual-site Avamar/Data Domain backup architecture. Figure 39. Dual Avamar backup architecture Avamar and Data Domain integration with VMware Avamar is integrated with VMware VADP, which enables seamless integration into cloud environments, and provides backup capabilities using the Changed Block Tracking (CBT) feature within the API. The virtual machine instant-access capability in EMC Avamar 7.0 enables you to use the flexibility of the Data Domain systems, where you can boot and run a virtual machine from a backup image in seconds. Combining these features with the Avamar deduplication process results in much less data travelling through the virtual and physical network, and greatly reduces the amount of data being physically stored. When you select a Data Domain system as the backup target, backup data is transferred directly to the Data Domain system. The related metadata generated by the Avamar client software is simultaneously sent to the Avamar server for storage. 66 EMC Hybrid Cloud 2.5 with VMware

67 Chapter 6: Backup in a CA Environment The metadata enables the Avamar management system to perform restore operations directly from the Data Domain system without first going through the Avamar server. Avamar client registrations In this solution, when an end-user resource virtual machine is enabled for backup, the EMC Hybrid Cloud workflows automatically register the virtual machine with both the primary and secondary Avamar instances, making them a part of the relevant backup and replication policies on both sites. This permits the secondary Avamar instance to assume responsibility for scheduled and on-demand backups should the primary fail. During on-demand restore operations, the EMC Hybrid Cloud workflows interact with the Avamar instance currently designated as the primary, and present a consolidated list of backups taken over time, automatically handling the restore process from the back end to the target virtual machine. This means that backups taken on either site are then visible (once replicated) and associated with the virtual machine irrespective of which site that virtual machine is currently running on. Virtual machines are always restored from data on the Avamar instance designated as the primary instance. Avamar proxy server configuration EMC recommends that a minimum of two Avamar proxy virtual appliance be deployed per CA-enabled cluster in vcenter (one per site), assuming that each cluster has a unique set of LUNs or vsphere datastores. To avoid backup over the WAN, keep the Avamar Proxy virtual appliances bound to their respective site by deploying them to non-vplex-enabled datastores or by setting VMware vsphere Distributed Resource Scheduler (DRS) affinity rules on the cluster. If you use affinity rules, then EMC recommends that: Affinity rules are configured to ensure that half the Avamar proxies remain bound to the hosts on Site A, and the other half bound to the hosts on Site B. Anti-affinity rules are configured on each site to ensure that the proxies bound to that site are distributed among the hosts on that site. Each proxy appliances should be registered with the Avamar server local to its own site. One Avamar proxy virtual appliance registers eight proxy clients to the Avamar server. The backup or Avamar administrator can configure Avamar proxy clients to be dedicated to specific backup service levels if required. By default, the Avamar proxy clients are available to service operations of all backup service levels and are automatically selected at the time of backup. When a new storage device is created and assigned to a vsphere cluster, the EMC Hybrid Cloud STaaS workflows automatically add the relevant datastore to the list of datastores protected by the Avamar proxy servers. EMC Hybrid Cloud 2.5 with VMware 67

68 Chapter 6: Backup in a CA Environment Replication of Backup Data Avamar replication The Avamar replication process copies client backups from a source Avamar server to a destination Avamar server. This enables you to avoid data loss if the source Avamar server fails, as the backup sets are still available via the surviving Avamar server. Avamar replication is supported irrespective of whether the backup data is being stored on an Avamar Data Store or on Data Domain nodes. The replication between primary and replica Data Domain systems is integrated into the Avamar management feature set and is configured via the Avamar Administrator through the Avamar replication policies that are applied to each dataset. When you use a Data Domain system with Avamar, the replication process transfers Avamar data from the source Data Domain system to a destination Data Domain system. When an Avamar system is configured to use a Data Domain system, there must be a corresponding Data Domain system configured within the destination Avamar server or replication will fail for backups sent to the source Data Domain system. Avamar replicates the data directly from one Data Domain system to another. Avamar does not stage the data on the Avamar server before replicating the data to the destination Data Domain system. This requires that the source and destination Data Domain systems have network connectivity across the WAN. Policy-based replication Policy-based replication provides granular control of the replication process. With policy-based replication, you create replication groups in Avamar Administrator to define the following replication settings: Members of the replication group, which are either entire domains or individual clients Priority for the order in which backup data replicates Types of backups to replicate based on the retention setting for the backup or the date on which the backup occurred Maximum number of backups to replicate for each client Destination server for the replicated backups Schedule for replication Retention period of replicated backups on the destination server Backup service-level creation is covered in detail in EMC Hybrid Cloud 2.5 with VMware: Data Protection Backup Solution Guide. This solution extends that process by creating a replication group associated with each backup policy and configuring it with a 60-minute stagger to the interval associated with the backup policy. This allows the backups to complete before the replication starts. Note: This schedule can be manually altered within the Avamar GUI if required, but it is important that changes are made to both the primary and secondary versions of the replication group schedule so that replication will operate as required should the Avamar personalities be reversed. 68 EMC Hybrid Cloud 2.5 with VMware

69 Chapter 6: Backup in a CA Environment Replication control Avamar is responsible for replication of Avamar data from the source Data Domain system to the destination Data Domain system. As a result, all configuration and monitoring of replication is done via the Avamar server. This includes the schedule on which Avamar data is replicated between Data Domain units. You cannot schedule replication of data on the Data Domain system separately from the replication of data on the Avamar server. There is no way to track replication by using Data Domain administration tools. Note: Do not configure Data Domain replication to replicate data to another Data Domain system that is configured for use with Avamar. When you use Data Domain replication, the replicated data does not refer to the associated remote Avamar server. CA Backup Use Cases Use Case 1: On- Demand Backup This use case describes how a cloud user can request an on-demand backup of a virtual machine, whenever required, from the vcac self-service portal. The user does not have to wait for the completion of the backup task. An notification of the backup status is automatically generated when the task is completed, whether the task succeeded or failed. After logging in to the vcac self-service portal, a cloud user can select On Demand Backup from the Actions dropdown list for a virtual machine, as highlighted in Figure 40. Figure 40. Select on-demand backup for the virtual machine When the task is completed, the user receives an automated notification with the status of the task. The status workflow runs asynchronously; therefore, the user does not need to wait for the completion status of the backup. EMC Hybrid Cloud 2.5 with VMware 69

70 Chapter 6: Backup in a CA Environment Use Case 2: On- Demand Restore Restore points of a virtual machine fall into one of two categories: Backups performed locally to the primary Avamar system. Replicated backups from the secondary Avamar system where, at some point, the backups were performed on the secondary instance and later replicated to the primary. During an on-demand restore operation, EMC Hybrid Cloud workflows dynamically interrogate the primary Avamar instance for relevant backups of both types and present a consolidated list of backups for the user to choose from as shown in Figure 41. Figure 41. Consolidated list of backup points Restore points that are taken to the other Avamar instance and replicated to the system currently designated as primary, have REPLICATED appended to the end of the backup details. Based on the choice the user makes, the EMC Hybrid Cloud workflows execute the relevant restore tasks to return the virtual machine to the correct point in time. Regardless of where the backup is taken (that is, to which Avamar instance) the data will always be restored from the Avamar system currently configured as the primary. Use Case 3: Toggling Avamar Designations The Toggle Avamar Designations catalog entry should be used in the event of a failure or planned failover of the primary Avamar instance enabling you to reconfigure the personalities of the primary and secondary Avamar instances as shown in Figure 42. When executed, this service enables the backup and replication policies are enabled on the system chosen to be the primary Avamar instance, and disables the backup and replication policies on the system chosen to be the secondary. Every on-demand backup and restore operation first checks to see which system is primary before executing the relevant tasks. 70 EMC Hybrid Cloud 2.5 with VMware

71 Chapter 6: Backup in a CA Environment Figure 42. Setting the primary and secondary Avamar instances If the original primary Avamar system is offline due to unit or site failure, then the Toggle Avamar Designations service will still enable the polices on the surviving Avamar instance once it is chosen as the primary. The Toggle Avamar Designations service will, however, be unable to disable the backup and replication policies on the secondary (unavailable) unit until such time as the unit is back online. When that occurs, you can run the Remediate Secondary Avamar Policies workflow to correct the status of the policies on that instance. Use Case 4: Remediate Secondary Avamar Policies In the event that the Toggle Avamar Designations catalog item is executed when one of the Avamar instances is offline, you must ensure that the backup and replication policies on that unit are disabled when the unit comes back online; otherwise, both Avamar instances will attempt to execute parallel scheduled backups of the virtual machines. The Remediate Secondary Avamar Policies catalog item shown in Figure 43 requires no further input. It automatically interrogates the Avamar instance designated as the secondary within the EMC Hybrid Cloud and disables all the backup and replication policies so that its only function is to receive backup replicas from the primary. EMC Hybrid Cloud 2.5 with VMware 71