DELL EMC DATA DOMAIN BOOST AND DYNAMIC INTERFACE GROUPS

Similar documents
Customer Onboarding with VMware NSX L2VPN Service for VMware Cloud Providers

DELL EMC DATA DOMAIN SECURE MULTI-TENANCY

DELL EMC DATA DOMAIN EXTENDED RETENTION SOFTWARE

Surveillance Dell EMC Storage with Aimetis Symphony

Never Drop a Call With TecInfo SIP Proxy White Paper

Virtualization with Protection for SMBs Using the ReadyDATA 5200

DELL EMC DATA DOMAIN OPERATING SYSTEM

Executive Summary. The Need for Shared Storage. The Shared Storage Dilemma for the SMB. The SMB Answer - DroboElite. Enhancing your VMware Environment

Dell EMC Data Domain Boost for Partner Integration

Dell EMC Oracle RMAN Agent

EMC DATA DOMAIN OPERATING SYSTEM

Advanced Architecture Design for Cloud-Based Disaster Recovery WHITE PAPER

Deploy Microsoft SQL Server 2014 on a Cisco Application Centric Infrastructure Policy Framework

TECHNICAL BRIEF. 3Com. XRN Technology Brief

Enterprise print management in VMware Horizon

WHY SECURE MULTI-TENANCY WITH DATA DOMAIN SYSTEMS?

Surveillance Dell EMC Isilon Storage with Video Management Systems

Business Benefits of Policy Based Data De-Duplication Data Footprint Reduction with Quality of Service (QoS) for Data Protection

EMC Data Domain Boost for Partner Integration

Address new markets with new services

vsan Remote Office Deployment January 09, 2018

vsphere Networking Update 1 ESXi 5.1 vcenter Server 5.1 vsphere 5.1 EN

Surveillance Dell EMC Isilon Storage with Video Management Systems

DELL EMC DATA DOMAIN OPERATING SYSTEM

DELL EMC DATA DOMAIN ENCRYPTION

Maximum Availability Architecture: Overview. An Oracle White Paper July 2002

GUIDE. Optimal Network Designs with Cohesity

TALK THUNDER SOFTWARE FOR BARE METAL HIGH-PERFORMANCE SOFTWARE FOR THE MODERN DATA CENTER WITH A10 DATASHEET YOUR CHOICE OF HARDWARE

Native vsphere Storage for Remote and Branch Offices

Ethernet Network Redundancy in SCADA and real-time Automation Platforms.

DELL EMC VxRAIL vsan STRETCHED CLUSTERS PLANNING GUIDE

MASERGY S MANAGED SD-WAN

How to Protect SAP HANA Applications with the Data Protection Suite

DATA DOMAIN INVULNERABILITY ARCHITECTURE: ENHANCING DATA INTEGRITY AND RECOVERABILITY

USING ISCSI AND VERITAS BACKUP EXEC 9.0 FOR WINDOWS SERVERS BENEFITS AND TEST CONFIGURATION

White paper: Agentless Backup is Not a Myth. Agentless Backup is Not a Myth

VMWARE PROTECTION WITH DELL EMC NETWORKER 9

WAN Cost Savings Report From Talari. This custom report was created for: Quinn Philips, Cogent ROI - December 15, 2015.

VxRack System SDDC Enabling External Services

vsphere Networking Update 2 VMware vsphere 5.5 VMware ESXi 5.5 vcenter Server 5.5 EN

DELL EMC UNITY: REPLICATION TECHNOLOGIES

Copyright 2010 EMC Corporation. Do not Copy - All Rights Reserved.

Microsoft E xchange 2010 on VMware

IBM Spectrum Protect Version Introduction to Data Protection Solutions IBM

Securely Access Services Over AWS PrivateLink. January 2019

Virtualization And High Availability. Howard Chow Microsoft MVP

Seven Criteria for a Sound Investment in WAN Optimization

Deploying enterprise applications on Dell Hybrid Cloud System for Microsoft Cloud Platform System Standard

EMC Data Domain Boost for OpenStorage

IBM Tivoli Storage Manager Version Introduction to Data Protection Solutions IBM

Veeam Availability Solution for Cisco UCS: Designed for Virtualized Environments. Solution Overview Cisco Public

ELASTIC DATA PLATFORM

Building Backup-to-Disk and Disaster Recovery Solutions with the ReadyDATA 5200

Bringing OpenStack to the Enterprise. An enterprise-class solution ensures you get the required performance, reliability, and security

Hyperconverged Infrastructure: Cost-effectively Simplifying IT to Improve Business Agility at Scale

Citrix SD-WAN for Optimal Office 365 Connectivity and Performance

TECHNICAL OVERVIEW OF NEW AND IMPROVED FEATURES OF DELL EMC ISILON ONEFS 8.0

EMC Solutions for Backup to Disk EMC Celerra LAN Backup to Disk with IBM Tivoli Storage Manager Best Practices Planning

F5 Networks F5LTM12: F5 Networks Configuring BIG-IP LTM: Local Traffic Manager. Upcoming Dates. Course Description. Course Outline

Real-time Protection for Microsoft Hyper-V

NAS When, Why and How?

Brocade Virtual Traffic Manager and Parallels Remote Application Server

Asigra Cloud Backup Provides Comprehensive Virtual Machine Data Protection Including Replication

Administering Cloud Pod Architecture in Horizon 7. Modified on 4 JAN 2018 VMware Horizon 7 7.4

See what s new: Data Domain Global Deduplication Array, DD Boost and more. Copyright 2010 EMC Corporation. All rights reserved.

Inside SD-WAN: WAN Virtualization Traffic Routing Options

OpenStack and Hadoop. Achieving near bare-metal performance for big data workloads running in a private cloud ABSTRACT

Preserving the World s Most Important Data. Yours. SYSTEMS AT-A-GLANCE: KEY FEATURES AND BENEFITS

SwiftStack and python-swiftclient

SAN Design Best Practices for the Dell PowerEdge M1000e Blade Enclosure and EqualLogic PS Series Storage (1GbE) A Dell Technical Whitepaper

Stateful Failover Technology White Paper

MIGRATING TO DELL EMC UNITY WITH SAN COPY

Dell EMC SAN Storage with Video Management Systems

Vendor: EMC. Exam Code: E Exam Name: Cloud Infrastructure and Services Exam. Version: Demo

Dell EMC Unity Family

DISASTER RECOVERY- AS-A-SERVICE FOR VMWARE CLOUD PROVIDER PARTNERS WHITE PAPER - OCTOBER 2017

vsphere Networking Update 1 Modified on 04 OCT 2017 VMware vsphere 6.5 VMware ESXi 6.5 vcenter Server 6.5

20 Fast Facts About Microsoft Windows Server 2012

EMC Celerra Replicator V2 with Silver Peak WAN Optimization

Optimizing and Managing File Storage in Windows Environments

iscsi Technology Brief Storage Area Network using Gbit Ethernet The iscsi Standard

Carbonite Availability. Technical overview

VMware vsphere Clusters in Security Zones

Protecting Mission-Critical Application Environments The Top 5 Challenges and Solutions for Backup and Recovery

DELL EMC DATA DOMAIN SISL SCALING ARCHITECTURE

TOP REASONS TO CHOOSE DELL EMC OVER VEEAM

INTRODUCTORY Q&A AMX SVSI NETWORKED AV

ACANO SOLUTION RESILIENT ARCHITECTURE. White Paper. Mark Blake, Acano CTO

Barracuda Link Balancer

CENTRALIZED MANAGEMENT DELL POWERVAULT DL 2100 POWERED BY SYMANTEC

Chapter 4. Fundamental Concepts and Models

Avoiding the Cost of Confusion: SQL Server Failover Cluster Instances versus Basic Availability Group on Standard Edition

IBM SmartCloud Resilience offers cloud-based services to support a more rapid, reliable and cost-effective enterprise-wide resiliency.

A Guide to Architecting the Active/Active Data Center

vsan Security Zone Deployment First Published On: Last Updated On:

Who Better than Dell EMC to Offer Best-for-VMware Data Protection?

Become a MongoDB Replica Set Expert in Under 5 Minutes:

ENHANCE APPLICATION SCALABILITY AND AVAILABILITY WITH NGINX PLUS AND THE DIAMANTI BARE-METAL KUBERNETES PLATFORM

Citrix NetScaler LLB Deployment Guide

SD-WAN Deployment Guide (CVD)

Transcription:

WHITE PAPER DELL EMC DATA DOMAIN BOOST AND DYNAMIC INTERFACE GROUPS Maximize the efficiency of multiple network interfaces Abstract Dell EMC delivers dynamic interface groups to simplify the use of multiple network interfaces between backup-application clients and the Dell EMC Data Domain System. Dynamic interface groups offer superior performance, load balancing and failover operations without involving the backup-application. This solution contains a policy engine that automatically routes clients to/from networks and encompasses multi-speed interfaces and VLAN tagged interfaces for smooth integration into any customer s network. August, 2017 Dell 1 Dell EMC EMC Data Data Domain Domain Boost Boost and Dynamic and Dynamic Interface Interface Groups Groups

TABLE OF CONTENTS EXECUTIVE SUMMARY... 3 Audience... 3 BACKGROUND... 3 LINK AGGREGATION... 3 CLIENT ROUTING AND IP MANAGEMENT... 6 How Client Routing Works... 6 BEST PRACTICES... 7 COMPARING WITH LACP... 7 CUSTOMER BENEFITS... 8 CONCLUSION... 8 2 Dell EMC Data Domain Boost and Dynamic Interface Groups

Executive Summary One of the biggest challenges for ingesting hundreds of streams into the Data Domain system is to distribute those streams across multiple network interfaces for optimum performance. However, backup application clients access the Data Domain system through one host-name or IP address, creating a bottleneck due to the single IP connectivity. Data Domain Boost in conjunction with dynamic interface groups provides dynamic load balancing and redundancy for failover recovery while delivering full network bandwidth capacity and maintaining data-path (VLAN) isolation. Audience This white paper is intended for customer administrators, Dell EMC systems engineers, Dell EMC partners and members of the Dell EMC and partner professional services community responsible for deploying and configuring connectivity between backup-application client devices and a Data Domain system. Background The dynamic interface groups (formerly known as ifgroups) mechanism distributes backup-application client connections across available links on the Data Domain system while maintaining data-path (VLAN) isolation. When an error is encountered on a link, the dynamic interface groups configuration initiates a fail-over to another link within the isolated VLAN. The dynamic interface groups solution has no additional overhead on the stream of data to the Data Domain system; therefore, dynamic interface groups provide better performance and easier configuration compared to LACP. This white paper will describe the dynamic interface groups best practice configuration and its advantages over LACP. Link Aggregation There are two types of link aggregation that are commonly used for load balancing and failover. They are LACP and dynamic interface groups. LACP (see figure 1) is one method of bundling several physical interfaces into one logical interface. LACP is defined in IEEE 802.3ad and is an open standard and should be used in a mixed vendor environment. However it is a point to point protocol, not an end to end protocol. LACP works in layer 2/3 of the Network stack. Figure 1: LACP (Point to Point) 3 Dell EMC Data Domain Boost and Dynamic Interface Groups

Dynamic interface groups (see figure 2) is a Dell EMC proprietary technology with 3 United States patents and is implemented in the application layer so it is an end to end protocol. It also has better performance due to less overhead in doing health check operations etc. Dynamic interface groups is part of the DD Boost API and recommended for efficient load balancing and failover plus many advanced features not available with LACP. Figure 2: Dynamic interface groups (End to End) Since backup-application clients continue to access the Data Domain system through a single host-name or IP address, the dynamic interface groups mechanism utilizes the DD Boost client software in conjunction with Data Domain to manage the network connections. Backup-applications connect to the Data Domain system prior to initiating the backup image or restore image operations. These images vary from multiple megabytes to terabytes. Load balancing is established at the start of the operation with network disconnect/reconnect to select the best network interface for the particular client. Once backup-application operations are in progress, there is no additional overhead. Unlike LACP, there are no additional health check messages to consume usable interface bandwidth. This means that dynamic interface groups can be up to 60% more efficient. Network errors are a combination of physical errors, such as a failed network switch, and transient errors, such as congestion errors. LACP is equipped to handle physical errors, but not transient errors at the TCP layer of the network. Dynamic interface groups is designed to handle both errors, and is especially effective for transient errors, where a network can reconnect on the same interface to clear transient congestion. The DD Boost protocol takes advantage of the dynamic interface groups failover ability; the client side protocol detects an unresponsive connection and initiates failover to reconnect to an IP provided by the Data Domain system. All dynamic interface groups configurations are localized to the Data Domain system, unlike LACP where additional configuration is required on the network switch to associate network interfaces into Ether Channels. The Data Domain 4 Dell EMC Data Domain Boost and Dynamic Interface Groups

system is responsible for selecting the load balancing and failover IP for each backup-application client. The dynamic interface groups feature set handles a wide variation of customer s networks with, WAN Single physical interface that is used by backup-application to connect to Data Domain system. LAN Multiple physical interfaces that can be used to distribute send or receive data including failover between these interfaces. Multi-speed network Mixed physical interfaces with different network speed (ie. 1G and 10G) where each backup-application client may be able to connect to a single speed or multiple speeds. VLAN Data-path isolation through virtual interfaces where backup-application client is limited to accessing specific virtual interfaces. NAT Client connection across NAT support load balancing over multiple Data Domain private IP addresses From a network connectivity perspective, VLAN tagged interfaces and different interfaces such as 1G and 10G, are similar in that they both result in client not being able to connect to a given IP address. Therefore, the dynamic interface group mechanism for these two unrelated problems is solved with the backup-application client Group association. The configuration of dynamic interface groups associates a list of IP addresses with a list of backup-application clients in a group. There are two underlying rules for a dynamic interface group, 1. All the clients MUST be able to connect to every IP address within the group. 2. Every IP address within the group is on a unique physical interface, to ensure failover recovery. These two rules ensure that a backup-application client can load balance against all interfaces within the group and can fail-over recover to any interface within its associated group. It is important to note that 10G interface and 1G interface are treated equally in the load balancing decision. Operations that start on the 10G interface will complete sooner, allowing the next operation to re-use the interface, therefore there is no advantage in assigning weights to the interface bandwidth capacity for load balancing assignment. However, the decision to combine 10G interface and 1G interface within the same dynamic interface group requires that each of the clients be able to communicate with both 10G and 1G. Each physical interface may exist as a virtual interface within a dynamic interface group. This allows multiple VLANs to utilize the same physical ports while maintaining data-path isolation. A typical network environment can also be gradually updated from 1G to 10G and move backup-application clients from dynamic interface groups containing 1G interfaces to dynamic interface group containing 10G interfaces. A dynamic interface group for NAT is established by configuring the pre-translated IP address of the Data Domain system against the physical port of the translated IP, creating a new group. Clients that need to access via NAT are configured to use the dynamic interface group with the pre-translated IP addresses. Unlike LACP which requires taking interfaces offline for configuration, dynamic interface groups configuration can be done at any time without impacting network traffic and availability. Adding dynamic interface groups with additional VLAN interfaces, or adding backup-application clients to dynamic interface groups does not impact any in progress operations. Newly made configuration changes are effective at the start of the next backup-application operation. For example, if an additional interface is added to a dynamic interface group, it will be available for load balancing at the start of next backup-application backup image or restore image. The dynamic interface groups mechanism is tailored to optimize performance between backup applications and the Data Domain system over multiple network paths where the physical network interfaces are dedicated to the backupapplication connections. For Data Domain systems prior to DD OS 5.7, the best practice recommendation was to separate physical interfaces involved in replication and they were not to be included in the list of dynamic interface groups interfaces. Prior to DD OS 5.7 Data Domain Managed File Replication (MFR) had been optimized to work best if it did not share a physical interface with backup image or restore image. This was especially true when the MFR source connection was a 10G interface and the target network had a much lower bandwidth. Sharing a physical link 5 Dell EMC Data Domain Boost and Dynamic Interface Groups

between dynamic interface groups and MFR caused TCP congestion, which was transparently recoverable for backup or restore operations, but not for MFR operations. Beginning with DD OS 5.7, Dell EMC has expanded the use cases for dynamic interface groups to include replication. Dynamic interface groups provides customers with a tool to increase replication performance (2 links) and reliability (failover) which is particularly attractive in situations where networks are unreliable. Dynamic interface groups are supported for Managed File Replication. Both the source and destination Data Domain systems are involved in load balancing and failover selection of the local interface. The dynamic interface group for MFR is selected based on the remote Data Domain system name and local Data Domain system MTree path involved in the replication. This mechanism allows separate dynamic interface groups to be created between two Data Domain systems for a different MTree path. This is ideal for service provider environments where they want to isolate replication traffic for each tenant to a different network. Client Routing and IP Management Client routing is a tool that allows administrators to control client connections using a dynamic interface group policy. This dynamic interface group use case started when customers asked Dell EMC to come up a solution to access clients on different subnets without using static routes. Subnets were growing fast because they were running out of IP address. Our solution was to implement a policy engine which could be used for automatic distribution of backup LAN IP addresses. Another customer challenge is that most backup networks are not linked to DNS server, so the backup IP addresses have to be managed separately. Dynamic interface groups provides a way to automate the distribution of IP addresses. There are multiple customer use cases for client routing with dynamic interface groups. Cost management for charge back purposes is one reason why many enterprise customers have metered-lans to monitor traffic and control costs. Corporate LANs are metered-lans, while backup networks are not. Dynamic client routing make sure the backup traffic says on the backup network, even when the backup client sits on the corporate LAN. In addition, if there is a problem with a client connecting to the Data Domain system, dynamic interface groups can prevent the clients from failing back to the public IP. Another use case is for IPv4 to IPv6 Transitions. If a client connects with an IPv6 or IPv4 address, it will be routed to the dynamic interface group of its type. A third use case is for managing a large pool of clients. In large customer environments it is difficult to maintain a client IP range on the same subnet as the Data Domain system. If the client and the Data Domain system are on separate subnets, often the solution is to implement static routes. Static routes are manual overrides which have to be tracked offline, which network administrators like to avoid because it creates extra work and risk because all changes are manual and it is easy to overlook one or more static routes over time. A better solution is to create additional IP alias/vlans to match the client subnet, no longer requiring the use of static routes. And finally, another use case is to overcome rules set by network administrators. Often large enterprises don t allow any deviation/changes to ETC/Host files on Unix clients. With this rule, you cannot make the changes necessary to put these clients onto the backup network. Administrators can overcome this obstacle using dynamic interface groups. How Client Routing Works Here is a brief explanation of how client routing works using dynamic interface groups. (see figure 3), 1. The client sends a session request that contains host name, client IP and the Data Domain system IP (IPv4 or IPv6) 2. The client information is matched to a group policy (lookup table) stored on the Data Domain system 3. The Data Domain system issues client a new IP address per group policy 6 Dell EMC Data Domain Boost and Dynamic Interface Groups

4. The backup client is connected to the Data Domain system over the backup network & begins backup job. Figure 3: Client Routing: How it works Best Practices Customers use dynamic interface groups to avoid having to configure VLAN IPs on clients for the data-path interface they want to use. Without dynamic interface groups customers would need to edit the /etc/hosts file on each client and add an entry for the Data Domain system data-path for the particular VLAN, For the DD Boost protocol use the dynamic interface group feature set for backup-application clients to get best performance. LACP does not deliver full bandwidth of all the interfaces that compose the link. For two interfaces, only 40% of the second interface is available for user data with LACP. In High Availability is required, use LACP on the WAN interface for the backup-application administered connection. The backup image and restore image will utilize the dynamic interface groups interfaces without LACP. For MFR use a separate physical interface than the dynamic interface groups interfaces to avoid network congestion. In a mixed protocol environment it s better to keep CIFS/NFS traffic and DD Boost traffic on different interfaces. If the customer cannot afford to create multiple interfaces it is ok to use dynamic interface groups for CIFS/NFS traffic. Comparing with LACP Some customers hesitate to use dynamic interface groups because they are not as familiar with it as LACP and don t understand some of the important differences of these two networking approaches. The chart in figure 4 highlights some of the important differences between Dynamic Interfaces Groups and LACP. 7 Dell EMC Data Domain Boost and Dynamic Interface Groups

Figure 4: Comparing dynamic interface groups with LACP Customer Benefits Data Domain customers using DD Boost can benefit in many ways by leveraging the dynamic interface groups feature set. Data Domain dynamic interface groups, Are easier to install and maintain than LACP Provide up to 60% greater bandwidth than LACP Changes are applied more quickly without the need to take interfaces down providing higher availability Provide greater resiliency to network failures Provide load balancing between 1G and 10G interfaces Gives customers more flexible client routing options Enables more scalable IP management Improve replication performance & reliability Conclusion Dynamic interface groups is a market proven Dell EMC patented technology that provides efficient load balancing and client failover, as well as dynamic client routing. With the greater performance and bandwidth that dynamic interface groups provides, customers can reduce costs and maximize private network utilization by redirecting clients. In addition, with dynamic interface groups, Hybrid Cloud application capabilities allow new DD Boost enabled clients to connect to a Data Domain system over the backup network lowering costs and requiring less configuration management. Learn more about Dell EMC Data Domain solutions Contact a Dell EMC Expert 8 Dell EMC Data Domain Boost and Dynamic Interface Groups All Rights Reserved. Dell, EMC and other trademarks are trademarks of Dell Inc. or its subsidiaries. Other trademarks may be trademarks of their respective owners. Reference Number: H14474