Commvault Backup to Cloudian Hyperstore CONFIGURATION GUIDE TO USE HYPERSTORE AS A STORAGE LIBRARY

Transcription

1 Commvault Backup to Cloudian Hyperstore CONFIGURATION GUIDE TO USE HYPERSTORE AS A STORAGE LIBRARY

2 CONTENTS EXECUTIVE SUMMARY... 2 SOLUTION OVERVIEW... 3 USE CASES... 4 SOLUTION COMPONENTS... 5 Commvault Platform... 5 Cloudian HyperStore Software... 6 CONFIGURATION... 9 Configure Cloudian Hyperstore... 9 Configure Commvault COMMVAULT BACKUP TO CLOUDIAN HYPERSTORE 1

3 EXECUTIVE SUMMARY Every organization needs an efficient backup and disaster recovery plan to effectively protect their data. Common requirements from organizations requiring storage solutions that embrace today s most commonly used tools and practices as well as having multiple data protection levels. In addition, the market is driving the need for storage and backup solutions to support multiple data centers or regions for disaster recovery. Cloudian HyperStore and CommVault together deliver the following benefits: Enterprise level backup Completely integrated data center solution: computing, networking, and storage Reduced total cost of ownership (TCO) that continues to improve as the solution scales out Operational efficiency Agility and scalability with the scale-out architectures of Cloudian HyperStore Complete Amazon Simple Storage Service (S3) API-compatible geographically federated object storage platform Enterprise-class features: multi-tenancy, quality of service (QoS), and dynamic data placement in a completely software-de ned storage (SDS) package Policy-based tiering between on-premises hybrid cloud storage platforms and any S3 API compliant private or public cloud Investment protection: mix and match different generations and densities of computing platforms to build your storage environment; more than 400 application vendors support S3 CommVault is an enterprise level integrated data and information management solution, built from the ground up on a single software platform and unified code base. The software contains modules to protect and archive, analyse, replicate, and search your data, which all share a common set of back-end services and advanced capabilities, seamlessly interacting with one another. This addresses all aspects of data management in the enterprise, while providing infinite scalability and unprecedented control of data and information. When combined with the Cloudian object storage platform, CommVault users can deliver a data protection and archive platform that automatically distributes data across multiple geographical locations - allowing backup and archival data to be available for both local and remote site access for disaster recovery scenarios. The HyperStore platform can scale to support hundreds of petabytes of storage in a single instance and provide a range of configurable data protection and data distribution options to ensure the correct SLA is applied to the appropriate data sets in order to fulfil the business objectives for RTO and RPO at the data set level. COMMVAULT BACKUP TO CLOUDIAN HYPERSTORE 2

4 This document, will detail the key considerations for the deployment of Cloudian HyperStore solution as a backup/archive storage target within a Commvault architecture with an illustration of deployment steps to guide you through a successful deployment SOLUTION OVERVIEW Cloud Storage Library on Hyperstore enables you to configure and use online storage devices cloud storage devices as storage targets. Cloud Storage provides the ability to easily increase your storage capacity as and when it is required. Cloud Storage provides centralized data access, better failover capabilities and reduces the day-to-day storage administration tasks. As the data gets transferred over the network, protecting the integrity of data is an important aspect of any cloud storage implementation. Cloud Storage protects the integrity of the data using the following features: Data is transferred through secured channels using HTTPS protocol. Data encryption feature further encrypts the data providing data protection during network transfer as well as storage. In case you like to put the Data to public Cloud The Commvault deduplication feature enables you to reduce cloud storage space usage and use network bandwidth efficiently. Deduplication identifies and eliminates redundant data in the backup, reducing not only the volume of data stored in Hyperstore but also the bandwidth required for data transfer. COMMVAULT BACKUP TO CLOUDIAN HYPERSTORE 3

5 Solution Benefits: Petabyte-scalable storage Scalable throughput (>18 TB/hr with 16 nodes) Costs under $.01perGBpermo, including support WORM for Archive USE CASES Cloudian Hyperstore as a direct Cloud Library in Commvault using Direct Deduplication. This means that you can connect your MediaAgent directly (rather than though a proxy gateway) with the S3 endpoint of your Hyperstore cluster and store data in a deduplicated format. In Direct Deduplication to Hyperstore, the cloud storage is defined as the storage target in the MediaAgent. Deduplication is enabled either at the client or at the MediaAgent. The deduplicated data is transferred to Cloud Storage library. The deduplication database resides on the MediaAgent (or on a designated volume that is attached to the MediaAgent). Cloudian Hyperstore as a direct Cloud Library in Commvault could be used for nearly every Commvault functionality like backup and archive until special performance requirements are needed for functionality like live mount in virtual environments. COMMVAULT BACKUP TO CLOUDIAN HYPERSTORE 4

6 SOLUTION COMPONENTS COMMVAULT PLATFORM The software platform is an enterprise-level, integrated data and information management solution, built from the ground up on a single platform and unified code base. All functions share the same back-end technologies to deliver the unparalleled advantages and benefits of a truly holistic approach to protecting, managing, and accessing data. The software contains modules to protect and archive, analyze, replicate, and search your data, which all share a common set of back-end services and advanced capabilities, seamlessly interacting with one another. This addresses all aspects of data management in the enterprise, while providing infinite scalability and unprecedented control of data and information. Production data is protected by installing agent software on the physical or virtual hosts which use operating system or application native APIs to properly protect data in a consistent state. Production data is processed by the agent software on client computers and backed up through a data manager, the MediaAgent, to disk, tape, or cloud storage. All data management activity in the environment is tracked by a centralized server, the CommServe, and can be managed by administrators through a central user interface. End users can access protected data using web browsers or mobile devices. COMMVAULT BACKUP TO CLOUDIAN HYPERSTORE 5

7 Key features of the software platform: Complete data protection solution supporting all major operating systems, applications, and databases on virtual and physical servers, NAS shares, cloud-based infrastructures, and mobile devices. Simplified management through a single console; view, manage, and access all functions and all data and information across the enterprise. Multiple protection methods including backup and archive, snapshot management, replication, and content indexing for ediscovery. Efficient storage management using deduplication for disk and tape. Integrated with the industry's top storage arrays to automate the creation of indexed, application-aware hardware snapshot copies across multi-vendor storage environments. Complete virtual infrastructure management supporting both VMware and Hyper-V. Advanced security capabilities to limit access to critical data, provide granular management capabilities, and provide single sign on access for Active Directory users. Policy based data management, transcending limitations of legacy backup products by managing data based on business needs and not physical location. Cutting edge end-user experience empowering them to protect, find and recover their own data using common tools such as web browsers, Microsoft Outlook and File Explorer. You can use third-party screen readers with the Web Console, Admin Console, and Command Line Interface. CLOUDIAN HYPERSTORE SOFTWARE Cloudian HyperStore software delivers a fully S3 API compliant, multi-tenant, and multi-data center hybrid cloud storage solution. Cloud service providers use HyperStore software to deploy public clouds and managed private clouds. Enterprises use HyperStore software to deploy private and hybrid clouds. HyperStore software employs a fully distributed and replicated peer-to-peer architecture with no single point of failure. It easily scales horizontally using commodity hardware so deployments can start with a few servers in a single data center and then scale out as usage increases to thousands of servers distributed across multiple data centers managing hundreds of petabytes of data. Its distributed architecture with automatic replication and recovery services makes it highly resilient to network and node failures without data loss. Similarly, when scaling the storage cluster or performing maintenance, changes in node availability are automatically detected without service interruption. COMMVAULT BACKUP TO CLOUDIAN HYPERSTORE 6

8 FIGURE 5 CLOUDIAN HYPERSTORE HYBRID CLOUD Features like hybrid cloud streaming, virtual nodes, configurable erasure coding, and data compression and encryption provide highly efficient storage and data management that lets users store and access their data where they want it, when they want it. Multi-Data Center and Multi-Region Each HyperStore software implementation starts with three or more distributed nodes and then objects are replicated or erasure coded across the available nodes for data durability and availability. Administrators can configure the number of replicas or erasure code strategy required to meet SLA and cost objectives, including the option to replicate copies to other data centers for geo redundancy. Reads and writes are always performed at the local data center with remote replication performed in the background to avoid latency of remote writes. COMMVAULT BACKUP TO CLOUDIAN HYPERSTORE 7

9 FIGURE 6 HYPERSTORE MULTI DATA CENTER TOPOLOGY EXAMPLE Summary of Key Features of Cloudian HyperStore Configurable Consistency The ability to configure the level of data consistency on reads or writes. Optimized for all data sizes Supports erasure coding and replication in the same system. Supports Heterogeneous Storage Nodes HyperStore enables deployment of heterogeneous nodes in a single cluster. Amazon S3 Data Tiering Tiering of on-premises storage into the AWS cloud or other S3 compatible storage. Quality of Service (QoS) Set a maximum limit on storage consumption and I/O, based on the user or groups Security HyperStore supports AES-256 Server-Side Encryption and SSL. Compression Three different types of data compression technology lz4, snapp and zlib. Multi-Tenancy Define specific classes of service for groups and users with billing and charge-back. Enterprise Management and Monitoring Systems monitoring and administration through via GUI or RESTful APIs. Fully S3 Compliant API for the Broadest Application Support S3 compliant API ensures seamless operation of applications developed for Amazon S3. COMMVAULT BACKUP TO CLOUDIAN HYPERSTORE 8

10 CONFIGURATION CONFIGURE CLOUDIAN HYPERSTORE To connect Commvault to use a Hyperstore Cluster as a backup target we need to set up a Bucket that is used as the Cloud Library. We need to set up a User, a Group and a S3 Bucket. We assume that the cluster is installed and Storage Policies are in place. To Set up the Group and User we need to log into the Cloudian Management Console as Admin and create these. 1. On the Top Menu of the CMC click on Users & Groups 2. On the Users & Groups submenu select Manage Groups 3. In the right upper corner click on + NEW GROUP 4. Type in a Group Name and a short description 5. Click on the Save button on the right. COMMVAULT BACKUP TO CLOUDIAN HYPERSTORE 9

11 After the successful creation of the Group we are going to create a User. 1. On the Users & Groups submenu select Manages Users 2. In the right upper corner click on + NEW USER 3. Type in a Username, select Group Admin in the User Type box, select the just created Group in the Group Name dropdown list and set a password 4. Click on the Save button on the right. Now we are ready to log on as the new User and create the Bucked used as Cloud Library on our Commvault MediaAgent. Create the Bucket: 1. On the top Menu of the CMC click on Buckets and Objects 2. Type in a Bucketname and click on Create COMMVAULT BACKUP TO CLOUDIAN HYPERSTORE 10

12 As a last step we need to capture the LogIn information from the user to configure Commvault to access the Bucket 1. On the top Menu of the CMC click on the user name and select Security Credentials 2. On the S3 ACCESS CREDENTIALS selection note or copy the ACCESS KEY ID 3. Then click on View Secret Key and note or copy the secret key CONFIGURE COMMVAULT 1. From the CommCell Browser, expand Storage Resources. 2. Right-click Libraries, point to Add, and then click Cloud Storage Library. The Add Cloud Storage dialog box appears. 3. In the General tab, enter the following information: Name: Enter the name of the cloud storage library. Type: Select Amazon S3. MediaAgent: Select the MediaAgent you want to use. Access information: Enter the credentials from the Hyperstore User. 4. Click OK. The new cloud storage library appears in the CommCell Browser under Storage Resources > Libraries and also under Storage Resources > MediaAgents > MediaAgent Cloudian, Inc. 177 Bovet Road, Suite 450, San Mateo, CA Tel: ; info@cloudian.com Cloudian, Inc. Cloudian, the Cloudian logo, and HyperStore are registered trademarks or trademarks of Cloudian, Inc. All other trademarks are property of their respective holders. TP-CVLT COMMVAULT BACKUP TO CLOUDIAN HYPERSTORE 11