Deploying Rubrik Datos IO to Protect MongoDB Database on GCP

Similar documents
MongoDB Management Suite Manual Release 1.4

Deploy Next-Generation Cloud Applications on Apache Cassandra with Datos IO RecoverX on Cisco UCS and Cisco ACI

Xcalar Installation Guide

USING NGC WITH GOOGLE CLOUD PLATFORM

Azure Marketplace Getting Started Tutorial. Community Edition

MMS Backup Manual Release 1.4

Azure Marketplace. Getting Started Tutorial. Community Edition

NexentaStor VVOL

HySecure Quick Start Guide. HySecure 5.0

Zadara Enterprise Storage in

Using PCF Ops Manager to Deploy Hyperledger Fabric

The Balabit s Privileged Session Management 5 F5 Azure Reference Guide

Migrating vrealize Automation 6.2 to 7.2

VMware AirWatch Content Gateway for Linux. VMware Workspace ONE UEM 1811 Unified Access Gateway

OnCommand Cloud Manager 3.2 Deploying and Managing ONTAP Cloud Systems

Using Fluentd as an alternative to Splunk

Booting a Galaxy Instance

Oracle WebLogic Server (WLS) 11gR1 ( and ) Installation on Oracle Linux 5 and 6

VMware Identity Manager Connector Installation and Configuration (Legacy Mode)

Cisco Prime Service Catalog Virtual Appliance Quick Start Guide 2

VMware Identity Manager Cloud Deployment. Modified on 01 OCT 2017 VMware Identity Manager

VMware Identity Manager Cloud Deployment. DEC 2017 VMware AirWatch 9.2 VMware Identity Manager

SUREedge MIGRATOR INSTALLATION GUIDE FOR VMWARE

Installing and Configuring vcloud Connector

SUREedge MIGRATOR INSTALLATION GUIDE FOR HYPERV

271 Waverley Oaks Rd. Telephone: Suite 206 Waltham, MA USA

VMware Skyline Collector Installation and Configuration Guide. VMware Skyline 1.4

Pexip Infinity and Google Cloud Platform Deployment Guide

SUREedge MIGRATOR INSTALLATION GUIDE FOR NUTANIX ACROPOLIS

BPPM Patrol Agent Installation Steps on Linux and Automation Integration

Upgrade Instructions. NetBrain Integrated Edition 7.1. Two-Server Deployment

vsphere Replication for Disaster Recovery to Cloud vsphere Replication 6.5

VMware Skyline Collector Installation and Configuration Guide. VMware Skyline Collector 2.0

Horizon DaaS Platform 6.1 Service Provider Installation - vcloud

Contents. Note: pay attention to where you are. Note: Plaintext version. Note: pay attention to where you are... 1 Note: Plaintext version...

Best Practices for Migrating Servers to Microsoft Azure with PlateSpin Migrate

Cloud Computing. Luigi Santangelo Department of Computer Engineering University of Pavia

How-to Guide: Tenable.io for Microsoft Azure. Last Updated: November 16, 2018

Commvault Backup to Cloudian Hyperstore CONFIGURATION GUIDE TO USE HYPERSTORE AS A STORAGE LIBRARY

Lockdown & support access guide

Tutorial 1. Account Registration

Installation and User Guide

vsphere Replication for Disaster Recovery to Cloud

cpouta exercises

Plexxi HCN Plexxi Connect Installation, Upgrade and Administration Guide Release 3.0.0

vsphere Replication for Disaster Recovery to Cloud vsphere Replication 8.1

Tungsten Dashboard for Clustering. Eric M. Stone, COO

Migrating the Cisco StadiumVision Director Server Environment to Platform 2 from the Cisco ADE 2140 Series Appliance

VIRTUAL GPU LICENSE SERVER VERSION , , AND 5.1.0

Quick Setup Guide. NetBrain Integrated Edition 7.0. Distributed Deployment

At course completion. Overview. Audience profile. Course Outline. : 55187B: Linux System Administration. Course Outline :: 55187B::

Securing Containers Using a PNSC and a Cisco VSG

Installing and Upgrading Cisco Network Registrar Virtual Appliance

Bitnami Re:dash for Huawei Enterprise Cloud

VMware vcloud Air User's Guide

Ansible Tower Quick Setup Guide

"Charting the Course... MOC B: Linux System Administration. Course Summary

Linux Administration

Installing and Configuring VMware Identity Manager Connector (Windows) OCT 2018 VMware Identity Manager VMware Identity Manager 3.

Exam LFCS/Course 55187B Linux System Administration

Installing Cisco MSE in a VMware Virtual Machine

Getting Started Guide 6/1/2017

CPM. Quick Start Guide V2.4.0

Upgrade Guide. This document details the upgrade process for customers moving from the full version of OnApp Cloud v2.3.1 to v2.3.2.

Setting Up Resources in VMware Identity Manager (On Premises) Modified on 30 AUG 2017 VMware AirWatch 9.1.1

Juniper Secure Analytics Patch Release Notes

VMware Mirage Getting Started Guide

Upgrade Tool Guide. July

CA Infrastructure Management Data Aggregator

Setting up a Chaincoin Masternode

Red Hat Enterprise Linux Atomic Host 7 Getting Started with Cockpit

HOW TO SECURELY CONFIGURE A LINUX HOST TO RUN CONTAINERS

Quick Setup Guide. NetBrain Integrated Edition 7.0. Two Servers Deployment

Enterprise Steam Installation and Setup

Storage Manager 2018 R1. Installation Guide

EASYHA SQL SERVER V1.0

Create Test Environment

Aware IM Version 8.1 Installation Guide

Enterprise Vault.cloud CloudLink Google Account Synchronization Guide. CloudLink to 4.0.3

Teradici PCoIP Connection Manager 1.8 and Security Gateway 1.14

Exam Name: VMware Certified Professional on vsphere 5 (Private Beta)

DEPLOYING A 3SCALE API GATEWAY ON RED HAT OPENSHIFT

Securing Containers Using a PNSC and a Cisco VSG

Inception Cloud User s Guide

FUJITSU Cloud Service S5. Introduction Guide. Ver. 1.3 FUJITSU AMERICA, INC.

Siemens PLM Software. HEEDS MDO Setting up a Windows-to- Linux Compute Resource.

Quick Start Guide for Intel FPGA Development Tools on the Microsoft* Azure* Platform

How to Deploy Axon on VMware vcenter

Table of Contents. Table of Contents License server installation guide - Linux. Download SCL

Cloudera s Enterprise Data Hub on the Amazon Web Services Cloud: Quick Start Reference Deployment October 2014

vcenter Server Appliance Configuration Modified on 17 APR 2018 VMware vsphere 6.7 VMware ESXi 6.7 vcenter Server 6.7

How to Lift-and-Shift a Line of Business Application onto Google Cloud Platform

VMware AirWatch Content Gateway Guide for Linux For Linux

STRM Log Manager Administration Guide

Google Cloud Platform Roles and Permissions

Cloudera Manager Quick Start Guide

User guide NotifySCM Installer

vsphere Replication for Disaster Recovery to Cloud

Contents. Index iii

Mission Guide: Office 365 OneDrive

Transcription:

DEPLOYMENT GUIDE Deploying Rubrik Datos IO to Protect MongoDB Database on GCP

TABLE OF CONTENTS INTRODUCTION... 1 OBJECTIVES... 1 COSTS... 2 BEFORE YOU BEGIN... 2 PROVISIONING YOUR INFRASTRUCTURE FOR THE TUTORIAL... 2 Create a Compute Engine instance for the MongoDB nodes... 2 Create and configure a Cloud Storage bucket... 3 Create a Compute Engine Instance for Rubrik Datos IO... 3 CONFIGURING THE MONGODB CLUSTER... 3 SETTING UP COMMUNICATIONS TO THE RUBRIK DATOS IO CLUSTER... 5 Set up network ports... 5 Create a Rubrik Datos IO user on the Rubrik Datos IO node... 6 Provide sudo privileges... 6 Configure Rubrik Datos IO nodes... 7 INSTALLING RUBRIK DATOS IO... 8 REGISTERING RUBRIK DATOS IO... 8 ACCESSING RUBRIK DATOS IO... 9 CONFIGURING RUBRIK DATOS IO... 9 CLEANING UP... 10 Delete your project... 10 Delete your Compute Engine instance...11 Delete your Cloud Storage bucket...11

INTRODUCTION This tutorial shows how to deploy and configure Rubrik Datos IO to protect your MongoDB database cluster. This tutorial assumes that your MongoDB database is already deployed and fully operational. For typical deployments, Rubrik Datos IO is located in the same project as the MongoDB cluster that needs to be protected. The following diagram shows a representative deployment. Deploying Rubrik Datos IO in a different project requires SSH connections from the Rubrik Datos IO node to all of the compute instances on which MongoDB is deployed. Rubrik Datos IO connects to the MongoDB nodes through SSH connections and uses standard MongoDB APIs to extract the data and the oplogs. Rubrik Datos IO deploys a lightweight agent on each of the selected MongoDB nodes to facilitate interfacing with the MongoDB cluster. Data is streamed in parallel to Cloud Storage and processed in batch mode offline. After the data is copied, Rubrik Datos IO processes the data to create a golden copy of the database that is cluster consistent and has no replicas. OBJECTIVES Create a Compute Engine instance for MongoDB. Create a Cloud Storage bucket to store your backup data. Create a Compute Engine instance for Rubrik Datos IO. Configure the MongoDB database. Deploy Rubrik Datos IO and connect from a remote location to configure backup policies. 1

COSTS This tutorial uses billable components of Cloud Platform, including: Compute Engine Cloud Storage Use the Pricing Calculator to generate a cost estimate based on your projected usage of GCP. In addition, Rubrik Datos IO is licensed directly through Rubrik Datos IO, based on the physical size of the database that needs to be protected. For pricing-related questions, contact us at rubrik.com/contact-sales. BEFORE YOU BEGIN 1. Select or create a GCP project. GO TO THE MANAGE RESOURCES PAGE 2. Enable billing for your project. ENABLE BILLING When you finish this tutorial, you can avoid continued billing by deleting the resources you created. See Cleaning up for more detail. PROVISIONING YOUR INFRASTRUCTURE FOR THE TUTORIAL To complete this tutorial, create Compute Engine instances for the MongoDB nodes in cluster 1, a Cloud Storage bucket to store the backup data, and a Compute Engine instance for Rubrik Datos IO in cluster 2. Create a Compute Engine instance for the MongoDB nodes 1. Create a Compute Engine instance. Use n1-standard-4 or the machine type that best meets your requirements. Note: Make a note of the service account number because it is used in the next step. The service account is in the form of [52153446160]-compute@developer.gserviceaccount.com where 52153446160 is the project number. 2. Deploy MongoDB on the Compute Engine instance. 2

Create and configure a Cloud Storage bucket Create a Cloud Storage bucket to store your backup data. 1. Create a Cloud Storage bucket using the same service account that you used to create the Compute Engine instances for MongoDB nodes. 2. Configure a Cloud Identity and Access Management (Cloud IAM) role or Access Control List (ACL) for the service account to allow read and write access to the Cloud Storage bucket with the role of Editor. Create a Compute Engine Instance for Rubrik Datos IO Rubrik Datos IO is scale-out software that is deployed in a single node. The minimum node type is n1-standard-8. The recommended node type for most deployments is n1-standard-16. 1. Create one Compute Engine instance of type n1-standard-8 using the service account. 2. For the boot disk, select CentOS 7 or RHEL 7.x. 3. In the Firewall section, select Allow HTTPS traffic. 4. For the Rubrik Datos IO Compute Engine instance, create an SSD disk (blank disk) with a capacity of at least 256 GB. 5. Select the appropriate network. 6. Format the file system and mount the volume. gcloud compute ssh [RECOVERX_NODE_NAME] \ sudo mkfs -t ext4 [VOLUME_NAME]; sudo mkdir /home sudo mount [VOLUME_NAME] /home [RECOVERX_NODE_NAME] is the name of your Rubrik Datos IO node. [VOLUME_NAME] is the name of your volume. CONFIGURING THE MONGODB CLUSTER To protect the MongoDB database cluster using Rubrik Datos IO and extract data from the source cluster, create a Rubrik Datos IO user account. Create the account and configure authentication for the user with the following minimum requirements: The home directory of datos_db_user must have at least 100 GB local storage. The default shell for datos_db_user must be bash. Create a Rubrik Datos IO user account, such as datos_db_user, on each MongoDB node with the same group ID (GID) as the MongoDB user. 3

1. Add datos_db_user to the MongoDB group. gcloud compute ssh [MongoDB_NODE_INSTANCE_NAME] \ sudo useradd -g MongoDB -m datos_db_user [MongoDB_NODE_INSTANCE_NAME] is the name of your MongoDB node instance, to grant the appropriate permissions. 2. Configure authentication for the user you created by using one of the following methods: Username and password Username and SSH key with passphrase Username and SSH access key 3. Give datos_db_user write permission to the /home/datos_db_user home directory on all MongoDB nodes. gcloud compute ssh [MongoDB_NODE_INSTANCE_NAME] \ sudo chmod -R u+w /home/datos_db_user 4. Give datos_db_user read and execute permissions to the MongoDB data directory and its parent directory on all MongoDB nodes. gcloud compute ssh [MongoDB_NODE_INSTANCE_NAME] \ sudo chmod -R g+rx /var/lib/mongodb; sudo chmod -R g+rx /var/lib/mongodb/data 5. Disable the SSH banner for datos_db_user in the datos_db_user home directory to hide the banner from the datos_db_user. gcloud compute ssh [MongoDB_NODE_INSTANCE_NAME] touch ~/.hushlogin 6. For each node of the MongoDB cluster, edit the file /etc/ssh/sshd_config and set sshd parameters MaxSessions to 500 and MaxStartups to 500:1:500. 7. Verify that Max Sessions and MaxStartups values of these paramaters were picked up by the SSHD service. /usr/sbin/sshd -T grep -i maxs 4

8. To resolve Mongos node hostnames from the Rubrik Datos IO server, connect to the config server and get hostnames of all Mongos instances in the MongoDB cluster. These hostnames are used to add firewall rules. mongo --host [CONFIG_IP] --port [CONFIG_PORT] db.mongos.find() [CONFIG_IP] is the IP address of the primary MongoDB node [CONFIG_PORT] is the port of the primary MongoDB node SETTING UP COMMUNICATIONS TO THE RUBRIK DATOS IO CLUSTER In this section, you set up network firewall rules and configure the communication between the MongoDB hosts and the Rubrik Datos IO cluster. Set up network ports Follow the instructions in firewall rules to open the network ports to turn on communication between Rubrik Datos IO, the nodes running MongoDB, and the Cloud Storage bucket. In the following table, open the ports to the compute instance running Rubrik Datos IO. In the following table, you open these ports from every node in the MongoDB cluster to the Rubrik Datos IO compute instance. Opening the ports is necessary to let specific MongoDB services communicate. 5

Create a Rubrik Datos IO user on the Rubrik Datos IO node In this section, you create a Rubrik Datos IO user, such as datos_db_user, on the Rubrik Datos IO node with the following characteristics: The home directory on the non-root volume that was previously created. SSH access to all the nodes in the MongoDB cluster. It s recommended that you provide key-based, passwordless SSH access to each Rubrik Datos IO node in the cluster. The same group ID (GID) as the datos_db_user that was created on the MongoDB compute instances. For example, if the datos_db_user has GID 1001, datos_db_user must have GID 1001. Add the Rubrik Datos IO user to the Rubrik Datos IO node. 1. Retrieve the GID on the MongoDB compute instance. id datos_db_user 2. On the Rubrik Datos IO node, create a new group using the GID you retrieved. id datos_db_user [GID] is the group ID that you retrieved in the first step. 3. Add the user. sudo useradd -g MongoDB -m datos_db_user -d /home/datos_db_user Provide sudo privileges On the Rubrik Datos IO node, the datos_db_user needs sudo privileges for the following commands: /bin/cp /sbin/chkconfig To add this privilege: 1. Log in as the root user. 2. Edit the configuration file for sudo access, using the visudo command. sudo visudo 6

3. Append the following line to the file and save the file. datos_db_user ALL=NOPASSWD: /sbin/chkconfig, /bin/cp Configure Rubrik Datos IO nodes Make the following changes in the limits.conf file of all Rubrik Datos IO nodes.: 1. Edit the nproc and nofiles parameters in /etc/security/limits.conf to match the following commands. hard nproc unlimited soft nproc unlimited hard nofile 64000 soft nofile 64000 2. Edit the nproc parameter in /etc/security/limits.d/90-nproc.conf to match the following commands. hard nproc unlimited soft nproc unlimited 3. Verify the changes. ulimit -a 4. Verify that the /tmp directory has at least 2 GB empty space on each Rubrik Datos IO node. df /tmp 5. Make sure that the short name and FQDN of the Rubrik Datos IO node is included in the /etc/hosts file. For example, a Rubrik Datos IO node with the hostname datosserver.dom.local and an IP address of 192.168.2.4 would have a hosts file listing similar to the following. cat /etc/hosts 127.0.0.1 localhost.localdomain localhost 192.168.2.4 datosserver datosserver.dom.local ::1 localhost6.localdomain6 localhost6. 7

INSTALLING RUBRIK DATOS IO When you install Rubrik Datos IO, you use the datos_db_user name that you created earlier. 1. Copy the Rubrik Datos IO compressed tar file to the compute instances. gcloud compute scp datos_[version].tar.gz :~ gcloud compute ssh sudo mv datos_[version].tar.gz \ /home/datos_db_user; sudo chown datos_db_user \ /home/datos_db_user/datos_[version].tar.gz [VERSION] is your version of the tar file. 2. Uncompress the tar file on the target node. A top-level directory called datos_[version] is included. tar -zxf datos_[version].tar.gz 3. Switch to the uncompressed Rubrik Datos IO directory. cd datos_[version] 4. Install Rubrik Datos IO in the target installation directory../install_datos --ip-address [IP_ADDRESS] \ --target-dir /home/datos_db_user/datosinstall. [IP_ADDRESS] is the internal IP addresses of the instances. REGISTERING RUBRIK DATOS IO After installation, you register Rubrik Datos IO to run as a service. 1. On the Rubrik Datos IO node, run the following commands as a system admin with root privileges. sudo cp datos-server /etc/init.d/ sudo chmod 755 /etc/init.d/datos-server sudo chkconfig --add datos-server sudo touch /var/lock/subsys/datos-server. 8

2. On the Recover X server, change to the datos user directory and run the following commands as a system admin with root privileges: sudo chown root $DATOS_INSTALL/lib/fuse/bin/fusermount sudo chmod u+s $DATOS_INSTALL/lib/fuse/bin/fusermount sudo modprobe fuse sudo mount -t fusectl fusectl /sys/fs/fuse/connections ACCESSING RUBRIK DATOS IO To log in to the Rubrik Datos IO console, you connect to the public IP address of the Rubrik Datos IO node. 1. Connect to the console using a browser. https://[ip_address]:9090/#/dashboard [IP_ADDRESS] is the IP address of the node where Rubrik Datos IO is deployed. 2. When you log in for the first time, use the following credentials. Username: admin Password: admin 3. To change the default password, click Settings, and select Change Password. CONFIGURING RUBRIK DATOS IO To add a data source to the Rubrik Datos IO environment, you add the configured MongoDB database cluster and the provisioned Cloud Storage bucket. You can choose to use Cassandra or MongoDB as the type of data source. 1. In Rubrik Datos IO, click Configuration > Data sources. 2. In the Data sources panel, click the Plus icon, and then configure the following data sources. Data Source Type: Select Cassandra or MongoDB. Cluster Name: Type a unique name for the data source. Configuration IP: For Cassandra, use the private IP address of any node. For MongoDB, use the IP address of all configuration servers for sharded clusters and the primary node for non-sharded clusters. 9

Configuration Port: For Cassandra, use the CQLSH port. For MongoDB, use the port on which the node listens. Source Authentication: Select the authentication method used by your source machines, and then provide the username, password, or key. To enable driver authentication, click Cassandra/MongoDB Driver Authentication. To ignore non-local secondary nodes in the MongoDB source replica sets, click Ignore Secondaries and enter the node IP address, hostnames, and port. CLEANING UP To avoid incurring charges to your Google Cloud Platform account for the resources used in this tutorial: Delete your project The easiest way to eliminate billing is to delete the project you created for the tutorial. Warning: Deleting a project has the following consequences: If you used an existing project, you ll also delete any other work you ve done in the project. You can t reuse the project ID of a deleted project. If you created a custom project ID that you plan to use in the future, delete the resources inside the project instead. This step ensures that URLs that use the project ID, such as an appspot.com URL, remain available. If you are exploring multiple tutorials and quickstarts, reusing projects instead of deleting them prevents you from exceeding project quota limits. 1. In the GCP Console, go to the Projects page. GO TO THE PROJECTS PAGE 2. In the project list, select the project you want to delete and click Delete project. 3. In the dialog, type the project ID, and then click Shut down to delete the project. 10

Delete your Compute Engine instance 1. In the GCP Console, go to the VM Instances page. GO TO THE VM INSTANCES PAGE 2. Click the checkbox next to the instance you want to delete. 3. Click the Delete button at the top of the page to delete the instance. Delete your Cloud Storage bucket 1. In the GCP Console, go to the Cloud Storage browser. GO TO THE CLOUD STORAGE BROWSER 2. Click the checkbox next to the bucket you want to delete. 3. Click the Delete button at the top of the page to delete the bucket. Global HQ 1001 Page Mill Rd., Building 2 Palo Alto, CA 94304 United States 1-844-4RUBRIK inquiries@rubrik.com www.rubrik.com Rubrik delivers a single platform to manage and protect data in the cloud, at the edge, and on-premises. Enterprises choose Rubrik s Cloud Data Management software to simplify backup and recovery, accelerate cloud adoption, and enable automation at scale. Rubrik s run-anywhere, scale-out architecture is built to empower IT departments today and in the future, reducing total cost of ownership while enabling infrastructure flexibility for a multi-cloud world. For more information, visit www.rubrik.com and follow @rubrikinc on Twitter. 20181130_v1 11