Interacting with dbgap Data on Stratus. Evan Bollig 08/24/2017
|
|
- Melina Brooks
- 6 years ago
- Views:
Transcription
1 Interacting with dbgap Data on Stratus Evan Bollig 08/24/2017
2 Overview What is Stratus? Accessing Stratus Booting Virtual Machines (VMs) Connecting to VMs Working with Volumes Working with Storage Tiers Installing Software
3 Background (MSI Core Services) Homogenous environment simplifies and satisfies most data-use agreements Most workflows generalize to large HPC clusters (Mesabi and Itasca) Tiered storage with a global namespace Central OIT ID management and authentication Edge cases handled as one-offs NIH requirements for dbgap could not be satisfied without impacting all MSI services.
4 What is Stratus?
5 Stratus Stratus is a subscription-based Research Compute Cloud designed for NIH Controlled-Access Data (i.e., Protected Data) Backed by HPE hardware and open-source software, OpenStack (Newton) and Ceph (Kraken) Three types of cloud storage: Block device Volumes S3-compatible Secure Object Cache S3-compatible Persistent Secure Object Storage The Infrastructure-as-a-Service is hosted on-premise at the Minnesota Supercomputing Institute
6 Why Cloud Computing? Cloud computing supports non-traditional HPC workflows: Clinically certified pipelines -- version locked software stacks for reproducibility Software distributed as images and containers -- developer controlled environments Protected data -- ephemeral storage, network isolation, per-user ACLs Long running jobs (> 1 mo.) -- persist through maintenance windows wrt dbgap, cloud computing offers: Project isolation (multi-tenancy) Scalable secure storage Multi-factor authentication Flexibility to work with Docker, other tools not supported on other MSI services Shared-responsibility security model in compliance with data-use agreement
7 Stratus or Mesabi? Stratus does not compete with HPC performance and is not available to general users. Stratus has a self-service, on-demand model. You get what you want, when you want it. The caveat: you share responsibility for management and security of your own VMs---this is a requirement of your data-use agreement. Whenever possible, use Mesabi! Controlled-Access Data? Stratus is the ONLY service at MSI approved for NIH controlled-access data, including computed derivatives considered to be controlled-access. Data designated as open-access can be processed on any MSI service (including Mesabi and Galaxy). Stratus is optional.
8 Managing Expectations Before you get started, let s clarify one more time: Stratus is not a fully-managed HPC environment No software modules. Install your own. No job scheduler. Run jobs as scripts or install your own. No global Tier I Storage (i.e., Panasas) with group directories. Transfer data manually. No automatic backups of VMs, storage, or data. When you delete a VM or Volume, the data is gone. Hardware is oversubscribed to emphasize flexibility and capacity over performance. Sane defaults for VM and port security are already applied. If you change settings, you are opting out of our protections at your own risk!
9 Know your Options (NIH Cloud Pilots) NIH Cancer Genomic Cloud (CGC) Cloud Pilot programs: Broad Institute FireCloud Institute SB Cancer Genomics Cloud (CGC) SevenBridges Cancer Genomics Cloud (CGC) Pros Cons Cloud credits offered by NIH to compute for free Public IPs for non-umn collaborations Much larger scale than Stratus NIH sponsored APIs/tools/workflows Charges you only for what you use Services are external to the University and entirely unsupported Same or more effort required for workflow and system setup Full responsibility for data security Cost beyond credit allocation is ~10x higher than Stratus
10 What does Stratus Provide? Security Firewall Base Images
11 What does Stratus Provide? Security Firewall Base Images Stratus only allows campus network traffic on ports and 443, and 8443 with SSL-encryption required. Tenants cannot connect to other tenants
12 What does Stratus Provide? Security Firewall Base Images Stratus images come pre-configured with Docker, S3 Object Storage Utilities (s3cmd, minio-client), and NIH utilities (e.g., gdc-client). Some security settings are baked in by MSI, but you can opt-out
13 What is the Cost? FY2018 Rates -- Subject to change annually. Prices based on a Zero-Profit Recovery model Base Subscription includes: 16 vcpus 32GB Memory 2TB Block Storage Access to Secure Object Cache (400TB) Compare to > $700/month
14 Break for Account Creation
15 Login to dbgap Show us your My Projects tab. We need: Project Number PI Name PI Project Start and End Date Your name (could be same as PI) Your (could be same as PI) Are you registered with UMN Sponsored Project Administration (SPA)?
16 Accessing Stratus (Eduroam, UofM Secure, or VPN required)
17 Login Login with any web browser: Choose UMN OIT - Shibboleth (with Duo)
18 Login Enter your UMN ID and Password when prompted.
19 Duo Two-factor Authentication must be enabled for your account If this is your first time using Duo, follow the setup prompts in the left window. Refer to OIT for configuration help: duo-setup-use-two-factor-authentic ation-0
20 You re In! Congratulations, you are authenticated! If you have one or more Stratus allocations, you will see a list of all of your projects. To become a Stratus subscriber, or to get help with other login issues, contact help@msi.umn.edu
21 The Horizon Interface The OpenStack web interface is called Horizon Horizon provides visibility and control over all Virtual Machines (VMs) and Volumes within each Project The simple Web UI is backed by an advanced Web Service API Click around and kick the tires a bit! Horizon only shows you features that you can control
22 Switching Projects To switch projects, use the omnipresent pull-down
23 Project Quotas Each project has a set of Limits visible from the Project > Compute > Overview tab The base subscription* to Stratus includes: 16 vcpus 32 GB RAM 2 TB of Volume Storage Exhausted quotas prevent creation of new VMs and Volumes (*) à la carte pricing is available for larger allocations
24 Instances The Project > Compute > Instances tab shows active VMs You can Launch or Delete instances, as well as modify settings for individual instances All active and manageable VMs are listed in the table WARNING! A deleted VM is gone for good. Be careful what you delete
25 Volumes The Project > Compute > Volumes tab shows active data volumes Volumes store data, and/or active file systems within VMs You can Create or Delete volumes, as well as modify settings like volume size and attachments All active and manageable VMs are listed in the table WARNING! A deleted volume is gone for good
26 Images The Project > Compute > Images tab shows available images for new VMs MSI provides a number of blessed images. These images come with some pre-configured rules and software for data security Images can be Launched as VMs or converted into Volumes. Volumes created from images can also be launched as VMs
27 Security Groups The Project > Compute > Access & Security tab shows security settings (e.g., security groups and key pairs), plus API access information Security Groups control network traffic to VMs, and work like a firewall By default Security Groups reject all incoming traffic to VMs. Additional Security Groups can be added with rules to open ports (e.g., ssh to TCP port 22)
28 Key Pairs SSH keypairs are essential for accessing VMs Create a new key pair to generate and download a new private key, or Import a key pair to upload an existing public key Every VM will boot with one key pair associated with the default user. To login to the VM you will need the matching private key
29 (Do this!!) API Access with OpenStack RC v3 Stratus is backed by many web service APIs that can be controlled directly Click Download OpenStack RC File v3 to get your OpenStack RC file for the current project When sourced in BASH, the OpenStack RC file activates the OpenStack Command Line Interface (CLI)
30 Setup CLI The OpenStack CLI can only connect to Stratus from the bastion host, stratus-bastion.msi.umn.edu To use the CLI: a) b) Transfer your OpenStack RC file to stratus-bastion.msi.umn.edu Source the file on stratus-bastion to authenticate the OpenStack CLI. Use your UMN Password You will be prompted to authenticate with Duo by the bastion host
31 You re Ready! Both Horizon and the OpenStack CLI are ready to roll Let s get started by booting VMs and moving some data!
32 Booting Virtual Machines (VMs)
33 Create a Key Pair (One Time Only) Use the bastion to import a new keypair: 1) 2) 3) Create the new key pair: ssh-keygen -t rsa -b f ~/.ssh/id_rsa Use the OpenStack CLI: openstack keypair create \ --public-key ~/.ssh/id_rsa.pub mykey Check the keypair with: openstack keypair list or go to: oject/access_and_security/ The key pair will be used to boot VMs. Stratus will hold onto the public key, and inject it into VMs, while you hold onto the private key.
34 A New Instance via Horizon The easiest way to boot a VM is through Horizon ( Go to Project > Compute > Instances and click Launch Instance
35 A New Instance via Horizon Horizon provides a Wizard to help you launch VMs. Look for stars (*); those are required fields and can only be set before instance creation! To begin, we name the VM Note that we have the option of booting more than one VM at once by specifying Count
36 A New Instance via Horizon Next we specify the image to boot from. Choose an image, or a volume/snapshot. Enable Create New Volume; this backs the VM with a volume. If you accidentally delete the VM, the volume will persist (unless you agree to Delete Volume on Instance Delete). Specify your Volume Size (GB) based on the capacity needed for the operating system and software on your VM.
37 A New Instance via Horizon Next, choose a Flavor that fits your needs for RAM and vcpus. Total Disk does not matter as the VM storage comes from the backing Volume. Horizon nicely shows you current capacities and the impact on your quota
38 A New Instance via Horizon Next, specify optional settings like additional Security Groups. Don t worry: you can modify optional settings on running VMs, but setting them now will save you time.
39 A New Instance via Horizon Finally, click Launch Instance Stratus will start the boot process and show you details of its current state Inspect the VM by clicking on the Instance Name.
40 A New Instance via Horizon Your instance is ready to go once Status is Active, and Power State is Running
41 Connecting to VMs
42 Opening Port 22 (One Time Only) Before you SSH to a VM, you must open port 22 within the Security Groups Go to Project > Compute > Access & Security and Create Security Group
43 Opening Port 22 (One Time Only) Name the Security Group ssh
44 Opening Port 22 (One Time Only) Next click Manage Rules on the ssh Security Group
45 Opening Port 22 (One Time Only) Click Add Rule
46 Opening Port 22 (One Time Only) Pull down the Rule and choose SSH The default CIDR allows connections from anywhere. Adjust as necessary for your use-case.
47 Opening Port 22 (One Time Only) You re all set! Any VM with the SSH Security Group attached will openly receive ingress (incoming) communication on Port 22
48 Edit a VM s Security Groups To attach the security group, go to Project > Compute > Instances and pull down the instance menu to Edit Security Groups Remember to add the security groups when booting instances, and save time!
49 Edit a VM s Security Groups Apply the new ssh Security Group and click Save The port will be open almost immediately (no reboot required).
50 Choosing the Right Cloud User All cloud images have a default user* for SSH access: On Centos the user is centos On Ubuntu the user is ubuntu See this guide for further details: (*) In the future, some MSI-blessed images will have LDAP enabled for SSH access via your UMNID
51 SSH to VMs Stratus VMs can only be reached via the bastion host, stratus-bastion.msi.umn.edu Remember: a) b) c) VMs are addressed with an IP, not a hostname You must specify the Cloud User when you run ssh Always double check that the server shows the ssh Security Group as attached
52 Working with Volumes
53 Why Volumes? Volumes are created from Block Storage You control the Volume Size Volumes can be formatted as POSIX Filesystems Volumes can migrate between VMs and persist when VMs are stopped Volumes allow for Snapshots
54 Volume Quotas All volumes count against the Volume Storage quota Snapshots are also included
55 Creating a new Volume Go to Project > Compute > Volumes and Create Volume VMs already have volumes attached and in-use for their root filesystem
56 Creating a new Volume Name your volume and specify the desired size (in GB) The size can be grown later The Volume Quota appears on the right
57 Creating a new Volume Success! The volume is created and available. Now you need to attach and format it
58 Attaching a new Volume Pull down the Volume Menu and select Manage Attachments
59 Attaching a new Volume Choose an instance to attach to The Device Name is auto-populated, but you can specify an override
60 Attaching a new Volume The volume is attached! Remember where it is attached to inside the VM (/dev/vdb) Now you need to format and mount the volume
61 Format and Mount a Volume SSH to your VM and check if the volume is present (/dev/vdb) with ls Use mkfs.ext4 (or another mkfs.* command) to format the POSIX filesystem on the volume: sudo mkfs.ext4 /dev/vdb Remember to use sudo for these commands!
62 Format and Mount a Volume The filesystem is ready, but still needs to be mounted. Create a mountpoint with mkdir -p, then mount the filesystem to the mountpoint: sudo mkdir -p /mnt/workspace sudo mount /dev/vdb /mnt/workspace Check the status with df -h Notice that filesystems lose some capacity due to formatting. We ll teach you how to adjust the volume size later
63 Format and Mount a Volume You re almost ready to use the new workspace! Final detail: the mounted filesystem is read-only for regular users. If you want to avoid sudo on every command, open the permissions with chmod: chmod 777 /mnt/workspace
64 Detaching Volumes To safely detach a volume, umount the mount point first: sudo umount /mnt/workspace Confirm it is gone with df -h or ls
65 Detaching Volumes Now you can detach the volume within Horizon Go to Project > Compute > Volumes and pull down the Volume Menu to Manage Attachments
66 Detaching Volumes Click on Detach Volume
67 Detaching Volumes The volume is detached, but not deleted. All data is safe. The volume can be reattached to the previous VM or attached to another VM (e.g., another piece of the workflow)
68 Volume Snapshots Snapshots can be made of any attached or detached volumes Snapshots are static backups of a volume To snapshot a volume, go to Project > Compute > Volumes and choose Create Snapshot from the Volume Menu
69 Volume Snapshots Snapshots can be made of any attached or detached volumes Snapshots are static backups of a volume To snapshot a volume, go to Project > Compute > Volumes and choose Create Snapshot from the Volume Menu
70 Volume Snapshots Label your snapshots intuitively (*) Bug in Horizon: Horizon fails to update the quota for volume snapshots. This will be fixed in the near future.
71 Volume Snapshots If your snapshot exceeds the quota, you will not be able to save it
72 Volume Snapshots You can also snapshot running VMs to lock your software stack Simply create a snapshot of the root volume
73 Volume Snapshots Remember to label and describe the snapshot clearly If the volume is attached and in-use, you can force the snapshot without detaching the volume
74 Volume Snapshots The snapshot might take a while to create
75 Volume Snapshots Viola! The snapshot is ready for use
76 Restoring Snapshots Snapshots are versatile Create Volume will restore the snapshot to a new, attachable volume Launch as Instance restores to a new volume, attached to a new VM instance*. This requires the filesystem inside to be a bootable operating system. (*) Snapshots are your personal VM images
77 Quota Management Storage quotas are always the easiest to fill Remember to delete unused volumes and snapshots to free quota Boot VMs with small volumes (~10GB) and move large workspace volumes between VMs if you would like to purchase a larger quota (1 TB/yr increments)
78 Working with Storage Tiers
79 Storage Tiers Data can migrate between the following Tiers on Stratus: 1. Active Analysis Volume Storage 2. Secure Archive dbgap Cache (s3cache) Persistent Secure Storage (s3secure) 3. Sanitized Data (i.e., non-protected and non-governed) Tier II (tier2) Archive Tape Storage* (*) Availability TBD
80 Where can I use dbgap Data? You can run analysis on dbgap data at MSI, but you must have an active Data Access Plan with the NIH dbgap was previously stored in /panfs/single_copy. It now goes onto Stratus (s3cache and s3secure) single_copy is deprecated and will be disabled on January 1,
81 S3 Cache (a.k.a. dbgap Cache) Intended for short-term caching of bulk protected data (e.g., NIH dbgap data). Consider this a scratch space. No source data; copies only! Capacity is limited to 400 TB total, shared by all dbgap users (fairshare). Don t be a jerk! Bucket ACLs are restricted to individual projects; do not open permissions If cache capacity is reached, objects are deleted following a First-In-First-Out rule regardless of 60-day lifecycle
82 S3 Secure Requires purchase (1 TB/yr increments) Dedicated object storage for protected data For data that cannot be made public No public sharing options Stream data directly in/out of VMs with mc and s3cmd
83 Tier II Storage Public sharing options Only for unprotected data! No dbgap clones or other data covered by policy Same archive storage that is available to the rest of MSI Move data between S3 Cache, S3 Secure, and Tier II using the mc or s3cmd commands on a VM Stage data from Tier I (Panasas) into Tier II before pulling into VMs
84 Encryption You are responsible for self-encrypting data at rest (i.e., within S3 Secure and S3 Cache). Use gpg with the S3cmd Use the encryption option with Minio Client* (*) Currently, Minio Client has limited support for encryption. This will improve in the near future.
85 Moving Data Between Tiers Stream data in/out of VMs with Minio Client (mc) or the S3 Command (s3cmd) Stage data from Tier I (Panasas) into Tier II, then pull data into VMs Pull data from NIH using gdc-client (pre-installed on VMs). Move data from VM to s3cache with mc Focus on staging read-write data on volumes, read-only/write-only data in object storage (s3cache and s3secure), and unprotected data in Tier II.
86 Setup Minio MSI blessed images have the Minio Client (mc) pre-installed To use the client: a) Upload your Minio config.json from stratus-bastion to the VM: scp -r On the VM: mc ls s3cache mc mb s3cache/dbgap-test mc cp test_file s3cache/dbgap-test/test_file
87 Moving Data Around Put a directory: mc cp -r./dbgap-test \ s3cache/dbgap-test Copy a single file: mc cp s3cache/dbgap-test/test_file \./dbgap-test-file.txt mc cp./dbgap-test-file.txt \ s3secure/dbgap-test/dbgap-test-file.txt Stream data from one storage platform to another: mc mirror s3secure/dbgap-test \ tier2/dbgap-test
88 Installing Software
89 SUDO Privileges Since VMs are self-service, users are in full control of what software gets installed Use sudo to escalate privileges to run commands as root
90 Software from a Package Manager Most operating systems come with a package manager Remember to run with sudo! On Centos use yum: sudo yum install <package> On Ubuntu use apt-get: sudo apt-get install <package>
91 Alternate Installations Refer to your application documentation for preferred installation methods Some packages are in platform agnostic repositories like CRAN ( or PyPi ( Some scientific applications are only available from source Remember: Stratus VMs are self-serve. MSI Staff cannot install software for you.
92 Docker Docker is installed by default on all MSI-blessed images Download and run Docker Container Images from DockerHub ( Try it out: docker run -it centos /bin/bash Or docker run -it biocontainers/samtools \ samtools --version
93 Ports 443 and 8443 To help protect users: a) b) Stratus only allows direct access to VM Ports 443 and 8443*. Any service/application running on these ports must have SSL enabled. All other ports are accessible from stratus-bastion.msi.umn.edu. (*) Security Groups do not open 443 or 8443 by default--follow the guide for Port 22 to open these ports
94 dbgap Software gdc-client is pre-installed on MSI blessed images Use gdc-client to stage data on a VM/volume and then push it into the dbgap Cache with the minio client (mc)
95 Questions? Contact the MSI Help Desk:
96 Next Steps
97 Complete the Stratus User Quiz
98 Sign the Agreement to Complete Activation
99 Choose your Subscription Level Send your EFS string for purchase:
100 Thank You!
101 Additional Slides
102 Two-Factor Options
103 MSI Blessed Images
104 Network
105
106 Hardware
Getting Started with Stratus. Evan Bollig 05/01/2017
Getting Started with Stratus Evan Bollig 05/01/2017 Overview What is Stratus? Accessing Stratus Booting Virtual Machines (VMs) Connecting to VMs Working with Volumes Working with Storage Tiers Installing
More informationBooting a Galaxy Instance
Booting a Galaxy Instance Create Security Groups First time Only Create Security Group for Galaxy Name the group galaxy Click Manage Rules for galaxy Click Add Rule Choose HTTPS and Click Add Repeat Security
More informationQuick Start Guide to Compute Canada Cloud Service
Quick Start Guide to Compute Canada Cloud Service Launching your first instance (VM) Login to the East or West cloud Dashboard SSH key pair Importing an existing key pair Creating a new key pair Launching
More informationZadara Enterprise Storage in
Zadara Enterprise Storage in Google Cloud Platform (GCP) Deployment Guide March 2017 Revision A 2011 2017 ZADARA Storage, Inc. All rights reserved. Zadara Storage / GCP - Deployment Guide Page 1 Contents
More informationgetting started guide
Pure commitment. getting started guide Cloud Native Infrastructure version 2.0 Contents Introduction... 3 Intended audience... 3 Logging in to the Cloud Native Infrastructure dashboard... 3 Creating your
More informationCSC- Bioweek 2018 Using cpouta for cloud computing Kimmo Mattila, Shubham Kapoor, Ari-Matti Saren (Jukka Nousiainen)
CSC- Bioweek 2018 Using cpouta for cloud computing 8.2.2018 Kimmo Mattila, Shubham Kapoor, Ari-Matti Saren (Jukka Nousiainen) CSC Finnish research, education and public administration ICT knowledge centre
More informationCIT 668: System Architecture. Amazon Web Services
CIT 668: System Architecture Amazon Web Services Topics 1. AWS Global Infrastructure 2. Foundation Services 1. Compute 2. Storage 3. Database 4. Network 3. AWS Economics Amazon Services Architecture Regions
More informationcpouta exercises
CSC Bioweek. 8.2. 2018 cpouta exercises 1 Table of Contents cpouta exercises 8.2. 2018 1. Launching a virtual machine... 2 1.1 Login to cpouta interface in... 2 1.2 Create your own SSH key pair... 2 A.
More informationOpenStack End User Guide. SUSE OpenStack Cloud 8
OpenStack End User Guide SUSE OpenStack Cloud 8 OpenStack End User Guide SUSE OpenStack Cloud 8 ABSTRACT OpenStack is an open-source cloud computing platform for public and private clouds. A series of
More informationlabibi Documentation Release 1.0 C. Titus Brown
labibi Documentation Release 1.0 C. Titus Brown Jun 05, 2017 Contents 1 Start here: Start an Amazon Web Services computer: 3 1.1 Click here to go to the workshop etherpad................................
More informationFile Storage Level 100
File Storage Level 100 Rohit Rahi November 2018 1 Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be
More informationVMware vcloud Air User's Guide
vcloud Air This document supports the version of each product listed and supports all subsequent versions until the document is replaced by a new edition. To check for more recent editions of this document,
More informationElasterStack 3.2 User Administration Guide - Advanced Zone
ElasterStack 3.2 User Administration Guide - Advanced Zone With Advance Zone Configuration TCloud Computing Inc. 6/22/2012 Copyright 2012 by TCloud Computing, Inc. All rights reserved. This document is
More information271 Waverley Oaks Rd. Telephone: Suite 206 Waltham, MA USA
Contacting Leostream Leostream Corporation http://www.leostream.com 271 Waverley Oaks Rd. Telephone: +1 781 890 2019 Suite 206 Waltham, MA 02452 USA To submit an enhancement request, email features@leostream.com.
More informationAmazon Elastic Compute Cloud
Amazon Elastic Compute Cloud Getting Started Guide AWS Management Console Table of Contents What s New...1 Introduction...2 Setting Up...3 Setting up an AWS Account...3 Signing up for Amazon EC2...3 Signing
More informationNetApp Cloud Volumes Service for AWS
NetApp Cloud Volumes Service for AWS AWS Account Setup Cloud Volumes Team, NetApp, Inc. March 29, 2019 Abstract This document provides instructions to set up the initial AWS environment for using the NetApp
More informationVMware Integrated OpenStack User Guide. VMware Integrated OpenStack 4.1
VMware Integrated OpenStack User Guide VMware Integrated OpenStack 4.1 You can find the most up-to-date technical documentation on the VMware website at: https://docs.vmware.com/ If you have comments about
More informationGetting Started and System Guide. Version
Version 1.0.29 2016 Waterford Technologies. All Rights Reserved. Information in this document is subject to change without notice. No part of this document may be reproduced or transmitted in any form
More informationVeeam Cloud Connect. Version 8.0. Administrator Guide
Veeam Cloud Connect Version 8.0 Administrator Guide June, 2015 2015 Veeam Software. All rights reserved. All trademarks are the property of their respective owners. No part of this publication may be reproduced,
More information271 Waverley Oaks Rd. Telephone: Suite 206 Waltham, MA USA
f Contacting Leostream Leostream Corporation http://www.leostream.com 271 Waverley Oaks Rd. Telephone: +1 781 890 2019 Suite 206 Waltham, MA 02452 USA To submit an enhancement request, email features@leostream.com.
More informationCPM. Quick Start Guide V2.4.0
CPM Quick Start Guide V2.4.0 1 Content 1 Introduction... 3 Launching the instance... 3 CloudFormation... 3 CPM Server Instance Connectivity... 3 2 CPM Server Instance Configuration... 4 CPM Server Configuration...
More informationUSING NGC WITH AZURE. DU _v01 September Setup Guide
USING NGC WITH AZURE DU-08833-001 _v01 September 2018 Setup Guide TABLE OF CONTENTS Chapter Introduction to... 1 Chapter 2. Before You Start... 2 2. Prerequisites... 2 2.2. Setting Up SSH Keys...3 2.3.
More informationDeploying Rubrik Datos IO to Protect MongoDB Database on GCP
DEPLOYMENT GUIDE Deploying Rubrik Datos IO to Protect MongoDB Database on GCP TABLE OF CONTENTS INTRODUCTION... 1 OBJECTIVES... 1 COSTS... 2 BEFORE YOU BEGIN... 2 PROVISIONING YOUR INFRASTRUCTURE FOR THE
More informationVMware Integrated OpenStack User Guide
VMware Integrated OpenStack User Guide VMware Integrated OpenStack 3.0 This document supports the version of each product listed and supports all subsequent versions until the document is replaced by a
More informationRedhat OpenStack 5.0 and PLUMgrid OpenStack Networking Suite 2.0 Installation Hands-on lab guide
Redhat OpenStack 5.0 and PLUMgrid OpenStack Networking Suite 2.0 Installation Hands-on lab guide Oded Nahum Principal Systems Engineer PLUMgrid EMEA November 2014 Page 1 Page 2 Table of Contents Table
More informationInformation Security Policy
Information Security Policy Information Security is a top priority for Ardoq, and we also rely on the security policies and follow the best practices set forth by AWS. Procedures will continuously be updated
More informationEucalyptus User Console Guide
Eucalyptus 4.0.2 User Console Guide 2014-11-05 Eucalyptus Systems Eucalyptus Contents 2 Contents User Console Overview...5 Install the Eucalyptus User Console...6 Install on Centos / RHEL 6.3...6 Configure
More information1. INTRODUCTION to AURO Cloud Computing
1. INTRODUCTION to AURO Cloud Computing Welcome to AURO! The purpose of this document is to help you get started with using AURO s Public Cloud Compute. This document covers how to setup and launch a virtual
More informationVMware AirWatch Content Gateway Guide for Linux For Linux
VMware AirWatch Content Gateway Guide for Linux For Linux Workspace ONE UEM v9.7 Have documentation feedback? Submit a Documentation Feedback support ticket using the Support Wizard on support.air-watch.com.
More informationGetting Started Guide 6/5/2018
Getting Started Guide 6/5/2018 Copyright 2016, 2018, Oracle and/or its affiliates. All rights reserved. This software and related documentation are provided under a license agreement containing restrictions
More information8/3/17. Encryption and Decryption centralized Single point of contact First line of defense. Bishop
Bishop Encryption and Decryption centralized Single point of contact First line of defense If working with VPC Creation and management of security groups Provides additional networking and security options
More informationVMware AirWatch Content Gateway for Linux. VMware Workspace ONE UEM 1811 Unified Access Gateway
VMware AirWatch Content Gateway for Linux VMware Workspace ONE UEM 1811 Unified Access Gateway You can find the most up-to-date technical documentation on the VMware website at: https://docs.vmware.com/
More informationEucalyptus User Console Guide
Eucalyptus 3.4.1 User Console Guide 2013-12-11 Eucalyptus Systems Eucalyptus Contents 2 Contents User Console Overview...5 Install the Eucalyptus User Console...6 Install on Centos / RHEL 6.3...6 Configure
More informationHySecure Quick Start Guide. HySecure 5.0
HySecure Quick Start Guide HySecure 5.0 Last Updated: 25 May 2017 2012-2017 Propalms Technologies Private Limited. All rights reserved. The information contained in this document represents the current
More informationAn introduction to Docker
An introduction to Docker Ing. Vincenzo Maffione Operating Systems Security Container technologies on Linux Several light virtualization technologies are available for Linux They build on cgroups, namespaces
More informationAnsible Tower Quick Setup Guide
Ansible Tower Quick Setup Guide Release Ansible Tower 2.4.5 Red Hat, Inc. Jun 06, 2017 CONTENTS 1 Quick Start 2 2 Login as a Superuser 3 3 Import a License 4 4 Examine the Tower Dashboard 6 5 The Setup
More informationUSING NGC WITH GOOGLE CLOUD PLATFORM
USING NGC WITH GOOGLE CLOUD PLATFORM DU-08962-001 _v02 April 2018 Setup Guide TABLE OF CONTENTS Chapter 1. Introduction to... 1 Chapter 2. Deploying an NVIDIA GPU Cloud Image from the GCP Console...3 2.1.
More informationDeploying a Production Gateway with Airavata
Deploying a Production Gateway with Airavata Table of Contents Pre-requisites... 1 Create a Gateway Request... 1 Gateway Deploy Steps... 2 Install Ansible & Python...2 Deploy the Gateway...3 Gateway Configuration...
More informationFUJITSU Cloud Service S5. Introduction Guide. Ver. 1.3 FUJITSU AMERICA, INC.
FUJITSU Cloud Service S5 Introduction Guide Ver. 1.3 FUJITSU AMERICA, INC. 1 FUJITSU Cloud Service S5 Introduction Guide Ver. 1.3 Date of publish: September, 2011 All Rights Reserved, Copyright FUJITSU
More informationAzure Marketplace. Getting Started Tutorial. Community Edition
Azure Marketplace Getting Started Tutorial Community Edition Introduction NooBaa software provides a distributed storage solution for unstructured data such as analytics data, multi-media, backup, and
More informationKubeNow Documentation
KubeNow Documentation Release 0.3.0 mcapuccini Dec 13, 2017 Getting Started 1 Prerequisites 3 1.1 Install Docker.............................................. 3 1.2 Get KubeNow..............................................
More informationHow To Guide: Long Term Archive for Rubrik. Using SwiftStack Storage as a Long Term Archive for Rubrik
Using SwiftStack Storage as a Long Term Archive for Rubrik Introduction 3 Solution Architecture 5 Example Design 5 Multi Region Cluster 6 Network Design 6 Minimum Supported Versions and Solution Limits
More informationakkadian Provisioning Manager Express
akkadian Provisioning Manager Express Version 4.11.04 Release Notes September 14 th, 2017 Copyright and Trademarks: I. Copyright: This website and its content is copyright 2017 Akkadian Labs, LLC. All
More informationIntroduction to Cloud Computing
You will learn how to: Build and deploy cloud applications and develop an effective implementation strategy Leverage cloud vendors Amazon EC2 and Amazon S3 Exploit Software as a Service (SaaS) to optimize
More informationPaperspace. Deployment Guide. Cloud VDI. 20 Jay St. Suite 312 Brooklyn, NY Technical Whitepaper
Deployment Guide Cloud VDI Copyright 2017 Paperspace, Co. All Rights Reserved September - 1-2017 Technical Whitepaper Whitepaper: Deployment Guide Paperspace Content 1. Overview... 3 2. User Management...
More informationOpenStack Havana All-in-One lab on VMware Workstation
OpenStack Havana All-in-One lab on VMware Workstation With all of the popularity of OpenStack in general, and specifically with my other posts on deploying the Rackspace Private Cloud lab on VMware Workstation,
More informationAndrew Pullin, Senior Software Designer, School of Computer Science / x4338 / HP5165 Last Updated: September 26, 2016
SCS OpenStack Cloud Table of Contents Introduction... 2 Who Can Access the SCS OpenStack?... 2 SCS OpenStack Statistics... 3 Definitions... 3 Using the Openstack Web Interface... 4 Logging into the OpenStack
More informationLENS Server Maintenance Guide JZ 2017/07/28
LENS Server Maintenance Guide JZ 2017/07/28 Duty Maintain LENS server with minimum downtime Patch critical vulnerabilities Assist LAB member for using the LENS services Evaluate for custom requirements
More informationOnCommand Cloud Manager 3.2 Deploying and Managing ONTAP Cloud Systems
OnCommand Cloud Manager 3.2 Deploying and Managing ONTAP Cloud Systems April 2017 215-12035_C0 doccomments@netapp.com Table of Contents 3 Contents Before you create ONTAP Cloud systems... 5 Logging in
More informationCPM Quick Start Guide V2.2.0
CPM Quick Start Guide V2.2.0 1 Content 1 Introduction... 3 1.1 Launching the instance... 3 1.2 CPM Server Instance Connectivity... 3 2 CPM Server Instance Configuration... 3 3 Creating a Simple Backup
More informationQuick Start Guide for Intel FPGA Development Tools on the Microsoft* Azure* Platform
Quick Start Guide for Intel FPGA Development Tools on the Microsoft* Azure* Platform Updated for Intel Quartus Prime Design Suite: 17.1 Subscribe Send Feedback Latest document on the web: PDF HTML Contents
More informationAzure Marketplace Getting Started Tutorial. Community Edition
Azure Marketplace Getting Started Tutorial Community Edition Introduction NooBaa software provides a distributed storage solution for unstructured data such as analytics data, multi-media, backup, and
More informationAnvil: HCC's Cloud. June Workshop Series - June 26th
Anvil: HCC's Cloud June Workshop Series - June 26th Anvil: HCC's Cloud OpenStack Cloud Resource offering customizable virtual machines For projects not well served by a traditional Linux environment: Software
More informationUsing the vrealize Orchestrator OpenStack Plug-In 2.0. Modified on 19 SEP 2017 vrealize Orchestrator 7.0
Using the vrealize Orchestrator OpenStack Plug-In 2.0 Modified on 19 SEP 2017 vrealize Orchestrator 7.0 You can find the most up-to-date technical documentation on the VMware website at: https://docs.vmware.com/
More informationInception Cloud User s Guide
Inception Cloud User s Guide 1 Overview Creating an inception cloud consists of preparing your workstation, preparing the VM environment by adding a temporary boot-up machine, and then executing the orchestrator
More informationGateway Guide. Leostream Gateway. Advanced Capacity and Connection Management for Hybrid Clouds
Gateway Guide Leostream Gateway Advanced Capacity and Connection Management for Hybrid Clouds Version 9.0 June 2018 Contacting Leostream Leostream Corporation 271 Waverley Oaks Rd Suite 206 Waltham, MA
More informationCIT 668: System Architecture
CIT 668: System Architecture Amazon Web Services I Topics 1. Economics 2. Key Concepts 3. Key Services 4. Elastic Compute Cloud 5. Creating an EC2 Instance Images from AWS EC2 User Guide or Wikipedia unless
More informationSetting up a Chaincoin Masternode
Setting up a Chaincoin Masternode Introduction So you want to set up your own Chaincoin Masternode? You ve come to the right place! These instructions are correct as of April, 2017, and relate to version
More informationInstallation of Informatica Services on Amazon EC2
Installation of Informatica Services on Amazon EC2 2014 Informatica Corporation. No part of this document may be reproduced or transmitted in any form, by any means (electronic, photocopying, recording
More informationDenyAll WAF User guide for AWS
DenyAll WAF User guide for AWS Version 6.x 06/13/2017 Summary 1. About this document... 3 1.1 Purpose... 3 2. Getting started... 3 2.1 Introduction... 3 2.2 AMI description... 3 2.3 Requirements... 3 2.4
More informationPexip Infinity and Google Cloud Platform Deployment Guide
Pexip Infinity and Google Cloud Platform Deployment Guide Contents Introduction 1 Deployment guidelines 2 Configuring your Google VPC network 4 Obtaining and preparing disk images for GCE Virtual Machines
More informationTELSTRA CLOUD SERVICES CLOUD INFRASTRUCTURE PRICING GUIDE UNITED KINGDOM
TELSTRA CLOUD SERVICES CLOUD INFRASTRUCTURE PRICING GUIDE UNITED KINGDOM WELCOME TO TELSTRA CLOUD SERVICES Our cloud infrastructure solutions are made up of a combination of scalable cloud resources, including
More informationPivotal Greenplum Database Azure Marketplace v4.0 Release Notes
Pivotal Greenplum Database Azure Marketplace v4.0 Release Notes Updated: February 2019 Overview Pivotal Greenplum is deployed on Azure using an Azure Resource Manager (ARM) template that has been optimized
More informationFEPS. SSH Access with Two-Factor Authentication. RSA Key-pairs
FEPS SSH Access with Two-Factor Authentication RSA Key-pairs access.eps.surrey.ac.uk Contents: Introduction - 3 RSA Key-pairs - 3 Where can I use my RSA Key-Pair? - 3 Step 1 Prepare to generate your RSA
More informationWho is Docker and how he can help us? Heino Talvik
Who is Docker and how he can help us? Heino Talvik heino.talvik@seb.ee heino.talvik@gmail.com What is Docker? Software guy view: Marriage of infrastucture and Source Code Management Hardware guy view:
More informationDeployment Guide for Nuage Networks VSP
Page 1 of 29 view online Overview This document discusses the deployment and configuration of Avi Vantage Load Balancer in a Nuage Networks integrated OpenStack platform for a single tenant mode. The following
More informationNexentaStor VVOL
NexentaStor 5.1.1 VVOL Admin Guide Date: January, 2018 Software Version: NexentaStor 5.1.1 VVOL Part Number: 3000-VVOL-5.1.1-000065-A Table of Contents Preface... 3 Intended Audience 3 References 3 Document
More informationDeployment Guide for Nuage Networks VSP
Page 1 of 11 view online Overview This document discusses the deployment and configuration of Avi Vantage Load Balancer in a Nuage Networks integrated OpenStack platform for a single tenant mode. The following
More informationRed Hat CloudForms 4.5
Red Hat CloudForms 4.5 Installing Red Hat CloudForms on Red Hat OpenStack Platform How to install and configure Red Hat CloudForms on a Red Hat OpenStack Platform environment Last Updated: 2018-10-10 Red
More informationFAST TRACK YOUR AMAZON AWS CLOUD TECHNICAL SKILLS. Enterprise Website Hosting with AWS
FAST TRACK YOUR AMAZON AWS CLOUD TECHNICAL SKILLS Enterprise Website Hosting with AWS 2 Day Course Outline Table of Contents Introduction Course Structure Course Outline Day 1 - Introduction to Cloud Computing,
More informationSystem Requirements ENTERPRISE
System Requirements ENTERPRISE Hardware Prerequisites You must have a single bootstrap node, Mesos master nodes, and Mesos agent nodes. Bootstrap node 1 node with 2 cores, 16 GB RAM, 60 GB HDD. This is
More informationGet your own Galaxy within minutes
Get your own Galaxy within minutes Enis Afgan, Nitesh Turaga, Nuwan Goonasekera GCC 2016 Bloomington, IN Access slides from bit.ly/gcc2016_usecloud Today s agenda Introduction Hands on, part 1 Launch your
More informationEdgeConnect for Amazon Web Services (AWS)
Silver Peak Systems EdgeConnect for Amazon Web Services (AWS) Dinesh Fernando 2-22-2018 Contents EdgeConnect for Amazon Web Services (AWS) Overview... 1 Deploying EC-V Router Mode... 2 Topology... 2 Assumptions
More informationAWS Course Syllabus. Linux Fundamentals. Installation and Initialization:
AWS Course Syllabus Linux Fundamentals Installation and Initialization: Installation, Package Selection Anatomy of a Kickstart File, Command line Introduction to Bash Shell System Initialization, Starting
More informationTestbed-12 TEAM Engine Virtualization User Guide
Testbed-12 TEAM Engine Virtualization User Guide Table of Contents 1. Introduction............................................................................. 3 2. VirtualBox...............................................................................
More informationINSTALLATION RUNBOOK FOR Triliodata + TrilioVault
INSTALLATION RUNBOOK FOR Triliodata + TrilioVault Application Type: [Backup and disaster recovery] Application Version: [2.1] MOS Version: [7.0] OpenStack version: [Kilo] Content Document History 1 Introduction
More informationContents. Note: pay attention to where you are. Note: Plaintext version. Note: pay attention to where you are... 1 Note: Plaintext version...
Contents Note: pay attention to where you are........................................... 1 Note: Plaintext version................................................... 1 Hello World of the Bash shell 2 Accessing
More informationAndrew Pullin, Senior Software Designer, School of Computer Science / x4338 / HP5165 Last Updated: October 05, 2015
SCS OpenStack Cloud Table of Contents Table of Contents... 1 Introduction... 2 Who Can Access the SCS OpenStack?... 2 SCS OpenStack Statistics... 3 Definitions... 3 How To... 4 Logging into the OpenStack
More informationCloudera s Enterprise Data Hub on the Amazon Web Services Cloud: Quick Start Reference Deployment October 2014
Cloudera s Enterprise Data Hub on the Amazon Web Services Cloud: Quick Start Reference Deployment October 2014 Karthik Krishnan Page 1 of 20 Table of Contents Table of Contents... 2 Abstract... 3 What
More informationNetflix OSS Spinnaker on the AWS Cloud
Netflix OSS Spinnaker on the AWS Cloud Quick Start Reference Deployment August 2016 Huy Huynh and Tony Vattathil Solutions Architects, Amazon Web Services Contents Overview... 2 Architecture... 3 Prerequisites...
More informationSecurity Overview of the BGI Online Platform
WHITEPAPER 2015 BGI Online All rights reserved Version: Draft v3, April 2015 Security Overview of the BGI Online Platform Data security is, in general, a very important aspect in computing. We put extra
More informationData Protection and Synchronization for Desktop and Laptop Users VERITAS BACKUP EXEC 9.1 FOR WINDOWS SERVERS DESKTOP AND LAPTOP OPTION
Data Protection and Synchronization for Desktop and Laptop Users VERITAS BACKUP EXEC 9.1 FOR WINDOWS SERVERS DESKTOP AND LAPTOP OPTION 1 TABLE OF CONTENTS VERITAS BACKUP EXEC 9.1 FOR WINDOWS SERVERS...1
More informationAWS Administration. Suggested Pre-requisites Basic IT Knowledge
Course Description Amazon Web Services Administration (AWS Administration) course starts your Cloud Journey. If you are planning to learn Cloud Computing and Amazon Web Services in particular, then this
More informationVMware AirWatch Content Gateway Guide For Linux
VMware AirWatch Content Gateway Guide For Linux AirWatch v9.2 Have documentation feedback? Submit a Documentation Feedback support ticket using the Support Wizard on support.air-watch.com. This product
More informationGetting Started Guide 6/1/2017
Getting Started Guide 6/1/2017 Copyright 2016, 2017, Oracle and/or its affiliates. All rights reserved. This software and related documentation are provided under a license agreement containing restrictions
More informationTELSTRA CLOUD SERVICES CLOUD INFRASTRUCTURE VIRTUAL SERVER (DEDICATED) GEN2 PRICING GUIDE AUSTRALIA
TELSTRA CLOUD SERVICES CLOUD INFRASTRUCTURE VIRTUAL SERVER (DEDICATED) GEN2 PRICING GUIDE AUSTRALIA WELCOME TO TELSTRA CLOUD GEN2 SERVICES Our cloud infrastructure solutions are made up of a combination
More informationvcloud Air - Virtual Private Cloud OnDemand User's Guide
vcloud Air - Virtual Private Cloud OnDemand User's Guide vcloud Air This document supports the version of each product listed and supports all subsequent versions until the document is replaced by a new
More informationGenomics on Cisco Metacloud + SwiftStack
Genomics on Cisco Metacloud + SwiftStack Technology is a large component of driving discovery in both research and providing timely answers for clinical treatments. Advances in genomic sequencing have
More informationDeploy the Firepower Management Center Virtual On the AWS Cloud
Deploy the Firepower Management Center Virtual On the AWS Cloud Amazon Virtual Private Cloud (Amazon VPC) enables you to launch Amazon Web Services (AWS) resources into a virtual network that you define.
More informationAUTOMATING IBM SPECTRUM SCALE CLUSTER BUILDS IN AWS PROOF OF CONCEPT
AUTOMATING IBM SPECTRUM SCALE CLUSTER BUILDS IN AWS PROOF OF CONCEPT By Joshua Kwedar Sr. Systems Engineer By Steve Horan Cloud Architect ATS Innovation Center, Malvern, PA Dates: Oct December 2017 INTRODUCTION
More informationSaaSaMe Transport Workload Snapshot Export for. Alibaba Cloud
SaaSaMe Transport Workload Snapshot Export for Alibaba Cloud Contents About This Document... 3 Revision History... 3 Workload Snapshot Export for Alibaba Cloud... 4 Workload Snapshot Export Feature...
More informationInfrastructure as a Service (IaaS) Compute with Storage and Backup PRICING DOCUMENT
Infrastructure as a Service (IaaS) Compute with Storage and Backup PRICING DOCUMENT Contents 1 Cloud+ IaaS Pricing...2 1.1 Service Pricing Guide... Error! Bookmark not defined. 1.2 Cloud+ Networking Pricing...
More informationMinnesota Supercomputing Institute Regents of the University of Minnesota. All rights reserved.
Minnesota Supercomputing Institute Introduction to Job Submission and Scheduling Andrew Gustafson Interacting with MSI Systems Connecting to MSI SSH is the most reliable connection method Linux and Mac
More informationHitachi File Services Manager Release Notes
Hitachi File Services Manager Release Notes Copyright 2011, 2015, Hitachi, Ltd., Hitachi Data Systems Corporation, ALL RIGHTS RESERVED Notice: No part of this publication may be reproduced or transmitted
More informationTable of Contents 1.1. Introduction. Overview of vsphere Integrated Containers 1.2
Table of Contents Introduction Overview of vsphere Integrated Containers 1.1 1.2 2 Overview of vsphere Integrated Containers This document provides an overview of VMware vsphere Integrated Containers.
More informationVMware Integrated OpenStack with Kubernetes Getting Started Guide. VMware Integrated OpenStack 4.0
VMware Integrated OpenStack with Kubernetes Getting Started Guide VMware Integrated OpenStack 4.0 VMware Integrated OpenStack with Kubernetes Getting Started Guide You can find the most up-to-date technical
More informationCritical Analysis and last hour guide for RHCSA/RHCE Enterprise 7
Critical Analysis and last hour guide for RHCSA/RHCE Enterprise 7 Disclaimer: I haven t gone through RHCSA/RHCE EL 7. I am preparing for upgrade of my RHCE certificate from RHCE EL4 to RHCE EL7. I don
More informationPRODUCT DOCUMENTATION. Backup & Replication v5.0. User Guide.
PRODUCT DOCUMENTATION User Guide Backup & Replication v5.0 www.nakivo.com Table of Contents Solution Architecture... 4 Deployment...11 System Requirements... 12 Deployment Scenarios... 15 Installing NAKIVO
More informationStatement of Compliance Cloud Platform
Bidder Name Statement of Compliance Cloud Platform S. No. Functional Requirements of Virtual Private Cloud and Hybrid Cloud Platform Cloud services 1 Cloud services for both Windows hyper-v and Vmware
More informationTraining on Amazon AWS Cloud Computing. Course Content
Training on Amazon AWS Cloud Computing Course Content 15 Amazon Web Services (AWS) Cloud Computing 1) Introduction to cloud computing Introduction to Cloud Computing Why Cloud Computing? Benefits of Cloud
More information