TPP On The Cloud. Joe Slagel

Size: px
Start display at page:

Download "TPP On The Cloud. Joe Slagel"

Transcription

1 TPP On The Cloud Joe Slagel

2 Lecture topics Introduc5on to Cloud Compu5ng and Amazon Web Services Overview of TPP Cloud components Setup trial AWS and use of the new TPP Web Launcher for Amazon (TWA) Future TPP Direc5on with the Cloud 2

3 So What is Cloud Compu5ng? Cloud compu5ng is Internet- based compu3ng, whereby shared resources, so9ware, and informa3on are provided to computer and other devices on demand, like the electricity grid. - - Wikipedia 3

4 Three Aspects of Cloud Compu5ng SaaS So9ware as a Service So9ware applica3ons available via the browser E.g. Gmail, flickr, NCBI IaaS Infrastructure as a Service Storage, servers and networking components provided on demand through the internet E.G Amazon EC2 & S3, Rackspace, IBM, HP, PaaS PlaKorm as a Service Hosted development environment for building and deploying cloud applica3ons E.g Google Apps, Microso9 Azure, Salesforce.com

5 Cloud Compu5ng Players Source: Gartner (June 2015) 5

6 Amazon Web Services Collec5on of web compu5ng services offered by Amazon Elas5c IT infrastructure allocate computers, storage, and other services as needed Cost effec5ve - - pay only for what you use Easy to use simple API accessed over HTTP which supports almost every language Elas3c Compute Cloud (EC2) Simple Queue Service Flexible Payments Services SimpleDB AWS Import/ Export Mechanical Turk Simple Storage Service (S3) Elas3c MapReduce And many more Large number of tools available built for it

7 Amazon Web Services Regions

8 Amazon S3: Simple Storage Service S3 lets you store files/data on the web in buckets Virtually unlimited storage, bandwidth, and # users No loss of data % durability/yr Always on % availability/yr Files can range from 1 byte to 5 gigabytes * in size with no limit to # files Authen5ca5on mechanisms ensure that data is kept secure and access rights can be granted to specific users. Uses standard h[p REST and SOAP interfaces to access the data that work with any language Storage Data Transfer Requests First Tier S3 Pricing $0.150 $0.11 $ per GB first 50 TB / month of storage used ( 100 GB = $35/yr ) In: $0.100 Free Out: $0.120 per GB first 10 TB/month (sliding scale) $0.01 per 1,000 PUT, COPY, POST, or LIST requests $0.01 per 10,000 GET and all other requests Delete requests are free

9 Amazon S3: Management Console Web based, secure management tool for managing S3 storage Features include: Create/delete buckets Create/delete folders Upload or download files Modify proper5es (permissions) 9

10 Amazon EC2: Elas5c Compute Cloud EC2 allows you launch new computer instances in minutes on demand Can choose from Small to High- CPU Extra Large to Cluster compute instances Choice of large assortment of different OS images (Linux, Windows) or create your own amazon machine image (AMI) Billed only for actual usage/hr + data transfers Full control of the instance Small Large High - CPU Extra Large US East EC2 Linux/Unix Pricing 1.7 GB 32- bit 1 Core, 1 ECU 1, 160 GB storage, Moderate I/O 7.5 GB, 64- bit, 2 Core 2 ECU 1 each 850 GB storage, High I/O 7GB, 64- bit, 8 Core, 2.5 ECU 1 each 1690 GB storage, High I/O $0.08/hr + I/O 2 $0.32/hr + I/O 2 $0.64/hr + I/O 2 1 EC2 Compute Units One unit is equivalent CPU capacity of a GHZ Operon or Xeon processor 2 Data transfer in is $0.10/GB free, transfer out is $0.12/GB for first 10 TB/month

11 Amazon EC2: Management Console Web based, secure management tool for managing EC2 Start and stop EC2 instances Find, manage, and create Amazon Machine Images (AMIs) Monitor instances with real 5me- opera5onal metrics 11

12 Gecng Started: Account Crea5on Go to h[ps://aws.amazon.com/ and click on the Create a Free Account bu[on

13 Gecng Started: AWS Console

14 Gecng Started: Amazon Key ID and Secret Key Your Amazon API key and secret key are used to programma5cally access Amazon services 1. Under the account menu select Security Creden3als 2. Go to iam users, select user to see Access Key ID/Keys 14

15 Lecture topics Introduc5on to Cloud Compu5ng and Amazon Web Services Overview of new TPP Cloud components Setup and Trial of the new TPP Web Launcher for Amazon (TWA) Future TPP Direc5on with the Cloud 15

16 TPP Amazon Images Publicly available Amazon Machine Instances (AMI) for the TPP Based on official public releases of Ubuntu Contain addi5onal open sogware (omssa, myrimatch, etc) Publicly available scripts for building, upda5ng and publishing images Instruc5ons on usage and details documented on wiki site 16

17 Using TPP on the Cloud TPP Web Application (TWA) Simple web based launcher to start petunia on a Amazon server Starts up an pre- configured TPP instance Doesn t require any sogware installa5on and is inexpensive to run Great tool for just trying out TPP Can be used when memory and be[er CPU is needed for an analysis TPP Amazon command line tools (amztpp) Advanced command line toolset Launches parallel searches of files across mul5ple nodes Currently supports X!Tandem, OMSSA, MyriMatch, InsPect Manage all aspects of cloud compu5ng including data transfer, scheduling, and instances Great for quickly and inexpensively processing large amounts of data Direct Cloud support in TPP s User Interface, Petunia

18 TPP Web Launcher for Amazon (TWA) 1. Navigate to h[p://tools.proteomecenter.org/twa 2. Enter your Amazon Key ID and Secret 3. Click Start Instance 4. Welcome to Petunia 5. When you are done just click Stop Instance 18

19 Using the amztpp tool Requires a separate installa5on not included in the standard TPP installa5on (See wiki for instruc5ons and post on spc- discuss mailing list) Has a simple command line interface amztpp <op3ons> <command> <file(s)> Examples: amztpp xtandem *.mzml => submit xtandem searches amztpp n 5 launch amztpp status amztpp man => start 5 more instances => report current status => display manual Supports X!Tandem, omssa, Myrimatch, and Inspect search engines Can run mul5ple different search engines in parallel on mul5ple instances Data automa5cally copied to the cloud and results downloaded when available Automa5cally launches instances based on amount of data being searched NEW! Execute and monitor X!Tandem searches via Petunia, as well as basic cloud account administra5on 19

20 Amazon Web Services Cost Hypothe5cal Analysis 100 mzxml files Avg 100MB/file Avg 10 min/file # EC2 Time (Hrs) Cost $ $8.10 Hours Compute Time vs Cost $15.00 $10.00 $5.00 $ $11.34 # Instances Compute Time Cost Actual Results AWS Cost Breakdown Data Set # EC2 / Threads # Files Scan Count Time Cost Cost/ file Amazon S3 1% Amazon SQS 0% / 8x 132 1,372,984 4:03 $ $ / 8x 132 2,279,874 6:08 $ $ 0.35 Amazon EC2 99% 20

21 amztpp: What does it cost? Canis lupus familiaris Data Set Total 982 raw files organized in 35 folders 598 raw files from LTQ Orbitrap 288 raw files from LTQ 96 raw files from LCQ Deca Searched using X!Tandem, InsPecT, MyriMatch and OMSSA Total of 3,928 searches Total AWS cost of $ % was EC instances Time to comple3on 5.95 hrs 3,915/3,928 Completed (99%) Total of 10,759,379 spectrum Spot price (- - ec2- spot) of $ 0.22 (market $.2160) Max # of EC2 instances (- m) = 100 Max # of parallel upload/download processes (- P) = 10 E C 2 S 3 S Q S Opera5on Spot Price Hours Cost m1.xlarge $ $ m1.xlarge $ $ Subtotal 423 $ Opera5on Price Usage Cost PublicIP- In $ 0.12/GB $ 0.00 PublicIP- Out $ 0.12/GB $ 0.00 InterZone- In $ 0.12/GB $ 0.00 InterZone- Out $ 0.12/GB $ 0.00 Subtotal $ 0.00 EC2 Total $ Opera5on Price Usage Cost PUT, COPY, POST, LIST $0.01/1,000 11,909 $ 0.12 GET, all other $0.01/10,000 17,433 $ 0.02 Data Transfer In $ $ - Data Transfer Out $ 0.12/GB $ S3 Total $ Opera5on Price Usage Cost Requests $0.01/10,000 58,392 $ 0.06 Data Transfer In $ - 0 $ - Data Transfer Out $ 0.12/GB $ 0.00 SQS Total $ 0.06

22 Advantages of Cloud vs. Cluster Scalable Unlimited amount of disk space As many servers as needed Dependable Large distributed system Secure Resilient Plauorm agnos5c CentOS, Debian, Ubuntu, Windows, etc. 32- bit/64- bit No support costs Tradi5onal Cluster High ini5al startup cost Limited scalability Single point of failure Requires local IT personal for maintenance OS/Hardware lock- in Requires 3 rd party grid sogware (PBS/GridEngine, etc) High ini5al costs and variable support costs Scheduling issues/complexity Users compete for resources

23 Advantages of Cloud vs. Cluster Performance issues Bandwidth between instances Bandwidth between S3 upload/ downloads Instance performance Resource alloca3on (instances) File I/O Cost model Could get expensive Pay as you go means you also pay for mistakes Lack of control Regulatory compliance Tradi5onal Cluster High Performance Can finely tune network performance Can finely tune hardware performance Excep3onal hardware capabili3es Excep3onal File I/O Dedicated resources Instances immediately available Host MPI Applica5ons Security

24 TPP Cloud Future Direc5ons Include features for persistently storing MS data and TPP results both using TWA and amztpp Improved performance in file transfers to S3 Launch other search engines in the cloud via Petunia Support more TPP programs (e.g prophets) Ability to share data sets on the cloud 24

25 Ar5cle in MCP describing AWS & TPP 25

26 More Informa5on TPP Cloud Services hxp://tools.proteomecenter.org/wiki/index.php?3tle=tpp:cloud Cloud compu5ng with Amazon Web Services hxp:// cloudaws1/ Amazon Elas5c Compute Cloud hxp://aws.amazon.com/ec2/ Amazon Simple Storage Solu5on hxp://aws.amazon.com/s3 TPP Mailing List hxp://groups.google.com/group/spctools- discuss 26

Basics of Cloud Computing Lecture 2. Cloud Providers. Satish Srirama

Basics of Cloud Computing Lecture 2. Cloud Providers. Satish Srirama Basics of Cloud Computing Lecture 2 Cloud Providers Satish Srirama Outline Cloud computing services recap Amazon cloud services Elastic Compute Cloud (EC2) Storage services - Amazon S3 and EBS Cloud managers

More information

Basics of Cloud Computing Lecture 2. Cloud Providers. Satish Srirama

Basics of Cloud Computing Lecture 2. Cloud Providers. Satish Srirama Basics of Cloud Computing Lecture 2 Cloud Providers Satish Srirama Outline Cloud computing services recap Amazon cloud services Elastic Compute Cloud (EC2) Storage services - Amazon S3 and EBS Cloud managers

More information

Introduction to Amazon Web Services

Introduction to Amazon Web Services Introduction to Amazon Web Services Introduction Amazon Web Services (AWS) is a collection of remote infrastructure services mainly in the Infrastructure as a Service (IaaS) category, with some services

More information

Basics of Cloud Computing Lecture 2. Cloud Providers. Satish Srirama

Basics of Cloud Computing Lecture 2. Cloud Providers. Satish Srirama Basics of Cloud Computing Lecture 2 Cloud Providers Satish Srirama Outline Cloud computing services recap Amazon cloud services Elastic Compute Cloud (EC2) Storage services -Amazon S3 and EBS Cloud managers

More information

Introduction to Cloud Computing

Introduction to Cloud Computing You will learn how to: Build and deploy cloud applications and develop an effective implementation strategy Leverage cloud vendors Amazon EC2 and Amazon S3 Exploit Software as a Service (SaaS) to optimize

More information

Cloud Computing 4/17/2016. Outline. Cloud Computing. Centralized versus Distributed Computing Some people argue that Cloud Computing. Cloud Computing.

Cloud Computing 4/17/2016. Outline. Cloud Computing. Centralized versus Distributed Computing Some people argue that Cloud Computing. Cloud Computing. Cloud Computing By: Muhammad Naseem Assistant Professor Department of Computer Engineering, Sir Syed University of Engineering & Technology, Web: http://sites.google.com/site/muhammadnaseem105 Email: mnaseem105@yahoo.com

More information

AWS: Basic Architecture Session SUNEY SHARMA Solutions Architect: AWS

AWS: Basic Architecture Session SUNEY SHARMA Solutions Architect: AWS AWS: Basic Architecture Session SUNEY SHARMA Solutions Architect: AWS suneys@amazon.com AWS Core Infrastructure and Services Traditional Infrastructure Amazon Web Services Security Security Firewalls ACLs

More information

AWS Iden)ty And Access Management (IAM) Manohar Rapolu

AWS Iden)ty And Access Management (IAM) Manohar Rapolu AWS Iden)ty And Access Management (IAM) Manohar Rapolu Topics Introduc5on Principals Authen5ca5on Authoriza5on Other Key Feature -> Mul5 Factor Authen5ca5on -> Rota5ng Keys -> Resolving Mul5ple Permissions

More information

Cloud Computing Lecture 4

Cloud Computing Lecture 4 Cloud Computing Lecture 4 1/17/2012 What is Hypervisor in Cloud Computing and its types? The hypervisor is a virtual machine monitor (VMM) that manages resources for virtual machines. The name hypervisor

More information

Course Overview. ECE 1779 Introduction to Cloud Computing. Marking. Class Mechanics. Eyal de Lara

Course Overview. ECE 1779 Introduction to Cloud Computing. Marking. Class Mechanics. Eyal de Lara ECE 1779 Introduction to Cloud Computing Eyal de Lara delara@cs.toronto.edu www.cs.toronto.edu/~delara/courses/ece1779 Course Overview Date Topic Sep 14 Introduction Sep 21 Python Sep 22 Tutorial: Python

More information

What is Cloud Computing? What are the Private and Public Clouds? What are IaaS, PaaS, and SaaS? What is the Amazon Web Services (AWS)?

What is Cloud Computing? What are the Private and Public Clouds? What are IaaS, PaaS, and SaaS? What is the Amazon Web Services (AWS)? What is Cloud Computing? What are the Private and Public Clouds? What are IaaS, PaaS, and SaaS? What is the Amazon Web Services (AWS)? What is Amazon Machine Image (AMI)? Amazon Elastic Compute Cloud (EC2)?

More information

CIT 668: System Architecture. Amazon Web Services

CIT 668: System Architecture. Amazon Web Services CIT 668: System Architecture Amazon Web Services Topics 1. AWS Global Infrastructure 2. Foundation Services 1. Compute 2. Storage 3. Database 4. Network 3. AWS Economics Amazon Services Architecture Regions

More information

DISTRIBUTED SYSTEMS [COMP9243] Lecture 8a: Cloud Computing WHAT IS CLOUD COMPUTING? 2. Slide 3. Slide 1. Why is it called Cloud?

DISTRIBUTED SYSTEMS [COMP9243] Lecture 8a: Cloud Computing WHAT IS CLOUD COMPUTING? 2. Slide 3. Slide 1. Why is it called Cloud? DISTRIBUTED SYSTEMS [COMP9243] Lecture 8a: Cloud Computing Slide 1 Slide 3 ➀ What is Cloud Computing? ➁ X as a Service ➂ Key Challenges ➃ Developing for the Cloud Why is it called Cloud? services provided

More information

LINUX, WINDOWS(MCSE),

LINUX, WINDOWS(MCSE), Virtualization Foundation Evolution of Virtualization Virtualization Basics Virtualization Types (Type1 & Type2) Virtualization Demo (VMware ESXi, Citrix Xenserver, Hyper-V, KVM) Cloud Computing Foundation

More information

Training on Amazon AWS Cloud Computing. Course Content

Training on Amazon AWS Cloud Computing. Course Content Training on Amazon AWS Cloud Computing Course Content 15 Amazon Web Services (AWS) Cloud Computing 1) Introduction to cloud computing Introduction to Cloud Computing Why Cloud Computing? Benefits of Cloud

More information

Western Michigan University

Western Michigan University CS-6030 Cloud compu;ng Google App engine Sepideh Mohammadi Summer II 2017 Western Michigan University content Categories of cloud compu;ng Google cloud plaborm Google App Engine Storage technologies Datastore

More information

Cloud Computing 1. CSCI 4850/5850 High-Performance Computing Spring 2018

Cloud Computing 1. CSCI 4850/5850 High-Performance Computing Spring 2018 Cloud Computing 1 CSCI 4850/5850 High-Performance Computing Spring 2018 Tae-Hyuk (Ted) Ahn Department of Computer Science Program of Bioinformatics and Computational Biology Saint Louis University Learning

More information

Large Scale Computing Infrastructures

Large Scale Computing Infrastructures GC3: Grid Computing Competence Center Large Scale Computing Infrastructures Lecture 2: Cloud technologies Sergio Maffioletti GC3: Grid Computing Competence Center, University

More information

Azure Marketplace Getting Started Tutorial. Community Edition

Azure Marketplace Getting Started Tutorial. Community Edition Azure Marketplace Getting Started Tutorial Community Edition Introduction NooBaa software provides a distributed storage solution for unstructured data such as analytics data, multi-media, backup, and

More information

CPET 581 Cloud Computing: Technologies and Enterprise IT Strategies

CPET 581 Cloud Computing: Technologies and Enterprise IT Strategies CPET 581 Cloud Computing: Technologies and Enterprise IT Strategies Lecture 8 Cloud Programming & Software Environments: High Performance Computing & AWS Services Part 2 of 2 Spring 2015 A Specialty Course

More information

Welcome to the New Era of Cloud Computing

Welcome to the New Era of Cloud Computing Welcome to the New Era of Cloud Computing Aaron Kimball The web is replacing the desktop 1 SDKs & toolkits are there What about the backend? Image: Wikipedia user Calyponte 2 Two key concepts Processing

More information

Amazon Web Services. Block 402, 4 th Floor, Saptagiri Towers, Above Pantaloons, Begumpet Main Road, Hyderabad Telangana India

Amazon Web Services. Block 402, 4 th Floor, Saptagiri Towers, Above Pantaloons, Begumpet Main Road, Hyderabad Telangana India (AWS) Overview: AWS is a cloud service from Amazon, which provides services in the form of building blocks, these building blocks can be used to create and deploy various types of application in the cloud.

More information

Introduction to data centers

Introduction to data centers Introduction to data centers Paolo Giaccone Notes for the class on Switching technologies for data centers Politecnico di Torino December 2017 Cloud computing Section 1 Cloud computing Giaccone (Politecnico

More information

Azure Marketplace. Getting Started Tutorial. Community Edition

Azure Marketplace. Getting Started Tutorial. Community Edition Azure Marketplace Getting Started Tutorial Community Edition Introduction NooBaa software provides a distributed storage solution for unstructured data such as analytics data, multi-media, backup, and

More information

CS15-319: Cloud Computing. Lecture 3 Course Project and Amazon AWS Majd Sakr and Mohammad Hammoud

CS15-319: Cloud Computing. Lecture 3 Course Project and Amazon AWS Majd Sakr and Mohammad Hammoud CS15-319: Cloud Computing Lecture 3 Course Project and Amazon AWS Majd Sakr and Mohammad Hammoud Lecture Outline Discussion On Course Project Amazon Web Services 2 Course Project Course Project Phase I-A

More information

Sausalito: An Applica/on Server for RESTful Services in the Cloud. Ma;hias Brantner & Donald Kossmann 28msec Inc. h;p://sausalito.28msec.

Sausalito: An Applica/on Server for RESTful Services in the Cloud. Ma;hias Brantner & Donald Kossmann 28msec Inc. h;p://sausalito.28msec. Sausalito: An Applica/on Server for RESTful Services in the Cloud Ma;hias Brantner & Donald Kossmann 28msec Inc. h;p://sausalito.28msec.com/ Conclusion Integrate DBMS, Applica3on Server, and Web Server

More information

Today s Objec4ves. Data Center. Virtualiza4on Cloud Compu4ng Amazon Web Services. What did you think? 10/23/17. Oct 23, 2017 Sprenkle - CSCI325

Today s Objec4ves. Data Center. Virtualiza4on Cloud Compu4ng Amazon Web Services. What did you think? 10/23/17. Oct 23, 2017 Sprenkle - CSCI325 Today s Objec4ves Virtualiza4on Cloud Compu4ng Amazon Web Services Oct 23, 2017 Sprenkle - CSCI325 1 Data Center What did you think? Oct 23, 2017 Sprenkle - CSCI325 2 1 10/23/17 Oct 23, 2017 Sprenkle -

More information

Case Study: Amazon AWS. CSE Cloud Compu0ng Prof. Douglas Thain University of Notre Dame

Case Study: Amazon AWS. CSE Cloud Compu0ng Prof. Douglas Thain University of Notre Dame Case Study: Amazon AWS CSE 40822 Cloud Compu0ng Prof. Douglas Thain University of Notre Dame Cau3on to the Reader: Herein are examples of prices consulted in spring 2016, to give a sense of the magnitude

More information

Introduction to. Amazon Web Services. Thilina Gunarathne Salsa Group, Indiana University. With contributions from Saliya Ekanayake.

Introduction to. Amazon Web Services. Thilina Gunarathne Salsa Group, Indiana University. With contributions from Saliya Ekanayake. Introduction to Amazon Web Services Thilina Gunarathne Salsa Group, Indiana University. With contributions from Saliya Ekanayake. Introduction Fourth Paradigm Data intensive scientific discovery DNA Sequencing

More information

Amazon Web Services (AWS) Solutions Architect Intermediate Level Course Content

Amazon Web Services (AWS) Solutions Architect Intermediate Level Course Content Amazon Web Services (AWS) Solutions Architect Intermediate Level Course Content Introduction to Cloud Computing A Short history Client Server Computing Concepts Challenges with Distributed Computing Introduction

More information

Cloud Computing Briefing Presentation. DANU

Cloud Computing Briefing Presentation. DANU Cloud Computing Briefing Presentation Contents Introducing the Cloud Value Proposition Opportunities Challenges Success Stories DANU Cloud Offering Introducing the Cloud What is Cloud Computing? IT capabilities

More information

Enroll Now to Take online Course Contact: Demo video By Chandra sir

Enroll Now to Take online Course   Contact: Demo video By Chandra sir Enroll Now to Take online Course www.vlrtraining.in/register-for-aws Contact:9059868766 9985269518 Demo video By Chandra sir www.youtube.com/watch?v=8pu1who2j_k Chandra sir Class 01 https://www.youtube.com/watch?v=fccgwstm-cc

More information

CIT 668: System Architecture

CIT 668: System Architecture CIT 668: System Architecture Amazon Web Services I Topics 1. Economics 2. Key Concepts 3. Key Services 4. Elastic Compute Cloud 5. Creating an EC2 Instance Images from AWS EC2 User Guide or Wikipedia unless

More information

Deploy. A step-by-step guide to successfully deploying your new app with the FileMaker Platform

Deploy. A step-by-step guide to successfully deploying your new app with the FileMaker Platform Deploy A step-by-step guide to successfully deploying your new app with the FileMaker Platform Share your custom app with your team! Now that you ve used the Plan Guide to define your custom app requirements,

More information

Elas%c Load Balancing, Amazon CloudWatch, and Auto Scaling Sco) Linder

Elas%c Load Balancing, Amazon CloudWatch, and Auto Scaling Sco) Linder Elas%c Load Balancing, Amazon, and Auto Scaling Sco) Linder Overview Elas4c Load Balancing Features/Restric4ons Connec4on Types Listeners Configura4on Op4ons Auto Scaling Launch Configura4ons Scaling Types

More information

Cloud Programming. Programming Environment Oct 29, 2015 Osamu Tatebe

Cloud Programming. Programming Environment Oct 29, 2015 Osamu Tatebe Cloud Programming Programming Environment Oct 29, 2015 Osamu Tatebe Cloud Computing Only required amount of CPU and storage can be used anytime from anywhere via network Availability, throughput, reliability

More information

Data Centers and Cloud Computing

Data Centers and Cloud Computing Data Centers and Cloud Computing CS677 Guest Lecture Tim Wood 1 Data Centers Large server and storage farms 1000s of servers Many TBs or PBs of data Used by Enterprises for server applications Internet

More information

Data Centers and Cloud Computing. Slides courtesy of Tim Wood

Data Centers and Cloud Computing. Slides courtesy of Tim Wood Data Centers and Cloud Computing Slides courtesy of Tim Wood 1 Data Centers Large server and storage farms 1000s of servers Many TBs or PBs of data Used by Enterprises for server applications Internet

More information

CPSC 426/526. Cloud Computing. Ennan Zhai. Computer Science Department Yale University

CPSC 426/526. Cloud Computing. Ennan Zhai. Computer Science Department Yale University CPSC 426/526 Cloud Computing Ennan Zhai Computer Science Department Yale University Recall: Lec-7 In the lec-7, I talked about: - P2P vs Enterprise control - Firewall - NATs - Software defined network

More information

At Course Completion Prepares you as per certification requirements for AWS Developer Associate.

At Course Completion Prepares you as per certification requirements for AWS Developer Associate. [AWS-DAW]: AWS Cloud Developer Associate Workshop Length Delivery Method : 4 days : Instructor-led (Classroom) At Course Completion Prepares you as per certification requirements for AWS Developer Associate.

More information

Amazon Web Services Training. Training Topics:

Amazon Web Services Training. Training Topics: Amazon Web Services Training Training Topics: SECTION1: INTRODUCTION TO CLOUD COMPUTING A Short history Client Server Computing Concepts Challenges with Distributed Computing Introduction to Cloud Computing

More information

Amazon Web Services Cloud Computing in Action. Jeff Barr

Amazon Web Services Cloud Computing in Action. Jeff Barr Amazon Web Services Cloud Computing in Action Jeff Barr jbarr@amazon.com Who am I? Software development background Programmable applications and sites Microsoft Visual Basic and.net Teams Startup / venture

More information

Data Centers and Cloud Computing. Data Centers

Data Centers and Cloud Computing. Data Centers Data Centers and Cloud Computing Slides courtesy of Tim Wood 1 Data Centers Large server and storage farms 1000s of servers Many TBs or PBs of data Used by Enterprises for server applications Internet

More information

Cloudera s Enterprise Data Hub on the Amazon Web Services Cloud: Quick Start Reference Deployment October 2014

Cloudera s Enterprise Data Hub on the Amazon Web Services Cloud: Quick Start Reference Deployment October 2014 Cloudera s Enterprise Data Hub on the Amazon Web Services Cloud: Quick Start Reference Deployment October 2014 Karthik Krishnan Page 1 of 20 Table of Contents Table of Contents... 2 Abstract... 3 What

More information

CSE 344 Introduc/on to Data Management. Sec/on 9: AWS, Hadoop, Pig La/n Yuyin Sun

CSE 344 Introduc/on to Data Management. Sec/on 9: AWS, Hadoop, Pig La/n Yuyin Sun CSE 344 Introduc/on to Data Management Sec/on 9: AWS, Hadoop, Pig La/n Yuyin Sun Homework 8 (Last hw J) 0.5 TB (yes, TeraBytes!) of data 251 files of ~ 2GB each btc-2010-chunk-000 to btc-2010-chunk-317

More information

AWS Solution Architecture Patterns

AWS Solution Architecture Patterns AWS Solution Architecture Patterns Objectives Key objectives of this chapter AWS reference architecture catalog Overview of some AWS solution architecture patterns 1.1 AWS Architecture Center The AWS Architecture

More information

CloudHealth. AWS and Azure On-Boarding

CloudHealth. AWS and Azure On-Boarding CloudHealth AWS and Azure On-Boarding Contents 1. Enabling AWS Accounts... 3 1.1 Setup Usage & Billing Reports... 3 1.2 Setting Up a Read-Only IAM Role... 3 1.3 CloudTrail Setup... 5 1.4 Cost and Usage

More information

Kaseya Fundamentals Workshop DAY TWO. Developed by Kaseya University. Powered by IT Scholars

Kaseya Fundamentals Workshop DAY TWO. Developed by Kaseya University. Powered by IT Scholars Kaseya Fundamentals Workshop DAY TWO Developed by Kaseya University Powered by IT Scholars Kaseya Version 6.5 Last updated March, 2014 Day One Review IT- Scholars Virtual LABS System Management Organiza@on

More information

What is Cloud Computing? Cloud computing is the dynamic delivery of IT resources and capabilities as a Service over the Internet.

What is Cloud Computing? Cloud computing is the dynamic delivery of IT resources and capabilities as a Service over the Internet. 1 INTRODUCTION What is Cloud Computing? Cloud computing is the dynamic delivery of IT resources and capabilities as a Service over the Internet. Cloud computing encompasses any Subscriptionbased or pay-per-use

More information

Amazon Web Services (AWS) Training Course Content

Amazon Web Services (AWS) Training Course Content Amazon Web Services (AWS) Training Course Content SECTION 1: CLOUD COMPUTING INTRODUCTION History of Cloud Computing Concept of Client Server Computing Distributed Computing and it s Challenges What is

More information

AWS Storage Gateway. Not your father s hybrid storage. University of Arizona IT Summit October 23, Jay Vagalatos, AWS Solutions Architect

AWS Storage Gateway. Not your father s hybrid storage. University of Arizona IT Summit October 23, Jay Vagalatos, AWS Solutions Architect AWS Storage Gateway Not your father s hybrid storage University of Arizona IT Summit 2017 Jay Vagalatos, AWS Solutions Architect October 23, 2017 The AWS Storage Portfolio Amazon EBS (persistent) Block

More information

Cloud Providers more AWS, Aneka

Cloud Providers more AWS, Aneka Basics of Cloud Computing Lecture 6 Cloud Providers more AWS, Aneka and GAE Satish Srirama Outline More AWS Some more PaaS Aneka Google App Engine Force.com 16.05.2012 Satish Srirama 2/51 Recap Last lecture

More information

2013 AWS Worldwide Public Sector Summit Washington, D.C.

2013 AWS Worldwide Public Sector Summit Washington, D.C. 2013 AWS Worldwide Public Sector Summit Washington, D.C. EMR for Fun and for Profit Ben Butler Sr. Manager, Big Data butlerb@amazon.com @bensbutler Overview 1. What is big data? 2. What is AWS Elastic

More information

How can you implement this through a script that a scheduling daemon runs daily on the application servers?

How can you implement this through a script that a scheduling daemon runs daily on the application servers? You ve been tasked with implementing an automated data backup solution for your application servers that run on Amazon EC2 with Amazon EBS volumes. You want to use a distributed data store for your backups

More information

COP Cloud Computing. Presented by: Sanketh Beerabbi University of Central Florida

COP Cloud Computing. Presented by: Sanketh Beerabbi University of Central Florida COP6087 - Cloud Computing Presented by: Sanketh Beerabbi University of Central Florida A cloud is a collection of networked resources configured such that users can request scalable resources (VMs, platforms,

More information

FutureGrid 101. Part 2: Ge*ng Started Craig Stewart

FutureGrid 101. Part 2: Ge*ng Started Craig Stewart FutureGrid 101 Part 2: Ge*ng Started Craig Stewart Futuregrid.org We re s9ll in early adopter mode But we are very much interested in applica9ons experiments, computa9onal science experiments, and computer

More information

SAA-C01. AWS Solutions Architect Associate. Exam Summary Syllabus Questions

SAA-C01. AWS Solutions Architect Associate. Exam Summary Syllabus Questions SAA-C01 AWS Solutions Architect Associate Exam Summary Syllabus Questions Table of Contents Introduction to SAA-C01 Exam on AWS Solutions Architect Associate... 2 AWS SAA-C01 Certification Details:...

More information

SQS, SWF, and SNS 7/24/17. References. Amazon Simple Queue Service(SQS)

SQS, SWF, and SNS 7/24/17. References. Amazon Simple Queue Service(SQS) SQS, SWF, and SNS Chapter 8 References All informa6on in this presenta6on was obtained from the following sources with all credit due to the listed authors: J. Baron, H. Baz, T. Bixler, B. Gaut, K. E.

More information

PrepAwayExam. High-efficient Exam Materials are the best high pass-rate Exam Dumps

PrepAwayExam.   High-efficient Exam Materials are the best high pass-rate Exam Dumps PrepAwayExam http://www.prepawayexam.com/ High-efficient Exam Materials are the best high pass-rate Exam Dumps Exam : SAA-C01 Title : AWS Certified Solutions Architect - Associate (Released February 2018)

More information

Oracle VM Workshop Applica>on Driven Virtualiza>on

Oracle VM Workshop Applica>on Driven Virtualiza>on Oracle VM Workshop Applica>on Driven Virtualiza>on Simon COTER Principal Product Manager Oracle VM & VirtualBox simon.coter@oracle.com hnps://blogs.oracle.com/scoter November 25th, 2015 Copyright 2014

More information

CLOUD AND AWS TECHNICAL ESSENTIALS PLUS

CLOUD AND AWS TECHNICAL ESSENTIALS PLUS 1 P a g e CLOUD AND AWS TECHNICAL ESSENTIALS PLUS Contents Description... 2 Course Objectives... 2 Cloud computing essentials:... 2 Pre-Cloud and Need for Cloud:... 2 Cloud Computing and in-depth discussion...

More information

Grids and Clouds. GridKa School 2009 Forschungszentrum Karlsruhe September 1st 2009 Christian Baun.

Grids and Clouds. GridKa School 2009 Forschungszentrum Karlsruhe September 1st 2009 Christian Baun. Grids and Clouds GridKa School 2009 Forschungszentrum Karlsruhe September 1st 2009 Christian Baun KIT The cooperation of Forschungszentrum Karlsruhe GmbH und Universität Karlsruhe (TH) http://www.kit.edu

More information

Scientific Workflows and Cloud Computing. Gideon Juve USC Information Sciences Institute

Scientific Workflows and Cloud Computing. Gideon Juve USC Information Sciences Institute Scientific Workflows and Cloud Computing Gideon Juve USC Information Sciences Institute gideon@isi.edu Scientific Workflows Loosely-coupled parallel applications Expressed as directed acyclic graphs (DAGs)

More information

AWS Concepts and Lab Intro

AWS Concepts and Lab Intro AWS Concepts and Lab Intro Saptarshi Debroy, Minh Nguyen Contact: Prasad Calyam Slides adapted from Hwang, Fox, Dongarra & Programming Amazon EC2, Vliet, Paganelli Growth of AWS DynanoDB 1.3 Trillion in

More information

Amazon Web Services. A Short Guide. SLUUG R. Scott Granneman Jans Carton

Amazon Web Services. A Short Guide. SLUUG R. Scott Granneman   Jans Carton Amazon Web Services A Short Guide SLUUG R. Scott Granneman scott@granneman.com www.granneman.com Jans Carton jans@websanity.com 2010 R. Scott Granneman Last updated 20101013 You are free to use this work,

More information

Cloud Computing. Technologies and Types

Cloud Computing. Technologies and Types Cloud Computing Cloud Computing Technologies and Types Dell Zhang Birkbeck, University of London 2017/18 The Technological Underpinnings of Cloud Computing Data centres Virtualisation RESTful APIs Cloud

More information

AWS Administration. Suggested Pre-requisites Basic IT Knowledge

AWS Administration. Suggested Pre-requisites Basic IT Knowledge Course Description Amazon Web Services Administration (AWS Administration) course starts your Cloud Journey. If you are planning to learn Cloud Computing and Amazon Web Services in particular, then this

More information

SUREedge Migrator Installation Guide for Amazon AWS

SUREedge Migrator Installation Guide for Amazon AWS SUREedge Migrator Installation Guide for Amazon AWS Contents 1. Introduction... 3 1.1 SUREedge Migrator Deployment Scenarios... 3 1.2 Installation Overview... 4 2. Obtaining Software and Documentation...

More information

6 Cloud/Grid Computing

6 Cloud/Grid Computing 6 Cloud/Grid Computing On-line lecture: http://buchananweb.co.uk/adv/unit06.html 6.1 Objectives The key objectives of this unit are to: Provide an introduction to cluster, grid and cloud infrastructures.

More information

Straight Talk on Business Critical Applications in the Cloud

Straight Talk on Business Critical Applications in the Cloud Straight Talk on Business Critical Applications in the Cloud INFOTEC March 27, 2018 Speaker Jim Hannan Principal Architect House of Brick Technologies Jim Hannan is one of the industry s leading architects

More information

Oracle IaaS, a modern felhő infrastruktúra

Oracle IaaS, a modern felhő infrastruktúra Sárecz Lajos Cloud Platform Sales Consultant Oracle IaaS, a modern felhő infrastruktúra Copyright 2017, Oracle and/or its affiliates. All rights reserved. Azure Window collapsed Oracle Infrastructure as

More information

SURVEY PAPER ON CLOUD COMPUTING

SURVEY PAPER ON CLOUD COMPUTING SURVEY PAPER ON CLOUD COMPUTING Kalpana Tiwari 1, Er. Sachin Chaudhary 2, Er. Kumar Shanu 3 1,2,3 Department of Computer Science and Engineering Bhagwant Institute of Technology, Muzaffarnagar, Uttar Pradesh

More information

Lecture 09: VMs and VCS head in the clouds

Lecture 09: VMs and VCS head in the clouds Lecture 09: VMs and VCS head in the Hands-on Unix system administration DeCal 2012-10-29 1 / 20 Projects groups of four people submit one form per group with OCF usernames, proposed project ideas, and

More information

BERLIN. 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved

BERLIN. 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved BERLIN 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved Introduction to Amazon EC2 Danilo Poccia Technical Evangelist @danilop 2015, Amazon Web Services, Inc. or its affiliates. All

More information

Amazon AWS-Solution-Architect-Associate Exam

Amazon AWS-Solution-Architect-Associate Exam Volume: 858 Questions Question: 1 You are trying to launch an EC2 instance, however the instance seems to go into a terminated status immediately. What would probably not be a reason that this is happening?

More information

Lab 2 Third Party API Integration, Cloud Deployment & Benchmarking

Lab 2 Third Party API Integration, Cloud Deployment & Benchmarking Lab 2 Third Party API Integration, Cloud Deployment & Benchmarking In lab 1, you have setup the web framework and the crawler. In this lab, you will complete the deployment flow for launching a web application

More information

Introduction to ArcGIS Server Architecture and Services. Amr Wahba

Introduction to ArcGIS Server Architecture and Services. Amr Wahba Introduction to ArcGIS Server 10.1 - Architecture and Services Amr Wahba awahba@esri.com Agenda Architecture Features Publishing Security Cloud Powerful GIS capabilities Delivered as Web services To help

More information

Guide for Attempting an HDP Certification Practice Exam. Revision 2 Hortonworks University

Guide for Attempting an HDP Certification Practice Exam. Revision 2 Hortonworks University Guide for Attempting an HDP Certification Practice Exam Revision 2 Hortonworks University Overview Hortonworks University has developed a practice environment that emulates our actual exam environment.

More information

VMware vcloud Air User's Guide

VMware vcloud Air User's Guide vcloud Air This document supports the version of each product listed and supports all subsequent versions until the document is replaced by a new edition. To check for more recent editions of this document,

More information

Amazon. Exam Questions AWS-Certified-Solutions-Architect- Professional. AWS-Certified-Solutions-Architect-Professional.

Amazon. Exam Questions AWS-Certified-Solutions-Architect- Professional. AWS-Certified-Solutions-Architect-Professional. Amazon Exam Questions AWS-Certified-Solutions-Architect- Professional AWS-Certified-Solutions-Architect-Professional Version:Demo 1.. The MySecureData company has five branches across the globe. They want

More information

Moving to the Cloud: Making It Happen With MarkLogic

Moving to the Cloud: Making It Happen With MarkLogic Moving to the Cloud: Making It Happen With MarkLogic Alex Bleasdale, Manager, Support, MarkLogic COPYRIGHT 20 April 2017 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. Agenda 1. MarkLogic in the cloud 2.

More information

Kaseya Fundamentals Workshop DAY FOUR. Developed by Kaseya University. Powered by IT Scholars

Kaseya Fundamentals Workshop DAY FOUR. Developed by Kaseya University. Powered by IT Scholars Kaseya Fundamentals Workshop DAY FOUR Developed by Kaseya University Powered by IT Scholars Kaseya Version 6.5 Last updated March, 2014 Day Three Review State Based Monitoring Event Based Monitoring Monitoring

More information

MySQL In the Cloud. Migration, Best Practices, High Availability, Scaling. Peter Zaitsev CEO Los Angeles MySQL Meetup June 12 th, 2017.

MySQL In the Cloud. Migration, Best Practices, High Availability, Scaling. Peter Zaitsev CEO Los Angeles MySQL Meetup June 12 th, 2017. MySQL In the Cloud Migration, Best Practices, High Availability, Scaling Peter Zaitsev CEO Los Angeles MySQL Meetup June 12 th, 2017 1 Let me start. With some Questions! 2 Question One How Many of you

More information

Hybrid Infrastructure Hosting Clouds + Dedicated + Colocated GoGrid / ServePath September 09

Hybrid Infrastructure Hosting Clouds + Dedicated + Colocated GoGrid / ServePath September 09 Hybrid Infrastructure Hosting Clouds + Dedicated + Colocated 2009 GoGrid / ServePath - 1 - September 09 Contents What is Cloud Computing? Benefits Cloud & Hybrid Hosting What can Clouds do for ME? When

More information

Backtesting in the Cloud

Backtesting in the Cloud Backtesting in the Cloud A Scalable Market Data Optimization Model for Amazon s AWS Environment A Tick Data Custom Data Solutions Group Case Study Bob Fenster, Software Engineer and AWS Certified Solutions

More information

SAP VORA 1.4 on AWS - MARKETPLACE EDITION FREQUENTLY ASKED QUESTIONS

SAP VORA 1.4 on AWS - MARKETPLACE EDITION FREQUENTLY ASKED QUESTIONS SAP VORA 1.4 on AWS - MARKETPLACE EDITION FREQUENTLY ASKED QUESTIONS 1. What is SAP Vora? SAP Vora is an in-memory, distributed computing solution that helps organizations uncover actionable business insights

More information

The Intersection of Cloud & Solid State Storage

The Intersection of Cloud & Solid State Storage The Intersection of Cloud & Solid State Storage Val Bercovici Cloud Czar, NetApp Office of the CTO SNIA Cloud Storage Initiative SNIA Solid State Storage Initiative Cloud Backdrop Worldwide IT spending

More information

AWS Solutions Architect Associate (SAA-C01) Sample Exam Questions

AWS Solutions Architect Associate (SAA-C01) Sample Exam Questions 1) A company is storing an access key (access key ID and secret access key) in a text file on a custom AMI. The company uses the access key to access DynamoDB tables from instances created from the AMI.

More information

Cloud Infrastructure

Cloud Infrastructure Cloud Infrastructure Part of this material is provided with the book: Cloud Computing: Theory and Practice. Author: Dan C. Marinescu 1 Contents IaaS services from Amazon. Regions and availability zones

More information

The webmethods CloudStreams Amazon EC2 Connector

The webmethods CloudStreams Amazon EC2 Connector The webmethods CloudStreams Amazon EC2 Connector Contents The webmethods CloudStreams Amazon EC2 Connector...3 Connector Details...3 Connector Description...3 Connector Highlights...4 Getting Started...4

More information

Srinath Vaddepally.

Srinath Vaddepally. Cloud Computing Srinath Vaddepally CEO & Founder Srinath.Vaddepally@ristcall.com Cell : (816) 728 2134 www.ristcall.com Agenda Automation testing Cloud Computing Motivation factors from Distributed systems

More information

User manual of STYLE WiFi Connec7on and Opera7on of imos STYLE app. (ios & Android version)

User manual of STYLE WiFi Connec7on and Opera7on of imos STYLE app. (ios & Android version) User manual of STYLE WiFi Connec7on and Opera7on of imos STYLE app (ios & Android version) 1 Welcome page First, make sure your phone is connected to your WiFi network The first 7me you set up a STYLE,

More information

Ansible Tower Quick Setup Guide

Ansible Tower Quick Setup Guide Ansible Tower Quick Setup Guide Release Ansible Tower 2.4.5 Red Hat, Inc. Jun 06, 2017 CONTENTS 1 Quick Start 2 2 Login as a Superuser 3 3 Import a License 4 4 Examine the Tower Dashboard 6 5 The Setup

More information

Big Data solution benchmark

Big Data solution benchmark Big Data solution benchmark Introduction In the last few years, Big Data Analytics have gained a very fair amount of success. The trend is expected to grow rapidly with further advancement in the coming

More information

User manual of STYLE WiFi Connec7on and Opera7on of imos STYLE app. (ios & Android version)

User manual of STYLE WiFi Connec7on and Opera7on of imos STYLE app. (ios & Android version) User manual of STYLE WiFi Connec7on and Opera7on of imos STYLE app (ios & Android version) 1 WiFi connec7on (light fixture) 1. Before the STYLE is connected to your WiFi, the panel will show a sta7c green

More information

Cloud Computing. Amazon Web Services (AWS)

Cloud Computing. Amazon Web Services (AWS) Cloud Computing What is Cloud Computing? Benefit of cloud computing Overview of IAAS, PAAS, SAAS Types Of Cloud private, public & hybrid Amazon Web Services (AWS) Introduction to Cloud Computing. Introduction

More information

Introduction to cloud computing

Introduction to cloud computing Introduction to cloud computing History of cloud Different vendors of Cloud computing Importance of cloud computing Advantages and disadvantages of cloud computing Cloud deployment methods Private cloud

More information

Setup Lab. A quick guide to infrastructure tools for EPL371

Setup Lab. A quick guide to infrastructure tools for EPL371 Setup Lab A quick guide to infrastructure tools for EPL371 Command Prompt Windows NT and beyond ship with Command Prompt 7 Common Tasks The Windows Command Prompt Makes Quick & Easy 1. Run Any Program

More information

What is. Thomas and Lori Duncan

What is. Thomas and Lori Duncan What is Thomas and Lori Duncan Definition of Cloud computing Cloud storage is a model of data storage where the digital data is stored in logical pools, the physical storage spans multiple servers (and

More information

Assignment thesis Integrate Cloud Infrastructure in Unified Hosting Environment

Assignment thesis Integrate Cloud Infrastructure in Unified Hosting Environment Assignment thesis Integrate Cloud Infrastructure in Unified Hosting Environment 01.06.2009 07.09.2009 Writer: Tri Vo Hoang Responsible: Dipl. Inf. Josef Spillner Chair owner: Prof. Dr. rer. nat. habil.

More information