Cloud Providers more AWS, Aneka

Basics of Cloud Computing Lecture 6 Cloud Providers more AWS, Aneka and GAE Satish Srirama

Outline More AWS Some more PaaS Aneka Google App Engine Force.com 16.05.2012 Satish Srirama 2/51

Recap Last lecture We have seen the information retrieval domain We have checked Boolean retrieval We also have seen Ranked retrieval in corpus TF.IDF We have seen how to calculate similarity between documents How several MapReduce jobs can be used to solve particular problem 16.05.2012 Satish Srirama 3/51

Cloud Providers and Services we Amazon Web Services Amazon EC2 Amazon S3 Amazon EBS Eucalyptus SciCloud Management providers ElasticFox RightScale already discussed 16.05.2012 Satish Srirama 4/51

MORE AWS 16.05.2012 Satish Srirama 5

AWS we discuss AWS Management Console AWS Identity and Access Management Amazon CloudWatch Amazon CloudFront AWS Elastic Beanstalk AWS CloudFormation Amazon Simple Workflow Service Amazon Simple Queue Service 16.05.2012 Satish Srirama 6/51

AWS Management Console Hope some of you have started using Amazon accounts You can manage your complete Amazon account with management console AMI Management Instance Management Security Group Management Elastic IP Management Elastic Block Store Key Pair management etc. Have different panes for different services 16.05.2012 Satish Srirama 7/51

AWS Management Console -screenshot https://console.aws.amazon.com/ 16.05.2012 Satish Srirama 8

AWS Identity and Access Management (IAM) How can an enterprise or group of people use a single credit card? Manage IAM users Create new users and manage them Create groups Manage permissions Creating policies Manage credentials Create and assign temporary security credentials 16.05.2012 Satish Srirama 9/51

IAM policy Example policy giving access to complete EC2 http://aws.amazon.com/iam/ 16.05.2012 Satish Srirama 10/51

Amazon CloudWatch How the instances are performing? Enables to monitor EC2instances,EBSvolumes,Elastic Load Balancers, and RDS DB instances in real-time Enables to collect and track metrics, gain insight, and react immediately to keep the applications and businesses running Metrics such as CPU utilization, latency, and request counts are provided automatically 16.05.2012 Satish Srirama 11/51

Amazon CloudWatch Provides access to up-to-the-minute statistics, view graphs, and set alarms for custom metric data The functionality is accessible in several ways via API, command-line tools, the AWS SDK, and the AWS Management Console Prices Detailed Monitoring for EC2 instances (at one-minute frequency) $3.50 per instance per month Custom Metrics $0.50 per metric per month Alarms $0.10 per alarm per month API Requests $0.01 per 1,000 Get, List, or Put requests http://aws.amazon.com/cloudwatch/ 16.05.2012 Satish Srirama 12/51

Amazon CloudFront Is a web service for content delivery with low latency and high data transfer speeds Easy to integrate with other Amazon Web Services (S3 and EC2) Delivers the static and streaming content using a global network of edge locations Objects are organized into distributions with unique CloudFront.net domain (e.g. content.cloudfront.net) distribution specifies the location of the original version of the objects Provides an API for accessing the service Automatically scales on demand without any external intervention 16.05.2012 Satish Srirama 13/51

Amazon CloudFront Distributions enable to download the content using the HTTP or HTTPS protocols, or stream the content using the RTMP protocol For instance, you can stream a live event using Adobe's Flash Media Server running in Amazon EC2 and deliver the live HTTP stream through Amazon CloudFront Prices $0.120 / GB for the fist 10 TB $0.080 / GB for the next 40 TB The cost/gb depends of the amount of data transferred http://calculator.s3.amazonaws.com/calc5.html http://aws.amazon.com/cloudfront/ 16.05.2012 Satish Srirama 14/51

AWS Elastic Beanstalk Enables to easily deploy and manage applications in the AWS cloud Simply upload a bundle of the applications build using.net, PHP and Java technologies Automatically handles the deployment details of capacity provisioning, load balancing, auto-scaling, and application health monitoring One retains full control over the AWS resources powering the application You can access the underlying resources at any time 16.05.2012 Satish Srirama 15/51

AWS Elastic Beanstalk AWS EBis built using familiar software stacks such as the Apache HTTP Server for PHP, IIS 7.5 for.net, and Apache Tomcat for Java There is no additional charge for Elastic Beanstalk Only the underlying AWS resources (e.g. Amazon EC2, Amazon S3) are charged Leverages AWS services such as Amazon EC2, S3, SNS, ELB, and Auto Scaling to deliver the same highly reliable, scalable, and cost-effective infrastructure http://aws.amazon.com/elasticbeanstalk 16.05.2012 Satish Srirama 16/51

AWS CloudFormation Provides an easy way to create and manage a collection of related AWS resources, provisioning and updating them in an orderly and predictable fashion It is based on templates model Templates describe the AWS resources, the associated dependencies, and runtime parameters to run an app. The templates describe stacks, which are set of software and hardware resources. Hides several details How the AWS services need to be provisioned Subtleties of how to make those dependencies work. 16.05.2012 Satish Srirama 17/51

AWS CloudFormation Amazon provides several pre-built templates to start common apps as: WordPress(blog) LAMP stack Gollum (wiki used by GitHub) There is no additional charge for AWS CloudFormation. You pay for AWS resources (e.g. EC2 instances, Elastic Load Balancers, etc.) http://aws.amazon.com/cloudformation/ 16.05.2012 Satish Srirama 18/51

Amazon Simple Workflow Service A workflow service for building scalable, resilient applications Reliably coordinates all of the processing steps within applications such as business processes, sophisticated data analytics applications, or managing cloud infrastructure services Manages task execution dependencies, scheduling, and concurrency Provides simple API calls from code written in any language Capable to run on EC2 instances, or any of the customer s machines located anywhere in the world 16.05.2012 Satish Srirama 19/51

Amazon Simple Workflow Service Maintains application state Tracks workflow executions and logs their progress Holds and dispatches tasks Controls which tasks each of the application hosts will be assigned to execute http://aws.amazon.com/swf/ 16.05.2012 Satish Srirama 20/51

Amazon Simple Queue Service Offers a reliable, highly scalable, hosted queue for storing messages as they travel between computers Used for moving data between distributed components Is used in combination with other AWS like Amazon SWS and Amazon EC2 Any computer on the Internet can add or read messages without any installed software or special firewall configurations The parties do not need to be in the same network, developed with same technologies, or running at the same time 16.05.2012 Satish Srirama 21/51

Amazon Simple Queue Service A queue can be created in 7 regions The message body can contain up to 64 KB of text in any format Messages can be retained in queues for up to 14 days Messages can be sent and read simultaneously Prices: $0.01 per 10,000 Amazon SQS Requests ($0.000001 per Request) http://aws.amazon.com/sqs/ 16.05.2012 Satish Srirama 22/51

AWS we considered AWS Management Console AWS Identity and Access Management Amazon CloudWatch Amazon CloudFront AWS Elastic Beanstalk AWS CloudFormation Amazon Simple Workflow Service Amazon Simple Queue Service 16.05.2012 Satish Srirama 23/51

Other interesting AWS Amazon Relational Database Service Provides access to the capabilities of familiar database engines MySQL, Oracle or Microsoft SQL Server NoSQL databases Simple DB DynamoDB 16.05.2012 Satish Srirama 24/51

ANEKA 16.05.2012 Satish Srirama 25

Aneka: The Cloud Application Platform for Resource-Intensive Apps PaaS from Melbourne Clouds Lab Available as Manjrasoft product Lightweight container hosting multiple services All programming models available from within the same container (unlike others) SDK containing APIs for multiple programming models and tools 16.05.2012 Satish Srirama 26/51

Aneka -continued Exploits the spare CPU cycles of a heterogeneous network Desktop PCs and servers or datacenters Each server hosts an instance of the Aneka Container Runtime Environment for managing application execution management Suitable for Development of Enterprise Cloud Applications Cloud enabling legacy applications Portability for Customer Apps: Enterprise Public Clouds.NET/Win Mono/Linux 16.05.2012 Satish Srirama 27/51

Aneka -architecture Application Software Development Kit Management Kit Management Studio Administration Portal APIs Design Explorer SLA-Negotiation Web Services Management Web Services Container Programming Models Task Thread Model Model Foundation Services Membership Reservation Services Services Map Reduce Model Storage License Services Services Other Models Accounting Services Persistence Security Fabric Services Dynamic Resource Provisioning Services Hardware Profile Services Infrastructure.NET @ Windows Mono @ Linux Physical Machines/Virtual Machines Private Cloud Microsoft Amazon Google IBM 16.05.2012 LAN network Satish Srirama Data Center 28/51

Aneka and Hour Glass Model (many in one, one in many) multiple applications multiple applications Thread Task... MapReduce TCP/IP Aneka multiple networks Multi-core Cluster Grid Cloud 2100 2100 2100 2100 2100 2100 2100 2100 Internet Architecture 16.05.2012 Satish Srirama Aneka Architecture 29/51

Aneka: components public DumbTask: ITask { public void Execute() { for(int i=0; i<n; i++) { } } } DumbTask task = new DumbTask(); app.submitexecution(task); work units Aneka enterprise Cloud Executor Executor Client Agent internet Executor Client Agent Aneka User Agent work units internet 16.05.2012 Satish Srirama Scheduler Aneka Manager Programming / Deployment Model Executor Aneka Worker Service 30/51

Aneka management studio 16.05.2012 Satish Srirama 31/51

Aneka Support for InterCloud/ Federation of Resource Pools XenServer Pool Provisioning over private Cloud managed by Xen Server VMWare Pool Provisioning over private Cloud managed by VMWare Amazon EC2 Pool Provisioning over public Cloud provider: Amazon EC2 Executor private enterprise network Private Cloud Client Libraries Executor Scheduler VPN (virtual resources) internet Executors Scheduler Executors/Schedulers publicly available resources (physical and virtual) Public Cloud 16.05.2012 Satish Srirama 32/51

Aneka cloud at UT We will soon be establishing Aneka cloud at UT Probably in summer Already have the basic setup ready Check for updates If anybody is interested; contact me directly Can be taken as an internship topic 16.05.2012 Satish Srirama 33/51

Google AppEngine 16.05.2012 Satish Srirama 34/51

What is AppEngine? Google platform to build web application on the Cloud Example of PaaS Does one thing well: running web apps Request Processing Response Google App Engine applications can currently be written in Java, Python, or Go 16.05.2012 Satish Srirama 35/51

No More LAMP 16.05.2012 Satish Srirama 36/51

Why App Engine 16.05.2012 Satish Srirama 37/51

Application Life Cycle 16.05.2012 Satish Srirama 38/51

Development Life cycle 16.05.2012 Satish Srirama 39/51

Physical Deployment Diagram 16.05.2012 Satish Srirama 40/51

APIs 16.05.2012 Satish Srirama 41/51

FORCE.COM 16.05.2012 Satish Srirama 42

Powerful Application Service A B D C End User Administration Web Services API Access Control Workflow Authentication / Engine SSO Services Search Engine Reporting & Analytics Multi-Device Multi-Language Multi- Currency Force.com - cloud platform for business apps 16.05.2012 Satish Srirama 43

Force.com Lets You Focus on Innovation Infrastructure Services Application Services Operations Services IT Network Storage Operating System Database App Server Web Server Data Center Disaster Recovery Authentication Availability Security Monitoring Sharing Patch Mgmt Integration Upgrades Customization Backup Web Services NOC API Multi-Language Multi-Currency Workflow Analytics Multi-Device Messaging Sales Search force You Innovation 16.05.2012 Satish Srirama 44

16.05.2012 Satish Srirama 45/51

Database as a Service Create any table Add any field Build any relationship Security & sharing Automatic tuning Automatic backups Automatic upgrades 16.05.2012 Satish Srirama 46

Integration as a Service 16.05.2012 Satish Srirama 47/51

Logic As A Service Declarative Logic History Tracking Workflow Rules Formula-Based Logic Formula Fields Validation Rules Procedural Logic Apex Triggers Apex Classes Apex Web Services 16.05.2012 Satish Srirama 48

User Interface as a Service UI generated automatically, no technical skills required Profile / Record Type / Page Layout mapping controls UI behavior UI generated by developer / technologist Full control of UI behavior Limited control over look and feel, but all UIs are consistent Page Layout Point and click to add Custom Buttons and Embedded Mashups Visualforce 16.05.2012 Satish Srirama 49

Next Week Summarize what we learnt Cloud based research at UT 16.05.2012 Satish Srirama 50/51

References Aneka http://www.manjrasoft.com/aneka_architectu re.html Google App Engine http://code.google.com/appengine/ Force.com http://www.salesforce.com/force/ Check Amazon videos and webinars at http://aws.amazon.com/resources/webinars/ 16.05.2012 Satish Srirama 51/51

Amazon DynamoDB Is a fully managed NoSQLdatabase service that provides fast and predictable performance with seamless scalability Automatically spreads the data and traffic for a table over a sufficient number of servers to handle the request capacity. Items are stored on Solid State Drives (SSDs) and are automatically replicated across multiple Availability Zones in a Region to provide built-in high availability and data durability. It hides details as hardware provisioning, setup and configuration, replication, software patching, or cluster scaling. 16.05.2012 Satish Srirama 52/51

Amazon DynamoDB DynamoDBorganizes data into tables containing items, and each item has one or more attributes An attribute is a name-value pair. The name must be a string, but the value can be a string, number, string set, or number set A collection of attributes forms an item, and the item is identified by its primary key. An item's attributes are a collection of name-value pairs, in any order Tables contain items, and organize information into discrete areas. All items in the table have the same primary key scheme Amazon provides of an API for access and management of the data 16.05.2012 Satish Srirama 53/51

Amazon DynamoDB When creating or updating an DynamoDBtable, one needs to specify how much capacity needs to be reserved for reads and writes operations. A unit of Write Capacity corresponds to perform one write per second for items of up to 1KB in size. Similarly, a unit of Read Capacity enables to perform one strongly consistent read per second of items of up to 1KB in size. Larger items will require more capacity. Prices A flat hourly rate based on the reserved capacity Write Throughput: $0.01 per hour for every 10 units of Write Capacity Read Throughput: $0.01 per hour for every 50 units of Read Capacity http://aws.amazon.com/dynamodb/ 16.05.2012 Satish Srirama 54/51

Amazon Relational Database Service Provides access to the capabilities of a familiar MySQL, Oracle or Microsoft SQL Server database engine. Existing code can easily adapted to access Amazon RDS. Automatically patches the database softwareand backs up the database data. Stores the backups for a user-defined retention period Enables point-in-time recovery. Is accessible via a single API calls. Amazon RDS for MySQLenables to scale out beyond the capacity of a single database deployment for readheavy database workloads. 16.05.2012 Satish Srirama 55/51

Amazon Relational Database Service Available DB instances. Small DB Instance: 1.7 GB memory, 1 ECU, 64-bit platform, Moderate I/O Capacity - Price $0.105 Large DB Instance: 7.5 GB memory, 4 ECUs,64-bit platform, High I/O Capacity Price $0.415 Extra Large DB Instance: 15 GB of memory, 8 ECUs, 64-bit platform, High I/O Capacity (MySQL DB Engine Only) - Price 0.830 High-Memory Extra Large Instance 17.1 GB memory, 6.5 ECU, 64- bit platform, High I/O Capacity Price 0.585 High-Memory Double Extra Large DB Instance: 34 GB of memory, 13 ECUs, 64-bit platform, High I/O Capacity Price $1.170 High-Memory Quadruple Extra Large DB Instance: 68 GB of memory, 26 ECUs, 64-bit platform, High I/O Capacity Price $2.340 http://aws.amazon.com/rds/ 16.05.2012 Satish Srirama 56/51

Amazon SimpleDB Is a highly available and flexible non-relational data store that offloads the work of database administration. Data is stored and queried via web services requests. The data is automatically indexed No pre-define schema is required. Scale-out as new domains are created Uses a data model based on domains, items, attributes and values. The data-set is organized into domains and can run queries across all of the data stored in a particular domain. Domains are collections of items that are described by attribute-value pairs. 16.05.2012 Satish Srirama 57/51

Amazon SimpleDB Machine utilization cost First 25 Amazon SimpleDBMachine Hours consumed per month are free after, $0.140 per Amazon SimpleDB Machine Hour consumed thereafter. Data transfer cost IN operations are free OUT operations are free up to 1GB. After $0.120 per GB up to 10 TB. http://aws.amazon.com/simpledb 16.05.2012 Satish Srirama 58/51