Cloud Computing. Ennan Zhai. Computer Science at Yale University
|
|
- Wesley Oscar Ford
- 6 years ago
- Views:
Transcription
1 Cloud Computing Ennan Zhai Computer Science at Yale University
2 About Final Project
3 About Final Project Important dates before demo session: - Oct 31: Proposal v1.0 - Nov 7: Source code v1.0 - Nov 14: Proposal v2.0 - Nov 21: Source code v2.0 - Dec 1: Bakeoff version
4 How to present? About Final Project - ~2 min video and ~2 min Q&A What to submit? - 1) Source code - 2) Proposal - 3) README Others - any programming language - running on zoo machines - individual or group (2-3 members)
5 About Final Project Topics: - Structured P2P system, e.g., Chord - Hybrid P2P system, e.g., BubbleStorm - client software - Decentralized read/write file system - Decentralized social network application - Sybil-resistant recommendation system - Fault tolerance (BFT) system - Accountability system, e.g., PeerReview
6 About Final Project A few good final projects in the past years: - Workable client - A picture-based encryption tool - A privacy-preserving social network
7 Questions?
8 Lecture Outline Cloud Computing Challenges in the Clouds A Concrete Cloud Reliability Case
9 Lecture Outline Cloud Computing Challenges in the Clouds A Concrete Cloud Reliability Case
10 What s the Cloud Computing?
11 What s the Cloud Computing? Cloud computing is a business model for enabling convenient network access to a shared pool of configurable resources which can be rapidly provisioned and released with minimal management effort or service provider interaction. --- according to NIST(National Institute of Standards and Technology)
12 Have You Used the Cloud?
13 Have You Used the Cloud?
14 Have You Used the Cloud?
15 Have You Used the Cloud?
16 Have You Used the Cloud?
17 Have You Used the Cloud?
18 Why We Like It?
19 Why We Like It? Why users like it? - Do not care where it is, it is just there - Access from any platform Why CS researchers like it? - High-performance computation with less money - Lots of hard and interesting challenges
20 Why We Like It? Why users like it? - Do not care where it is, it is just there - Access from any platform Why CS researchers like it? - High-performance computation with less money - Lots of hard and interesting challenges
21 Why We Like It? Why users like it? - Do not care where it is, it is just there - Access from any platform Why CS researchers like it? - High-performance computation with less money - Lots of hard and interesting challenges
22 Cloud V.S. Distributed Systems
23 What Kinds of Clouds Exist Now?
24 What Kinds of Clouds Exist Now? Three types of services: - Software as a Service (SaaS) - Analogy: Restaurant. Prepares&serves entire meal, does the dishes, etc - Platform as a Service (PaaS) - Analogy: Take-out food. Prepares meal but does not serve it. - Infrastructure as a Service (IaaS) - Analogy: Grocery store. Provides raw ingredients.
25 What Kinds of Clouds Exist Now? Three types of services: - Software as a Service (SaaS) - Analogy: Restaurant. Prepares&serves entire meal, does the dishes, etc - Platform as a Service (PaaS) - Analogy: Take-out food. Prepares meal but does not serve it. - Infrastructure as a Service (IaaS) - Analogy: Grocery store. Provides raw ingredients.
26 What Kinds of Clouds Exist Now? Three types of services: - Software as a Service (SaaS) - Analogy: Restaurant. Prepares&serves entire meal, does the dishes, etc - Platform as a Service (PaaS) - Analogy: Take-out food. Prepares meal but does not serve it. - Infrastructure as a Service (IaaS) - Analogy: Grocery store. Provides raw ingredients.
27 What Kinds of Clouds Exist Now? Three types of services: - Software as a Service (SaaS) - Analogy: Restaurant. Prepares&serves entire meal, does the dishes, etc - Platform as a Service (PaaS) - Analogy: Take-out food. Prepares meal but does not serve it. - Infrastructure as a Service (IaaS) - Analogy: Grocery store. Provides raw ingredients.
28 Software as a Service (SaaS)
29 Software as a Service (SaaS) Cloud Provider (i.e., SaaS Provider) Application Middleware Hardware
30 Software as a Service (SaaS) Cloud Provider (i.e., SaaS Provider) Application Middleware Hardware SaaS provider offers an entire application - Word processor, spreadsheet, CRM software, etc. - Customer pays cloud provider - Example: Google Apps, Salesforce.com, etc.
31 Software as a Service (SaaS) Cloud Provider (i.e., SaaS Provider) Application Middleware Hardware SaaS provider offers an entire application - Word processor, spreadsheet, CRM software, etc. - Customer pays cloud provider - Example: Google Apps, Salesforce.com, etc.
32 Software as a Service (SaaS) Customer Cloud Provider (i.e., SaaS Provider) Application Middleware Hardware SaaS provider offers an entire application - Word processor, spreadsheet, CRM software, etc. - Customer pays cloud provider and uses the service - Example: Google Apps, Salesforce.com, etc.
33 Software as a Service (SaaS) Customer Cloud Provider (i.e., SaaS Provider) Application Middleware Hardware SaaS provider offers an entire application - Word processor, spreadsheet, CRM software, etc. - Customer pays cloud provider and uses the service - Example: Google Apps, Salesforce.com, etc.
34 Software as a Service (SaaS) Customer Cloud Provider (i.e., SaaS Provider) Application Middleware Hardware SaaS provider offers an entire application - Word processor, spreadsheet, CRM software, etc. - Customer pays cloud provider and uses the service - Example: Google Apps, Salesforce.com, etc.
35 A Typical SaaS: Gmail
36 A Typical SaaS: Gmail Gmail Provider Application Middleware Hardware
37 A Typical SaaS: Gmail Gmail Provider Application Middleware Hardware Outsourcing your software: - Distributed, replicated message store in BigTable - Weak consistency model for some operations (e.g., msg read) - Stronger consistency for others (e.g., send msg)
38 A Typical SaaS: Gmail Gmail Provider Application Middleware Hardware BigTable Outsourcing your software: - Distributed, replicated message store in BigTable - Weak consistency model for some operations (e.g., msg read) - Stronger consistency for others (e.g., send msg)
39 A Typical SaaS: Gmail Gmail Provider Application BigTable Middleware APIs Hardware BigTable Outsourcing your software: - Distributed, replicated message store in BigTable - Weak consistency model for some operations (e.g., msg read) - Stronger consistency for others (e.g., send msg)
40 A Typical SaaS: Gmail Gmail Provider Application Gmail BigTable Middleware APIs Hardware BigTable Outsourcing your software: - Distributed, replicated message store in BigTable - Weak consistency model for some operations (e.g., msg read) - Stronger consistency for others (e.g., send msg)
41 A Typical SaaS: Gmail Customer Gmail Provider Application Gmail BigTable Middleware APIs Hardware BigTable Outsourcing your software: - Distributed, replicated message store in BigTable - Weak consistency model for some operations (e.g., msg read) - Stronger consistency for others (e.g., send msg)
42 A Typical SaaS: Gmail Customer Gmail Provider Application Gmail BigTable Middleware APIs Hardware BigTable Outsourcing your software: - Distributed, replicated message store in BigTable - Weak consistency model for some operations (e.g., msg read) - Stronger consistency for others (e.g., send msg)
43 A Typical SaaS: Gmail Customer Gmail Provider Application Gmail BigTable Middleware APIs Hardware BigTable Outsourcing your software: - Distributed, replicated message store in BigTable - Weak consistency model for some operations (e.g., msg read) - Stronger consistency for others (e.g., send msg)
44 A Typical SaaS: Gmail Customer Gmail Provider Application Gmail BigTable Middleware APIs Hardware BigTable Outsourcing your software: - Distributed, replicated message store in BigTable - Weak consistency model for some operations (e.g., msg read) - Stronger consistency for others (e.g., send msg)
45 Platform as a Service (PaaS)
46 Platform as a Service (PaaS) Cloud Provider (i.e., PaaS Provider) Application Middleware Hardware Cloud provides middleware/infrastructure - For example, Microsoft Common Language Runtime (CLR) - Customer pays SaaS provider for the service - SaaS provider pays the cloud for the platform - Example: Windows Azure, Google App Engine, etc.
47 Platform as a Service (PaaS) Cloud Provider (i.e., PaaS Provider) Application Middleware Hardware Cloud provides middleware/infrastructure - For example, Microsoft Common Language Runtime (CLR) - Customer pays SaaS provider for the service - SaaS provider pays the cloud for the platform - Example: Windows Azure, Google App Engine, etc.
48 Platform as a Service (PaaS) App Provider Cloud Provider (i.e., PaaS Provider) Application Middleware Hardware Cloud provides middleware/infrastructure - For example, Microsoft Common Language Runtime (CLR) - App provider pays the cloud for the platform - Customer pays App provider for the service - Example: Windows Azure, Google App Engine, etc.
49 Platform as a Service (PaaS) App Provider Cloud Provider (i.e., PaaS Provider) Application Middleware Hardware Cloud provides middleware/infrastructure - For example, Microsoft Common Language Runtime (CLR) - App provider pays the cloud for the platform - Customer pays App provider for the service - Example: Windows Azure, Google App Engine, etc.
50 Platform as a Service (PaaS) App Provider Customer Application Middleware Hardware Cloud Provider (i.e., PaaS Provider) Cloud provides middleware/infrastructure - For example, Microsoft Common Language Runtime (CLR) - App provider pays the cloud for the platform - Customer pays app provider for the service - Example: Windows Azure, Google App Engine, etc.
51 Platform as a Service (PaaS) App Provider Customer Application Middleware Hardware Cloud Provider (i.e., PaaS Provider) Cloud provides middleware/infrastructure - For example, Microsoft Common Language Runtime (CLR) - App provider pays the cloud for the platform - Customer pays app provider for the service - Example: Windows Azure, Google App Engine, etc.
52 Platform as a Service (PaaS) App Provider Customer Application Middleware Hardware Cloud Provider (i.e., PaaS Provider) Cloud provides middleware/infrastructure - For example, Microsoft Common Language Runtime (CLR) - App provider pays the cloud for the platform - Customer pays app provider for the service - Example: Windows Azure, Google App Engine, etc.
53 A Typical PaaS: Facebook
54 A Typical PaaS: Facebook Application Middleware Facebook Provider Hardware
55 A Typical PaaS: Facebook Facebook Provider Application Middleware Hardware Facebook offers PaaS capabilities to App provider - Facebook APIs allow access to social network properties - Third-party game applications - Facebook itself also uses PaaS provided by its company, e.g., log analysis for recommendations
56 A Typical PaaS: Facebook Facebook Provider Application Facebook Middleware APIs Facebook Hardware Clusters Facebook offers PaaS capabilities to App provider - Facebook APIs allow access to social network properties - Third-party game applications - Facebook itself also uses PaaS provided by its company, e.g., log analysis for recommendations
57 A Typical PaaS: Facebook Facebook Provider Application Facebook Middleware APIs Facebook Hardware Clusters Facebook offers PaaS capabilities to App provider - Facebook APIs allow access to social network properties - Third-party game applications - Facebook itself also uses PaaS provided by its company, e.g., log analysis for recommendations
58 A Typical PaaS: Facebook App Provider Facebook Application Game Facebook Middleware APIs Facebook Hardware Clusters Facebook Provider Facebook offers PaaS capabilities to App provider - Facebook APIs allow access to social network properties - App providers adopt their services (e.g., game) onto Facebook - Facebook itself also uses PaaS provided by its company, e.g., log analysis for recommendations
59 A Typical PaaS: Facebook App Provider Facebook Application Game Facebook Middleware APIs Facebook Hardware Clusters Facebook Provider Facebook offers PaaS capabilities to App provider - Facebook APIs allow access to social network properties - App providers adopt their services (e.g., game) onto Facebook - Facebook itself also uses PaaS provided by its company, e.g., log analysis for recommendations
60 A Typical PaaS: Facebook App Provider Customer Facebook Application Game Facebook Middleware APIs Facebook Hardware Clusters Facebook Provider Facebook offers PaaS capabilities to App provider - Facebook APIs allow access to social network properties - App providers adopt their services (e.g., game) onto Facebook - Facebook itself also uses PaaS provided by its company, e.g., log analysis for recommendations
61 A Typical PaaS: Facebook App Provider Customer Facebook Application Game Facebook Middleware APIs Facebook Hardware Clusters Facebook Provider Facebook offers PaaS capabilities to App provider - Facebook APIs allow access to social network properties - App providers adopt their services (e.g., game) onto Facebook - Facebook itself also uses PaaS provided by its company, e.g., log analysis for recommendations
62 A Typical PaaS: Facebook App Provider Customer Facebook Application Game Facebook Middleware APIs Facebook Hardware Clusters Facebook Provider Facebook offers PaaS capabilities to App provider - Facebook APIs allow access to social network properties - App providers adopt their services (e.g., game) onto Facebook - Facebook itself also uses PaaS provided by its company, e.g., log analysis for recommendations
63 Infrastructure as a Service (IaaS)
64 Infrastructure as a Service (IaaS) Cloud Provider (i.e., IaaS Provider) Application Middleware Hardware Cloud provides raw computing resources - Virtual machines, blade servers, hard disk, etc. - Customer pays SaaS provider for the service - SaaS provider pays the cloud for the resources - Example: Amazon Web Services, Rackspace Cloud, etc.
65 Infrastructure as a Service (IaaS) Cloud Provider (i.e., IaaS Provider) Application Middleware Hardware Cloud provides raw computing resources - Virtual machines, blade servers, hard disk, etc. - Customer pays SaaS provider for the service - SaaS provider pays the cloud for the resources - Example: Amazon Web Services, Rackspace Cloud, etc.
66 Infrastructure as a Service (IaaS) App Provider Cloud Provider (i.e., IaaS Provider) Application Middleware Hardware Cloud provides raw computing resources - Virtual machines, blade servers, hard disk, etc. - App provider pays the cloud for the resources - Customer pays App provider for the service - Example: Amazon Web Services, Rackspace Cloud, etc.
67 Infrastructure as a Service (IaaS) App Provider Cloud Provider (i.e., IaaS Provider) Application Middleware Hardware Cloud provides raw computing resources - Virtual machines, blade servers, hard disk, etc. - App provider pays the cloud for the resources - Customer pays App provider for the service - Example: Amazon Web Services, Rackspace Cloud, etc.
68 Infrastructure as a Service (IaaS) App Provider Customer Application Middleware Hardware Cloud Provider (i.e., IaaS Provider) Cloud provides raw computing resources - Virtual machines, blade servers, hard disk, etc. - App provider pays the cloud for the resources - Customer pays App provider for the service - Example: Amazon Web Services, Rackspace Cloud, etc.
69 Infrastructure as a Service (IaaS) App Provider Customer Application Middleware Hardware Cloud Provider (i.e., IaaS Provider) Cloud provides raw computing resources - Virtual machines, blade servers, hard disk, etc. - App provider pays the cloud for the resources - Customer pays App provider for the service - Example: Amazon Web Services, Rackspace Cloud, etc.
70 Infrastructure as a Service (IaaS) App Provider Customer Application Middleware Hardware Cloud Provider (i.e., IaaS Provider) Cloud provides raw computing resources - Virtual machines, blade servers, hard disk, etc. - App provider pays the cloud for the resources - Customer pays App provider for the service - Example: Amazon Web Services, Rackspace Cloud, etc.
71 Typical IaaS: EC2 and S3 Application Middleware Amazon Hardware
72 Typical IaaS: EC2 and S3 Application Middleware Amazon EC2 Hardware S3
73 Typical IaaS: EC2 and S3 Netflix Provider Amazon Application Middleware EC2 Hardware S3 Netflix (app) heavily depends on Amazon AWS: - Media files are stored in S3 - Transcoding to target devices (e.g., ipad) using EC2 - Analysis of streaming sessions based on Elastic MapReduce
74 Typical IaaS: EC2 and S3 Netflix Provider Amazon Application Middleware EC2 Hardware S3 Netflix (app) heavily depends on Amazon AWS: - Media files are stored in S3 - Transcoding to target devices (e.g., ipad) using EC2 - Analysis of streaming sessions based on Elastic MapReduce
75 Typical IaaS: EC2 and S3 Netflix Provider Application Netflix Middleware Amazon EC2 Hardware S3 Netflix (app) heavily depends on Amazon AWS: - Media files are stored in S3 - Transcoding to target devices (e.g., ipad) using EC2 - Analysis of streaming sessions based on Elastic MapReduce
76 Typical IaaS: EC2 and S3 Netflix Provider Application Netflix Middleware Amazon EC2 Hardware S3 Netflix (app) heavily depends on Amazon AWS: - Media files are stored in S3 - Transcoding to target devices (e.g., ipad) using EC2 - Analysis of streaming sessions based on Elastic MapReduce
77 Typical IaaS: EC2 and S3 Netflix Provider Customer Application Netflix Middleware Amazon EC2 Hardware S3 Netflix (app) heavily depends on Amazon AWS: - Media files are stored in S3 - Transcoding to target devices (e.g., ipad) using EC2 - Analysis of streaming sessions based on Elastic MapReduce
78 Typical IaaS: EC2 and S3 Netflix Provider Customer Application Netflix Middleware Amazon EC2 Hardware S3 Netflix (app) heavily depends on Amazon AWS: - Media files are stored in S3 - Transcoding to target devices (e.g., ipad) using EC2 - Analysis of streaming sessions based on Elastic MapReduce
79 Recall Three types of services: - Software as a Service (SaaS) - Analogy: Restaurant. Prepares&serves entire meal, does the dishes, etc - Platform as a Service (PaaS) - Analogy: Take-out food. Prepares meal but does not serve it. - Infrastructure as a Service (IaaS) - Analogy: Grocery store. Provides raw ingredients.
80 Recall Three types of services: - Software as a Service (SaaS) - Analogy: Restaurant. Prepares&serves entire meal, does the dishes, etc Zoo? - Platform as a Service (PaaS) - Analogy: Take-out food. Prepares meal but does not serve it. - Infrastructure as a Service (IaaS) - Analogy: Grocery store. Provides raw ingredients.
81 The Major Cloud Providers
82 The Major Cloud Providers Amazon is the big player: - Infrastructure as a service (e.g., EC2) - Storage as a service (e.g., S3) But there are many others: - Microsoft Azure: It has similar services to Amazon, with an emphasis on.net programming model - Google App Engine: It offers programming interface, Hadoop, also software as a service, e.g., Gmail and Google Docs - IBM, HP, Yahoo!: They seem to focus on enterprise scale cloud apps
83 The Major Cloud Providers Amazon is the big player: - Infrastructure as a service (e.g., EC2) - Storage as a service (e.g., S3) But there are many others: - Microsoft Azure: It has similar services to Amazon, with an emphasis on.net programming model - Google App Engine: It offers programming interface, Hadoop, also software as a service, e.g., Gmail and Google Docs - IBM, HP, Yahoo!: They seem to focus on enterprise scale cloud apps
84 Lecture Outline Cloud Computing Challenges in the Clouds A Concrete Cloud Reliability Case
85 Lecture Outline Cloud Computing Challenges in the Clouds A Concrete Cloud Reliability Case
86 What Kinds of Challenges?
87 What Kinds of Challenges? Scalability Availability and reliability Security and privacy
88 What Kinds of Challenges? Scalability Availability and reliability Security and privacy
89 PC Scalability
90 Scalability PC What if one computer is not enough? - Buy a bigger (server-class) computer
91 Scalability PC Server What if one computer is not enough? - Buy a bigger (server-class) computer
92 Scalability PC Server What if one computer is not enough? - Buy a bigger (server-class) computer What if the biggest computer is not enough? - Buy many computers
93 Scalability PC Server Cluster What if one computer is not enough? - Buy a bigger (server-class) computer What if the biggest computer is not enough? - Buy many computers
94 Scalability
95 Rack Scalability
96 Rack Scalability Network switches (connects nodes with each other and with other racks)
97 Rack Scalability Network switches (connects nodes with each other and with other racks) Many nodes/blades (often identical)
98 Rack Scalability Network switches (connects nodes with each other and with other racks) Many nodes/blades (often identical) Storage device(s)
99 Scalability PC Server Cluster What if cluster is too big to fit into machine room? - Build a separate building for the cluster - Building can have lots of cooling and power - Result: Data center
100 Scalability PC Server Cluster What if cluster is too big to fit into machine room? - Build a separate building for the cluster - Building can have lots of cooling and power - Result: Data center
101 Scalability PC Server Cluster Data center What if cluster is too big to fit into machine room? - Build a separate building for the cluster - Building can have lots of cooling and power - Result: Data center
102 Google Data Center in Oregon
103 Google Data Center in Oregon Data centers (size of a football field)
104 Google Data Center in Oregon Data centers (size of a football field) A warehouse-sized computer - A single data center can easily contain 10,000 racks with 100 cores in each rack (1,000,000 cores total)
105 Google Data Center Locations
106 Google Data Centers in the USA
107 Google Data Centers in Europe
108 Google Data Centers World Wide
109 Open Challenges
110 Open Challenges Can you manage thousands of racks effectively? - Cloud monitor systems (e.g., PlanetSeer [OSDI 04]) - Can you design more scalable data center network?
111 Open Challenges Can you manage thousands of racks effectively? - Cloud monitor systems (e.g., PlanetSeer [OSDI 04]) - Can you design more scalable data center network?
112 Open Challenges Can you manage thousands of racks effectively? - Cloud monitor systems (e.g., PlanetSeer [OSDI 04]) Can you make data center more scalable? - Scalable data center architecture (e.g., VL2 [SIGCOMM 09]) - Can you design more scalable data center network?
113 Open Challenges Can you manage thousands of racks effectively? - Cloud monitor systems (e.g., PlanetSeer [OSDI 04]) Can you make data center more scalable? - Scalable data center architecture (e.g., VL2 [SIGCOMM 09]) - Can you design more scalable data center network?
114 What Kinds of Challenges? Scalability Availability and reliability Security and privacy
115 What Kinds of Challenges? Scalability Availability and reliability Security and privacy
116 Availability & Reliability Is the cloud always there when you need it? - Service outages - Connectivity outages
117 Recent Cloud Disasters
118 Recent Cloud Disasters
119 Recent Cloud Disasters
120 Top10 Cloud Service Outages
121 Open Challenges Can you build a system to find out the root-cause when a service becomes unavailable? - Diagnosis systems (e.g., Sherlock [SIGCOMM 07])
122 Open Challenges Can you build a system to find out the root-cause when a service becomes unavailable? - Diagnosis systems (e.g., Sherlock [SIGCOMM 07]) - Accountable cloud (e.g., AVM [OSDI 10])
123 Open Challenges Can you build a system to find out the root-cause when a service becomes unavailable? - Diagnosis systems (e.g., Sherlock [SIGCOMM 07]) - Accountable cloud (e.g., AVM [OSDI 10])
124 Open Challenges Can you build a system to find out the root-cause when a service becomes unavailable? - Diagnosis systems (e.g., Sherlock [SIGCOMM 07]) - Accountable cloud (e.g., AVM [OSDI 10]) Can you propose an approach to make the clouds more robust? - Fault tolerate systems (e.g., F10 [NSDI 13])
125 Open Challenges Can you build a system to find out the root-cause when a service becomes unavailable? - Diagnosis systems (e.g., Sherlock [SIGCOMM 07]) - Accountable cloud (e.g., AVM [OSDI 10]) Can you propose an approach to make the clouds more robust? - Fault tolerate systems (e.g., F10 [NSDI 13])
126 What Kinds of Challenges? Scalability Availability and reliability Security and privacy
127 What Kinds of Challenges? Scalability Availability and reliability Security and privacy
128 Security & Privacy Compromised your cloud accounts - Hacker does not need to break into your home to steal all your private data, if he can break or guess your cloud password - Even worse, if hack who cracks your Facebook account get into your accounts everywhere online
129 Security & Privacy Compromised your cloud accounts - Hacker does not need to break into your home to steal all your private data, if he can break or guess your cloud password - Even worse, if hack who cracks your Facebook account get into your accounts everywhere online You do not know if the cloud providers read your private data
130 Open Challenges Can you build a system to preserve the privacy of your data on the clouds? - MAC for MapReduce (e.g., Airavat [NSDI 10]) - Trusted storage (e.g., Depot [OSDI 10])
131 Open Challenges Can you build a system to preserve the privacy of your data on the clouds? - MAC for MapReduce (e.g., Airavat [NSDI 10]) - Trusted storage (e.g., Depot [OSDI 10])
132 Open Challenges Can you build a system to preserve the privacy of your data on the clouds? - MAC for MapReduce (e.g., Airavat [NSDI 10]) - Trusted storage (e.g., Depot [OSDI 10])
133 Open Challenges Can you build a system to preserve the privacy of your data on the clouds? - MAC for MapReduce (e.g., Airavat [NSDI 10]) - Trusted storage (e.g., Depot [OSDI 10]) Can you propose an approach to verify if the cloud provider modifies your data? - Trusted cloud computing (e.g., Excalibur [USENIX Sec 12])
134 Open Challenges Can you build a system to preserve the privacy of your data on the clouds? - MAC for MapReduce (e.g., Airavat [NSDI 10]) - Trusted storage (e.g., Depot [OSDI 10]) Can you propose an approach to verify if the cloud provider modifies your data? - Trusted cloud computing (e.g., Excalibur [USENIX Sec 12])
135 More Risks?
136 More Risks? EverClouds is a project of DeDiS group (Bryan is PI): - aims to solve tricky cloud security problems (e.g., timing channels) - tries to make the clouds more reliable (e.g., failure detection) We already have some efforts: - SRA: A cloud structural reliability auditing system (submitted) - irec: A cloud independence recommender system (HotDep 13) - P-SRA: A privacy-preserving structural-reliability auditor (CCSW 13) - Timing channel control with provider-enforced deterministic execution (CCSW 10)
137 Lecture Outline Cloud Computing Challenges in the Clouds A Concrete Cloud Reliability Case
138 Lecture Outline Cloud Computing Challenges in the Clouds A Concrete Cloud Reliability Case
139 Realistic Problem
140 Realistic Problem Correlated failures resulting from EBS due to bugs in one EBS server Summary of the October 22, 2012 AWS Service Event in the US-East Region We d like to share more about the service event that occurred on Monday, October 22nd in the US-East Region. We have now completed the analysis of the events that affected AWS customers, and we want to describe what happened, our understanding of how customers were affected, and what we are doing to prevent a similar issue from occurring in the future. The Primary Event and the Impact to Amazon Elastic Block Store (EBS) and Amazon Elastic Compute Cloud (EC2)
141 Realistic Problem Elastic Compute Cloud (EC2) Elastic Block Store (EBS)
142 Realistic Problem Elastic Block Store (EBS)
143 Realistic Problem VM1 VM2 VM1 VM3 VM1 VM2 VM3 VM Elastic Block Store (EBS)
144 Realistic Problem VM1 VM2 VM1 VM3 VM1 VM2 VM3 VM EBS Server1 EBS Server2
145 Realistic Problem VM1 VM2 VM1 VM3 VM1 VM2 VM3 VM EBS Server1 EBS Server2
146 Realistic Problem VM1 VM2 VM1 VM3 VM1 VM2 VM3 VM EBS Server1 EBS Server2
147 Realistic Problem VM1 VM2 VM1 VM3 VM1 VM2 VM3 VM EBS Server1 EBS Server2
148 System We Need #1: Dependency collections #2: Dependency representation #3: Efficient auditing
149 System We Need #1: Dependency collections #2: Dependency representation #3: Efficient auditing
150 Dependency Data Collections Reuse existing data collection tools: - Convert the outputs to uniform format. - Three types of format: NET, HW and SW. Our defined format Type Network Hardware Software Dependency Expression <src= S dst= D route= x,y,z /> <hw= H type= T dep= x /> <pgm= S hw= H dep= x,y,z />
151 Dependency Data Collections
152 Dependency Data Collections NSDMiner DepDB
153 Dependency Data Collections NSDMiner DepDB
154 Dependency Data Collections NSDMiner DepDB
155 <src= S1 dst= Internet route= ToR1,Core1 /> <src= S1 dst= Internet route= ToR1,Core2 /> <src= S2 dst= Internet route= ToR1,Core1 /> <src= S2 dst= Internet route= ToR1,Core2 /> NSDMiner DepDB
156 <src= S1 dst= Internet route= ToR1,Core1 /> <src= S1 dst= Internet route= ToR1,Core2 /> <src= S2 dst= Internet route= ToR1,Core1 /> <src= S2 dst= Internet route= ToR1,Core2 /> NSDMiner DepDB
157 System We Need #1: Dependency collections #2: Dependency representation #3: Efficient auditing
158 Example Redundancy
159 Example Redundancy
160 Example Redundancy SW HW NET
161 Building Fault Graph Top-to-Bottom SW HW NET
162 Step1: Root Node Redundancy configuration fails
163 Step2: Server Nodes Redundancy configuration fails Server 1 fails Server 2 fails
164 Step2: Server Nodes Redundancy configuration fails Server 1 fails Server 2 fails AND gate: all the sublayer nodes fail, the upper layer node fails
165 Step3: Dependency Nodes Redundancy configuration fails Server 1 fails Server 2 fails +" +" HW fails Net fails SW fails Net fails SW fails HW fails
166 Step3: Dependency Nodes Redundancy configuration fails Server 1 fails Server 2 fails +" +" HW fails Net fails SW fails Net fails SW fails HW fails OR gate: one of the sublayer nodes fails, the upper layer node fails
167 Step4: Hardware Dependency Redundancy configuration fails Server 1 fails Server 2 fails +" +" HW fails Net fails SW fails Net fails SW fails HW fails +" +" CPU1 Disk1 CPU2 Disk2
168 Step5: Network Dependency Redundancy configuration fails Server 1 fails Server 2 fails +" +" HW fails Net fails SW fails Net fails SW fails HW fails +" +" CPU1 Disk1 Path1 Path2 CPU2 Disk2 Core1 +" +" ToR1 Core2
169 Step6: Software Dependency Redundancy configuration fails Server 1 fails Server 2 fails +" +" HW fails Net fails SW fails Net fails SW fails HW fails +" CPU1 Disk1 Path1 Path2 Riak +" Query CPU2 +" Disk2 +" +" +" +" Core1 ToR1 Core2 libsvnl libc6 libccl
170 System We Need #1: Dependency collections #2: Dependency representation #3: Efficient auditing
171 Efficient Auditing Two algorithms balancing cost and accuracy: - Minimal fault set algorithm - Failure sampling algorithm
172 Efficient Auditing Two algorithms balancing cost and accuracy: - Minimal fault set algorithm - Failure sampling algorithm
173 Minimal Fault Set Algorithm Traditional algorithm in safety engineering - Exponential complexity (NP-hard) We are the first to apply it in Cloud area: - Analyzing a fat tree with 30,528 with ~40 hours
174 Minimal Fault Set Algorithm Traditional algorithm in safety engineering - Exponential complexity (NP-hard) We are the first to apply it in Cloud area: - Analyzing a fat tree with 30,528 with ~40 hours We propose efficient failure sampling algorithm.
175 Failure Sampling Algorithm Redundancy configuration fails Server 1 fails Server 2 fails +" +" Server1 s HW fails Switch1 fails Server2 s HW fails
176 Failure Sampling Algorithm Redundancy configuration fails Server 1 fails Server 2 fails +" +" Server1 s HW fails Switch1 fails Server2 s HW fails 1 or 0 1 or 0 1 or 0
177 Failure Sampling Algorithm Redundancy configuration fails 1 or 0? Server 1 fails Server 2 fails +" +" Server1 s HW fails Switch1 fails Server2 s HW fails 1 or 0 1 or 0 1 or 0
178 Failure Sampling Algorithm Redundancy configuration fails 1 or 0? Server 1 fails Server 2 fails +" +" Server1 s HW fails Switch1 fails Server2 s HW fails 1 or 0 1 or 0 1 or 0 Fault Sets
179 The 1st Sampling Round Redundancy configuration fails Server 1 fails Server 2 fails +" +" Server1 s HW fails Switch1 fails Server2 s HW fails Fault Sets
180 The 1st Sampling Round Redundancy configuration fails Server 1 fails Server 2 fails +" +" Server1 s HW fails Switch1 fails Server2 s HW fails 1 or 0 1 or 0 1 or 0 Fault Sets
181 The 1st Sampling Round Redundancy configuration fails Server 1 fails Server 2 fails +" +" Server1 s HW fails Switch1 fails Fault Sets Server2 s HW fails
182 The 1st Sampling Round Redundancy configuration fails Server 1 fails Server 2 fails +" +" Server1 s HW fails Switch1 fails Fault Sets Server2 s HW fails
183 The 1st Sampling Round Redundancy configuration fails Server 1 fails Server 2 fails +" +" Server1 s HW fails Switch1 fails Fault Sets Server2 s HW fails {Server1 s HW, Server2 s HW}
184 The 2nd Sampling Round Redundancy configuration fails Server 1 fails Server 2 fails +" +" Server1 s HW fails Switch1 fails Server2 s HW fails Fault Sets {Server1 s HW, Server2 s HW}
185 The 2nd Sampling Round Redundancy configuration fails Server 1 fails Server 2 fails +" +" Server1 s HW fails Switch1 fails Server2 s HW fails 1 or 0 1 or 0 1 or 0 Fault Sets {Server1 s HW, Server2 s HW}
186 The 2nd Sampling Round Redundancy configuration fails Server 1 fails Server 2 fails +" +" Server1 s HW fails Switch1 fails Fault Sets Server2 s HW fails {Server1 s HW, Server2 s HW}
187 The 2nd Sampling Round Redundancy configuration fails Server 1 fails Server 2 fails +" +" Server1 s HW fails Switch1 fails Fault Sets Server2 s HW fails {Server1 s HW, Server2 s HW}
188 The 3rd Sampling Round Redundancy configuration fails Server 1 fails Server 2 fails +" +" Server1 s HW fails Switch1 fails Server2 s HW fails Fault Sets {Server1 s HW, Server2 s HW}
189 The 3rd Sampling Round Redundancy configuration fails Server 1 fails Server 2 fails +" +" Server1 s HW fails Switch1 fails Fault Sets Server2 s HW fails {Server1 s HW, Server2 s HW}
190 The 3rd Sampling Round Redundancy configuration fails Server 1 fails Server 2 fails +" +" Server1 s HW fails Switch1 fails Fault Sets Server2 s HW fails {Server1 s HW, Server2 s HW}
191 The 3rd Sampling Round Redundancy configuration fails Server 1 fails Server 2 fails +" +" Server1 s HW fails Switch1 fails Fault Sets Server2 s HW fails {Server1 s HW, Server2 s HW} {Switch1}
192 After Many (e.g., 10 7 ) Rounds Fault Sets {Server1 s HW, Server2 s HW} {Switch1} {Switch1, Server2 s HW} {Switch1} {Switch1, Server2 s HW}......
193 Size-Based Ranking Fault Sets {Server1 s HW, Server2 s HW} {Switch1} {Switch1, Server2 s HW} {Switch1} {Switch1, Server2 s HW}......
194 Size-Based Ranking Fault Sets {Switch1} {Switch1} {Switch1, Server2 s HW} {Switch1, Server2 s HW} {Server1 s HW, Server2 s HW}......
195 Thanks! Questions?
CPSC 426/526. Cloud Computing. Ennan Zhai. Computer Science Department Yale University
CPSC 426/526 Cloud Computing Ennan Zhai Computer Science Department Yale University Recall: Lec-7 In the lec-7, I talked about: - P2P vs Enterprise control - Firewall - NATs - Software defined network
More informationHeading Off Correlated Failures through Independence-as-a-Service
Heading Off Correlated Failures through Independence-as-a-Service Ennan Zhai 1 Ruichuan Chen 2, David Isaac Wolinsky 1, Bryan Ford 1 1 Yale University 2 Bell Labs/Alcatel-Lucent Background Cloud services
More informationMapReduce for Scalable and Cloud Computing
1 MapReduce for Scalable and Cloud Computing CS6323 Adapted from NETS212, U. Penn, USA 2 Overview Networked computing The need for scalability; scale of current services Scaling up: From PCs to data centers
More informationMapReduce for Scalable and Cloud Computing
1 MapReduce for Scalable and Cloud Computing CS6323 Adapted from NETS212, U. Penn, USA 2 Overview Networked computing The need for scalability; scale of current services Scaling up: From PCs to data centers
More informationIntroduction To Cloud Computing
Introduction To Cloud Computing What is Cloud Computing? Cloud computing is a model for enabling ubiquitous, convenient, on-demand network access to a shared pool of configurable computing resources (e.g.,
More informationIntroduction to data centers
Introduction to data centers Paolo Giaccone Notes for the class on Switching technologies for data centers Politecnico di Torino December 2017 Cloud computing Section 1 Cloud computing Giaccone (Politecnico
More informationFailures in Distributed Systems
CPSC 426/526 Failures in Distributed Systems Ennan Zhai Computer Science Department Yale University Recall: Lec-14 In lec-14, we learned: - Difference between privacy and anonymity - Anonymous communications
More informationDISTRIBUTED SYSTEMS [COMP9243] Lecture 8a: Cloud Computing WHAT IS CLOUD COMPUTING? 2. Slide 3. Slide 1. Why is it called Cloud?
DISTRIBUTED SYSTEMS [COMP9243] Lecture 8a: Cloud Computing Slide 1 Slide 3 ➀ What is Cloud Computing? ➁ X as a Service ➂ Key Challenges ➃ Developing for the Cloud Why is it called Cloud? services provided
More informationData Centers and Cloud Computing
Data Centers and Cloud Computing CS677 Guest Lecture Tim Wood 1 Data Centers Large server and storage farms 1000s of servers Many TBs or PBs of data Used by Enterprises for server applications Internet
More informationCourse Overview. ECE 1779 Introduction to Cloud Computing. Marking. Class Mechanics. Eyal de Lara
ECE 1779 Introduction to Cloud Computing Eyal de Lara delara@cs.toronto.edu www.cs.toronto.edu/~delara/courses/ece1779 Course Overview Date Topic Sep 14 Introduction Sep 21 Python Sep 22 Tutorial: Python
More informationData Centers and Cloud Computing. Slides courtesy of Tim Wood
Data Centers and Cloud Computing Slides courtesy of Tim Wood 1 Data Centers Large server and storage farms 1000s of servers Many TBs or PBs of data Used by Enterprises for server applications Internet
More informationData Centers and Cloud Computing. Data Centers
Data Centers and Cloud Computing Slides courtesy of Tim Wood 1 Data Centers Large server and storage farms 1000s of servers Many TBs or PBs of data Used by Enterprises for server applications Internet
More informationProgramowanie w chmurze na platformie Java EE Wykład 1 - dr inż. Piotr Zając
Programowanie w chmurze na platformie Java EE Wykład 1 - dr inż. Piotr Zając Cloud computing definition Cloud computing is a model for enabling ubiquitous, convenient, ondemand network access to a shared
More informationCloud Computing. Technologies and Types
Cloud Computing Cloud Computing Technologies and Types Dell Zhang Birkbeck, University of London 2017/18 The Technological Underpinnings of Cloud Computing Data centres Virtualisation RESTful APIs Cloud
More informationCloud Computing 4/17/2016. Outline. Cloud Computing. Centralized versus Distributed Computing Some people argue that Cloud Computing. Cloud Computing.
Cloud Computing By: Muhammad Naseem Assistant Professor Department of Computer Engineering, Sir Syed University of Engineering & Technology, Web: http://sites.google.com/site/muhammadnaseem105 Email: mnaseem105@yahoo.com
More informationSEEM3450 Engineering Innovation and Entrepreneurship
SEEM3450 Engineering Innovation and Entrepreneurship Cloud Computing Guest Lecture Gabriel Fung, Ph.D. 2017-10-26 What is Cloud Computing? According to NIST (National Institute of Standards and Technology)
More informationCloud-Security: Show-Stopper or Enabling Technology?
Cloud-Security: Show-Stopper or Enabling Technology? Fraunhofer Institute for Secure Information Technology (SIT) Technische Universität München Open Grid Forum, 16.3,. 2010, Munich Overview 1. Cloud Characteristics
More informationIntroduction to Cloud Computing. [thoughtsoncloud.com] 1
Introduction to Cloud Computing [thoughtsoncloud.com] 1 Outline What is Cloud Computing? Characteristics of the Cloud Computing model Evolution of Cloud Computing Cloud Computing Architecture Cloud Services:
More informationDistributed Systems. CS422/522 Lecture17 17 November 2014
Distributed Systems CS422/522 Lecture17 17 November 2014 Lecture Outline Introduction Hadoop Chord What s a distributed system? What s a distributed system? A distributed system is a collection of loosely
More informationDistributed Systems. 31. The Cloud: Infrastructure as a Service Paul Krzyzanowski. Rutgers University. Fall 2013
Distributed Systems 31. The Cloud: Infrastructure as a Service Paul Krzyzanowski Rutgers University Fall 2013 December 12, 2014 2013 Paul Krzyzanowski 1 Motivation for the Cloud Self-service configuration
More informationBasics of Cloud Computing Lecture 2. Cloud Providers. Satish Srirama
Basics of Cloud Computing Lecture 2 Cloud Providers Satish Srirama Outline Cloud computing services recap Amazon cloud services Elastic Compute Cloud (EC2) Storage services - Amazon S3 and EBS Cloud managers
More informationCLOUD COMPUTING. A public cloud sells services to anyone on the Internet. The cloud infrastructure is made available to
CLOUD COMPUTING In the simplest terms, cloud computing means storing and accessing data and programs over the Internet instead of your computer's hard drive. The cloud is just a metaphor for the Internet.
More informationCloud Programming. Programming Environment Oct 29, 2015 Osamu Tatebe
Cloud Programming Programming Environment Oct 29, 2015 Osamu Tatebe Cloud Computing Only required amount of CPU and storage can be used anytime from anywhere via network Availability, throughput, reliability
More informationLarge Scale Computing Infrastructures
GC3: Grid Computing Competence Center Large Scale Computing Infrastructures Lecture 2: Cloud technologies Sergio Maffioletti GC3: Grid Computing Competence Center, University
More informationCloud Computing Technologies and Types
Cloud Computing Technologies and Types Jo, Heeseung From Dell Zhang's, Birkbeck, University of London The Technological Underpinnings of Cloud Computing Data centers Virtualization RESTful APIs Cloud storage
More informationUVA HPC & BIG DATA COURSE. Cloud Computing. Adam Belloum
UVA HPC & BIG DATA COURSE Cloud Computing Adam Belloum outline Cloud computing: Approach and vision Resource Provisioning in Cloud systems: Cloud Systems: IaaS, PaaS, SaaS Using Cloud Systems in practice
More informationLecture 09: VMs and VCS head in the clouds
Lecture 09: VMs and VCS head in the Hands-on Unix system administration DeCal 2012-10-29 1 / 20 Projects groups of four people submit one form per group with OCF usernames, proposed project ideas, and
More informationCLOUD 102 The Long Range Forecast is Cloudy, with a Chance Of Virtualization Ron Clifton, James Kelso & Thomas Crowe III
CLOUD 102 a The Long Range Forecast is Cloudy, with a Chance Of Virtualization Ron Clifton, James Kelso & Thomas Crowe III Cloud 102 Intro: Ron Clifton Page: 1 Cloud 102:Introduction Ron W. Clifton CliftonGroup
More informationCloud & container monitoring , Lars Michelsen Check_MK Conference #4
Cloud & container monitoring 04.05.2018, Lars Michelsen Some cloud definitions Applications Data Runtime Middleware O/S Virtualization Servers Storage Networking Software-as-a-Service (SaaS) Applications
More informationFaculté Polytechnique
Faculté Polytechnique INFORMATIQUE PARALLÈLE ET DISTRIBUÉE CHAPTER 7 : CLOUD COMPUTING Sidi Ahmed Mahmoudi sidi.mahmoudi@umons.ac.be 13 December 2017 PLAN Introduction I. History of Cloud Computing and
More informationBasics of Cloud Computing Lecture 2. Cloud Providers. Satish Srirama
Basics of Cloud Computing Lecture 2 Cloud Providers Satish Srirama Outline Cloud computing services recap Amazon cloud services Elastic Compute Cloud (EC2) Storage services - Amazon S3 and EBS Cloud managers
More informationDistributed Systems CS6421
Distributed Systems CS6421 Intro to Distributed Systems and the Cloud Prof. Tim Wood v I teach: Software Engineering, Operating Systems, Sr. Design I like: distributed systems, networks, building cool
More informationNext-Generation Cloud Platform
Next-Generation Cloud Platform Jangwoo Kim Jun 24, 2013 E-mail: jangwoo@postech.ac.kr High Performance Computing Lab Department of Computer Science & Engineering Pohang University of Science and Technology
More informationCLOUD COMPUTING PRIMER FOR EXECUTIVES
CLOUD COMPUTING PRIMER FOR EXECUTIVES Cloud Computing Who Cares? Enables New products, services, business models (digital) Faster growth (agility) Better efficiency (not necessarily cheaper) Requires different
More informationCloud Computing Lecture 4
Cloud Computing Lecture 4 1/17/2012 What is Hypervisor in Cloud Computing and its types? The hypervisor is a virtual machine monitor (VMM) that manages resources for virtual machines. The name hypervisor
More informationMoving to the Cloud. Developing Apps in. the New World of Cloud Computing. Dinkar Sitaram. Geetha Manjunath. David R. Deily ELSEVIER.
Moving to the Cloud Developing Apps in the New World of Cloud Computing Dinkar Sitaram Geetha Manjunath Technical Editor David R. Deily AMSTERDAM BOSTON HEIDELBERG LONDON NEW YORK OXFORD PARIS SAN DIEGO
More informationProtecting your Data in the Cloud. Cyber Security Awareness Month Seminar Series
Protecting your Data in the Cloud Cyber Security Awareness Month Seminar Series October 24, 2012 Agenda Introduction What is the Cloud Types of Clouds Anatomy of a cloud Why we love the cloud Consumer
More informationCloud Computing Briefing Presentation. DANU
Cloud Computing Briefing Presentation Contents Introducing the Cloud Value Proposition Opportunities Challenges Success Stories DANU Cloud Offering Introducing the Cloud What is Cloud Computing? IT capabilities
More informationCloud Computing, SaaS and Outsourcing
Cloud Computing, SaaS and Outsourcing Michelle Perez, AGC Privacy, IPG Bonnie Yeomans, VP, AGC & Privacy Officer, CA Technologies PLI TechLaw Institute 2017: The Digital Agenda Introduction to the Cloud
More informationFAST TRACK YOUR AMAZON AWS CLOUD TECHNICAL SKILLS. Enterprise Website Hosting with AWS
FAST TRACK YOUR AMAZON AWS CLOUD TECHNICAL SKILLS Enterprise Website Hosting with AWS 2 Day Course Outline Table of Contents Introduction Course Structure Course Outline Day 1 - Introduction to Cloud Computing,
More informationCloud Computing and Service-Oriented Architectures
Material and some slide content from: - Atif Kahn SERVICES COMPONENTS OBJECTS MODULES Cloud Computing and Service-Oriented Architectures Reid Holmes Lecture 29 - Friday March 22 2013. Cloud precursors
More informationEpiserver Digital Experience Cloud Norge Thechforum 2017
Digital Experience Cloud Norge Thechforum 2017 Daniel Browne Cloud Sales Solution Architect 8/31/2017 4 So let s talk cloud! 8/31/2017 5 What's the difference between all the different available cloud
More informationCloud Computing. What is cloud computing. CS 537 Fall 2017
Cloud Computing CS 537 Fall 2017 What is cloud computing Illusion of infinite computing resources available on demand Scale-up for most apps Elimination of up-front commitment Small initial investment,
More informationMoving to computing are auditors ready for the security challenges? Albert Otete CPA CISA ISACA Uganda Workshop
Moving to computing are auditors ready for the security challenges? Albert Otete CPA CISA ISACA Uganda Workshop 10.08.2011 What is computing? Examples of service providers Computing preface Cloud computing
More informationCloud Computing 1. CSCI 4850/5850 High-Performance Computing Spring 2018
Cloud Computing 1 CSCI 4850/5850 High-Performance Computing Spring 2018 Tae-Hyuk (Ted) Ahn Department of Computer Science Program of Bioinformatics and Computational Biology Saint Louis University Learning
More informationDEEP DIVE INTO CLOUD COMPUTING
International Journal of Research in Engineering, Technology and Science, Volume VI, Special Issue, July 2016 www.ijrets.com, editor@ijrets.com, ISSN 2454-1915 DEEP DIVE INTO CLOUD COMPUTING Ranvir Gorai
More informationWelcome to the New Era of Cloud Computing
Welcome to the New Era of Cloud Computing Aaron Kimball The web is replacing the desktop 1 SDKs & toolkits are there What about the backend? Image: Wikipedia user Calyponte 2 Two key concepts Processing
More informationMigrating Enterprise Applications to the Cloud Session 672. Leighton L. Nelson
Migrating Enterprise Applications to the Cloud Session 672 Leighton L. Nelson Leighton L. Nelson Instructional Technology Principal Oracle ACE & Oracle Certified Expert Oracle Database Administrator Author/blogger
More informationLecture 7: Data Center Networks
Lecture 7: Data Center Networks CSE 222A: Computer Communication Networks Alex C. Snoeren Thanks: Nick Feamster Lecture 7 Overview Project discussion Data Centers overview Fat Tree paper discussion CSE
More informationCloud Computing. Amazon Web Services (AWS)
Cloud Computing What is Cloud Computing? Benefit of cloud computing Overview of IAAS, PAAS, SAAS Types Of Cloud private, public & hybrid Amazon Web Services (AWS) Introduction to Cloud Computing. Introduction
More informationCloud Infrastructure and Operations Chapter 2B/8 Page Main concept from which Cloud Computing developed
Cloud Infrastructure and Operations Chapter 2B/8 Page 1 Chapter 2: Cloud Layer Setup and Maintenance Topics covered: 2.1 Basic Cloud Computing Concept 2.2 Benefits of Cloud Computing 2.3 Main concept from
More informationCSE6331: Cloud Computing
CSE6331: Cloud Computing Leonidas Fegaras University of Texas at Arlington c 2019 by Leonidas Fegaras Cloud Computing Fundamentals Based on: J. Freire s class notes on Big Data http://vgc.poly.edu/~juliana/courses/bigdata2016/
More informationNEXT GENERATION CLOUD SECURITY
SESSION ID: CMI-F02 NEXT GENERATION CLOUD SECURITY Myles Hosford Head of FSI Security & Compliance Asia Amazon Web Services Agenda Introduction to Cloud Security Benefits of Cloud Security Cloud APIs &
More informationIntroduction to Cloud Computing
You will learn how to: Build and deploy cloud applications and develop an effective implementation strategy Leverage cloud vendors Amazon EC2 and Amazon S3 Exploit Software as a Service (SaaS) to optimize
More informationDesigning MQ deployments for the cloud generation
Designing MQ deployments for the cloud generation WebSphere User Group, London Arthur Barr, Senior Software Engineer, IBM MQ 30 th March 2017 Top business drivers for cloud 2 Source: OpenStack user survey,
More informationCHEM-E Process Automation and Information Systems: Applications
CHEM-E7205 - Process Automation and Information Systems: Applications Cloud computing Jukka Kortela Contents What is Cloud Computing? Overview of Cloud Computing Comparison of Cloud Deployment Models Comparison
More informationTopics II SaaS 2.0 OaSe*: OpenCms as a Service Cloud Sites SaaS 3.0 Google Apps (Gmail, Google Docs) Cloud Assessment Services Cloudify: Cloud Applica
Topics I CaMuS Cloud aware Content Management Framework OpenCAMP Open Cloud Application Management Platform AppScale Cloud Foundry OpenShift Open Cloud Operating Systems Apache CloudStack Eucalyptus OpenNebula
More informationEmbedded Technosolutions
Hadoop Big Data An Important technology in IT Sector Hadoop - Big Data Oerie 90% of the worlds data was generated in the last few years. Due to the advent of new technologies, devices, and communication
More informationIn this unit we are going to look at cloud computing. Cloud computing, also known as 'on-demand computing', is a kind of Internet-based computing,
In this unit we are going to look at cloud computing. Cloud computing, also known as 'on-demand computing', is a kind of Internet-based computing, where shared resources, data and information are provided
More informationCloud Computing and Service-Oriented Architectures
Material and some slide content from: - Atif Kahn SERVICES COMPONENTS OBJECTS MODULES Cloud Computing and Service-Oriented Architectures Reid Holmes Lecture 20 - Tuesday November 23 2010. SOA Service-oriented
More informationIBM Cloud Security for the Cloud. Amr Ismail Security Solutions Sales Leader Middle East & Pakistan
IBM Cloud Security for the Cloud Amr Ismail Security Solutions Sales Leader Middle East & Pakistan Today s Drivers for Cloud Adoption ELASTIC LOWER COST SOLVES SKILLS SHORTAGE RAPID INNOVATION GREATER
More informationExamining Public Cloud Platforms
Examining Public Cloud Platforms A Survey Copyright 2012 Chappell & Associates Agenda What is Cloud Computing? Cloud Platform Technologies: An Overview Public Cloud Platforms: Reviewing the Terrain What
More informationLarge-Scale Web Applications
Large-Scale Web Applications Mendel Rosenblum Web Application Architecture Web Browser Web Server / Application server Storage System HTTP Internet CS142 Lecture Notes - Intro LAN 2 Large-Scale: Scale-Out
More informationCloud Computing An IT Paradigm Changer
Cloud Computing An IT Paradigm Changer Mazin Yousif, PhD CTO, Cloud Computing IBM Canada Ltd. Mazin Yousif, PhD T-Systems International 2009 IBM Corporation IT infrastructure reached breaking point App
More informationWhose Cloud Is It Anyway? Exploring Data Security, Ownership and Control
Whose Cloud Is It Anyway? Exploring Data Security, Ownership and Control SESSION ID: CDS-T11 Sheung-Chi NG Senior Security Consulting Manager, APAC SafeNet, Inc. Cloud and Virtualization Are Change the
More informationCSE 124: THE DATACENTER AS A COMPUTER. George Porter November 20 and 22, 2017
CSE 124: THE DATACENTER AS A COMPUTER George Porter November 20 and 22, 2017 ATTRIBUTION These slides are released under an Attribution-NonCommercial-ShareAlike 3.0 Unported (CC BY-NC-SA 3.0) Creative
More informationLeveraging the Cloud for Law Enforcement. Richard A. Falkenrath, PhD Principal, The Chertoff Group
Leveraging the Cloud for Law Enforcement Richard A. Falkenrath, PhD Principal, The Chertoff Group Law Enforcement Information Management Training Conference & Technology Exposition May 21,2013 Outline
More informationWhat is Cloud Computing? What are the Private and Public Clouds? What are IaaS, PaaS, and SaaS? What is the Amazon Web Services (AWS)?
What is Cloud Computing? What are the Private and Public Clouds? What are IaaS, PaaS, and SaaS? What is the Amazon Web Services (AWS)? What is Amazon Machine Image (AMI)? Amazon Elastic Compute Cloud (EC2)?
More informationHow to Move Your Oracle Database to The Cloud. Clay Jackson Database Solutions Sales Engineer
How to Move Your Oracle Database to The Cloud Clay Jackson Database Solutions Sales Engineer Agenda: Clear the clouds on (pun intended) What s The Cloud? Why Should I Move to The Cloud? How Do I Move to
More informationCloud & AWS Essentials Agenda. Introduction What is the cloud? DevOps approach Basic AWS overview. VPC EC2 and EBS S3 RDS.
Agenda Introduction What is the cloud? DevOps approach Basic AWS overview VPC EC2 and EBS S3 RDS Hands-on exercise 1 What is the cloud? Cloud computing it is a model for enabling ubiquitous, on-demand
More informationWhat is. Thomas and Lori Duncan
What is Thomas and Lori Duncan Definition of Cloud computing Cloud storage is a model of data storage where the digital data is stored in logical pools, the physical storage spans multiple servers (and
More informationMoving to the Cloud: Making It Happen With MarkLogic
Moving to the Cloud: Making It Happen With MarkLogic Alex Bleasdale, Manager, Support, MarkLogic COPYRIGHT 20 April 2017 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. Agenda 1. MarkLogic in the cloud 2.
More informationData Center Fundamentals: The Datacenter as a Computer
Data Center Fundamentals: The Datacenter as a Computer George Porter CSE 124 Feb 9, 2016 *Includes material taken from Barroso et al., 2013, and UCSD 222a. Much in our life is now on the web 2 The web
More informationOPENSTACK: THE OPEN CLOUD
OPENSTACK: THE OPEN CLOUD Anuj Sehgal (s.anuj@jacobs-university.de) AIMS 2012 Labs 04 June 2012 1 Outline What is the cloud? Background Architecture OpenStack Nova OpenStack Glance 2 What is the Cloud?
More informationDistributed Data Infrastructures, Fall 2017, Chapter 2. Jussi Kangasharju
Distributed Data Infrastructures, Fall 2017, Chapter 2 Jussi Kangasharju Chapter Outline Warehouse-scale computing overview Workloads and software infrastructure Failures and repairs Note: Term Warehouse-scale
More informationMobile Cloud Computing
MTAT.03.262 -Mobile Application Development Lecture 8 Mobile Cloud Computing Satish Srirama, Huber Flores satish.srirama@ut.ee Outline Cloud Computing Mobile Cloud Access schemes HomeAssignment3 10/20/2014
More informationAcknowledgements. Beyond DBMSs. Presentation Outline
Acknowledgements Beyond RDBMSs These slides are put together from a variety of sources (both papers and slides/tutorials available on the web) Sharma Chakravarthy Information Technology Laboratory Computer
More informationECE Enterprise Storage Architecture. Fall ~* CLOUD *~. Tyler Bletsch Duke University
ECE590-03 Enterprise Storage Architecture Fall 2017.~* CLOUD *~. Tyler Bletsch Duke University Includes material adapted from the course Information Storage and Management v2 (module 13), published by
More informationAWS Solution Architecture Patterns
AWS Solution Architecture Patterns Objectives Key objectives of this chapter AWS reference architecture catalog Overview of some AWS solution architecture patterns 1.1 AWS Architecture Center The AWS Architecture
More informationIntro to Software as a Service (SaaS) and Cloud Computing
UC Berkeley Intro to Software as a Service (SaaS) and Cloud Computing Armando Fox, UC Berkeley Reliable Adaptive Distributed Systems Lab 2009-2012 Image: John Curley http://www.flickr.com/photos/jay_que/1834540/
More informationCommunity Clouds And why you should care about them
Community Clouds And why you should care about them Matt Johnson, Ed Zedlewski, Eduserv Introduction What is Cloud Computing? National Institute of Standards & Technology (NIST) a model for enabling convenient,
More informationAnalysis of Cloud Computing Delivery Architecture Models
2011 Workshops of International Conference on Advanced Information Networking and Applications Analysis of Computing Delivery Architecture Models Irena Bojanova Graduate School of Management and Technology
More informationCS 6393 Lecture 10. Cloud Computing. Prof. Ravi Sandhu Executive Director and Endowed Chair. April 12,
CS 6393 Lecture 10 Cloud Computing Prof. Ravi Sandhu Executive Director and Endowed Chair April 12, 2013 ravi.sandhu@utsa.edu www.profsandhu.com Ravi Sandhu 1 The Cloud The Network is the Computer - Sun
More informationCloud & Virtualization Technologies
Cloud & Virtualization Technologies December 2018 John Blackwood, CIS Faculty Where to begin? Technology at the heart of every company Most companies will need some type of cloudbased solution The Cloud
More informationWhite Paper Impact of DoD Cloud Strategy and FedRAMP on CSP, Government Agencies and Integrators.
White Paper Impact of DoD Cloud Strategy and FedRAMP on CSP, Government Agencies and Integrators. www.spirentfederal.com Table of Contents 1.0 DOD CLOUD STRATEGY IMPACT.............................................................
More informationThe Freedom to Choose
Anat Dror The Freedom to Choose Choosing between SQL Server offerings Anat Dror SQL Server Expert, Quest SQL Server and DB2 domain expert with over 20 years of experience in a long list of IT related roles.
More informationBasics of Cloud Computing Lecture 2. Cloud Providers. Satish Srirama
Basics of Cloud Computing Lecture 2 Cloud Providers Satish Srirama Outline Cloud computing services recap Amazon cloud services Elastic Compute Cloud (EC2) Storage services -Amazon S3 and EBS Cloud managers
More informationHigh Performance and Cloud Computing (HPCC) for Bioinformatics
High Performance and Cloud Computing (HPCC) for Bioinformatics King Jordan Georgia Tech January 13, 2016 Adopted From BIOS-ICGEB HPCC for Bioinformatics 1 Outline High performance computing (HPC) Cloud
More informationHOW TO PLAN & EXECUTE A SUCCESSFUL CLOUD MIGRATION
HOW TO PLAN & EXECUTE A SUCCESSFUL CLOUD MIGRATION Steve Bertoldi, Solutions Director, MarkLogic Agenda Cloud computing and on premise issues Comparison of traditional vs cloud architecture Review of use
More informationIntroduction to Cloud Computing
Introduction to Cloud Computing Nabil Abdennadher nabil.abdennadher@hesge.ch 2017/2018 1 Plan Context Definition Market Cloud service models Cloud deployments models Key drivers to adopting the Cloud Barriers
More informationPrivacy hacking & Data Theft
Privacy hacking & Data Theft Cloud Computing risks & the Patricia A RoweSeale CIA, CISA, CISSP, CRISC, CRMA The IIA (Barbados Chapter) Internal Audit Portfolio Director CIBC FirstCaribbean Objectives Cloud
More informationINFS 214: Introduction to Computing
INFS 214: Introduction to Computing Session 13 Cloud Computing Lecturer: Dr. Ebenezer Ankrah, Dept. of Information Studies Contact Information: eankrah@ug.edu.gh College of Education School of Continuing
More informationCS5950 / CS6030 Cloud Computing
CS5950 / CS6030 Cloud Computing http://www.cs.wmich.edu/gupta/teaching/cs6030/6030clouds17/cs6030cloud.php Ajay Gupta B239, CEAS Computer Science Department Western Michigan University ajay.gupta@wmich.edu
More informationDeveloping Enterprise Cloud Solutions with Azure
Developing Enterprise Cloud Solutions with Azure Java Focused 5 Day Course AUDIENCE FORMAT Developers and Software Architects Instructor-led with hands-on labs LEVEL 300 COURSE DESCRIPTION This course
More informationWhat is Cloud Computing? Cloud computing is the dynamic delivery of IT resources and capabilities as a Service over the Internet.
1 INTRODUCTION What is Cloud Computing? Cloud computing is the dynamic delivery of IT resources and capabilities as a Service over the Internet. Cloud computing encompasses any Subscriptionbased or pay-per-use
More informationArchitectural Implications of Cloud Computing
Architectural Implications of Cloud Computing Grace Lewis Research, Technology and Systems Solutions (RTSS) Program Lewis is a senior member of the technical staff at the SEI in the Research, Technology,
More informationAzure SQL Database Basics
Intro: Timothy P. McAliley timothy.mcaliley@microsoft.com Microsoft Account Technology Strategist, Washington, DC CISA, CISM, CISSP, ITIL V3, MCSA, MCSE, MCITP, MCTS, MCT, PMP www.itprocamp.com www.meetup.com/mfcf-dc
More informationScalable Tools - Part I Introduction to Scalable Tools
Scalable Tools - Part I Introduction to Scalable Tools Adisak Sukul, Ph.D., Lecturer, Department of Computer Science, adisak@iastate.edu http://web.cs.iastate.edu/~adisak/mbds2018/ Scalable Tools session
More informationDistributed Data Management. Christoph Lofi Institut für Informationssysteme Technische Universität Braunschweig
Distributed Data Management Christoph Lofi Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de 12.0 The Cloud 12.1 Map & Reduce 12.2 Cloud beyond Storage 12.3
More informationCLOUD AND AWS TECHNICAL ESSENTIALS PLUS
1 P a g e CLOUD AND AWS TECHNICAL ESSENTIALS PLUS Contents Description... 2 Course Objectives... 2 Cloud computing essentials:... 2 Pre-Cloud and Need for Cloud:... 2 Cloud Computing and in-depth discussion...
More information