1 1 MapReduce for Scalable and Cloud Computing CS6323 Adapted from NETS212, U. Penn, USA
2 2 Overview Networked computing The need for scalability; scale of current services Scaling up: From PCs to data centers Problems with 'classical' scaling techniques Utility computing and cloud computing What are utility computing and cloud computing? What kinds of clouds exist today? What kinds of applications run on the cloud? Virtualization: How clouds work 'under the hood' Some cloud computing challenges
3 3 Cloud Computing Concept Jobs User Cloud provider University College Cork
4 4 Cloud Computing Concept Network structure hidden from user No concept of programming paradigm Jobs User Cloud provider Focus on programming paradigm University College Cork
5 5 How many users and objects? Flickr has >6 billion photos Facebook has 1.15 billion active users Google is serving >1.2 billion queries/day on more than 27 billion items >2 billion videos/day watched on YouTube
6 6 How much data? Modern applications use massive data: Rendering 'Avatar' movie required >1 petabyte of storage ebay has >6.5 petabytes of user data CERN's LHC will produce about 15 petabytes of data per year In 2008, Google processed 20 petabytes per day German Climate computing center dimensioned for 60 petabytes of climate data Google now designing for 1 exabyte of storage NSA Utah Data Center is said to have 5 zettabyte (!) How much is a zettabyte? 1,000,000,000,000,000,000,000 bytes A stack of 1TB hard disks that is 25,400 km high 25,400 km
7 7 How much computation? No single computer can process that much data Need many computers! How many computers do modern services need? Facebook is thought to have more than 60,000 servers 1&1 Internet has over 70,000 servers Akamai has 95,000 servers in 71 countries Intel has ~100,000 servers in 97 data centers Microsoft reportedly had at least 200,000 servers in 2008 Google is thought to have more than 1 million servers, is planning for 10 million (according to Jeff Dean)
8 8 Why should I care? Suppose you want to build the next Google How do you download and store billions of web pages and images?... quickly find the pages that contain a given set of terms?... find the pages that are most relevant to a given search?... answer 1.2 billion queries of this type every day? Suppose you want to build the next Facebook How do you store the profiles of over 500 million users?... avoid losing any of them?... find out which users might want to be friends? Stay tuned!
9 9 Overview Networked Computing The need for scalability; scale of current services Scaling up: From PCs to data centers Problems with 'classical' scaling techniques NEXT Utility computing and cloud computing What are utility computing and cloud computing? What kinds of clouds exist today? What kinds of applications run on the cloud? Virtualization: How clouds work 'under the hood' Some cloud computing challenges
10 11 Clusters Network switch (connects nodes with each other and with other racks) Rack Many nodes/blades (often identical) Storage device(s) Characteristics of a cluster: Many similar machines, close interconnection (same room?) Often special, standardized hardware (racks, blades) Usually owned and used by a single organization
11 12 Power and cooling Clusters need lots of power Example: 140 Watts per server Rack with 32 servers: 4.5kW (needs special power supply!) Most of this power is converted into heat Large clusters need massive cooling 4.5kW is about 3 space heaters And that's just one rack!
12 13 Scaling up PC Server Cluster Data center What if your cluster is too big (hot, power hungry) to fit into your office building? Build a separate building for the cluster Building can have lots of cooling and power Result: Data center
13 14 What does a data center look like? Cooling plant Data centers (size of a football field) Google data center in The Dalles, Oregon A warehouse-sized computer A single data center can easily contain 10,000 racks with 100 cores in each rack (1,000,000 cores total)
14 15 What's in a data center? Source: 1&1 Hundreds or thousands of racks
15 16 What's in a data center? Source: 1&1 Massive networking
16 17 What's in a data center? Source: 1&1 Emergency power supplies
17 18 What's in a data center? Source: 1&1 Massive cooling
18 19 Energy matters! Company Servers Electricity Cost ebay 16K ~0.6*10 5 MWh ~$3.7M/yr Akamai 40K ~1.7*10 5 MWh ~$10M/yr Rackspace 50K ~2*10 5 MWh ~$12M/yr Microsoft >200K >6*10 5 MWh >$36M/yr Google >500K >6.3*10 5 MWh >$38M/yr USA (2006) 10.9M 610*10 5 MWh $4.5B/yr Source: Qureshi et al., SIGCOMM 2009 Data centers consume a lot of energy Makes sense to build them near sources of cheap electricity Example: Price per KWh is 3.6ct in Idaho (near hydroelectric power), 10ct in California (long distance transmission), 18ct in Hawaii (must ship fuel) Most of this is converted into heat Cooling is a big issue!
19 20 Scaling up PC Server Cluster Data center Network of data centers What if even a data center is not big enough? Build additional data centers Where? How many?
20 21 Global distribution Data centers are often globally distributed Example above: Google data center locations (inferred) Why? Need to be close to users (physics!) Cheaper resources Protection against failures
21 22 Trend: Modular data center Need more capacity? Just deploy another container!
22 23 Overview Networked Computing The need for scalability; scale of current services Scaling up: From PCs to data centers Problems with 'classical' scaling techniques NEXT Utility computing and cloud computing What are utility computing and cloud computing? What kinds of clouds exist today? What kinds of applications run on the cloud? Virtualization: How clouds work 'under the hood' Some cloud computing challenges
23 24 Problem #1: Difficult to dimension 2x-10x Jobs cannot be completed Dissatisfied customers leave Provisioning for the peak load Provisioning below the peak Problem: Load can vary considerably Peak load can exceed average load by factor 2x-10x But: Few users deliberately provision for less than the peak Result: Server utilization in existing data centers ~5%-20%!! Dilemma: Waste resources or lose customers!
24 25 Problem #2: Expensive Need to invest many $$$ in hardware Even a small cluster can easily cost $100,000 Microsoft recently invested $499 million in a single data center Need expertise Planning and setting up a large cluster is highly nontrivial Cluster may require special software, etc. Need maintenance Someone needs to replace faulty hardware, install software upgrades, maintain user accounts,...
25 26 Problem #3: Difficult to scale Scaling up is difficult Need to order new machines, install them, integrate with existing cluster - can take weeks Large scaling factors may require major redesign, e.g., new storage system, new interconnect, new building (!) Scaling down is difficult What to do with superfluous hardware? Server idle power is about 60% of peak Energy is consumed even when no work is being done Many fixed costs, such as construction
26 27 Recap: Computing at scale Modern applications require huge amounts of processing and data Measured in petabytes, millions of users, billions of objects Need special hardware, algorithms, tools to work at this scale Clusters and data centers can provide the resources we need Main difference: Scale (room-sized vs. building-sized) Special hardware; power and cooling are big concerns Clusters and data centers are not perfect Difficult to dimension; expensive; difficult to scale
27 28 Plan for today Computing at scale The need for scalability; scale of current services Scaling up: From PCs to data centers Problems with 'classical' scaling techniques Utility computing and cloud computing What are utility computing and cloud computing? What kinds of clouds exist today? What kinds of applications run on the cloud? Virtualization: How clouds work 'under the hood' Some cloud computing challenges NEXT
28 29 The power plant analogy Steam engine at Stott Park Bobbin Mill Waterwheel at the Neuhausen ob Eck Open-Air Museum It used to be that everyone had their own power source Challenges are similar to the cluster: Needs large up-front investment, expertise to operate, difficult to scale up/down...
29 Scaling the power plant Then people started to build large, centralized power plants with very large capacity... 30
30 Metered usage model Power source Network Metering device Customer Power plants are connected to customers by a network Usage is metered, and everyone (basically) pays only for what they actually use 31
31 32 Why is this a good thing? Electricity Economies of scale Cheaper to run one big power plant than many small ones Statistical multiplexing High utilization! No up-front commitment No investment in generator; pay-as-you-go model Scalability Thousands of kilowatts available on demand; add more within seconds Computing Cheaper to run one big data center than many small ones High utilization! No investment in data center; pay-as-you-go model Thousands of computers available on demand; add more within seconds
32 33 What is cloud computing?
33 34 What is cloud computing? The interesting thing about Cloud Computing is that we've redefined Cloud Computing to include everything that we already do... I don't understand what we would do differently in the light of Cloud Computing other than change the wording of some of our ads. Larry Ellison, quoted in the Wall Street Journal, September 26, 2008 A lot of people are jumping on the [cloud] bandwagon, but I have not heard two people say the same thing about it. There are multiple definitions out there of "the cloud". Andy Isherwood, quoted in ZDnet News, December 11, 2008
34 35 So what is it, really? According to NIST: Cloud computing is a model for enabling convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction. Essential characteristics: On-demand self service Broad network access Resource pooling Rapid elasticity Measured service
35 36 Other terms you may have heard Utility computing The service being sold by a cloud Focuses on the business model (pay-as-you-go), similar to classical utility companies The Web The Internet's information sharing model Some web services run on clouds, but not all The Internet A network of networks. Used by the web; connects (most) clouds to their customers
36 37 Plan for today Computing at scale The need for scalability; scale of current services Scaling up: From PCs to data centers Problems with 'classical' scaling techniques Utility computing and cloud computing What are utility computing and cloud computing? What kinds of clouds exist today? NEXT What kinds of applications run on the cloud? Virtualization: How clouds work 'under the hood' Some cloud computing challenges
37 38 Everything as a Service What kind of service does the cloud provide? Does it offer an entire application, or just resources? If resources, what kind / level of abstraction? Three types commonly distinguished: Software as a service (SaaS) Analogy: Restaurant. Prepares&serves entire meal, does the dishes,... Platform as a service (PaaS) Analogy: Take-out food. Prepares meal, but does not serve it. Infrastructure as a service (IaaS) Analogy: Grocery store. Provides raw ingredients. Other xaas types have been defined, but are less common Desktop, Backend, Communication, Network, Monitoring,...
38 39 Software as a Service (SaaS) User Application Middleware Cloud provider Hardware Cloud provides an entire application Word processor, spreadsheet, CRM software, calendar... Customer pays cloud provider Example: Google Apps, Salesforce.com
39 40 Platform as a Service (PaaS) SaaS provider User Application Middleware Cloud provider Hardware Cloud provides middleware/infrastructure For example, Microsoft Common Language Runtime (CLR) Customer pays SaaS provider for the service; SaaS provider pays the cloud for the infrastructure Example: Windows Azure, Google App Engine
40 41 Infrastructure as a Service (IaaS) SaaS provider User Application Middleware Cloud provider Hardware Cloud provides raw computing resources Virtual machine, blade server, hard disk,... Customer pays SaaS provider for the service; SaaS provider pays the cloud for the resources Examples: Amazon Web Services, Rackspace Cloud, GoGrid
41 42 Private/hybrid/community clouds Company A Company B Public Community Private Who can become a customer of the cloud? Public cloud: Commercial service; open to (almost) anyone. Example: Amazon AWS, Microsoft Azure, Google App Engine Community cloud: Shared by several similar organizations. Example: Google's "Gov Cloud" Private cloud: Shared within a single organization. Example: Internal datacenter of a large company.
42 New Paradigm for Large Scale Data Processing Need to process lots of data ( > 1 TB) Parallelize across hundreds/thousands of CPUs Want to make this easy Approach Divide and conquer Split processing across multiple CPUs Integrate outputs Network is virtual No fixed structure, but dynamic structure Traditional networks (telephone, etc.) Fixed structure
43 Divide and Conquer Work Partition w 1 w 2 w 3 worker worker worker r 1 r 2 r 3 Result Combine
44 45 MapReduce Framework Divide and conquer Makes use of thousands of CPUs Network structure is demand-driven Access CPUs/storage based on dynamic jobs Framework (e.g., Hadoop) creates network on demand
45 Parallelization Challenges How do we assign work units to workers? What if we have more work units than workers? What if workers need to share partial results? How do we aggregate partial results? How do we know all the workers have finished? What if workers die?
46 47 Examples of cloud applications Application hosting Backup and Storage Content delivery E-commerce High-performance computing Media hosting On-demand workforce Search engines Web hosting
47 48 Other examples DreamWorks is using the Cerelink cloud to render animation movies Cloud was already used to render parts of Shrek Forever After and How to Train your Dragon CERN is working on a "science cloud" to process experimental data Virgin atlantic is hosting their new travel portal on Amazon AWS
48 49 Recap: Cloud applications Clouds are good for many things... Applications that involve large amounts of computation, storage, bandwidth Especially when lots of resources are needed quickly (Washington Post example) or load varies rapidly (TicketLeap example)... but not for all things
49 50 Stay tuned Next lecture: Details of MapReduce
1 MapReduce for Scalable and Cloud Computing CS6323 Adapted from NETS212, U. Penn, USA 2 Overview Networked computing The need for scalability; scale of current services Scaling up: From PCs to data centers
Cloud Computing Ennan Zhai Computer Science at Yale University firstname.lastname@example.org About Final Project About Final Project Important dates before demo session: - Oct 31: Proposal v1.0 - Nov 7: Source code
CIS 602-01: Scalable Data Analysis Cloud Workloads Dr. David Koop Scaling Up PC [Haeberlen and Ives, 2015] 2 Scaling Up PC Server [Haeberlen and Ives, 2015] 2 Scaling Up PC Server Cluster [Haeberlen and
Introduction To Cloud Computing What is Cloud Computing? Cloud computing is a model for enabling ubiquitous, convenient, on-demand network access to a shared pool of configurable computing resources (e.g.,
Cloud Computing CS 537 Fall 2017 What is cloud computing Illusion of infinite computing resources available on demand Scale-up for most apps Elimination of up-front commitment Small initial investment,
Data Centers and Cloud Computing CS677 Guest Lecture Tim Wood 1 Data Centers Large server and storage farms 1000s of servers Many TBs or PBs of data Used by Enterprises for server applications Internet
Introduction to data centers Paolo Giaccone Notes for the class on Switching technologies for data centers Politecnico di Torino December 2017 Cloud computing Section 1 Cloud computing Giaccone (Politecnico
Introduction to Cloud Computing [thoughtsoncloud.com] 1 Outline What is Cloud Computing? Characteristics of the Cloud Computing model Evolution of Cloud Computing Cloud Computing Architecture Cloud Services:
UC Berkeley Intro to Software as a Service (SaaS) and Cloud Computing Armando Fox, UC Berkeley Reliable Adaptive Distributed Systems Lab 2009-2012 Image: John Curley http://www.flickr.com/photos/jay_que/1834540/
CSE6331: Cloud Computing Leonidas Fegaras University of Texas at Arlington c 2019 by Leonidas Fegaras Cloud Computing Fundamentals Based on: J. Freire s class notes on Big Data http://vgc.poly.edu/~juliana/courses/bigdata2016/
CS 6240: Parallel Data Processing in MapReduce: Module 1 Mirek Riedewald Why Parallel Processing? Answer 1: Big Data 2 How Much Information? Source: http://www2.sims.berkeley.edu/research/projects/ho w-much-info-2003/execsum.htm
High Performance and Cloud Computing (HPCC) for Bioinformatics King Jordan Georgia Tech January 13, 2016 Adopted From BIOS-ICGEB HPCC for Bioinformatics 1 Outline High performance computing (HPC) Cloud
Cloud Computing By: Muhammad Naseem Assistant Professor Department of Computer Engineering, Sir Syed University of Engineering & Technology, Web: http://sites.google.com/site/muhammadnaseem105 Email: email@example.com
From Internet Data Centers to Data Centers in the Cloud This case study is a short extract from a keynote address given to the Doctoral Symposium at Middleware 2009 by Lucy Cherkasova of HP Research Labs
Programowanie w chmurze na platformie Java EE Wykład 1 - dr inż. Piotr Zając Cloud computing definition Cloud computing is a model for enabling ubiquitous, convenient, ondemand network access to a shared
UVA HPC & BIG DATA COURSE Cloud Computing Adam Belloum outline Cloud computing: Approach and vision Resource Provisioning in Cloud systems: Cloud Systems: IaaS, PaaS, SaaS Using Cloud Systems in practice
International Journal of Research in Engineering, Technology and Science, Volume VI, Special Issue, July 2016 www.ijrets.com, firstname.lastname@example.org, ISSN 2454-1915 DEEP DIVE INTO CLOUD COMPUTING Ranvir Gorai
CHEM-E7205 - Process Automation and Information Systems: Applications Cloud computing Jukka Kortela Contents What is Cloud Computing? Overview of Cloud Computing Comparison of Cloud Deployment Models Comparison
High Performance and Cloud Computing (HPCC) for Bioinformatics King Jordan Georgia Tech January 13, 2016 Adopted From BIOS-ICGEB HPCC for Bioinformatics 1 Outline High performance computing (HPC) Cloud
CLOUD COMPUTING In the simplest terms, cloud computing means storing and accessing data and programs over the Internet instead of your computer's hard drive. The cloud is just a metaphor for the Internet.
Architekturen für die Cloud Eberhard Wolff Architecture & Technology Manager adesso AG 08.06.11 What is Cloud? National Institute for Standards and Technology (NIST) Definition On-demand self-service >
Acknowledgements Beyond RDBMSs These slides are put together from a variety of sources (both papers and slides/tutorials available on the web) Sharma Chakravarthy Information Technology Laboratory Computer
Cloud Computing Briefing Presentation Contents Introducing the Cloud Value Proposition Opportunities Challenges Success Stories DANU Cloud Offering Introducing the Cloud What is Cloud Computing? IT capabilities
1 CLOUD COMPUTING Networks and Communication Department Lecture 4: Introductory lecture for cloud computing By: Latifa ALrashed Outline 2 Introduction to the cloud comupting Define the concept of cloud
Distributed Systems 31. The Cloud: Infrastructure as a Service Paul Krzyzanowski Rutgers University Fall 2013 December 12, 2014 2013 Paul Krzyzanowski 1 Motivation for the Cloud Self-service configuration
cutting the electric bill for internetscale systems Asfandyar Qureshi (MIT) Rick Weber (Akamai) Hari Balakrishnan (MIT) John Guttag (MIT) Bruce Maggs (Duke/Akamai) Éole @ flickr context: massive systems
Cloud Computing Topics 1. What is the Cloud? 2. What is Cloud Computing? 3. Cloud Service Architectures 4. History of Cloud Computing 5. Advantages of Cloud Computing 6. Disadvantages of Cloud Computing
SEEM3450 Engineering Innovation and Entrepreneurship Cloud Computing Guest Lecture Gabriel Fung, Ph.D. 2017-10-26 What is Cloud Computing? According to NIST (National Institute of Standards and Technology)
International Journal of Private Cloud Computing Environment and Management Vol. 2, No. 1, (2015), pp. 27-32 http://dx.doi.org/10.21742/ijpccem.2015.2.1.04 High Performance Computing on MapReduce Programming
Faculté Polytechnique INFORMATIQUE PARALLÈLE ET DISTRIBUÉE CHAPTER 7 : CLOUD COMPUTING Sidi Ahmed Mahmoudi email@example.com 13 December 2017 PLAN Introduction I. History of Cloud Computing and
Distributed Data Infrastructures, Fall 2017, Chapter 2 Jussi Kangasharju Chapter Outline Warehouse-scale computing overview Workloads and software infrastructure Failures and repairs Note: Term Warehouse-scale
Large-Scale Data Engineering Overview and Introduction Administration Blackboard Page Announcements, also via email (pardon html formatting) Practical enrollment, Turning in assignments, Check Grades Contact:
Concepts Introduced in Chapter 6 Warehouse-Scale Computers A cluster is a collection of desktop computers or servers connected together by a local area network to act as a single larger computer. introduction
Yang, Chaowei et al. (2011) 'Spatial cloud computing: how can the geospatial sciences use and help shape cloud computing?', International Journal of Digital Earth, 4: 4, 305 329 GEOG 482/582 : GIS Data
En oversikt, likheter og forskjeller Rune Zakariassen Microsoft Historic Computing Transformations We are all excited about the cloud IDC Sees Cloud Market Maturing Quickly In 2009, approximately $17 billion
Community Clouds And why you should care about them Matt Johnson, Ed Zedlewski, Eduserv Introduction What is Cloud Computing? National Institute of Standards & Technology (NIST) a model for enabling convenient,
A quiet revolutation is taking place in networking speeds for servers and storage, one that is converting 1Gb and 10 Gb connections to 25Gb, 50Gb and 100 Gb connections in order to support faster servers,
INFS 214: Introduction to Computing Session 13 Cloud Computing Lecturer: Dr. Ebenezer Ankrah, Dept. of Information Studies Contact Information: firstname.lastname@example.org College of Education School of Continuing
DISTRIBUTED SYSTEMS [COMP9243] Lecture 8a: Cloud Computing Slide 1 Slide 3 ➀ What is Cloud Computing? ➁ X as a Service ➂ Key Challenges ➃ Developing for the Cloud Why is it called Cloud? services provided
Cloud Computing Introduction & Offerings from IBM Gytis Račiukaitis IT Architect, IBM Global Business Services Agenda What is cloud computing? Benefits Risks & Issues Thinking about moving into the cloud?
MTAT.03.262 Mobile Application Development Mobile Cloud Computing Satish Srirama, Huber Flores email@example.com Tartu, Estonia, 2013 Outline Cloud Computing Mobile Cloud Access schemas Research challenges
Lecture 7: Data Center Networks CSE 222A: Computer Communication Networks Alex C. Snoeren Thanks: Nick Feamster Lecture 7 Overview Project discussion Data Centers overview Fat Tree paper discussion CSE
CLOUD COMPUTING Rajesh Kumar DevOps Architect @RajeshKumarIN www.rajeshkumar.xyz www.scmgalaxy.com 1 Session Objectives This session will help you to: Introduction to Cloud Computing Cloud Computing Architecture
Tour of Database Platforms as a Service June 2016 Warner Chaves Christo Kutrovsky Solutions Architect Bio Solutions Architect at Pythian Specialize high performance data processing and analytics 15 years
Cloud Computing Lecture 4 1/17/2012 What is Hypervisor in Cloud Computing and its types? The hypervisor is a virtual machine monitor (VMM) that manages resources for virtual machines. The name hypervisor
THE DATA CENTER AS A COMPUTER Cloud Computing November- 2013 FIB-UPC Master MEI CLOUD COMPUTING It s here to stay CONTENT 1. How do we get here? 2. What is Cloud Computing? 3. Definitons and types 4. Case
Cloud Programming Programming Environment Oct 29, 2015 Osamu Tatebe Cloud Computing Only required amount of CPU and storage can be used anytime from anywhere via network Availability, throughput, reliability
In this unit we are going to look at cloud computing. Cloud computing, also known as 'on-demand computing', is a kind of Internet-based computing, where shared resources, data and information are provided
Cloud Computing Technologies and Types Jo, Heeseung From Dell Zhang's, Birkbeck, University of London The Technological Underpinnings of Cloud Computing Data centers Virtualization RESTful APIs Cloud storage
Cloud Computing in Learning Magdy S. Aqel Instructional technology department Islamic University of Gaza (IUG) firstname.lastname@example.org 2011 2 What is Cloud Computing? 3 What is Cloud Computing? Cloud computing
Everything you need to know about cloud For companies with people in them You used to know where you stood with the word cloud. It meant those fluffy things floating above you, bringing shade and rain,
White Paper Impact of DoD Cloud Strategy and FedRAMP on CSP, Government Agencies and Integrators. www.spirentfederal.com Table of Contents 1.0 DOD CLOUD STRATEGY IMPACT.............................................................
Cloud Computing Cloud Computing Technologies and Types Dell Zhang Birkbeck, University of London 2017/18 The Technological Underpinnings of Cloud Computing Data centres Virtualisation RESTful APIs Cloud
Modernize Your IT with FlexPod NetApp & Schneider Electric Hyper-distribution of Applications and Data 30M New devices connected every week 277X Data created by IoE devices v. end-user 180B Mobile apps
Cloud Computing? Dipl. Ing. Abdelnasser Abdelhadi Islamic University Gaza Department of Computer Engineering April 2010 Computing as a Service Business Processes Collaboration Industry Applications Software
Transform Your Business To An Open Hybrid Cloud Architecture Presenter Name Title Date Why You Need To Transform Your Business Public cloud performance setting new expectations for: IT speed, flexibility
A Computer Scientist Looks at the Energy Problem Randy H. Katz University of California, Berkeley EECS BEARS Symposium February 12, 2009 Energy permits things to exist; information, to behave purposefully.
CS 6393 Lecture 10 Cloud Computing Prof. Ravi Sandhu Executive Director and Endowed Chair April 12, 2013 email@example.com www.profsandhu.com Ravi Sandhu 1 The Cloud The Network is the Computer - Sun
RACKSPACE ONMETAL I/O V2 OUTPERFORMS AMAZON EC2 BY UP TO 2X IN BENCHMARK TESTING EXECUTIVE SUMMARY Today, businesses are increasingly turning to cloud services for rapid deployment of apps and services.
International Journal of Advances in Engineering & Scientific Research (IJAESR) ISSN: 2349 3607 (Online), ISSN: 2349 4824 (Print) Download Full paper from : http://www.arseam.com/content/volume-1-issue-7-nov-2014-0
Examining Public Cloud Platforms A Survey Copyright 2012 Chappell & Associates Agenda What is Cloud Computing? Cloud Platform Technologies: An Overview Public Cloud Platforms: Reviewing the Terrain What
Renovating your storage infrastructure for Cloud era Nguyen Phuc Cuong Software Defined Storage Country Sales Leader Copyright IBM Corporation 2016 2 Business SLAs Challenging Traditional Storage Approaches
Where We Are Introduction to Data Management CSE 344 Lecture 22: MapReduce We are talking about parallel query processing There exist two main types of engines: Parallel DBMSs (last lecture + quick review)
Module Day Topic 1 Definition of Cloud Computing and its Basics 1 2 3 1. How does cloud computing provides on-demand functionality? 2. What is the difference between scalability and elasticity? 3. What
Case Study 2: Document Retrieval Clustering Documents Machine Learning for Big Data CSE547/STAT548, University of Washington Sham Kakade April 21 th, 2015 Sham Kakade 2016 1 Document Retrieval Goal: Retrieve
Cloud Computing and Cloud Networking Dr. Adel Nadjaran Toosi Cloud Computing and Distributed Systems (CLOUDS) Laboratory, School of Computing and Information Systems The University of Melbourne, Australia
Big Data and Cloud Computing Presented at Faculty of Computer Science University of Murcia Presenter: Muhammad Fahim, PhD Department of Computer Eng. Istanbul S. Zaim University, Istanbul, Turkey About
Falling Out of the Clouds: When Your Big Data Needs a New Home Executive Summary Today s public cloud computing infrastructures are not architected to support truly large Big Data applications. While it
image credit http://eyepluscamera.files.wordpress.com/ Fabien Hermenier Cloud compting 101 1 ? was cloud computing needed 2 3 Mainframes Then came with affordable PCs Then we spread out the load for security,
image credit http://eyepluscamera.files.wordpress.com/ Fabien Hermenier Cloud compting 101 1 was cloud computing needed? 2 3 Mainframes Then came with affordable PCs Then we spread out the load for security,
Scaling Without Sharding Baron Schwartz Percona Inc Surge 2010 Web Scale!!!! http://www.xtranormal.com/watch/6995033/ A Sharding Thought Experiment 64 shards per proxy  1 TB of data storage per node
January 2015 Cloud & Xaas When computers flies in the sky Jérôme Blanchard Research Engineer ATILF, CNRS firstname.lastname@example.org Presentation Organization Part 1. 30'. A little bit of cloud computing
Data Centres: The Infrastructure That Underpins The Cloud May 2017 Cloud computing is redefining the way that IT services are accessed and delivered On Demand, Self-Service Characteristics Pay-as-you-use,
Case Study 2: Document Retrieval Clustering Documents Machine Learning for Big Data CSE547/STAT548, University of Washington Sham Kakade April, 2017 Sham Kakade 2017 1 Document Retrieval n Goal: Retrieve