Service Oriented Computing (3)

Transcription

1 1 Service Oriented Computing (3) Chan-Hyun YOUN Dept of Electrical Engineering, KAIST

2 2 Computing Paradigm

3 3 Traditional Data Centers Static Resource Allocation Setup and Maintenance are very costly Pay-as-you-go model is more attractive 3

4 Large Scale Data Center in US 4 Quincy, WA San Antonio, TX Northlate (Chicago), IL Dublin, Ireland Iowa (soon) Each data center is 11.5 times the size of a football field 4

5 Limitation of Current Paradigm : Service Provider 5 Substantial economies of scale Service Scale [$13/Mbps]: $0.04/GB Mid Size [$95/Mbps]: $0.30/GB (7.1x) Service Scale: ~$2.5/GB/year Mid Size: $26.00/GB/year* (5.7x) Service Scale: 2,000+ servers/admin Enterprise: ~140 servers/admin (15.7x) What limits application of infinite cores? Power: cost rising and will dominate Data: inability to get data to processor when needed Most sub-moore attributes require most innovation Infinite processors require infinite power Getting data to processors in time to use next cycle: Caches, multi-threading, ILP, consume power

6 Problem 6 Business capability inextricably linked to IT capability Overwhelming complexity >70% of IT budgets just to keep the lights on <30% of IT budgets goes to innovation and competitive advantage VMWare Tech Talk (Peter Zeglis)

7 Goal Eliminate complexity and unlock business value 7 IT as a Service (Internally or Externally Provisioned) Efficiency - Without incurring new costs by better utilizing existing infrastructure Control - Greater degree of control over service levels back to the business Choice - Freedom of choice without locking into proprietary architectures H/W, O/S, applications etc VMWare Presentation (2009)

8 8 Goal Just like.. IT as a Service Inexpensive, pay as you go, pay for what you use Ubiquitously available Reliable Choice of providers VMWare Presentation (2009)

9 9 Cloud Computing

10 Cloud Computing - Carr, Nicholas , The dynamo 1882, Central power station Corporate DC IDC

11 Cloud Computing Wikipedia 11 Scalable As a Service Virtualized Internet IaaS SaaS PaaS * Source: Wikipedia.org

12 12 Definition of Cloud Computing Cloud computing refers to computing resources being accessed which are typically owned and operated by a thirdparty provider on a consolidated basis in Data Center locations. Wikipedia Cloud computing is a computing paradigm in which tasks are assigned to a combination of connections, software and services accessed over a network. This network of servers and connections is collectively known as the cloud. whatis.com

13 Cloud Computing 13 :Definition Definition "A paradigm in which information is permanently stored in servers on the Internet and cached temporarily on clients that include desktops, entertainment centers, table computers, notebooks, wall computers, handhelds, etc. [1] Three Different Level of Cloud computing [2] Application Services in the Cloud (ex. Google Web Doc, SalesForces.com) Platform in the Cloud (ex. Google App Engine) Infrastructure in the Cloud (ex. Amazon EC2, GoGrid) [1] The Definition of cloud computing used in IEEE Computer Society [2] Define Cloud Computing 13

14 Why Cloud Computing? 14 Strengthening Competitiveness Ubiquitous Life User-Centric IT Environment Cloud Computing Smart Device Internet Grid Computing Virtualization SW Platform IT Evolution Global Issues Economic Crisis Energy Green IT Global Warming From Samsung SDS Presentation (Clouds 2008)

15 Services of Cloud computing 15

16 Cloud Computing - NIST 16 CRM ON DEMAND BEEHIVE ON DEMAND AT&T Synaptic Hosting Oracle, Enabler NS-BOS Application Grid(JVM, Coherence) WebLogic Suite, SOA Suite Real Application Clusters DB Options(Active Data Guard Advanced Security, Database Vault) Linux(UBL) Oracle VM <VirtualIron Integration> Data Compression ASM National Institute of Standards and Technology

17 X as a service Cloud Computing Old ideas: Grids, vector supercomputers Software as a Service (SaaS) Def: delivering applications over the Internet Recently: [Hardware, Infrastructure, Platform] as a service Poorly defined so we avoid all X as a service Utility Computing: pay-as-you-go computing Illusion of infinite resources No up-front cost Fine-grained billing (e.g. hourly) 17 17

18 18 Cloud Computing influencers Computing Technology Web Evolution Cloud Computing Open Source Virtualization Grid Computing/Utility Computing

19 19 Evolving Computer Technology

20 Timesharing (1960 s) 20 IBM 7090 hardware Transistorized version of IBM 709 scientific computer 32K of 36-bit words of magnetic core storage Three channels with 19 tape units Three Flexowriter typewriters Two special modifications: 60 cycle/sec accounting and interrupt clock Special mode for memory protection, dynamic relocation and trapping of all user I/O Time-sharing 4 users (3 online typewriters) Fourth passive user in the background

21 21 IBM 7090 Four significant design features of the foreground system for users: Enables development of programs in languages compatible with the background system Can develop a private file of programs Enables debugging sessions at the state of the previous session Setting their own pace without wasting computer time Single OS, a few simultaneous users

22 IBM System/360 Model (Aug 65) First IBM system with virtual memory capabilities S/360 Model 65 with addition of the Dynamic Address Translation facility (DAT box) 16 MB (24-bit addresses) Supported segmentation and paging Memory virtualization enables multiple, larger, simultaneous applications Very high reliability/availability System/360 had a overall circuit failure rate about percent per 1,000 hours Single OS, many simultaneous users

23 23 DEC PDP-11 (1970) 16-bit successor to the PDP-8 UNIX provided virtualization (strong isolation) of memory, computation, storage Single OS, many users Low-cost alternative to mainframe-based computing, but less capable

24 IBM System/370 (Aug 72) 24 Virtual memory 2KB or 4KB pages of memory, 64KB or 1MB segment sizes High performance virtual address translation using Translation- Lookaside Buffer (TLB) VM/370 True Virtual Machine Manager (VMM) First instance of hardware assisted virtualization Privileged I/O: special-purpose control instructions, privileged I/O instructions Privileged System Control: privileged system-control instructions Complete virtualization (strong isolation) of memory, computation, storage Multiple simultaneous OSes (VMs), 100 s-1,000 s simultaneous users But very, very expensive platform

25 25 Enabling Tech: Virtualization Application Virtualization Server virtualization Storage Virtualization CPU Virtualization Datacenter Virtualization Network Virtualizaiton

26 26 What is Virtualization? The abstraction of computer resources A technique for hiding the physical characteristics of computing resources from the way in which other systems, applications, or end users interact with those resources. 26

27 27 Benefits Partitioning Multiple applications and OSes can be supported within a single physical system. Servers can be consolidated into VMs on either a scale-up (scale vertically) or scale-out (scale horizontally) architecture. Computing resources are treated as a uniform pool to be allocated to VMs in a controlled manner. Isolation VMs are completely isolated from the host machine and other VMs. If a VM crashes, all others are unaffected. Data does not leak across VMs and applications can only communicate over configured network connections. Encapsulation Complete VM environment is saved as a single file; easy to backup, move and copy. Standardized virtualized H/W is presented to the application. guaranteeing compatibility. 27

28 28 Platform Virtualization

29 Platform Virtualization 29 : Multiple OS on a Single Machine

30 Virtual Machines: Moving From Niche to Mainstream 30 Large enterprises started sooner Global 500 (G500) are perhaps 25% virtualized 60% 50% Percentage of Installed x86 Workloads Running in a VM 48% Small or midsize businesses (SMBs) started later, and tend to be less virtualized SMBs are virtualizing very fast will exceed G500 penetration in 2009 or % 30% 20% 10% 0% 38% 28% 19% 12% 7% 4% 2%

31 31 Desktop Virtualization The ability to display a graphical desktop from one computer system on another computer system or smart display device Presentation Virtualization Virtual sessions Executing project their user interfaces remotely Each session might run only a single application, or it might present its user with a complete desktop offering multiple applications. 31

32 Application Virtualization 32 Separating the application configuration layer from the OS It enables applications to run on clients without being installed, and to be administered from a central location. 32 Application virtualization makes deployment significantly easier.

33 33 Cloud Computing in Details 33

34 Cloud Computing Core Tecch 34 Source: NIST, US

35 35 Cloud Servises Web Application Service Collaboration Services Compute Service Datacenter Infrastructure Database service Job Scheduling Service Cloud Computing Service Catalog Storage service Virtual Client service Content Classification Storage backup, archive service

36 36 Shapes of Cloud computing (1) Cloud Shapes: The Data Center Cloud Shapes: Distributed Computing Cloud Shapes: A Utility Grid Cloud Shapes: Software as a Service

37 37 Cloud Computing Shapes (2) Software-as-a-Service (SaaS) e.g., Animoto Platform-as-a-Service (PaaS) e.g.googleapp Engine Infrastructure-as-a-Service (IaaS) e.g., AWS, GoGrid, Flexiscale, Science Clouds 37

38 38 Examples of Cloud Computing Shapes As in... SaaS SW as a service an application offered on-demand via multitenancy (Salesforce, GoogleApps) PaaS Platform as a Service aka Application Stack Cloud Provider [ASCP] (Google App Engine, Force.com, Morph, AWS - packaged AMIs) IaaS Infrastructure as a Service aka HW as a Service (AWS - EC2/S3, BlueLock) SaaS PaaS platform svc containers host OS app guest OS CPU disk which do I write to?

39 Deep Inside Cloud Computing : Technologies and Models 39 Management Load Balancing High Availability Fail-Over Quality-Of-Service Virtualization Platform Network Technology Cloud Computing Service Delivery Model Software as-a-service Platform-as-a-Service Infrastructure-as-a-Service Model Distributed System Database File Computing Billing & Provisioning Model Utility Computing What s the next?

40 Core Technology 40 Distributed Data Storing Technology Distributed file system Distributed data management Distributed Computing Technology Message passing : MPI, PVM Distributed shared memory model Data Parallel Model Cluster Management Technology HA Cluster, Load-Balancing Cluster, Computing Cluster, Service Provisioning, Job Scheduling

41 Distributed File System 41 Distributed file management in the network Open software: Hadoop, GFS(Redhat), CODA, Andrew No open SW: GFS(Google) Configuration Mater Server- Manage Metadata Information Slave Server- Store actual data <Hadoop DFS IO performance measurement> 10 Hadoop configured PC vs 1 NAS 5 MB Wriring. No of concurrent users (horizontal axis), response time, ms (Vertical axis) Good for massive data processing and concurrent processing

42 Hadoop Project 42 Distributed file system + parallel computing framework Joint project for Google and IBM: Hadoop platform + Tivoli (IBM) <Distributed file system>

43 DFS I/O Operation 43

44 Distributed Data Management 44 Distributed system (parallel processing) BigTable(google), Apaches Hbase and HyperTable Distributed file system, MapReduce Source: MS

45 Distributed Computing Technology 45 Message passing : MPI, PVM Distributed shared memory model: TupleSpace, JavaSpace, OpenMP, Linda Data Parallel Model : MapReduce Efficient mecfhanism Hadoop

46 MapReduce parallel processing 46 Programming model for parallel processing in Data handling Single block (64KB) for Map Task <MapReduce 구성도 > Source: Apache Hadoop Web site Example of MapReduce

47 Cluster Management Technology 47 High Available Cluster Load-Balancing Cluster Job Scheduling Service Provisioning

48 Service Provisioning 48 Source: MS

49 Background for Cloud Computing Cloud Service and Resource Management Model 49 Source: IBM Corporate Strategy analysis of MI, PR, AR and VCG compilations

50 컴퓨팅자원관리이슈 50 Changes of Resource Characteristics 50

51 클라우드컴퓨팅자원관리이슈 51 Cloud Resource Management Model User/Broker SLA Resource Allocator Virtual Machine Physical Machine

52 52 Different Types Of Cloud Computing 3 Main Types or Personalities Application/Information Sometimes referred to as Software-as-a-Service, a wide ranging services delivered via varied business models normally available as public offering. Development Sometimes referred to as Platform-as-a-Service, application development platforms enable application authoring and runtime environment. Infrastructure Sometimes referred to as elastic compute clouds or Infrastructure-as-a- Service, virtual hardware made available for varied uses. 2 Main Deployment Environments Public Accessible over the internet for general consumption Private Behind corporate firewall for use by limited, predetermined audience

53 Trends of Cloud Computing 53 Infrastructure Development Application Cloud Local Cloud Local Cloud Local Software-as-a-Service Oracle, SAP, Exchange, Managed Application Hosting C, C++ J2EE,.Net Hosting Colocation On-Premise Datacenter Traditional New Model Mashups, Web 2.0 Web services, loosely coupled apps Platform-as-a-Service Virtual Appliances Python, R-on-R, Hadoop Elastic Comput e Clouds Grid, utility computing Marketplace ISVs End Customers Service Providers

54 54 The Cloud as Architecture Datacenter/ Cloud Cloud OS Virtualization is the key to making all of this happen in an evolutionary way Existing Apps New Apps Existing and multiple future app models Management Policies Software Hardware SLA management model Security, Compliance Scale and availability through software Industry Standard building blocks

55 55 Case Study I. Autonomic Resource Management in Virtualized Data Center [4] [4] J. Xu, M. Zhao, J. Fortes, R. Carpenter, M. Yousif, Autonomic Resource Management in Virtualized Data Centers in press, Cluster Computing: The Journal of Networks, Software Tools and Applications, July

56 Traditional Data Centers 56 Static Resource Allocation Setup and Maintenance are very costly Pay-as-you-go model is more attractive 56

57 57 Overview Goal Automatic, SLA-compliant, cost-effective Resource Allocation Challenges Dynamically changing application workload and workload mixes On-demand resource allocation Solution Virtual resource containers Flexible resource allocation for application-specific execution environment Two-level resource control SLA-driven optimization at both application level and data center level Fuzzy-logic-based application-level controllers 57

58 58 Virtualized Data Center Virtual Container VMWare[5] or Xen[6] Application-tailored execution environment Isolation, Security, Customization Fine-grained Dynamic Resource Allocation [5] VMware : Virtualization via Hypervisor, Virtual Machine & Server Consolidation [6] Home of the Xen hypervisor, the powerful open source industry standard for 58

59 59 Two-level Control Local Controller Employed at each virtual container Determines resource needed by the application Makes resource request to data center Global Controller Serves resource requests from local controllers Allocates resources among virtual containers 59

60 60 Local Controller Fuzzy Modeling based local controller Fuzzy Modeling characterize the relation between workload and resource consumption Fuzzy Inference system estimates resource demands using fuzzy models 60

61 61 Resource Demand Estimation Fuzzy Inference System (FIS) Knowledge base stores fuzzy sets and rules Fuzzification compute membership degrees Fuzzy Inference evaluates fuzzy rules Defuzzification calculates weighted average of outputs 61

62 62 Experiments Result Workload 8 hours of trace from 98 World Cup web site Replayed at 12x Speedup 62

63 63 Cloud Vendors for Commercial Application Services

64 64 IBM Cloud Computing Solution.

65 65 Cloud Computing Architecture Apache Virtual Machine Virtual Machine Virtual Machine Virtual Machine Tivoli Monitoring Agent Open Source Linux with Xen IBM Monitoring v.6 Monitoring DB2 Data Center System x Provisioning Manager v.5.1 Provisioning Management Stack Provisioning Baremetal & Xen VM WebSphere Application Server Virtualized Infrastructure based on Open Source Linux & Xen Cloud computing infrastructure to support the academic initiative can be delivered either as hosted or onsite solution. 65

66 Amazon EC2 66 Virtual Compute Cloud Pay-as-you-go model computing service Cost: $0.10 per hour EC2 Instance Xen-based Virtual Machine 1.7 GHz x86, 1.7 GB RAM, 160 GB Disk, 250 MB/s Network AWS Interface (SOAP, REST) Amazon Machine Image (AMI) Pre-defined or user-built machine image (including OS) Start/stop programmatically, Rootlevel access Simple APIs SOAP & HTTP Query Manage and control Instance & AMI EC2 Manger EC2 Instance EC2 Instance Xen Hypervisor EC2 Host S3 Manger EC2 Instance Pool EC2 Instance EC2 Instance Xen Hypervisor EC2 Host Amazon S3 AMI

67 67 Google App Engine Cloud Platform Service Free access over Google Infra 500MB Storage, 10 GB Bandwidth In&Out/day, 5 million PV/1 month Python web development environment Performance guarantee, trouble shooting, Scalable Arch Google App Engine Scalable Service Infrastructure Python runtime and Various Service API Software Development Kit Web-based Admin Console Scalable Datastore (GFS, Bigtable, Memcached etc )

68 68 Google App Engine Platform Web-based Admin Console App App App App Service APIs User Image Mail URL Fetch Status Info Datastore Memcache Python Runtime: Service Environment App Engine SDK Web Server Management Uploader API local version Python Framework webapp, Django Upload Memcache: Gloval Cache Bigtable: Distributed System GFS: Distributed File System Develop & Test Commodity Server Cluster

69 69 Sun's Open Source Strategy Building Open and Free Communities Java & MySQL Community Solaris Infrastructure SPARC Building a Vibrant Ecosystem: Sun is the Largest Commercial Contributor to Open Source Communities Ecosystem java.net The Source for Java Technology Collaboration

70 70 A hosted software platform for building, deploying, running, and managing your applications

71 71 Small Business to Enterprise Consumer & SOHO SMB to Enterprise To The APPLICATIONS & SOLUTIONS Database and Beyond! BUILDING BLOCK SERVICES Server OS IDENTITY AND ACCESS DATA SERVICES COMMUNICATIONS BUSINESS LOGIC Azure Services Platform SEARCH CORE SERVICES SERVICE DELIVERY GLOBAL FOUNDATION DATA CENTERS COMPUTERS NETWORKS

72 HP Private Cloud Architecture Infrastructure as a Service: Instantly Create Project and Test Environments End Users Request New Resources Interfaces Adaptive Computing Portal Access Portal 72 Cluster Service Manager Dashboard + HP Admin Tools Manager Monitor, Diagnose, Manage Review Service Levels, Capacity Planning,etc. Information Monitoring Allocation Management Update Allocation, Usage, Charges Intelligent Orchestration Report Current State & Provision Resources Adaptation Tools Provisioning Manager HP BSA Maintain Usage Credits & Charges Monitor / Configure HP OVO, Supermon Monitor / Configure HP SIM Monitor / Configure HP Site Scope, etc. Workload & Capacity Management Adaptive Env. Orchestration Schedule Service Levels Provisioning, Updates, etc. Applications. Middleware Web Tools, DB,. Operating System SLES, RHEL, Windows Storage Storage Compute Resources Source: HP Korea