Xen and CloudStack. Ewan Mellor. Director, Engineering, Open-source Cloud Platforms Citrix Systems

Size: px

Start display at page:

Download "Xen and CloudStack. Ewan Mellor. Director, Engineering, Open-source Cloud Platforms Citrix Systems"

Ariel Cooper
5 years ago
Views:

1 Xen and CloudStack Ewan Mellor Director, Engineering, Open-source Cloud Platforms Citrix Systems

2 Agenda What is CloudStack? Move to the Apache Foundation CloudStack architecture on Xen The future for CloudStack Developing on CloudStack

3 CloudStack is Infrastructure-as-a-Service software For people to build Amazon-style clouds either as a public service, or as a private cloud within your own organization.

Local Disk iscsi NFS Channel Swift Network Network &

4 CloudStack is Compute Hypervisor XenServer Oracle VM vsphere KVM Bare metal Storage Block & Object Fiber Local Disk iscsi NFS Channel Swift Network Network & Network Services Network Type Isolation Firewall Load balancer VPN

6 CloudStack versus OpenStack CloudStack Apache Foundation (incubating) 2008-present Java Fairly centralized Complete solution OpenStack OpenStack Foundation (founding in progress) 2010-present Python Aggressively distributed More of a framework

7 Apache incubation Citrix donated the CloudStack code to the Apache Software Foundation and Apache Incubator The project now needs to prove that it can operate openly and independent of Citrix If it can do that, it can be accepted as a top-level Apache project.

8 CloudStack and Xen Most CloudStack users choose Xen or XenServer Xen VMware KVM It is the combination that works the best!

9 CloudStack is A cluster of management servers An orchestration engine State and user management Region, zone, pod, cluster model A large collection of effectors System VMs Usage reporting User interface

10 Users Management cluster Access layer switches Router Load balancer L3 core switch Servers Secondary Storage Pod 1 Pod 2 Pod 3 Pod N

11 Two types of storage Primary storage Stores virtual disks Configured at cluster level Close to hosts for better performance Requires high IOPS Pod 1 Cluster 1 L2 switch L3 switch Secondary storage Secondary storage Stores templates, ISOs and snapshots Configured at zone level Zone can have one or more High capacity, low cost Host 1 Host 2 Primary storage

12 Users Management cluster Access layer switches Router Load balancer L3 core switch Servers Secondary Storage Pod 1 Pod 2 Pod 3 Pod N

13 Networking features Choice of network isolation Physical, VLAN, L3 (anti-spoof), overlay (GRE) Multiple networks Shared networks, project networks IPAM / DHCP Gateway (inc VRRP) VPN, stateful firewall, NAT, port forwarding Traffic monitoring Load balancing User-data / password-change services

Virtual network topologies CS Virtual Router provides network services External devices provide network services Public network Guest network Public network Guest network CS Virtual Router DHCP, DNS,

14 Virtual network topologies CS Virtual Router provides network services External devices provide network services Public network Guest network Public network Guest network CS Virtual Router DHCP, DNS, NAT, LB, VPN Guest VM 1 Guest VM 2 Guest VM 3 SRX firewall NetScaler LB Guest VM 1 Guest VM 2 Guest VM Guest VM Guest VM 4 DHCP, DNS CS Virtual Router

15 Multi-tier virtual network topology Public network Guest network Guest network Guest network SRX firewall Web VM 1 Web VM App VM App VM Netscaler LB Web VM DB VM Web VM DHCP, DNS, user-data CS Virtual Router DHCP, DNS, user-data CS Virtual Router DHCP, DNS user-data, NAT, VPN CS Virtual Router Public network

16 Users Management cluster Access layer switches Router Load balancer L3 core switch Servers Secondary Storage Pod 1 Pod 2 Pod 3 Pod N

17 Users Management cluster Access layer switches Router Load balancer L3 core switch Servers Secondary Storage Pod 1 Pod 2 Pod 3 Pod N System VMs Customer VMs

18 Driver domains Control domain (dom0) Guest VM n Apps Driver Domain e.g. Disk Network PV Back Ends PV Front Ends PV Back End HW Drivers HW Driver Guest OS Kernel Xen Hypervisor I/O Memory CPUs Host HW 18

19 The road ahead

20 The future for CloudStack Disentangle some core components Make it easier for people to work on subsystems Make it easier to scale the API layers

21 S3 API system VM S3 API S3 API VM NFS, CIFS, HDFS, 3 rd - party object store API, S3 API VM Object store (e.g., NetApp, Hadoop, ) S3 API VM

22 The future for CloudStack Absorb new changes from Xen and XS Storage migration The Windsor architecture I/O subsystem changes

23 The future for CloudStack New object storage systems Caringo CAStor HDFS Riak CS New block storage systems GlusterFS? Ceph? Open vswitch / OpenFlow / VXLAN

24 DevCloud

25 DevCloud What is inside? VirtualBox VM Xen Cloud Platform Ubuntu dom0 (aka Kronos) JVM, Tomcat, developer tools NFS server MySQL Working, pre-configured CloudStack System VMs Tiny Linux template

27 Why? Eliminates need for another machine / hypervisor Primary and secondary storage Networking, VLAN, etc Install and configuration of environment Disposable changes Revert to snapshot

28 Run Start the DevCloud VM from VirtualBox UI Access the CloudStack UI Access the dom0 ssh p 2222 From the UI, enable the zone System VMs will start up

31 CloudStack architecture

32 Management Server Cluster User API Admin API Load Balancer Management Server Management Server MySQL Replication Replica MS is stateless. MS can be deployed as physical server or VM Single MS node can manage up to 10K hosts. Multiple nodes can be deployed for scale or redundancy Infrastructure Resources

Components Hosts Servers onto which services will be provisioned Primary Storage

Collection of clusters in the same failure boundary Network Logical network

storage Zone Collection of pods, network offerings and secondary storage Network

33 Components Hosts Servers onto which services will be provisioned Primary Storage VM disk storage Cluster A grouping of hosts and their associated storage Pod Collection of clusters in the same failure boundary Network Logical network associated with service offerings Secondary Storage Template, snapshot and ISO storage Zone Collection of pods, network offerings and secondary storage Network Seconda ry Storage CloudStack Pod Zone Host Host Primar y Storag e Cluster Cluster VM VM CloudStack Pod

Deployment Architecture Management Server Cluster Internet Hypervisor is the

Zone 1 L3 Cluster consists of one ore more hosts of same hypervisor Pod 1 L2

. Pod N Secondar y Storage All hosts in cluster have access to shared

34 Deployment Architecture Management Server Cluster Internet Hypervisor is the basic unit of scale. Zone 1 L3 Cluster consists of one ore more hosts of same hypervisor Pod 1 L2 Cluster N.. Pod N Secondar y Storage All hosts in cluster have access to shared (primary) storage Pod is one or more clusters, usually with L2 switches. Cluster 1 Host 1 Host 2 Primary Storage Availability Zone has one or more pods, has access to secondary storage. One or more zones

35 DevCloud step-by-step

36 Overview Install Virtual Box Download DevCloud virtual machine Install DevCloud VM Run the VM Login to the CloudStack GUI Start a CloudStack VM.

37 Virtual Box Download / install from Oracle Ensure that VT-d and virtualization extensions are enabled in your laptop CPU Recommend at least 2 GB for DevCloud VM

38 DevCloud VM Download from oud/devcloud.ova Latest install instructions here: ud Import DevCloud into VirtualBox Change memory allocation to 2 GB Snapshot for known good state

Getting to Know Apache CloudStack

Getting to Know Apache CloudStack Joe Brockmeier PPMC Member Apache CloudStack jzb@apache.org Five Six Characteristics of Clouds On-Demand Self-Service Broad Network Access Resource Pooling Rapid Elasticity