Overview Demo Claudia OpenNebula

Transcription

1 1 Overview Demo Claudia OpenNebula

2 RESERVOIR Reference Architecture 2

3 Virtual Execution Environment Manager Service Manager VMI Client Policy Engine Remote VEEMs OpenNebula Monitoring VEE Hosts 3

4 VEEH Dynamic binding of VEE s to VEEH Responsible for VEE provisioning as opposed to the management Provides abstraction to the virtualization technology adding to the virtualisation platform the necessary functions 4

5 VEEH Perform the elementary control and monitoring of VEEs and their resources placement of VEEs creating a VEE, allocating additional resources to a VEE, monitoring a VEE, migrating a VEE, creating a virtual network and storage pool, etc. 5

6 6 Credits: Borja Sotomayor University of Chicago

7 7

8 8

9 9

10 10

11 11

12 12

13 13

14 14

15 15

16 16

17 OpenNebula Management Console 17

18 OpenNebula Management Console Setup: 18

19 Platform ISF VMware Vsphere Eucalyptus Nimbus OpenNebula Virtualization Management Virtual Network Management Image Management Service Contextualization VMware, Xen VMware Xen, KVM Xen Xen, KVM, VMware Yes Yes No Yes Yes Yes Yes Yes Yes Yes No No No Yes Yes Scheduling Yes Yes No No Yes Administration Interface Hybrid Cloud Computing Yes Yes No No Yes No No No No Yes Cloud Interfaces No vcloud EC2 WSRF, EC2 EC2 Query Flexibility and Extensibility Yes No Yes Yes Yes Open Source No No GPL Apache Apache 19

20 Opennebula, basic installation Architecture Overview Front-end: executes the OpenNebula service Nodes: hosts providing resources needed by VMS. Image repository: any storage medium holding images of the VMs. OpenNebula daemon (oned): core service of the system. Drivers: used by the core to interface with subsystems (oneadmin: administration user) 20

21 Opennebula, basic installation Images storage Shared FS: Non shared FS configuration possible (but only allows cold migrations) Accounts: oneadmin created and able to perform ssh commands. Virtualisation tools: to be installed on nodes Xen KVM VMWare 21

22 Opennebula commands (1/2) OpenNebula provides four commands: onevm to submit, control and monitor VMs onehost to add, delete and monitor hosts onevnet to add, delete and monitor virtual networks oneuser to add, delete and monitor users Common parameters: -l, list x,y,z: Selects columns to display with list command. -f, filter x,y,z: Filter data. An array is specified with column=value pairs. -d, delay seconds: Sets the delay in seconds for top command. -h, help: Shows help information. -v, verbose: Tells more information if the command is successful 22

23 Opennebula commands (2/2) Examples: Submit a new virtual machine, adding it to the ONE VM pool onevm create <template> Starts a previously submitted VM on a specific host onevm deploy <vm_id> <host_id> Shutdown an already deployed VM onevm shutdown <vm_id> Saves a running VM and starts it again in the specified host onevm migrate <vm_id> <host_id> Saves a running VM: onevm suspend <vm_id> Resume execution of a saved VM: onevm resume <vm_id> Stop a running VM: onevm stop <vm_id> Delete a VM from the pool: onevm delete <vm_id> 23

24 Opennebula, before installation Impact of Linux distribution Installation of OpenNebula is eased under Ubuntu (packages available in repositories, documentation, ) but Is it the distribution of your scientific cluster? Is your enterprise contracting support for it? Deployment on Red Hat related/compatible distros must be considered Use of CentOS in examples too 24

25 Ubuntu basic installation Ubuntu (Lucid Lynx) version (1/3) Deploying application Opennebula already in repositories Deployment of front end node sudo apt-get install opennebula Deployment of compute node (to be replicated X times!) sudo apt-get install opennebula-node User oneadmin created, setting password and keys (for ssh and scp) sudo scp /var/lib/one/.ssh/id_rsa.pub oneadmin@mynode01:/var/lib/one/.ssh/authorized_keys sudo scp /var/lib/one/.ssh/id_rsa.pub oneadmin@mynodexx:/var/lib/one/.ssh/authorized_keys sudo sh -c "cat /var/lib/one/.ssh/id_rsa.pub >> /var/lib/one/.ssh/authorized_keys" sudo sh -c "ssh-keygen -f.ssh/known_hosts -F mynode01 1>> /etc/ssh/ssh_known_hosts" sudo sh -c "ssh-keygen -f.ssh/known_hosts -F mynodexx 1>> /etc/ssh/ssh_known_hosts" 25

26 Ubuntu basic installation Ubuntu (Lucid Lynx) version (2/3) Configuration (1/2) Preparing space for VMs sudo mkdir /var/lib/one/images sudo chown oneadmin /var/lib/one/images/ Adding VMs to Opennebula onehost create node01 im_kvm vmm_kvm tm_ssh onehost create node02 im_kvm vmm_kvm tm_ssh Network configuration (basic): «vnet01.template» file: NAME = "LAN" TYPE = RANGED BRIDGE = br0 NETWORK_SIZE = C NETWORK_ADDRESS = Applying network configuration onevnet create vnet01.template 26

27 Ubuntu basic installation Ubuntu (Lucid Lynx) version (3/3) Configuration (2/2) Preparing VM template «vm01.template» file: NAME = vm01 CPU = 0.5 MEMORY = 512 OS = [ BOOT = hd ] DISK = [ source = "/var/lib/one/images/vm01.qcow2", target = "hda", readonly = "no" ] NIC = [ NETWORK="LAN" ] GRAPHICS = [type="vnc",listen=" ",port="-1"] Applying VM configuration onevm submit vm01.template Check details about VMs: onevm list onevm show vm01 27

28 Ubuntu basic installation Ubuntu versions prior to Setting up repositories deb intrepid main Ubuntu 8.10 (intrepid) configuration. Use same value for 9.04 (jaunty). Also available for 8.04 LTS with «hardy» value Deploying application Follow steps described for Checking result onevm list ID NAME STAT CPU MEM HOSTNAME TIME 0 one-0 runn testh :00:02

29 CentOS basic installation CentOS5, front node Plain vanilla CentOS installation OpenNebula requires several applications / libraries Manual installation ruby >= (install through yum) sqlite3 >= sqlite3-dev >= sqlite3-ruby libxmlrpc-c >= 1.06 scons >= 0.97 g++ >= 4 (install through yum) Adding repositories and installing packages Add «Extra Packages for Enterprise Linux» (EPEL) repository ( Packages to install: ruby ruby-devel gcc gcc-c++ make openssl-devel scons flex bison Add Karan repository Packages to install: xmlrpc-c Still manually install sqlite Optional: setup dynamic DNS Setup VM images repository (as in Ubuntu installation) Install mkisofs (for contextualisation) 29

30 Opennebula, Public Cloud OCCI Interface RESTful API (HTTP) Allow to specify requirements on Storage Network Compute resources Authentication In each message (user/password parameters) Based on server location 30

31 OCCI short example Storage Network <DISK> <NAME>UbuntuImage</NAME> <URL>file: //images/ubuntu.img</url> </DISK> <NETWORK> <NAME>MyServiceNetwork</NAME> <ADDRESS> </ADDRESS> <SIZE>200</SIZE> </NETWORK> Compute resource <COMPUTE> <NAME>MyCompute</NAME> <STORAGE> <SWAP size= 1024 dev= sda2 /> <DISK image= abcd8888-5ade-012c-f1d bd6f386 dev= sda1 /> <FS size= 512 format= ext3 dev= sda3 /> </STORAGE> <NETWORK> <NIC network= 23 ip= /> </NETWORK> <INSTANCE TYPE>small</INSTANCE TYPE> </COMPUTE> Request executed through occi-compute command 31

32 Opennebula, Hybrid Cloud configuration Adaptors (MAD) configuration in oned.conf file for EC2 IM_MAD = [ name = "im_ec2", executable = "one_im_ec2", arguments = "im_ec2/im_ec2.conf", default = "im_ec2/im_ec2.conf" ] VM_MAD = [ name = "vmm_ec2", executable = "one_vmm_ec2", arguments = "<ec2_options> vmm_ec2/vmm_ec2.conf", type = "xml" ] <ec2_options>: flags used to setup EC2 environment (home, cert., etc.) Authentication information must also be set (see ec2rc file in mad folder) Maximum capacity is set in im_ec2.conf file 32

33 OpenNebula Architecture summary 33

34 OpenNebula, summary Internal Interfaces for Administrators and Users - Unix-like CLI and XML-RPC API to manage VM life-cycle and physical boxes; and libvirt virtualization API Scheduler - Requirement/rank matchmaker allowing the definition of workload and resource-aware allocation policies; and support for advance reservation of capacity Virtualization Management Xen, KVM and VMware connectors; and generic libvirt connector to other VM managers. Virtual Box (planned) Image Management - General mechanisms to transfer and clone VM images Network Management - Definition of isolated virtual networks to interconnect VMs Service Management and Contextualization - Support for multi-tier services consisting of groups of interconnected VMs, and their auto-configuration at boot time Security - Management of users by the infrastructure administrator Fault Tolerance - Persistent database backend to store host and VM information Scalability - Tested in the management of medium scale infrastructures Installation - on a UNIX cluster front-end, include in Linux distros. Flexibility and Extensibility - Open, flexible and extensible architecture, interfaces and components, allowing its integration with other products or tools 34