Part 1. At a Glance: Scalable IT Infrastructure

Transcription

1 Objectives Understand the Architecture of scalable IT infrastructure Understand the concepts, architecture and projects of OpenStack Familiar with the basic operation of OpenStack 1

2 Part 1 At a Glance: Scalable IT Infrastructure

3 IT Infrastructure for Online Services 3rd Party APP/Bigdata WAN/Internet Database Domain Name Service Access/CDN/FW Loadbalancer Web Service Cache Datacenter(s) Storage 3 Datacenter 2

4 Network Acess, WAN, Datacenter Underlay network(physical) Overlay network(sdn part) 4

5 Physical network (Underlay) in a datacenter Troug ut: bandwidth; time delay Availability: fail over; convergence Security: firewall; VPN; VLAN Spine L3 L2 GW IP: GW MAC: 0011:2222:3333 GW IP: GW MAC: 0011:2222:

6 Overlay Network Tenant Network VXLAN,Virtual Router, Service Chain Orchestration 6 VTS provisions VTEP, VLAN for each VTEP and EVPN on ToR/VTF 9 VTS provisions L3 VXLAN (distributed L2/L3), Anycast gateway with EVPN Spine Spine 1 Create Tenant Networks 2 Tenent and Tenant Networks Created NX-API, CLI, YANG REST API Controller 3 VNID assigned for each network VXLAN VXLAN 4 Attach VM to Network OpenStack Tenant View 5 VM Host info captured by VTS and mapped to the right ToR & ToR port using topology database ToR VLAN VTEP ToR VLAN VTEP VLAN ToR VTEP 8 Create router and attach interfaces to tenant networks 7 Neutron agent modified to request VLAN information from VTS before programming vswitch VM Hypervisor x86 Server Hypervisor VM VM x86 Server Hypervisor VM x86 Server VLAN 6

7 Storage Models Object storage Storage types Distributed storage Block File Object Database Cinder; Ceph; Sheepdog HDFS; GlusterFS Swift;Dynamo; Ceph Bigtable; Hbase; O/M 7

8 Distributed object storage Web API, Restful No directory, flat stucture Distributed, high available, scalable, cost effective, multi-site 8

9 Computing Multi-hypervisor Virtualization Scale up vs. Scale out High availability 9

10 Part 2 Openstack Introduction

11 What is Openstack Open source software for building private and public clouds Virtual machine resource Storage resource Network resource Object and image store Multi-tenant: Tenant&user manage Quota Resource isolate 11

12 Openstack Sponsors 500+ Sponsors Contributors: From 175 Countries 12

13 13 Kilo Nova Glance Swift Horizon Keystone Neutron Cinder Heat Ceilomet er Trove Sahara Ironic Zaqar Manila Designate Barbican Nova Glance Swift Austin Bexar Cactus Diablo Nova Glance Swift Horizon Keystone Essex Nova Glance Swift Horizon Keystone Quantum Cinder Folsom Nova Glance Swift Horizon Keystone Quantum Cinder Grizzl y Nova Glance Swift Horizon Keystone Neutron Cinder Heat Ceilomet er Havana Nova Glance Swift Horizon Keystone Neutron Cinder Heat Ceilomet er Trove Icehouse Nova Glance Swift Horizon Keystone Neutron Cinder Heat Ceilomet er Trove Sahara Juno 计算服务镜像服务对象存储用户界面认证服务网络服务块存储工作流计量服务数据库服务大数据物理机管理消息服务文件共享 DNS 服务密钥服务 Openstack Releases and Projects Nova Glance Swift Horizon Keystone Neutron Cinder Heat Ceilomet er Trove Sahara Ironic Zaqar Manila Designate Barbican Libert y Astara Barbican Chef Openstack Cloudkitty App Catalog Congress Cue Designate Dragonflow Ec2-Api Freezer Fuel I18N Infrastructure Kolla Kuryr Magnum Mistral Monasca Murano Openstack Client Openstack Ux Openstackansible Oslo Packaging-Deb Packaging-Rpm Puppet Openstack Quality Assurance Rally Refstack Release Manage Searchlight Security Senlin Solum Tacker Tripleo Winstackers Zaqar

14 API Centric Commercial Cloud Platform Functions provided by API Functions provided by user interface Openstack Functions provided by user interface Functions provided by API Operators oriented User experience Manual operation API(object) oriented Distributed, scale Automate operation by machines 14

15 Openstack Core projects Portal Auth Storage Compute Storage Storage block storage Image storage Object storage Network Monitor/meter Orchestration 15

16 OpenStack Conceptual Architecture 16

17 Basic OpenStack Physical Components This sample three-node configuration shows the basic components of an OpenStack installation Cloud Controller node Network node One or more Compute nodes NOTICE: All of the basic components can exist on the same device or horizontally distributed, with with multiple network, compute, and controller nodes. 17

18 Keystone in OpenStack Conceptual Architecture 18

19 Tenant, User & Role User: God User:Alice User: Eve User: Bob Role: admin Role: member Role: netadmin Role: netadmin Role: member VM Network Network VM Tenant: Development Tenant: Testing 19

20 Keystone Backends SQL LDAP KVS Memcach Redis File Memory Noop Identity Token Cache Catalog Policy NOTICE: The backend for each function is defined in the keystone.conf file. TIP: IDM can be integrated with keystone 20

21 Glance - Image Service

22 Glance in OpenStack Conceptual Architecture 22

23 Glance Architecture File system Swift glance-api S3 glance-registry glance database store adaptor HTTP RBD GridFS Sheepdog Cinder 23 Vmware datastore

24 Glance supported Image disk format qcow2 ari raw ami ec2 import/export vmdk qemu-img convert iso aki vhd vdi 24

25 Nova - Compute Service

26 Nova in OpenStack Conceptual Architecture 26

27 VM Provisioning Before instance is created After instance is created Nova Controller Nova Compute (with available vcpm, memory, and local disk resources) Nova Controller Nova Compute (with available vcpm, memory, and local disk resources) Glance (with predefined images) Cinder (with predefined volumes) Glance (with predefined images) Instance vda vdb vdc Cinder (with predefined volumes) Image 1 1 n Image 1 1 n Image n Image n 27

28 Nova Supported Hypervisors nova-compute docker hyperv vmwareapi xenapi libvirt Compute drivers Docker Hyper-V ESXi XenServer XCP KVM QEMU Xen LXC VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM 28

29 Horizon - Dashboard Service

30 Horizon in OpenStack Conceptual Architecture 30

31 Horizon The Face of OpenStack Web-based graphical user interface to OpenStack services (e.g. Nova, Swift, Keystone, Glance, etc.) Stateless, can be scaled horizontally Supports a subset of OpenStack API, not all 31

32 Neutron - Networking Service

33 Neutron in OpenStack Conceptual Architecture 33

34 Neutron Overview Network as a Service Allow tenants to control their own private networks Isolated Rich topologies Choose their own IP addressing scheme, even if those IP addresses overlap with those used by other tenants Open APIs for operating logical networks Technology agnostic. Separate logical operations and backend provisions Backend technologies are provisioned/configured by plugins/drivers Modular design API specifies service, vendor provides its implementation Extensions for vendor-specific features Advance services support Load balancing, VPN, Firewall Support emerging network technology SDN/OpenFlow-based network Overlay tunneling (VXLAN, NVGRE, STT, ) 34

35 Neutron Deployment Use Cases Per-tenant Routers with Private Networks Tenant-A VM Tenant-A VM Tenant-A VM Tenant-A VM Tenant-C VM Tenant-C VM Tenant-A Private Net /24 Tenant-A Private Net /24 Tenant-C Private Net / Tenant-A Router Tenant-C Router External Net / Physical Router 35

36 Advanced Services Load balance HAProxy Embrane Netscaler Radware VPN IPsec Cisco IPsec Cisco CSR Firewall Iptables Varmour 36

37 Cinder - Block Storage Service

38 Cinder in OpenStack Conceptual Architecture 38

39 OpenStack Storage Overview Comparison of standard boot storage, block storage, and object storage technologies in OpenStack 39 On-instance / ephemeral Volumes block storage (Cinder) Object Storage (Swift) OS and scratch space Persistent storage volume for VM VM images and data Persists until VM is terminated Persists until deleted Persists until deleted Access associated with VM Access associated with VM Available from anywhere Implemented as filesystem Size settings based on flavors Example: 10GB first disk, 30GB/core second disk Mounted via Cinder controlled protocol (iscsi, FC, etc.) Sizing based on need Example: 1TB extra hard drive REST API Easily scalable for future growth Example: 10s of TBs of dataset storage

40 Cinder Overview Provides volumes to VMs provisioned by OpenStack Uses RESTful APIs to communicate with other OpenStack components Storage can SSD or HD and reside in the compute node or a dedicated storage device Uses iscsi or FC to communicate between VM and dedicated storage device Supports NFS and CIFS file systems Volumes cannot be shared by servers Can be backed up to Swift NOTE: By default, primary OS volume doesn t come from Cinder, but rather from ephemeral storage, however, you can create a Cinder boot volume 40

41 Cinder Components cinder database cinder-api cinderscheduler queue cinder-backup cinder-volume Storage provider 41

42 Snapshots A snapshot in cinder is a read-only point in time copy of a volume The snapshot can be created from a volume that is currently in use or in an available state The snapshot can be used to create a new volume via create from snapshot. volume snapshot new volume 42

43 Swift - Object Storage Service

44 Swift in OpenStack Conceptual Architecture 44

45 Object Storage Swift is an OpenStack service that allows you to store and retrieve data objects Object Swift File, folder, image, archive, etc. 45

46 Swift Overview Software to reliably store billions of objects distributed across standard hardware Object storage Support multi-tenancy It s not a file system Access with RESTful API Augments SAN/NAS/DAS Runs on commodity hardware Hardware agnostic (no need for RAID) Fully distributed evenly throughout the system No central database Provides data redundancy Eventually consistent Auditors to check staleness of data Optimized for scaling to zettabytes 46

47 User View: Accounts, Containers, Objects User accesses an account Account owns containers Containers contain objects Containers User Swift Account Each object is identified by its account/container/object tuple Objects 47

48 Partitions Unit of Swift storage in which objects are placed Swift are divided into a power of 2 number of partitions Partitions are sections of address space, not disk space Directory on a disk with a hash table that describes the contents of a partition Storage Node Disks Partitions 48

49 Zones Zones are user defined single points of failure within the storage cluster Partitions can be replicated across zones 3 partitions at least for high availability, 5 partitions is recommended Lowest latency placement algorithm used Zone 1 Zone 2 Zone 3 Zone 4 Zone 5 partitions partitions partitions partitions partitions partitions partitions partitions partitions partitions storage storage storage storage storage 49

50 Ceilometer - Metering Service

51 Ceilometer in OpenStack Conceptual Architecture 51

52 Ceilometer Overview Provide efficient collection of metering data, in terms of CPU and network costs. Allow deployers to integrate with the metering system directly or by replacing components. Data may be collected by monitoring notifications sent from existing services or by polling the infrastructure. Allow deployers to configure the type of data collected to meet their operating requirements. The data collected by the metering system is made visible to some users through a REST API. 52

53 Heat - Orchestration Service

54 Heat in OpenStack Conceptual Architecture 54

55 Heat Overview Orchestration service that executes OpenStack API calls to generate running cloud applications AWS CloudFormation implementation for OpenStack API Uses template mechanism HOT TOSCA Allow creation of resource types Instances, networks, floating IPs, volumes, security groups, users, etc. Some advanced services HA, auto-scaling Integrated well with Puppet and Chef 55

56 Part 3 Learn Openstack and get Certificated

57 COA: Certified OpenStack Administrator Openstack Foundation Certified Openstack Administrator With Hands-on Installation, Operation, Troubleshooting 3 Days Class 150 Min exam 58

58 Thank you