Building Service Platforms using OpenStack and CEPH. Malte Dreyer

Transcription

1 Building Service Platforms using OpenStack and CEPH Malte Dreyer

2 Humboldt-Universität zu Berlin Founded in 1810 Faculties: 9 Students: (5 000 International) Degree Programs: 185 Professorships: 419(483) Academic Staff: Non-Academic: Campuses, ~180 Buildings

3 Computer and Media Service Broad Range of Services ADS AFS Accounts Anti Virus Software Audio / Video Equipment Backup-Service Calendar Service Campus Management SW Chat Service Compute Clusters Computer Networks Computer Training Rooms Database Service Managed Desktops File Exchange File Service Graphics Service Hardware Service Identity Management Image Editing Mail Service Mailing Lists Map Service Media Repository Moodle Printing Service Public Computers Publication Repository Resource Management SW Scanning Service Shibboleth Software Service Statistics SW Service Storage Area Network Survey Service Terminalserver Service Repositories Training Trouble Ticket Systems User Certificates User Support VPN Video Conferences Video Service WLAN Web Content Management Web Files Web Hosting Website Management Wiki and Blog Farms Windows Domains epublishing

4 Projects in Close Cooperation with Scholars Customizations and feature developments Media Repository Farm Joint projects and software developments Laudatio Corpus Repository

5 "Products of research are not just publications. NSF senior policy specialist Beth Strausser. Biographical Sketch(es), has been revised to rename the Publications section to Products and amend terminology and instructions accordingly. 13 January 2013: "National Science Foundation s Merit Review Criteria: Review and Revisions Chapter II.C.2.f(i)(c),

6 1. Recommended open access to scholarly papers of publicly funded research 2. Recommended open access to all digital outputs of publicly funded research 3. Mandated open access to scholarly papers of publicly funded research 4. Mandated open access to all digital outputs of publicly funded research 5. Enforced, mandated open access to scholarly papers of publicly funded research 6. Enforced, mandated open access to all digital outputs of publicly funded research

7 From a Data Center Point of View 80 individual projects 80 setups 80 databases 80 configs Custom software Fedora Repository CakePHP Elastic Search PID-Server (Handle) jquery / Bootstrap Apache Xerces +RedMine for Tickets

8 Cloud as e-infrastructure Supporting Research SaaS Applications Applications and Data PaaS Platform OS & Basic Services Platform OS & Basic Services IaaS Infrastructure Servers Storage- Network Infrastructure Servers Storage- Network Infrastructure Servers Storage- Network

9 XaaS/EaaS: Software-led Infrastructure (Software Defined Data Center) Backup Database Identity Monitoring Network Security Storage. as a Service Media Repository Seafile Repository xyz. as a Service

10 Flexible e-infrastructure keep services alive beyond project lifetime reduce technology stack for project staff easy testing environments concentrate on what you are really interested in

11 We Took a Look At (Being aware that these are different in type) amazon web services Apache Cloudstack Docker / LXC Eucalyptus Microsoft Azure OpenNebula OpenStack VMware And still use Proxmox for VM management for many services

12 and Chose OpenStack still under heavy development

13 Macro Scripting Manage VMs like a Linux Process

14 Pet or Cattle Images: Sheep: Public Domain; Toy Dog: By Toyloverz (Own work) [CC BY-SA 3.0 ( via Wikimedia Commons

15 OpenStack Component Architecture Horizon Heat Ceilometer Dashboard Orchestration Metering Trove Database Mgmt Sahara Hadoop Glance Keystone Cinder Image Mgmt Identity Mgmt Block Storage Nova Compute Neutron Network Swift Object Storage

16 Preise [TEUR] WDM (Licht) Linecards 10 Gbps x20 MLX (Router) Chassis 8x Linecards (26) 10Gbps x Summe

17

18

19 CEPH Server SAN MB/s Aggregated 160 MB/s Number of instances 7 8 Read from disk Read from cache Aggregated read from disk Aggregated read from cache Figure to the left: By Inktank, CC-BY-SA

20 Seafile: Deployment in OpenStack Using Ansible and Heat ANSIBLE Playbook # update packet cache - hosts: all tasks: - apt: - name: apply common configuration to all nodes hosts: all roles: - common - name: deploy and configure memcached server hosts: memcached roles: - memcached - name: deploy MySQL and configure the databases hosts: db roles: - db - name: deploy seafile and apply configuration hosts: nodes roles: - nodes - name: deploy loadbalancer hosts: loadbalancer roles: - loadbalancer tags: - loadbalancer HEAT my_port01: type: OS::Neutron::Port properties: admin_state_up: true name: Port01 network_id: { get_resource: my_first_network } my_server07: type: OS::Nova::Server properties: name: seaf07 key_name: { get_param: keypair_name } flavor: { get_param: machine_flavor } image: { get_param: image_id } networks: [{ "port": { get_resource: my_port07 }, }] user_data: #!/bin/bash -v. cinder_volume07: type: OS::Cinder::Volume properties: size: { get_param: volume_size } volume_attachment07: type: OS::Cinder::VolumeAttachment properties: volume_id: { get_resource: cinder_volume07 } instance_uuid: { get_resource: my_server07 } mountpoint: /dev/vdb

21 Organizational Responsibilities Horizon Dashboard Heat Orchestration Ceilometer Metering Trove Sahara Database Mgmt Hadoop Glance Image Mgmt Keystone Identity Mgmt Cinder Block Storage Nova Compute Neutron Network Swift Object Storage

22 Organizational Responsibilities /1 Horizon Dashboard Heat Orchestration Ceilometer Metering Trove Database Mgmt Sahara Hadoop Glance Image Mgmt Keystone Identity Mgmt Cinder Block Storage Nova Compute Neutron Network Swift Object Storage

23 Organizational Responsibilities /2 Horizon Dashboard Heat Orchestration Ceilometer Metering Trove Database Mgmt Sahara Hadoop Glance Image Mgmt Keystone Identity Mgmt Cinder Block Storage Nova Compute Neutron Network Swift Object Storage

24 Organizational Responsibilities /3 Horizon Dashboard Heat Orchestration Ceilometer Metering Trove Database Mgmt Sahara Hadoop Glance Image Mgmt Keystone Identity Mgmt Cinder Block Storage Nova Compute Neutron Network Swift Object Storage

25 Organizational Responsibilities /4 Horizon Dashboard Heat Orchestration Ceilometer Metering Trove Database Mgmt Sahara Hadoop Glance Image Mgmt Keystone Identity Mgmt Cinder Block Storage Nova Compute Neutron Network Swift Object Storage

26 Organizational Responsibilities /5 Horizon Dashboard Heat Orchestration Ceilometer Metering Trove Database Mgmt Sahara Hadoop Glance Image Mgmt Keystone Identity Mgmt Cinder Block Storage Nova Compute Neutron Network Swift Object Storage

27 Organizational Responsibilities /6 Horizon Dashboard Heat Orchestration Ceilometer Metering Trove Database Mgmt Sahara Hadoop Glance Image Mgmt Keystone Identity Mgmt Cinder Block Storage Nova Compute Neutron Network Swift Object Storage

28 Organizational Responsibilities: New Distributed Competency Horizon Dashboard Heat Orchestration Ceilometer Metering Trove Database Mgmt Sahara Hadoop Glance Keystone Cinder Image Mgmt Identity Mgmt Block Storage Nova Compute Neutron Network Swift Object Storage

29 Organizational Challenges and Conclusions Build new competencies OpenStack is complex and additional technologies are needed An advanced training program Changing system administration styles Develop vs. configure manually step by step Re-Use what others built already (and share again) Read scripts from other people Be patient when OpenStack is still immature, or Neutron fails again So far it develops/improves very fast Dogfooding builds trust

30 .. Thanks..

31 Questions?