VHPC 13 FLEXIBLE STORAGE FOR HPC CLOUDS WITH TECHNICAL LEAD, SYNNEFO

Transcription

1 FLEXIBLE STORAGE FOR HPC CLOUDS WITH ARCHIPELAGO AND CEPH. VANGELIS KOUKIS TECHNICAL LEAD, SYNNEFO 1

2 Outline Archipelao overview Storae resources, clones/snapshots HPC workflow with Archipelao Resource Composition Archipelao Implementation Flexible I/O pipelines Interation with Synnefo Future directions 2

3 p Archipelao overview Distributed Storae System - Powerin storae in clouds Decouples storae resources from storae backends - Files / Imaes / Volumes / Snapshots Unified way to provision, handle, and present resources Decouples loic from actual physical storae - Software-Defined Storae 3

4 p Archipelao loic Thin provisionin, with clones and snapshots - Independent from the underlyin storae technoloy Hash-based data deduplication Pluable architecture - Multiple endpoint (northbound) drivers - Multiple l backend (southbound) drivers Multiple storae backends - Unified manaement - with storae mirations 4

5 Unified view of resources Files - User files, with Dropbox-like syncin Imaes - Templates for VM creation Volumes - Live disks, as seen from VMs Snapshots - Point-in-time i ti snapshots of Volumes 5

6 Spawn my own Ubuntu Freeze 6

7 Clone Ubuntu + user data Snapshot 7

8 p The bi picture Archipelao Core Storae backend 1 Storae backend 2 Storae backend 3 (e.., Ceph cluster 1) (e.., Ceph cluster 2) (e.., NFS over NAS) 8

9 9

10 End-to-end workflow with unified storae 10

11 Live demo! Loin, view/upload files Unified imae store: Imaes as files View/create/destroy servers from Imaes on multiple storae backends on Archipelao, for thin, super-fast creation with per-server customization, e.., file injection Take a point-in-time time snapshot of a VM s disk, in seconds Share it with collaborators, with fine-rained Access Control Create a virtual cluster from this Snapshot from the command-line, and in Python scripts 11

12 12

13 block I/O Linux block driver Northbound interface RADOS Volume Composer Monitor nodes Mapper Archipelao Core Storae Ceph/RADOS driver Southbound interface object I/O Object Storae nodes 13

14 Resource composition 14

15 p Archipelao interfaces GLUSTER DRIVER GLUSTER 15

16 p Runnin Archipelao 16

17 p Implementation Internals 17

18 pp Flexible I/O pipeline Linux block drv Linux block drv Volume Composer Blocker Mapper Storae backend 19

19 pp Flexible I/O pipeline Linux block drv Linux block drv Cacher Volume Composer Blocker Mapper Storae backend 20

20 pp Flexible I/O pipeline Linux block drv Linux block drv Volume Composer Cacher Blocker Mapper Storae backend 21

21 p Archipelao overview Distributed Storae System - Powerin storae in clouds Decouples storae resources from storae backends - Files / Imaes / Volumes / Snapshots Unified way to provision, handle, and present resources Decouples loic from actual physical storae - Software-Defined Storae 20

22 p Archipelao loic Thin provisionin, with clones and snapshots - Independent from the underlyin storae technoloy Hash-based data deduplication Pluable architecture - Multiple endpoint (northbound) drivers - Multiple l backend (southbound) drivers Multiple storae backends - Unified manaement - with storae mirations 21

23 y Interation with Synnefo IaaS open source cloud software Identity, Storae, Compute/Network/Imae/Volume services Production since June Powerin the ~okeanos public cloud Written in Python/Djano, exposes OpenStack APIs Uses Goole Ganeti at the backend BSD licensed 22

24 Cluster vs Cloud OPENSTACK SYNNEFO UI OPENSTACK OPENSTACK API OPENSTACK LIBVIRT SYNNEFO GANETI CLOUD CLUSTER NODE KVM KVM HYPERVISOR 23

25 Goole Ganeti Mature, production-ready VM cluster manaement - used for Goole s corporate infrastructure Multiple storae backends out of the box -LVM, DRBD - Files on local or shared directory -RBD(Ceph/RADOS) External Storae Interface for SAN/NAS support Ganeti cluster = masterd on master, noded on nodes Easy to interate into existin infrastructure - Remote API over HTTP, pre/post hooks for every action! 24

26 Architecture 25

27 Storae service: Pithos Exposes the OpenStack Object Storae (Swift) API - plus extensions, for sharin and syncin Rich sharin, with fine-rained Access Control Lists Content-based addressin for blocks Partial file transfers, deduplication, efficient syncin Backed by Archipelao - Provides a northbound endpoint for Archipelao -Implements the HTTP ateway - Exposes the Swift API to end users 26

28 y Interation with Synnefo 27

29 Future Directions I/O Flow identification Per-user, per-volume policy enforcement for QoS Archipelao XSEG over RDMA - Archipelao I/O pipelines across physical nodes - 1-sided d operations for remote communication Expose the Archipelao data path inside VMs - Direct VM userspace access to storae - for ultra-lowlow latency access to storae Improved handlin of multiple backends - Tiered Storae - Volumes livin i across backends, automated t mirations 28

30 y Try it out! Support: 29