Ceph Intro & Architectural Overview. Federico Lucifredi Product Management Director, Ceph Storage Vancouver & Guadalajara, May 18th, 2015

Transcription

1 Ceph Intro & Architectural Overview Federico Lucifredi Product anagement Director, Ceph Storage Vancouver & Guadalajara, ay 8th, 25

2 CLOUD SERVICES COPUTE NETWORK STORAGE the future of storage 2

3 ROCK INK PAPER TAPE 3

4 TAPE 4

5 YOU TECHNOLOGY YOUR DATA 5

6 gaaaaaaaaahhhh!!!!!! cloud computing distributed storage computers paper writing carving How uch Store Things All Human History?! 6

7 7

8 8

9 GIANT SPENDY 9

10

11

12 STORAGE APPLIANCE 2

13 Storage Appliance ichael oll, Wikipedia / CC BY-SA 2. 3

14 $NYSE:EC, FY24 K SUPPORT AND AINTENANCE PROPRIETARY SOFTWARE 34% of revenue (5.7 billion dollars).3 billion in R&D Spent in a year PROPRIETARY HARDWARE.6+ million square feet of manufacturing space 4

15 THE CLOUD 5

16 (optional) SUPPORT AND AINTENANCE PROPRIETARY SOFTWARE PROPRIETARY HARDWARE ENTERPRISE SUBSCRIPTION OPEN SOURCE SOFTWARE STANDARD HARDWARE 6

17 7

18 philosophy OPEN SOURCE COUNITY-FOCUSED design SCALABLE NO SINGLE POINT OF FAILURE SOFTWARE BASED SELF-ANAGING 8

19 8 years & 2, commits later 9

20 2

21 APP LIBRADOS A library allowing apps to directly access RADOS, with support for C, C++, Java, Python, Ruby, and PHP APP HOST/V CLIENT RADOSGW RBD CEPH FS A bucket-based REST gateway, compatible with S3 and Swift A reliable and fullydistributed block device, with a Linux kernel client and a QEU/KV driver A POSIX-compliant distributed file system, with a Linux kernel client and support for FUSE RADOS A reliable, autonomous, distributed object store comprised of self-healing, self-managing, intelligent storage nodes 2

22 APP LIBRADOS A library allowing apps to directly access RADOS, with support for C, C++, Java, Python, Ruby, and PHP APP HOST/V CLIENT RADOSGW RBD CEPH FS A bucket-based REST gateway, compatible with S3 and Swift A reliable and fullydistributed block device, with a Linux kernel client and a QEU/KV driver A POSIX-compliant distributed file system, with a Linux kernel client and support for FUSE RADOS A reliable, autonomous, distributed object store comprised of self-healing, self-managing, intelligent storage nodes 22

23 OSD OSD OSD OSD OSD FS FS FS FS FS btrfs xfs ext4 23

24 24

25 OSDs: s to s in a cluster One per disk (or one per SSD, RAID group ) Serve stored objects to clients Intelligently peer to perform replication and recovery tasks onitors: aintain cluster membership and state Provide consensus for distributed decision-making Small, odd number These do not serve stored objects to clients 25

26 APP LIBRADOS A library allowing apps to directly access RADOS, with support for C, C++, Java, Python, Ruby, and PHP APP HOST/V CLIENT RADOSGW RBD CEPH FS A bucket-based REST gateway, compatible with S3 and Swift A reliable and fullydistributed block device, with a Linux kernel client and a QEU/KV driver A POSIX-compliant distributed file system, with a Linux kernel client and support for FUSE RADOS A reliable, autonomous, distributed object store comprised of self-healing, self-managing, intelligent storage nodes 26

27 APP LIBRADOS socket 27

28 L LIBRADOS Provides direct access to RADOS for applications C, C++, Python, PHP, Java, Erlang Direct access to storage nodes No HTTP overhead

29 APP LIBRADOS A library allowing apps to directly access RADOS, with support for C, C++, Java, Python, Ruby, and PHP APP HOST/V CLIENT RADOSGW RBD CEPH FS A bucket-based REST gateway, compatible with S3 and Swift A reliable and fullydistributed block device, with a Linux kernel client and a QEU/KV driver A POSIX-compliant distributed file system, with a Linux kernel client and support for FUSE RADOS A reliable, autonomous, distributed object store comprised of self-healing, self-managing, intelligent storage nodes 29

30 APP REST RADOSGW LIBRADOS socket 3

31 RADOS Gatew ay: REST-based object storage proxy Uses RADOS to store objects API supports buckets, accounts Usage accounting for billing Com patible with S3 and Sw ift applications 3

32 APP LIBRADOS A library allowing apps to directly access RADOS, with support for C, C++, Java, Python, Ruby, and PHP APP HOST/V CLIENT RADOSGW RBD CEPH FS A bucket-based REST gateway, compatible with S3 and Swift A reliable and fullydistributed block device, with a Linux kernel client and a QEU/KV driver A POSIX-compliant distributed file system, with a Linux kernel client and support for FUSE RADOS A reliable, autonomous, distributed object store comprised of self-healing, self-managing, intelligent storage nodes 32

33 V VIRTUALIZATION CONTAINER LIBRBD LIBRADOS 33

34 CONTAINER V CONTAINER LIBRBD LIBRADOS LIBRBD LIBRADOS 34

35 HOST KRBD (KERNEL ODULE) LIBRADOS 35

36 RADOS Block Device: Storage of disk images in RADOS Decouples Vs from host Images are striped across the cluster (pool) Snapshots Copy-on-write clones Support in: ainline Linux Kernel ( ) Qemu/KV OpenStack, CloudStack 36

37 APP LIBRADOS A library allowing apps to directly access RADOS, with support for C, C++, Java, Python, Ruby, and PHP APP HOST/V CLIENT RADOSGW RBD CEPH FS A bucket-based REST gateway, compatible with S3 and Swift A reliable and fullydistributed block device, with a Linux kernel client and a QEU/KV driver A POSIX-compliant distributed file system, with a Linux kernel client and support for FUSE RADOS A reliable, autonomous, distributed object store comprised of self-healing, self-managing, intelligent storage nodes 37

38 CLIENT metadata data 38

39 etadata Server anages metadata for a POSIX- compliant shared filesystem Directory hierarchy File metadata (owner, timestamps, mode, etc.) Stores metadata in RADOS Does not serve file data to clients Only required for shared filesystem 39

40 Questions? Federico Lucifredi P Director, Ceph federico@ xf2 redhat.com ceph.com 4