Hitra rast hranjenih podatkov

Transcription

1

2 Tomaž Borštnar - član uredništva računalniške revije Monitor od začetka (oktober 1991; ne-pc okolja (Unix, etc) - sodelavec YUNAC in ARNES od začetka - postavil in upravljal večino strežnikov na SiOL - zasnoval in vodil postavitev projekta FreeVolja (cilj: uporabnikov z nizkimi stroški!) - za svoje podjetje Siix postavil Med.Over.net, ki je prerastel v omrežje Over.Net - že več kot 20 let predavatelj doma in v tujini - 19 certifikatov s področja omrežij, požarnih zidov, Openstack, Microsoft, Suse, Red Hat, EnterpriseDB - več na LinkedIn ( 2

3

4 Hitra rast hranjenih podatkov Mobile Data Medical Data IoT Data Videos Transactional Data s 4

5 5

6 6

7 7

8 8

9 9

10 10

11 11

12 12

13 13

14 14

15 15

16 16

17

18 Kaj je SUSE Enterprise Storage? Distribuiran sistem za hranjenje podatkov. Narejen za: razširljivost, zanesljivost, hitrost. Temelji na odprtokodnem projektu Ceph. Uporablja običajno strežniško in omrežno opremo. 18

19 Prednosti SUSE Enterprise Storage? Razširljivost podpira na tisoče strežnikov v gruči ter petabyte+ podatkov. Uporablja običajne strežnike za svoje delovanje ter Ethernet stikala. Samostojno delovanje sistem se prilagaja namernim in nenamernim spremembam samodejno prerazporedi podatke. Ob primerni zasnovi nima tkim. Single Point of Failure. Odprtokodna rešitev, kjer nismo vezani na enega ponudnika. 19

20 Kaj je Software Defined Storage? Delovanje in upravljanje take rešitve je v programski opremi, ki ni odvisna od namenske strojne opreme. Bistveno zniža TCO zlasti ko presežemo mejo nad 200TB. Nam ne predpisuje izbire strojne platforme. Ne rabimo kupovati na zalogo, ampak po potrebi oz ko se pojavijo nove tehnologije, ki dodatno znižajo TCO. 20

21 Ceph Največji odprtokodni SDS projekt Zelo aktiven razvoj Vsakih 9 mesecev nova LTS verzija s povprečno dobo 18 mesecev Časovnica Ceph: SUSE Enterprise Storage temelji na Luminous (12.2.x) Ceph Advisory Board Ceph community committed to the Ceph project: Canonical CERN Cisco Fujitsu Intel Red Hat SanDisk SUSE... 21

22 22

23

24 Openstack velik uporabnik Ceph SDS rešitev Natively Integrated with Openstack Ceph RBD is integrated with Openstack Ceph gaining acceptance as Glance backend for Openstack Most Deployed Block Storage Backend for Openstack Ceph RBD is used in almost Half the Deployments 48% Usage in Large Clouds with over 1000 Cores Benefits: Massively Scalable Openstack User Survey April 2017* N=363 Single Storage Architecture for Block (Cinder) and Archive (Glance) Low TCO over traditional storage Picture Truncated for Brevity 24

25

26 SUSE Enterprise Storage v5 26

27

28

29 Minimum Storage Configuration For Proof of Concept deployment Four Object Storage Nodes: 10 Gb Ethernet (two networks bonded to multiple switches) 32 OSDs per storage cluster OSD journal can reside on OSD disk Dedicated OS disk for each Object Storage Node 1 GB of RAM per TB of raw OSD capacity for each Object Storage Node 1.5 GHz per OSD for each Object Storage Node Ceph Monitors, gateway and Metadata Servers can reside on Object Storage Nodes - Three Ceph Monitor nodes (requires SSD for dedicated OS drive) - Ceph Monitors, RADOS Gateways and Metadata Servers nodes require redundant deployment - iscsi Gateways, RADOS Gateways and Metadata Servers require incremental 4 GB RAM and four cores Separate management node with 4 GB RAM, four cores, 1 TB capacity 29

30 Smaller Production Cluster Configuration Four Object Storage Nodes 10 Gb Ethernet (four physical networks bonded to two switches) 32+ OSDs per storage cluster RAID 1 OS disks for each OSD storage node SSDs for Journal with 6:1 ratio SSD journal to OSD 1.5 GB of RAM per TB of raw OSD capacity for each Object Storage Node 2 GHz per OSD for each Object Storage Node Dedicated physical infrastructure nodes Three Ceph Monitor nodes: 64 GB RAM, 10 core processor, RAID 1 SSDs for disk One SES management node: 4 GB RAM, 6 core processor, RAID 1 SSDs for disk Extra services deployed on monitor nodes with possibility to later move them to dedicated nodes. 30

31 Recommended Production Cluster Configuration Seven Object Storage Nodes No single node exceeds ~15% of total storage 10 Gb Ethernet (four physical networks bonded to multiple switches) 56+ OSDs per storage cluster RAID 1 OS disks for each OSD storage node SSDs for Journal with 6:1 ratio SSD journal to OSD 1.5 GB of RAM per TB of raw OSD capacity for each Object Storage Node 2 GHz per OSD for each Object Storage Node Dedicated physical infrastructure nodes Three Ceph Monitor nodes: 4 GB RAM, 4 core processor, RAID 1 SSDs for disk One SES management node: 4 GB RAM, 4 core processor, RAID 1 SSDs for disk Redundant physical deployment of gateway or Metadata Server nodes: RADOS Gateway nodes: 32 GB RAM, 8 core processor, RAID 1 SSDs for disk iscsi Gateway nodes: 16 GB RAM, 4 core processor, RAID 1 SSDs for disk Metadata Server nodes (one active/one hot standby): 32 GB RAM, 8 core processor, RAID 1 SSDs for disk 31

32 SUSE Enterprise Storage Licenciranje Base Configuration Expansion Node iscsi Gateway or RADOS Gateway or CephFS MDS Nodes Infrastructure Node AND Storage Nodes Management Node Monitor Nodes 4 Storage Nodes AND 6 Infrastructure Nodes Storage Node 1 Storage Node AND 1 Infrastructure Node

33 Cena HW 4 OSD (4x96 TB bruto) 192 TB neto Monitor disk 3x SSD 3000 Switch 6000 Skupaj HW Licence support 5Y Postavitev 5000 Skupaj HW + SW 5Y + Postavitev 88005

34