Parallels Summit Break Through. #ParallelsSummit Parallels IP Holdings GmbH

Transcription

1 Parallels Summit 2014 Break Through #ParallelsSummit 2014 Parallels IP Holdings GmbH

2 Kirill Korotaev VP Advanced Research Workshop: 2014 Parallels IP Holdings GmbH 2

3 Agenda 1. Introduction 2. Cluster creation 3. Shared content demo 4. Join new node 5. HA demo 6. CT operations 7. iscsi 8. Hot Plug

4 Infrastructure Overview Meta Data Server () Stores metadata in memory Tracks data chunks and their versions Is highly available Can run on the same server as the chunk server and client Chunk Server (CS) Stores data chunks Manages data chunks Performs read/write operations on data chunks Can run on the same server as the client System Requirements: CS/client: 1 GB free memory : 1 GB free memory for each 100 TB stored data Recommendations: Mixed CS//Client roles on one node (Dedicated nodes not needed) Don t overcommit memory

5 How It Works

6 How It Works File: File: File:

7 How It Works File: File: File:

8 Look & Feel/Demo

9 Installation Easy way of initial cluster configuration Create new cluster Join existing cluster

10 PCS Demo: Create new cluster Action: create initial cluster es # pstorage -c $CLUSTER_NAME make-mds I a $IP p r $JOURNAL # service pstorage-mdsd start # pstorage load-license -p ZD767F-NZJ681-KFXHCF-01S1XY-YMJHZR Action: authorize all other nodes # pstorage -c $CLUSTER_NAME auth-node

11 PCS Demo: create more es for HA Action: create more servers for HA # pstorage -c $CLUSTER_NAME make-mds I a $IP p r $JOURNAL # service pstorage-mdsd start Action: mount pstorage on all nodes pstorage-mount -c $CLUSTER_NAME /pstorage

12 HotPlug

13 PCS Demo: HotPlug Action: plug all HDDs to automatically add storage

14 PCS Demo: Advise configuration # pstorage -c $CLUSTER_NAME advise-configuration --cs /hdd1 --cs /hdd2 --cs /hdd3 --ssd /ssd -m /pstorage # <create CS as proposed> # service pstorage-csd start

15 PCS Demo: Cluster monitoring Action: cluster view / statistics / event-log # pstorage -c $CLUSTER_NAME top Action: automation of monitoring # pstorage -c $CLUSTER_NAME stat -X

16 PCS Demo: Shared Content Action: show shared PCS content # date > /pstorage/file # cat /pstorage/file

17 VM/CT on

18 PCS Demo: Create and start container CT 100 Action: create/start container # vzctl create 100 # vzctl start 100

19 PCS Demo: Import CT CT 100 CT 400 This laptop Action: import CT # cp a summit/400 /pstorage/private/400 # vzctl register /pstorage/private/ # vzctl start 400

20 PCS Demo: Migrate CT CT 100 CT 400 This laptop Action: live migration 1. Connect to CT by XVnc 2. # vzmigrate --online $pcs4 400

21 PCS Demo: I/O monitoring CT 100 CT 400 Action: I/O Monitoring # pstorage -c $CLUSTER_NAME top # pstorage mnt-top /pstorage # vziotop Action: Limit containers to avoid abuse # vzctl set iolimit <MB/s> --iopslimit <IOPS>

22 Cluster Configuration

23 PCS Demo: Changing cluster configuration CT 100 CT 400 Action: changing cluster parameters force rebalancing # pstorage -c $CLUSTER_NAME set-configmds.wd.offline_tout=30000 # pstorage -c $CLUSTER_NAME set-configmds.balance.threshold=1 # pstorage -c $CLUSTER_NAME set-configmds.wd.overcommit_tout=10000 Action: changing cluster parameters change replication level # pstorage -c $CLUSTER_NAME set-attr p -R / replicas=3

24 PCS Demo: Hot Plug/Unplug Action: locate disk pstorage -c $CLUSTER_NAME locate-disk #CSID Action: plug/unplug of disks pstorage -c $CLUSTER_NAME top

25 High Availability

26 PCS Demo: Configure HA CT 100 CT 400 Action: configure HA on all nodes # shaman -c $CLUSTER_NAME join # chkconfig snmpd on # service snmpd start # chkconfig shamand on # service shamand start # chkconfig pdrsd on # service pdrsd start

27 PCS Demo: Special HA tunning CT 100 CT 400 Action: special HA options # shaman set-config RESOURCE_RELOCATION_MODE=drs,round-robin,spare # prlctl set ha-enable no # prlctl set ha-prio 1 Action: HA monitoring # shaman stat

28 PCS Demo: Auto recovery and HA CT 100 CT 400 Action: kill the node # pstorage -c $CLUSTER_NAME top # shaman stat

29 PCS Demo: Auto recovery and HA CT 100 CT 400 Action: CT started on other node # pstorage -c $CLUSTER_NAME top # shaman stat

30 iscsi

31 PCS Demo: iscsi iscsi target Action: create iscsi target # pstorage-iscsi create -n target1 -a # pstorage-iscsi lun-add -t iqn com.pstorage:target1 -l 1 -s 100G # pstorage-iscsi start -t iqn com.pstorage:target1

32 PCS Demo: iscsi iscsi target This laptop Action: connection iscsi For Windows: Control Panel -> iscsi initiator -> Discovery -> Add Portal -> For Linux: # iscsiadm --mode discovery --type sendtargets --portal # service iscsi restart

33 PCS Demo: iscsi HA iscsi target This laptop Action: kill the node

34 PCS Demo: iscsi HA iscsi target This laptop iscsi was moved to another node

35 PCS Demo: iscsi shapshots iscsi target Action: create iscsi snapshot # pstorage-iscsi snapshot-create -t iqn com.pstorage:target1 -l 1 Action: list iscsi snapshots # pstorage-iscsi snapshot-list -t iqn com.pstorage:target1 -l 1 Action: delete iscsi snapshot # pstorage-iscsi snapshot-delete -u a65b413c-ccd7-47ab-b94f ac80d

36 PCS Demo: iscsi shapshots iscsi target Other iscsi commands and authorization: # pstorage-iscsi account-*

37 New PStorage features Failure domains is a set of services which can fail in a correlated manner. Due to correlated failures it is very critical to scatter data replicas across different failure domains for data availability. Failure domain can be: disk allocate anywhere host no more then 1 replica per host (default) rack no more then 1 replicas per RACK Automatically hot data rebalancing: Closer to where it is needed Hot data on SSD, cold on SAS/SATA Distribute across the cluster using performance of all disks

38 Thank you! Questions?

39 #ParallelsSummit 2014 Parallels IP Holdings GmbH 40