Wendelin Exanalytics Hypercube Big Data Center

Transcription

1 Wendelin Exanalytics Hypercube Big Data Center Shanghai Wendelin Project et al. CC SA-NC

2 Standard Bay 10 Gbps L2 Switch Standard Server IPMI L2 Switch Management Server Standard Bay 2014 Wendelin Project et al. CC SA-NC

3 Standard Server Minimum Typical 2 x 10 Gbps 2 x 10 Gbps 1 x IPMI 1 x IPMI 1 x i7 CPU 2 x 6 core Xeon CPU 32 GB RAM 512 GB RAM 1 x 200 GB SSD 4 x 1 TB SSD 1 x M2090 GPU 2014 Wendelin Project et al. CC SA-NC

4 Standard Server 100% open source GNU/Linux base OS SlapOS cloud / orchestrator / billing Babel low latency routing re6st address range allocation IPMI management protocol 2014 Wendelin Project et al. CC SA-NC

5 Management Server Minimum Typical 2 x 100 Mbps 2 x 1 Gbps 1 x IPMI 1 x IPMI 1 x Atom CPU 1 x i5 CPU 1 GB RAM 16 GB RAM 1 x 16 GB SSD 1 x 120 GB SSD 2014 Wendelin Project et al. CC SA-NC

6 Management Server 100% open source GNU/Linux base OS + router (dhcpd, PXE, iptables) Kadeploy base OS deployment IPMI management protocol 2014 Wendelin Project et al. CC SA-NC

7 LAN Cabling 10 Gbps L2 Switch Standard Server IPMI L2 Switch Management Server Standard Bay 2014 Wendelin Project et al. CC SA-NC

8 LAN Confguration Static IPv6 address range Big Data transfer Non routable IPv4 Base OS deployment 2014 Wendelin Project et al. CC SA-NC

9 IPMI Cabling 10 Gbps L2 Switch Standard Server IPMI L2 Switch Management Server Standard Bay 2014 Wendelin Project et al. CC SA-NC

10 IPMI Confguration Non routable IPv4 IPMI access 2014 Wendelin Project et al. CC SA-NC

11 Recursive Management Topology 2014 Wendelin Project et al. CC SA-NC

12 Hypercube Cabling 10 Gbps L2 Switch Standard Server IPMI L2 Switch Management Server Standard Bay 2014 Wendelin Project et al. CC SA-NC

13 Hypercube Confguration IPv6 Local Link no confguration Big Data transfer 2014 Wendelin Project et al. CC SA-NC

14 Hypercube Topology 2014 Wendelin Project et al. CC SA-NC

15 N-dimensional Cube Performance N 2 Size: Max latency: N exponential O(N ) minimal N O(2 ) scalable N O(N 2 ) exponential Storage Size (TB): N Capacity (GFLOPS): O(N 2 ) exponential Core bandwidth (Gbps): 2014 Wendelin Project et al. CC SA-NC

16 8-dimensional Cube Performance N 2 Size: Max latency: N 2048 servers O(N ) 8 x (10G + kernel latency) N Tbps N 4 N TB Storage Size (TB): N Capacity (GFLOPS): 500 N 2 1,024,000 GFLOPS Core bandwidth (Gbps): 2014 Wendelin Project et al. CC SA-NC

17 Standard Applications Wendelin (Big Data as a Service) Kvm (Infrastructure as as Service) Webrunner (Platform as a Service) MariaDB / TokuDB (Database) 2014 Wendelin Project et al. CC SA-NC

18 Optional Applications open architecture HADOOP (Big Data as a Service) OpenStack (Infrastructure as as Service) Mongo (Database) Cassandra (Database) PostgreSQL (Database) etc Wendelin Project et al. CC SA-NC

19 Wendelin Exanalytics Hypercube Big Data Center Shanghai Wendelin Project et al. CC SA-NC

20 Cloud Computing Resiliency: from Illusion to Reality 1 Wendelin Exanalytics Hypercube Big Data Center Shanghai Wendelin Project et al. CC SA-NC

21 Cloud Computing Resiliency: from Illusion to Reality 2

22 Cloud Computing Resiliency: from Illusion to Reality 3

23 Cloud Computing Resiliency: from Illusion to Reality 4

24 Cloud Computing Resiliency: from Illusion to Reality 5 Management Server Minimum Typical 2 x 100 Mbps 2 x 1 Gbps 1 x IPMI 1 x IPMI 1 x Atom CPU 1 x i5 CPU 1 GB RAM 16 GB RAM 1 x 16 GB SSD 1 x 120 GB SSD 2014 Wendelin Project et al. CC SA-NC

25 Cloud Computing Resiliency: from Illusion to Reality 6

26 Cloud Computing Resiliency: from Illusion to Reality 7

27 Cloud Computing Resiliency: from Illusion to Reality LAN Confguration Static IPv6 address range Big Data transfer Non routable IPv4 Base OS deployment 2014 Wendelin Project et al. CC SA-NC 8

28 Cloud Computing Resiliency: from Illusion to Reality 9

29 Cloud Computing Resiliency: from Illusion to Reality IPMI Confguration Non routable IPv4 IPMI access 2014 Wendelin Project et al. CC SA-NC 10

30 Cloud Computing Resiliency: from Illusion to Reality 11

31 Cloud Computing Resiliency: from Illusion to Reality 12

32 Cloud Computing Resiliency: from Illusion to Reality Hypercube Confguration IPv6 Local Link no confguration Big Data transfer 2014 Wendelin Project et al. CC SA-NC 13

33 Cloud Computing Resiliency: from Illusion to Reality 14

34 Cloud Computing Resiliency: from Illusion to Reality 15 N-dimensional Cube Performance N 2N Size: Max latency: Core bandwidth (Gbps): exponential O(N ) minimal O(2 N ) scalable O( N 2 N ) exponential Storage Size (TB): N Capacity (GFLOPS): O(N 2 ) exponential 2014 Wendelin Project et al. CC SA-NC

35 Cloud Computing Resiliency: from Illusion to Reality 16 8-dimensional Cube Performance N 2N Size: Max latency: Core bandwidth (Gbps): 2048 servers O(N ) 8 x (10G + kernel latency) N Tbps N Storage Size (TB): 4 N TB N Capacity (GFLOPS): 500 N 2 1,024,000 GFLOPS 2014 Wendelin Project et al. CC SA-NC

36 Cloud Computing Resiliency: from Illusion to Reality Standard Applications Wendelin (Big Data as a Service) Kvm (Infrastructure as as Service) Webrunner (Platform as a Service) MariaDB / TokuDB (Database) 2014 Wendelin Project et al. CC SA-NC 17

37 Cloud Computing Resiliency: from Illusion to Reality Optional Applications open architecture HADOOP (Big Data as a Service) OpenStack (Infrastructure as as Service) Mongo (Database) Cassandra (Database) PostgreSQL (Database) etc Wendelin Project et al. CC SA-NC 18

38 Cloud Computing Resiliency: from Illusion to Reality 19 Wendelin Exanalytics Hypercube Big Data Center Shanghai Wendelin Project et al. CC SA-NC