Schneller Interconnect für Spectrum Scale. März 2017

Transcription

1 Schneller Interconnect für Spectrum Scale ärz 2017

2 ompany Overview icker: LN Leading provider of high-throughput, low-latency Server and Storage Interconnect DR 100Gb/s (5 th generation) InfiniBand and 10/25/0/50/100Gb HDR 200G coming later this year Reduces application wait-time for data Dramatically increases ROI on data center infrastructure ompany headquarters: Yokneam, Israel; Sunnyvale, alifornia ~ 3,000 employees worldwide Solid financial position Record revenue last 3 years >$1B On a run rate close to $1B annual Sales 2016 ellanox echnologies 2

3 Leading Supplier of nd-to-nd Interconnect Solutions Server / ompute Virtual Protocol Interconnect 56/100/200G InfiniBand Switch / Gateway Virtual Protocol Interconnect 56/100/200G InfiniBand Storage ront / Back-nd 10/0/56/100/200Gb 10/0/56/100/200Gb omprehensive nd-to-nd InfiniBand and thernet Portfolio (VPI) Is Adapter ards NPU & ulticore Switches/Gateways Software etro / WAN ables/odules IL NPS 2016 ellanox echnologies 3

4 ellanox Unique Differentiated Hardware Why ellanox stablished technology leader Dominant in High Speed thernet irst to market with 25, 50, and 100Gb astest growing thernet switch vendor Only nd to nd thernet Solution rusted supplier to all major OS ellanox thernet Switches wice the performance at half the price Unique form factors - Ideal for hyper-converged networking Best in-class performance - hroughput - Latency - Power consumption - Highest Value/$ ellanox 75% Source: rehan Research, arch 2016 thernet NI arket Share Speeds aster than 10 Gigabit 25% All Others 80% 20% 89% % 2016 ellanox echnologies

5 Growth is in the 25Gb/s & Above High Speed Adapter arket orecast 2016 ($1.B) High Speed Adapter arket orecast 2020 ($1.8B) 19% 57% Key essages: 25 is the New 10! 50 & 100 are Now! uture Proof Your Network! With 10/25Gb/s thernet! rehan Research: Q3 15 Server lass Adapter arket Share (Nov 2015), Long Range orecast Server-class Adapters & LO (Jan 2016), Adapter forecast includes LO; 2016 ellanox echnologies 5

6 25/50/100Gb: he uture is Here! Network 0Gb Network 150% Higher Bandwidth 100Gb Similar onnectors Similar Infrastructure 10Gb 0Gb 25Gb 50Gb Similar ost / Power ompute Nodes Storage Nodes ompute Nodes 150% Higher Bandwidth Storage Nodes 25% Higher Bandwidth 2016 ellanox echnologies 6

7 aster Storage Needs aster Networks! PU PU = & Without Ro With Ro hree NVe lash Drive One 100Gb Links Needs Ro Just three NVe lash can saturate 100 Gb/s Link Needs 100Gb onnect- & RDA RDA Burn Rubber! Not PU ycles ellanox echnologies 7

8 IB ellanox Infrastructure for SS/Spectrum Scale Dual NSD Port Bandwidth options Ports 10Gb 0Gb 2x 0Gb 56Gb 2x 56Gb DR DR 100Gb DR One Port wo Ports hree Ports our Ports ive Ports Six Ports OR INRNAL US ONLY cannot be posted online or reproduced without ellanox consent 1-ar-17 v8

9 IB ellanox Infrastructure for SS/Spectrum Scale SINGL NSD Port Bandwidth options Ports 10Gb 0Gb 2x 0Gb 56Gb 2x 56Gb DR DR 100Gb DR One Port wo Ports hree Ports our Ports ive Ports Six Ports OR INRNAL US ONLY cannot be posted online or reproduced without ellanox consent 1-ar-17 v8

10 IB Landing Page ellanox echnologies 10

11 IB SS / Spectrum Scale Quick Reference Guide 1-ar-17 v7 ain Benefits AIIZ H NWORK aximize datacenter connectivity ROI through: Density, Scale, Performance OPN H NWORK Leverage new technologies that increase functionality, investment & ROI reedom from vendor lock-in Unique apability LLANO: H DIRN IS IN H HIP ounded as a state-of-the-art silicon chip (ASI) manufacturer Intelligence built directly onto our own chip Other switch vendors are forced to source expensive ASIs from third parties such as Broadcom ellanox uses own chip & passes savings to customers 6 th Generation 10/0/56Gb & 0/56 Gb IB 7 th Generation 0/56/100 Gb IB ellanox designs & builds intelligent ASIs that power switches, adapters, & cables Key Differentiators VALU & PRORAN he nterprise Integrated model is familiar to those with traditional SAN deployments. Adding SS/Spectrum Scale will not only eliminate the data silos, but can also improve performance and reduce data bottleneck. he most common deployment is using Network Shared Disks, whose modular design scales performance and capacity independently. or those familiar with HDS, or other scale-out software-defined storage, we support shared nothing clusters that provide the native locality APIs for HDS, but work like centralized parallel storage for other protocols. Using commodity storage rich servers can be the most economical way to scale out your storage needs. arket Opportunities SAL-OU SORAG ombines compute & storage, easier to manage & lowers cost top of rack switch with density at lower price point most attractive LOUD reate economies of scale through shared services open switch platform with fairness best for software-defined D. DIA & NRAINN Video streaming & postproduction on k/8k workflows needs extreme high bandwidth to support real-time frame-rates BIG DAA Improved analytics for better business decisions needs non-blocking architecture to speed data ingestion. GNOIS xtreme scalability using a building - block approach: apacity, bandwidth and a single name space expand as more building blocks are added, resulting in near-linear performance gains SAL OU DAABAS Scale out of DB2 PureScale, Oracle RA, SAP HANA ompany Background stablished 1999 * NASDAQ: LN nd-to-end thernet onnectivity Solutions Adapters, Switches, ables, Software, Support World-class, non-outsourced technical support rusted as switch manufacturer for every major server O OR INRNAL US ONLY cannot be posted online or reproduced without ellanox consent 825

12 IB ellanox Infrastructure for SS / Spectrum Scale Speed Switch abling Adapter Optics* DR DR 0 Gb 10/0 Gb S SB S N2 S S8 See lists on right L3D 3 3 3A L3 L0 (SR) 3A B27 + B2J or B2K B28 + BD or B hoice of abling 0Gb / DR abling Length Description 0.5m 0Gb / DR opper able QSP B0 1m 0Gb / DR opper able QSP B1 2m 0Gb / DR opper able QSP B2 3m 0Gb / DR Optical able QSP BA 5m 0Gb / DR Optical able QSP BB 10m 0Gb / DR Optical able QSP B 15m 0Gb / DR Optical able QSP BD 20m 0Gb / DR Optical able QSP B 30m 0Gb / DR Optical able QSP B 50m 0Gb / DR Optical able QSP BG nterprise Integrated odel Network Shared Disk (NSD) odel DR abling Length Description 0.5m DR opper able QSP28 B50 1m DR opper able QSP28 B51 2m DR opper able QSP28 B52 1.5m DR opper abling QSP28 B5 3m DR Optical able QSP28 B5A 5m DR Optical able QSP28 B5B Unify and parallelize storage silos odular High-Performance Scaling Shared Nothing luster (SN) odel Span storage rich servers for converged architecture or HDS deployment 10m DR Optical able QSP28 B5 15m DR Optical able QSP28 B5D 20m DR Optical able QSP28 B5 30m DR Optical able QSP28 B5 50m DR Optical able QSP28 B5G 100m DR Optical able QSP28 B5H * Optics are IB Parts only OR INRNAL US ONLY cannot be posted online or reproduced without ellanox consent 1-ar-17 v7

13 IB ellanox Infrastructure for 10/0 Gb SS / Spectrum Scale Speed Switch abling Adapter Optics* hoice of abling 0Gb / DR abling Length Description 10/0 Gb S S8 Scenario One H S SS IO Node 1 SS IO Node 2 See list on right 37 / L3 2 / L0 (SR) 3A Scenario wo H S SS IO Node 1 SS IO Node 2 B28 + BD or B B27 + B2J or B2K 0.5m 0Gb / DR opper able QSP B0 1m 0Gb / DR opper able QSP B1 2m 0Gb / DR opper able QSP B2 3m 0Gb / DR Optical able QSP BA 5m 0Gb / DR Optical able QSP BB 10m 0Gb / DR Optical able QSP B 15m 0Gb / DR Optical able QSP BD 20m 0Gb / DR Optical able QSP B 30m 0Gb / DR Optical able QSP B 50m 0Gb / DR Optical able QSP BG 1Gb xa Network 1Gb H Network 0 Gb Data Network 8831-S8 8x 10Gb + 12x 0Gb 8831-S8 8x 10Gb + 12x 0Gb 10 Gb Data Network 10 Gb lient 0 Gb ustomer Network 10 Gb ustomer Network OR OR * 10GB & Optics are IB Parts only OR INRNAL US ONLY cannot be posted online or reproduced without ellanox consent 1-ar-17 v7

14 IB ellanox Infrastructure for 0 Gb SS / Spectrum Scale Speed Switch abling Adapter Optics* 0 Gb S N2 S See list on right Scenario hree H S SS IO Node 1 SS IO Node N2 36x 0Gb Q 3A B27 + B2J or B2K hoice of abling 0Gb / DR abling Length Description 0.5m 0Gb / DR opper able QSP B0 1m 0Gb / DR opper able QSP B1 2m 0Gb / DR opper able QSP B2 3m 0Gb / DR Optical able QSP BA 5m 0Gb / DR Optical able QSP BB 10m 0Gb / DR Optical able QSP B 15m 0Gb / DR Optical able QSP BD 20m 0Gb / DR Optical able QSP B 30m 0Gb / DR Optical able QSP B 50m 0Gb / DR Optical able QSP BG 1m* Passive QSP+ x Break-out able 3m* Passive QSP+ x Break-out able B2 B25 5m* Passive QSP+ 1Gb x xa Break-out Network B26 able 1Gb H Network 0 Gb Data Network S Passive QSP+ Break-out able 0 Gb lient 10 Gb lient 0 Gb ustomer Network OR Q * QSP to SP+ Adapter (QSA) SP+ DA or ransceiver 10 Gb ustomer Network * 10GB & Optics are IB Parts only OR INRNAL US ONLY cannot be posted online or reproduced without ellanox consent 1-ar-17 v7

15 IB ellanox Infrastructure for DR SS / Spectrum Scale Speed Switch abling Adapter Optics DR S Scenario our H S See list on right 32 / L3D NA SS IO Node 1 SS IO Node 2 hoice of abling 0Gb / DR abling Length Description 0.5m 0Gb / DR opper able QSP B0 1m 0Gb / DR opper able QSP B1 2m 0Gb / DR opper able QSP B2 3m 0Gb / DR Optical able QSP BA 5m 0Gb / DR Optical able QSP BB 10m 0Gb / DR Optical able QSP B 15m 0Gb / DR Optical able QSP BD 20m 0Gb / DR Optical able QSP B 30m 0Gb / DR Optical able QSP B 50m 0Gb / DR Optical able QSP BG x QDR/DR 1Gb xa Network 1Gb H Network DR Data Network QDR/DR lient QDR/DR ustomer Network OR INRNAL US ONLY cannot be posted online or reproduced without ellanox consent 1-ar-17 v7

16 IB ellanox Infrastructure for DR SS / Spectrum Scale Speed Switch abling Adapter Optics DR SB See list on right 3 3 NA hoice of abling DR abling Length Description 0.5m DR opper able QSP28 B50 1m DR opper able QSP28 B51 2m DR opper able QSP28 B52 1.5m DR opper abling QSP28 B5 Scenario ive H S SS IO Node 1 SS IO Node 2 3m DR Optical able QSP28 B5A 5m DR Optical able QSP28 B5B 10m DR Optical able QSP28 B5 15m DR Optical able QSP28 B5D 20m DR Optical able QSP28 B5 30m DR Optical able QSP28 B5 50m DR Optical able QSP28 B5G 100m DR Optical able QSP28 B5H x QDR/DR/DR 1Gb xa Network 1Gb H Network DR Data Network QDR/DR/DR lient QDR/DR/DR ustomer Network OR INRNAL US ONLY cannot be posted online or reproduced without ellanox consent 1-ar-17 v7

17 IB ellanox Infrastructure for DR/DR SS / Spectrum Scale Speed Switch abling Adapter Optics hoice of abling DR abling Length Description 0.5m DR opper able QSP28 B50 DR / DR SB See list on right 32 / L3D NA 1m DR opper able QSP28 B51 2m DR opper able QSP28 B m DR opper abling QSP28 B5 3m DR Optical able QSP28 B5A 5m DR Optical able QSP28 B5B Scenario Six H S SS IO Node 1 SS IO Node x QDR/DR/DR 10m DR Optical able QSP28 B5 15m DR Optical able QSP28 B5D 20m DR Optical able QSP28 B5 30m DR Optical able QSP28 B5 50m DR Optical able QSP28 B5G 100m DR Optical able QSP28 1Gb xa Network 1Gb H Network DR Data Network DR Data Network QDR/DR lient QDR/DR/DR lient B5H QDR/DR/DR ustomer Network OR INRNAL US ONLY cannot be posted online or reproduced without ellanox consent 1-ar-17 v7

18 IB ellanox Infrastructure for IB luster SS / Spectrum Scale Speed Switch abling Adapter Optics DR / DR SB See list on right 3 3 NA hoice of abling DR abling Length Description 0.5m DR opper able QSP28 B50 1m DR opper able QSP28 B51 2m DR opper able QSP28 B52 1.5m DR opper abling QSP28 B5 Sample 72 Node luster 3m DR Optical able QSP28 B5A 5m DR Optical able QSP28 B5B x QDR/DR/DR Spine 10m DR Optical able QSP28 B5 15m DR Optical able QSP28 B5D 20m DR Optical able QSP28 B5 30m DR Optical able QSP28 B5 9x DR Link per Spine 9x DR Link per Spine 50m DR Optical able QSP28 B5G 100m DR Optical able QSP28 B5H 18x IB ndpoints per Leaf 18x IB ndpoints per Leaf 18x IB ndpoints per Leaf 18x IB ndpoints per Leaf Leaf 1Gb xa Network 1Gb H Network DR Data Network DR Data Network QDR/DR lient QDR/DR/DR lient QDR/DR/DR ustomer Network # Links to Spine # Spines #Leafs #Ports Some Rules: Links from Leaf to Spine must be odulo of 18-1,2,3,6,9 Non-Blocking requires as many links down to servers from Leaf as up to Spine from Leaf Biggest two tier network is 68 Nodes, 18 Spines & 36 Leafs hink ahead. Add Spines at day 1 for expansion, so extra leafs can be added without re-cabling existing leafs OR INRNAL US ONLY cannot be posted online or reproduced without ellanox consent 1-ar-17 v7

19 IB ellanox Infrastructure for 0Gb luster SS/Spectrum Scale Speed Switch abling Adapter Optics 0 Gb S N N2 36x 0Gb See list on right 3A Sample 72 Node L2 (VS) luster SS at 0 Gb connects here IPL x 56Gb B27 + B2J or B2K hoice of abling 0Gb / DR abling Length Description 0.5m 0Gb / DR opper able QSP B0 1m 0Gb / DR opper able QSP B1 2m 0Gb / DR opper able QSP B2 3m 0Gb / DR Optical able QSP BA 5m 0Gb / DR Optical able QSP BB 10m 0Gb / DR Optical able QSP B 15m 0Gb / DR Optical able QSP BD 20m 0Gb / DR Optical able QSP B 30m 0Gb / DR Optical able QSP B 50m 0Gb / DR Optical able QSP BG Spine 7x 56 Gb Link per Spine 7x 56 Gb Link per Spine 1Gb xa Network 1Gb H Network 0 Gb Data Network Q Q Leaf 0 Gb lient 0 Gb ustomer Network OR OR Q * QSP to SP+ Adapter (QSA) SP+ DA or ransceiver 18x 0 Gb ndpoints per Leaf 10 Gb ustomer Network * 10GB & Optics are IB Parts only OR INRNAL US ONLY cannot be posted online or reproduced without ellanox consent 1-ar-17 v7

20 IB ellanox Infrastructure for 10 Gb luster SS/Spectrum Scale Speed Switch abling Adapter Optics 0 Gb 10/0 Gb S N2 S S N2 36x 0Gb See list on right 3A 37 / L3 2 / L0 (SR) Sample 192 Node L2 (VS) luster SS at 0 Gb connects here IPL x 56Gb B27 + B2J or B2K B28 + BD or B hoice of abling 0Gb / DR abling Length Description 0.5m 0Gb / DR opper able QSP B0 1m 0Gb / DR opper able QSP B1 2m 0Gb / DR opper able QSP B2 3m 0Gb / DR Optical able QSP BA 5m 0Gb / DR Optical able QSP BB 10m 0Gb / DR Optical able QSP B 15m 0Gb / DR Optical able QSP BD 20m 0Gb / DR Optical able QSP B 30m 0Gb / DR Optical able QSP B 50m 0Gb / DR Optical able QSP BG Spine 6x 0 Gb Link per Spine 6 x 0 Gb Link per Spine 8831-S8 8x 10Gb + 12x 0Gb Leaf 10 Gb lient 8x 10 Gb ndpoints per Leaf OR INRNAL US ONLY cannot be posted online or reproduced without ellanox consent 1-ar-17 v7

21 IB ellanox Infrastructure for SS/Spectrum Scale Some Guidelines Bandwidth 10Gb = ~800B/s Both ports can be used and will provide ~1.6GB per ard 0Gb = ~ 3.2GB/s Both ports can be used and will provide ~.3GB per ard, ax Bandwidth per adapter is ~52Gb/.3GB DR (56Gb) = ~5.6GB/s Both ports can be used and will provide ~11.2GB per ard, ore cards will provide redundancy and more access to disk up to maximum disk i/o capacity DR (100Gb) = ~10GB/s 2 Ports per Node will exceed Disk i/o capacity, third provides redundancy One port active per ard ax Bandwidth per adapter is 100Gb/10GB Load Balancing P/IP Aggregated Links Recommended number of adapters in aggregation for IP traffic = WO (2) Reason as there are only two IP addresses on the SS, hashing algorithms will only hash to max of two adapters. If more than 800B/s per client / server is required for R/W then use 0Gb instead of 10Gb. Load Balancing in Infiniband Infiniband has no issue and can Hash across all ports. Ro oday supports only one active port. (Work under way to make Active/Active on one card will see PU SYS time reduction, so more application PU will see PU SYS time reduction and throughput improvement Storage onnection o ensure that all nodes have same distance to/from storage the best recommendation is a storage and management switch with no nodes on it. Best option storage only option is 12 Port 0Gb/56Gb/DR or 16 Port 10/25/0/50/100 Gb with 7x 0Gbe Ports down and 5 56Gb ports up. 6x DR ports up and down, with S connected to other switches 8x 100Gb ports up and down. his today can be sourced via ellanox BP and Distributors. he available e-onfig option is use of N2 / 36 / 36 switches with only management nodes and storage nodes on them. OR INRNAL US ONLY cannot be posted online or reproduced without ellanox consent 1-ar-17 v7