Cisco Hyper Converged Infrastructure - Hyperflex

Transcription

1 Cisco Hyper Converged Infrastructure - Hyperflex Silvo Lipovšek Sistemski inženir Cisco

2 Infrastructure Landscape

3

4 ASAP Data Center and Cloud Architecture Software and Orchestration SDN UCS Director Cisco CloudCenter Cisco Prime Services Catalog Hardware Platforms NEXUS Networking UCS Compute Best of Breed Solutions MDS 9000 Storage ASA 5000 NGFW Security Converged Infrastructure HyperFlex Hyper-Converged Infrastructure

5 Hyper Flex

6 Software Modules Inside a Server DATASTORE/VOLUME IO Visor VAAI sthyp HDD HDD SDD SDD SSD SSD SSD SSD Controller Has Direct Control of Drives IO Visor Module Presents NFS to ESX and Stripes IO VAAI Plugin Offloads Snapshots and Clone Operations sthypervisorsvc Coordinates Native Recovery Snapshots and Replication

7 Hyperconverged Scale Out and Distributed File System HYPERCONVERGED HYPERCONVERGED DATA PLATFORM HYPERCONVERGED DATA PLATFORM HYPERCONVERGED DATA PLATFORM DATA PLATFORM Start with As Few As Three Nodes Hyperconverged Data Platform Installs in Minutes Network Fabric Policy Configures QoS Settings Add Servers, One or More at a Time Distribute and Rebalance Data Across Servers Automatically Retire Older Servers

8 Building on the Right Foundation Cisco HX Data Platform Unique Architecture Distributed File system Local FS Local FS Local FS Local FS Built From the Ground Up for Hyperconvergence Distributed Log- Structured File System Designed for Scale-out, Distributed Storage Advanced Data Services (Snapshots, Clones) and Data Optimization (Inline Dedupe, Compression) Without Trade-offs Better Flash Endurance and Disk Performance Computing, Storage, Networking, and Hypervisor Integration Eliminates Management Silos

9 Dynamic Data Distribution Systems built on conventional file systems write locally, then replicate, creating performance hotspots HX Data Platform stripes data across all nodes simultaneously, leveraging cache across all SSDs for fast writes Balanced space utilization: no data migration required following a migration HX HX Data Platform

10 Capacity and Network Utilization HX balances space utilization: no data migration required following a migration DATASTORE Balanced Space Utilization No Data Migration on Migration Less Stress on Network

11 High Resiliency, Fast Recovery Platform can sustain simultaneous 2 node failure without data loss; replication factor is tunable If a node fails, the evacuated s re-attach with no data movement required Replacement node automatically configured via UCS Service Profile HX Data Platform automatically redistributes data to node HX Data Platform HX Data Platform

12 Data Protection and High Availability Data Protected by Replication of Data Across the Cluster Nodes Replication Factor 3 (RF3) Default and Recommended is Replication Factor = 3 Every block is written to 3 different nodes in the cluster Write IO Higher availability to survive multi-point failures; Higher device protection Reduces raw disk capacity to 33% x1 Replicate x2 x3 Replication Factor 3 or 4 Node Cluster 5+ Node Cluster 3 *drives across different nodes Simultaneous Failures Supported: 1 node / 2 drives* Simultaneous Failures Supported: 2 nodes / 2 drives*

13 Independent Scaling of Compute and Capacity Scale Compute- Only Racks Scale Compute-Only Blades HX Data Platform HX Data Platform HX Data Platform Non- HyperFlex Hosts Can Connect to Storage with Scale Cache or Capacity Within Nodes Add Nodes

14 Supporting External Storage Connectivity HX Converged node supports mounting external storage arrays via NFS, iscsi, FC, FCoE : Storage array must be on Cisco HCL migration and data transfer Co-existence with Existing SAN environment Present RDM from FC SAN to s Use ware storage vmotion for migrations over Ethernet Use for backup and other application support All Direct Connect modes Except FC direct connect. (NFS, iscsi with Appliance ports) HX Datastore is not exportable outside the HX cluster HX UCS Domain HX DATASTORE iscsi/nfs or FC Storage Volume* NFS/iSCSI FC

15 Data Distribution and Non-Disruptive Operations DATASTORE DATASTORE File.vmdk A B C D E A 1 B 2 C 2 D 3 E 1 B 1 A 2 C 3 E 3 D 1 C 1 A 3 D 2 E 2 B 3 D 1 E 1 B 3 Stripes blocks of virtual disk files across servers using a hashing algorithm Replicate one or two additional copies to other servers Handle entire server or disk failures Restore back to original number of copies Rebalance s and data post replacement Rolling one-click software upgrades

16 Native Clones for Rapid Provisioning Pointer-Based Writeable Snapshots (Instantaneous Clones) VAAI integrated -level granularity Batch creation GUI Apply unique names Use customization spec to apply IP Powerful tool to rapidly setup a large set of s using just VC (without scripting or View composer); Up to 256 clones in parallel per job Golden/Base can be a template, powered on or powered off

17 Real Innovation Independent Scaling of Compute and Capacity Dynamic Data Distribution #$% &/= Continuous Data Optimization Integrated Management and Data Services

18

19 Usable Cluster Capacity (TB) - HX M5 Nodes RF3 HX220c M5 HX240c M5 HXAF220 M5 HXAF240 M5 3 Nodes 4 Nodes 5 Nodes 6 Nodes 7 Nodes 8 Nodes 16 Nodes Edge w/ RF Edge w/ RF TB 1.8TB 1.2TB 1.8TB 960G 3.84TB 960G 3.84TB Notes: For max capacity, assume Full SSD/HDD population (23 on HXAF240) and assume RF3. HX Edge Capacity is using RF2 and can be configured with 3 drives or 6. The above calculations are before deduplication & compression. Effective capacity will be higher. Additional capacity headroom recommended. Consult your Cisco CSE for the latest sizing & design guidance.

20 ware vcenter Plug-In Extends virtualization management seamlessly No switching between management consoles View storage alerts/alarms alongside with ESX alerts/alarms Command line interface for automation

21 Native HyperFlex Connect HTML5 GUI

22 REST APIs Well-documented syntax and examples with REST API explorer Secure token based access with RBAC and auditing Eco-system: UCS Mgmt., Services (CMS), 3 rd party (Veeam, etc.) Expanded coverage by adding AAA, Encryption, Data Protection, Support, and Performance APIs Accessed Via: API example

23 Disk Options Self Encrypting Disk (SED) Used for write caching disk and capacity disks Disk hardware encrypts all data written to the device Can use UCSM derived local encryption keys, or keys from a centralized KMS via KMIP Secure erase, re-key Non-Volatile Memory Express (Ne) Replaces SAS write caching disk More efficient streamlined protocol Uses PCI-Express instead of legacy serial bus Multi-queue, more commands per queue, high parallelism Higher performance, lower latency

24 Intel Optane Support HX 3.0 I N T E L O P T A N E S U P P O R T Intel Optane SSD DC P4800X Series (Formerly known as Cold Stream) (Specs) Caching drive option available with HX 3.0 Available on M5 only All Flash only configurations Part number: HX-NEXP-I G drive capacity, 3D XPoint Advantages: Higher Endurance: 20.5PBW (~ 30DWPD) Higher drive level performance

25 Comparison of Hybrid Options SMALL FORM FACTOR (SFF) LARGE FORM FACTOR (LFF) P E R F O R M A N C E O P T I M I Z E D Drive options 1.2TB, 1.8TB Krpm SAS Max Capacity (per node) Cost Capacity ($/GB)Multiple Performance Features 37.7TiB raw (11.5TiB usable) 1X Better Parity C A P A C I T Y O P T I M I Z E D Drive options 6TB, 8TB Krpm Max Capacity (per node) Cost Capacity ($/GB) Multiple Performance Features 87.3TiB raw (26.8TiB usable) < 0.5X Lower Parity

26 HX Replication Overview Use Case: Replication for Disaster Recovery Primary Secondary New in 2.6 Support for All- Flash to Hybrid Replication for DR Supported Configuration Point-to-Point (1-to-1) Replication Different number of Cluster nodes on each site Replicate between HX220 and HX240 Clusters (New in 2.6) Replicate between Hybrid and All Flash clusters 1 2 WAN 1. Replicate 2. Bi-directional Underlying Technology 1 2 Snapshot based, Periodic Replication Scale-out, performant, reliable and network optimized Centric Replication Single PIT (latest) image for Recovery Flexible RPO of 15mins to 24 hours HTML 5 based, REST API & CLI based operations and monitoring Disaster Recovery Recover from the latest Snapshot copy Supports planned and unplanned recovery Active Active and Active-Passive DR via bi-directional replication Enabled to integrate with 3 rd party DR orchestration products

27 HyperFlex Stretched Cluster Cloud Scale Data Platform HX 3.0 Power Mission Critical Apps with Disaster Avoidance Maximum Uptime Zero RPO Automated DR DB APP APP DB HX Data Platform Synchronous Replication Site-A Site-B SSD SSD SSD SSD SSD SSD

28 HyperFlex Stretched Cluster ZERO RPO! NEAR ZERO RTO! HX 3.0 Witness Server 3 rd site Site-B Configuration Support Single Stretched Cluster across 2 sites Symmetric Configuration Site to host a Witness Server (small ) 8 HX nodes on each site Management Cross site Cluster creation Non disruptive online rolling upgrade Site awareness in HX Connect Site specific Alarm and Events on a single Dashboard IO Path Active-Active sites s Active on each site Read IOs served locally Write IOs Sync-Writes across sites 2x copies on each site HA Operations Recover from a Site failure Recover from a Local failure Failover of vmotion of Split Brain handling Site-A

29 64 Node Scale with Resiliency Cloud Scale Data Platform HX Node & Capacity Scalability Automated Availability Zones Up to 32 HX nodes Up to 32 compute nodes Availability Grp 1 Availability Grp 2 Availability Grp 3

30 Logical Availability Zones (LAZ) HX 3.0 Cluster Scale With High Availability Increased resiliency without added manageability overhead H X D A T A P L A T F O R M How does it work? HX nodes grouped into logical availability groups (N/A for compute nodes) HXDP never places 2 copies of the data in the same availability group Clusters with LAZ can survive > 2 simultaneous node failures without data loss or loss of availability Availability Grp 1 Availability Grp 2 Availability Grp 3 Tolerate more independent failures

31 LAZ Failure Scenario Cluster State: Offline Online LAZ: Off

32 Zone 05 Zone 04 Zone 03 Zone 02 Zone 01 LAZ Failure Scenario Cluster State: Offline Online LAZ: On

33 Veeam Backup & Replication HX Data Platform Fabric Interconnect LAN/SAN frontend Fabric Interconnect LAN/SAN frontend Backups and restores via a Veeam proxy CBT aware, compressed and deduped backups Cluster to Cluster replication for disaster recovery Full, file and item level recovery WAN acceleration, replica traffic encryption and throttling Recover Time & Point Objectives < 15 for apps and data

34 Purpose built Management Tools Operations Automation / Orchestration Multi-Site Remote / Branch / Edge Performance Hyperconverged

35 One Interface, One API Cisco Intersight

36 HX Tools HX Sizer End to End Sizing Includes compute (CPU & Memory), Storage performance and capacity Application templates to aid application based sizing HX Workload Profiler OVA deployed in existing environments Quantify usage for sizing Integration with sizer to automate end to end sizing of environments HXBench OVA with benchmarking built on vdbench Benchmarking made easy Follows industry standard benchmarking practices for a realistic readout

37 Cisco HX Bench User Interface 37

38 IOPs Benchmark 1 Performance Results Using Vdbench Tests 8K 100% Sequential Write Workload ,61 Maximum Sequential Write IOPs ,35 Latency , , GbE GbE 2.6 M5 20,00 18,00 16,00 14,00 12,00 10,00 8,00 6,00 4,00 2,00 0,00 Latency Target Write Latency < 10ms 16 OIO Per Disk 27% Latency Reduction and IOPs Gain with 40 GbE 6% Latency Reduction and IOPs Gain on Ne 8% Latency Reduction and IOPs Gain with HX 2.6 on M5 38

39 IOPs Benchmark 2 Performance Results Using Vdbench Tests 8K 100% Random Read Workload Maximum Random Read IOPs ,26 4,93 Latency ,00 3, GbE GbE 2.6 M5 20,00 18,00 16,00 14,00 12,00 10,00 8,00 6,00 4,00 2,00 0,00 Latency Target Read Latency < 5ms 32 OIO Per Disk 7% Latency Reduction and IOPs Gain with 40 GbE 23% Latency Reduction and IOPs Gain on Ne 3% Latency Reduction and IOPs Gain with HX 2.6 on M5 39

40 Benchmark 3 Performance Results Using Vdbench Tests 100% Random 70/30% R/W with Varying Block Sizes 4K 8K 16K 64K 256K IOPs R Latency W Latency IOPs R Latency W Latency IOPs R Latency W Latency IOPs R Latency W Latency IOPs R Latency W Latency , , , , , GbE 152, , , , , GbE 161, , , , , M5 180, , , , , Target Read Latency < 5ms and Write Latency < 10ms for 4-16K blocks 8 OIO Per Disk ~6% Latency Reduction and IOPs Gain with 40 GbE at 4-8K, % Gains for Larger Blocks 10-22% Latency Reductions and IOPs Gains with HyperFlex 2.5 and Ne Caching Disks 3-11% Latency Reductions and IOPs Gains with HyperFlex 2.6 on M5 Generation Servers 40

41 Benchmark 4 Performance Results Using Vdbench Tests 8K 100% Random 70/30% R/W IOPs Curve 100% 20% 40% 60% 80% IOPs IOPs STDV Avg Latency IOPs IOPs STDV Avg Latency IOPs IOPs STDV Avg Latency IOPs IOPs STDV Avg Latency IOPs IOPs STDV Avg Latency , % , % , % , % , % GbE 151, % , % , % , % , % GbE 169, % , % , % , % , % M5 173, % , % , % , % , % 2.38 Curve test measures IOPs stability by calculating the standard deviation of IOPs as a percentage of the final average result, at various performance levels, starting with a 100% unthrottled test, then again at a percentage of that maximum Maximum speed, unthrottled tests will always have more variability due to more aggressive background tasks 20% through 60% values are typically very low because the system is not being pushed very hard 65% improvement in IOPs stability with 40 GbE at 80% of maximum HX 2.5 shows a further 78% improvement HX 2.5 also shows a 54% improvement of IOPs stability in the 100% unthrottled test HX 2.6 on M5 generation servers shows improvements in all tests, including 28% at 100%, and 45% at 80% 41

42 Benchmark 5 Performance Results Using Vdbench Tests I/O Blender 100% Random 70/30% R/W IOPs Curve 100% 20% 40% 60% 80% IOPs IOPs STDV Avg Latency IOPs IOPs STDV Avg Latency IOPs IOPs STDV Avg Latency IOPs IOPs STDV Avg Latency IOPs IOPs STDV Avg Latency , % , % , % , % , % GbE 114, % , % , % , % , % GbE 137, % , % , % , % , % M5 137, % , % , % , % , % 2.89 Test measures IOPs stability by calculating the standard deviation of IOPs as a percentage of the final average result, at various performance levels, starting with a 100% unthrottled test, then again at a percentage of that maximum Block Size Mix: 4K 40%, 8K 40%,16K 10%, 64K 10% 20% through 60% values are typically very low because the system is not being pushed very hard 30% improvement in IOPs stability with 40 GbE at 80% of maximum, HX 2.5 shows a further 84% improvement HX 2.5 also shows a 39% improvement of IOPs stability in the 100% unthrottled test HX 2.6 on M5 generation servers shows improvements in all tests, including 11% at 100%, and 20% at 80% 42

43 Per Test Results Variation IOPS in a 70/30 Workload 1 Hour Duration HX Vendor Y Intervals Intervals

44 HyperFlex Performance Testing Findings 3x Higher Density 3x Better TCO 3x Reduced Read/Write Latency More Workloads on Hyperconverged 7:1 Reduced IOPS Variability Predictable End-User Experience Read the full ESG report: cisco.com/go/hyperflex

45 IOPS IOPS HyperFlex All-Flash Performance Consistency Each dot represents a Virtual Machine and its average IOPS over an hour of load Cisco HyperFlex IOPS per 1200 Vendor B IOPS per Consistent Performance for All s on the Cluster Wildly Inconsistent Performance Across the Cluster

46 HyperFlex Solutions / Workloads Portfolio WORKLOADS / APPLICATIONS INTEGRATION / INTEROP Citrix XenDesktop Ware Horizon Oracle Single Instance Cisco UC Veeam Commvault VSI on HX MS SQL SAP (Non Prod / Prod) ACI Cloud Center UCSD Oracle RAC Splunk MS Exchange N1K 3 rd Party Arrays NVIDIA Cisco HyperFlex: HX Data Platform Data Services and Storage Optimization HX Tools (for sizing) Resources: HX homepage (external) Current

47

48