EMC ScaleIO In The Enterprise: The Citi Experience. Tamir Segal Head of ScaleIO Marketing Eliot A. Wilson Senior Engineer, Citi

EMC ScaleIO In The Enterprise: The Citi Experience Tamir Segal Head of ScaleIO Marketing Eliot A. Wilson Senior Engineer, Citi

EMC ScaleIO In The Enterprise: The Citi Experience Agenda: ScaleIO Overview Citi Storage Strategy Current Deployment Innovation to Maturation Performance 2 2017 Citigroup Inc. All rights reserved. Not to be distributed or reproduced.

ScaleIO Overview

Today s pace is faster. Data growth is rapid. Multiple Tier 1 Workloads IaaS / Private Cloud DevOps 4 Copyright 2017 Dell Inc.

CapEx and Capacity is Just The Tip of The Iceberg $ $ $ $ $ $ $ $ Capex Capacity S.S STORAGE Storage planning Procurement Deployment Ongoing Operations Migration planning Migrations 5 Copyright 2017 Dell Inc.

Virtualization Introduced a Key Concept Abstract, Pool and Automate 2001 (VMware) Compute Pool Storage Pool????? SDS 6 Copyright 2017 Dell Inc.

ScaleIO brings the power of SDS to data centers Software-defined storage which applies the principles of server virtualization to standard x86 server storage creating a flexible, scalable, enterprise-class block storage solution. Abstract Pool Automate Abstracts the local storage out of each server, including HDD, SDD and All-Flash Pools all of the storage resources together, leaving no resources stranded Automatically allocates and balances resources based upon each application s need 7 Copyright 2017 Dell Inc.

ScaleIO Abstract Pool Automate 100K IOPS 10 TB 100K IOPS 10 TB 100K IOPS 10 TB 100K IOPS 10 TB 100K IOPS 10 TB 100K IOPS 10 TB 100K IOPS 10 TB 100K IOPS 10 TB 100K IOPS 10 TB 100K IOPS 10 TB 10 TB 100K IOPS 30 TB 50K IOPS 4 TB 20K IOPS 2 TB 35K IOPS 1 TB 4K IOPS 17 TB 20K IOPS 5 TB 10K IOPS 10 TB 10K IOPS 2 TB 8K IOPS 5 TB 5K IOPS 1 ScaleIO abstracts the local storage out of each server, including HDDs, SSDs and all-flash 3 Automatically allocates and balances resources based upon each application s need 2 ScaleIO pools all of the storage resources together, leaving no resources stranded 1,000,000 IOPS 100 TB 8 Copyright 2017 Dell Inc.

Change how you build your Data Center with ScaleIO Standardize your infrastructure with these building blocks Software-Defined Storage Standard x86 Hardware Software Ethernet Network Escape the cycle of complexity. Begin operating with ruthless efficiency. 9 Copyright 2017 Dell Inc.

Available by End of Year.next Data Center Grade Software-Defined Storage 10 10 Copyright 2017 Dell Inc. Copyright 2017 Dell Inc. New Data Services! Inline Compression, Snapshot enhancements, data mobility NVMe Support! ScaleIO Ready Node Models Based on Dell PowerEdge 14G, ScaleIO Ready Node management enhancements Enhanced VMware Integration Full VMware vvols support

The Citi Experience Information Classification: Public 2017 Citigroup Inc. All rights reserved. Not to be distributed or reproduced.

Citi Storage Strategy - Objectives Transition from vendor provided hardware appliances to software defined storage (SDS) on commodity off the shelf (COTS) Reduction in CapEx and OpEx by leveraging COTS hardware Time-to-market improvements with automation and a DevOps model SDS for file, object, and block will provide the building blocks of higher level data services such as IaaS, PaaS, CaaS, DBaaS, Big Data Analytics, Data Lake, etc 12 2017 Citigroup Inc. All rights reserved. Not to be distributed or reproduced.

Citi Storage Strategy Our Customer Benefits Lower Costs CapEx and OpEx savings translate to lower chargeback rates incentivizing adoption of new technology Robust and Compliant Solutions Proven end to end stack adhering to Citi security requirements Faster Time-to-Market and Improved Agility Innovative, Best-in-Class Solutions 13 2017 Citigroup Inc. All rights reserved. Not to be distributed or reproduced.

Current Deployment Global ScaleIO deployment across a several datacenters Deployed for Citi Private Cloud Disaggregated Model Scale of Current Deployment: Total Capacity > 20 PB ScaleIO Clusters > 15 ScaleIO Nodes > 1300 14 2017 Citigroup Inc. All rights reserved. Not to be distributed or reproduced.

Timeline of ScaleIO at Citi 2013-2014 ScaleIO evaluation and lab testing started Network Designs Evaluated Software enhancements 2015 First datacenter deployment for dev cloud Hardware Design with SSD, SAS, and NL-SAS Tiers 2016 Expanded to non-critical applications and DBaaS 3 rd Generation Hardware Design with Increased Density Security Enhancements Cluster Expansions 2017 All Flash Design 4 th Generation Hardware Design with Increased Density Two SSD Tiers 15 2017 Citigroup Inc. All rights reserved. Not to be distributed or reproduced.

Key Enablers for Our Deployment Executive Sponsor Innovation requires vision and faith Network a reliable and elastic fabric A Robust Commodity Hardware Platform Plan for strong component integration testing Nothing just works Strong Partnership with Storage Software Vendor 16 2017 Citigroup Inc. All rights reserved. Not to be distributed or reproduced.

Network Citi s Leaf Spine Ethernet Fabric Elastic network allows for scale-out while maintaining the same number of hops between all nodes Arista 10Gb ToR switches are dedicated for storage connectivity while spine switches are shared Design for minimal network contention and packet-loss to ensure high performance of block storage traffic, not your regular Ethernet network Well planned IP addressing and subnetting will simplify static route configuration needed for storage networking A reliable network is key to ensure your storage is highly available 17 2017 Citigroup Inc. All rights reserved. Not to be distributed or reproduced.

Network Citi s ScaleIO Networking NIC ports and ToR switches dedicated for storage network Dual, independent paths for resilience Segregation of frontend (client) and backend (backplane) traffic Jumbo frames 18 2017 Citigroup Inc. All rights reserved. Not to be distributed or reproduced.

Hardware Citi s Rack Scale Platform A scalable hardware platform composed of COTS x86 servers/disks capable of running a variety of different SDS solutions if necessary Deployed in pods consisting of multiple compute and storage building blocks (multiple racks) At a minimum a pod consists of one compute block and one storage block Compute and storage can scale separately as needed Well defined compute and storage blocks can be sourced from multiple vendors and rapidly deployed 19 2017 Citigroup Inc. All rights reserved. Not to be distributed or reproduced.

Hardware Disaggregated Compute and Storage 2-layer model Primarily to provide independent scaling of compute and storage resources as well as management independence (avoiding green zone conflicts) Converged models may be used for engineered solutions for specific well-defined use cases 20 2017 Citigroup Inc. All rights reserved. Not to be distributed or reproduced.

ScaleIO Layout MDM and Tie-Breaker Placement Each rack in a pod is completely independent of each other. However, in order to make sure there is no Single-Point-of-Failure, the ScaleIO metadata managers (MDMs) and Tie-Breakers(TBs) are configured on the rack nodes as shown below. TBs are moved to new storage racks when a pod is expanded. 21 2017 Citigroup Inc. All rights 1. Text reserved. for footnote Not to goes be distributed here. or reproduced.

ScaleIO Layout Fault Sets A Fault Set is a logical entity that contains a group of SDSs within a Protection Domain that have a higher probability of failing as a single unit; for example if they are all located in the same rack. ScaleIO creates two copies of stored data and each copy is placed in a different fault set. When ScaleIO is configured on the storage block, each of the racks (and all the SDS nodes in that rack) is its own fault set. 22 2017 Citigroup Inc. All rights 1. Text reserved. for footnote Not to goes be distributed here. or reproduced.

ScaleIO Layout Pools The 4 th generation T4 design uses the following pool layout: 2 High Performance Pools using 8 write-intensive SSDs from 27 Performance Nodes 3 General Purpose Pools using 24 read-intensive SSDs from 12 General Purpose Nodes We also have a variant with 1 fewer pool of each type for deployments with lower capacity requirements 23 2017 Citigroup Inc. All rights 1. Text reserved. for footnote Not to goes be distributed here. or reproduced.

ScaleIO Clients Supported Configurations at Citi Only ESXi, Windows Server, and RHEL clients are supported Proprietary software (SDC) must be installed on each client node but it provides benefits: Eliminates some scaling limits with standard protocols (e.g. iscsi path limits, SCSI device limits) Provides data location awareness to clients enabling parallelism and improved load balancing 24 2017 Citigroup Inc. All rights reserved. Not to be distributed or reproduced.

ScaleIO Use Cases at Citi Example use cases: Cloud Applications - Windows and RHEL VMs (ESXi) Mongo-as-a-Service - hosted on ESXi Oracle-as-a-Service - RHEL physical hosts SAN Replacement Windows and RHEL physical hosts Netbackup Target (NL-SAS tiers) Splunk Analytics hosted on ESXi Virtual Desktop Infrastructure (VDI) hosted on ESXi Backend storage for File SDS (IBM Spectrum Scale) 25 2017 Citigroup Inc. All rights 1. Text reserved. for footnote Not to goes be distributed here. or reproduced.

Citi Storage Tier Evolution 26 2017 Citigroup Inc. All rights 1. Text reserved. for footnote Not to goes be distributed here. or reproduced.

Innovation to Maturation An innovative SDS solution is now a reality at Citi with ScaleIO and we re continuing our partnership with EMC to help mature the product to be fully enterprise class and automated. Key features, enhancements, and our future objectives include: Hardware Independent Support for both converged and disaggregated models Resilience and Serviceability Enterprise-level Security Enhancements in 2.0 Robust self-healing and self-managing Persistent CRC to detect and correct silent data corruption.next Integration with scale-out management standards like redfish to improve hardware awareness (e.g. self-discovery, automatic fault set configuration) Citi Ask 27 2017 Citigroup Inc. All rights reserved. Not to be distributed or reproduced.

Innovation to Maturation More IP Networking Support For both client access and backend connectivity Support for dual independent networks on front and back end Scalability Performance Very good load balancing across nodes and paths QoS Throttles for maximum IOPS and throughput Enhancements for bursting based on system load Citi Ask Data Efficiency with Compression/Dedup -.Next/Citi Ask ESXi vvol Support and enhanced snapshots.next 28 2017 Citigroup Inc. All rights reserved. Not to be distributed or reproduced.

Innovation to Maturation Even More Management Interfaces Improved reporting of thin provisioning and over-commitment Citi Ask Enhanced reporting to add service time metrics and historical Citi Ask Multi-cluster management Citi Ask Citi to leverage automated provisioning with ScaleIO REST API in 2017 Citi use of API for installation automation with Chef in 2017 Tech refresh via in-situ rolling upgrade rather than fork-lift ScaleIO Client in ESXi kernel Integration with VUM update manager -.Next Data Mobility between Pools and Protection Domains -.Next 29 2017 Citigroup Inc. All rights reserved. Not to be distributed or reproduced.

Performance Information Classification: Public 2017 Citigroup Inc. All rights reserved. Not to be distributed or reproduced.

Example of Performance Each generation of our hardware platform has increased density and performance 4KB IOPS OLTP2HW IOPS 20,000,000 8,000,000 15,000,000 6,000,000 10,000,000 4,000,000 5,000,000 2,000,000 0 0 T2 T3 T4 T2 T3 T4 31 2017 Citigroup Inc. All rights 1. Text reserved. for footnote Not to goes be distributed here. or reproduced.

Example of Rebuild Performance Pool Capacity (TB) 500 450 400 350 300 250 200 150 100 50 0 Rebuild Time After Node Loss T3 NL-SAS T3 SAS T3 SSD T4 GPF T4 HPF 420 360 300 240 180 120 60 0 Rebuild Time (minutes) Pool Capacity Rebuild Time 32 2017 Citigroup Inc. All rights reserved. Not to be distributed or reproduced.

Summary Software Defined Storage is available today SDS is providing hardware independence, cost benefits, and faster time to market Further maturation will make them easier to install, maintain, and migrate to All flash solutions are at the cross over point to be cost competitive with spinning disk 33 Copyright 2017 Dell Inc.

ScaleIO SDS allows enterprises to operate like web scalers w/ruthless efficiency Software automation Standard x86 servers & Ethernet Minimal variation of components Rolling upgrades, no data migration 34 Copyright 2017 Dell Inc.

Want More ScaleIO? EMC ScaleIO In The Enterprise: The Citi Experience (storage.28) 35 Monday @ 3:00 PM; Tuesday @ 8:30 AM ScaleIO: Architecture Deep Dive (storage.29) Monday @ 3:00 PM; Thursday @ 1:00 PM ScaleIO: Architecting For Availability, Performance & Networking With ScaleIO (storage.30) Monday @ 1:30 PM; Thursday @ 10:00 AM ScaleIO: Simplying OpenStack With ScaleIO Software Defined Storage (storage.32) Monday @ 08:30 AM ScaleIO & vsan: Software-Defined Storage - The Revolution is Here! (storage.33) Monday @ 12:00 PM; Wednesday @ 12:00 PM ScaleIO: Customer Panel: How Is Software Defined Storage Helping My Data Center? (storage.34) Monday @ 4:30 PM; Wednesday @ 3:00 PM ScaleIO: Software-Defined Storage Lifecycle Management Viewed Through Demos (storage.36) Copyright 2017 Dell Inc. Monday @ 8:30 AM; Thursday @ 8:30 AM Try our Hands-on-Labs Build A 100-Node ScaleIO SDS Cluster In Minutes! Operations & Lifecycle Management Of Dell EMC ScaleIO Software Defined Storage Use REX-Ray & ScaleIO With Docker, Mesos & Kubernetes (Hands-on Lab) Visit us in Booth! #757

Learn More Join the ECN ScaleIO Product Community Follow Us on Twitter @DellEMCStorage VISIT www.dellemc.com/scaleio AND www.dellemc.com/vxrack where you ll have access to whitepapers, videos, demos etc. DOWNLOAD Free & Frictionless version of ScaleIO Reach out to your local sales team! 36 Copyright 2017 Dell Inc.

Want to win a Levitating Death Star Speaker? Follow @DellEMCStorage while at Dell EMC World 2 Winners will be chosen daily from Monday May 8 through Thursday May 11 All winners will be notified through Twitter Direct Message NO PURCHASE NECESSARY. Ends 05/11/2017. To enter and for Official Rules, visit http://thecoreblog.emc.com/dell-emc-world-follow-win-sweepstakes-2017/ 37 Copyright 2017 Dell Inc.