Isilon Scale Out NAS. Morten Petersen, Senior Systems Engineer, Isilon Division

Size: px

Start display at page:

Download "Isilon Scale Out NAS. Morten Petersen, Senior Systems Engineer, Isilon Division"

Gervase Brown
5 years ago
Views:

1 Isilon Scale Out NAS Morten Petersen, Senior Systems Engineer, Isilon Division 1

2 Agenda Architecture Overview Next Generation Hardware Performance Caching Performance SMB 3 - MultiChannel 2

3 OneFS Architecture Overview 3

4 Scale-Up NOT for Big Data Not Scalable, Not Efficient, Not Right for Big Data Islands of storage Not scalable Performance bottlenecks Not highly available Massive complexity Cost prohibitive Servers Servers Servers Storage Device #1 Storage Device #2 Storage Device #3 4

5 Isilon Scale-Out NAS Optimized for the Storage of BIG data Servers Servers NFS, CIFS, FTP, HTTP Servers Servers Storage Device #1 Storage Device #2 Servers Servers Storage Device #3 5

<1FTE Business agility Investment protection Other Multiple RAID, volumes, file systems Single

6 Simplicity Management & Economics File Systems Volumes Isilon Other Aggregates (~16TB) RAID Management Economics Isilon 1 volume, 1 file system Single volume up to 20PB 80%+ utilization, <1FTE Business agility Investment protection Other Multiple RAID, volumes, file systems Single volume up 100TB (16TB typical) 57% utilization, Multiple FTE s Silos, limitations Controller swaps and relicensing 6

7 Isilon s Scale-out NAS Storage Solution Expandable 6TB (3 nodes) to >20 PB single file system (144 nodes) Sequential I/O performance= 200 GB/sec Maximum NFS I/O operations/sec = 3.75M NFS IOPs 7

8 OneFS Network Architecture Servers Servers Servers Client/Application Layer Standard 1GbE / 10GbE layer Isilon IQ Storage Layer IB for Intracluster Communication 8

performance Isilon Scale-Out NAS Product Family S200 X400 Purpose-built for transactional & IOPS-intensive workloads X200 A flexible solution to accelerate high-concurrent and sequential

9 performance Isilon Scale-Out NAS Product Family S200 X400 Purpose-built for transactional & IOPS-intensive workloads X200 A flexible solution to accelerate high-concurrent and sequential throughput workloads A slimmer solution costoptimized for performance NL400 Near-Linear Scaling of Performance and Capacity Purpose-built for cost-effective, high capacity storage capacity 9

10 EFFICIENCY Isilon Simplicity and Ease of Use Single volume and file system that spans nodes Directories and files striped across the cluster Automation: NO manual intervention NO reconfiguration NO server or client mount point or application changes NO data migrations NO RAID 10

11 Largest and Most Scalable File System More scalable than traditional storage systems OneFS scales from 18 TB to 20 PB in a single file system, single volume Under 1 min to scale with no downtime 11

12 Comprehensive Enterprise Software DATA PROTECTION SnapshotIQ Fast, efficient data backup and recovery SyncIQ Fast and flexible asynchronous replication for disaster recovery protection SmartConnect Policy-based client failover with load balancing SmartLock Policy-based WORM data protection DATA MANAGEMENT SmartPools Policy-based automated tiering SmartQuotas Quota management and thin provisioning InsightIQ Performance monitoring and reporting to manage storage resources Isilon for vcenter VMware integrated management features 12

complexity, and risks for scaling storage AutoBalance automatically moves content to new storage nodes

13 Gain New Levels of Efficiency Isilon AutoBalance BALANCED EMPTY FULL BALANCED EMPTY FULL BALANCED EMPTY FULL BALANCED EMPTY FULL BALANCED EMPTY AutoBalance Automated data balancing across nodes reduces costs, complexity, and risks for scaling storage AutoBalance automatically moves content to new storage nodes while system is online and in production Eliminates hot spots Enables unmatched storage utilization of more than 80% 13

NO application changes Optimize storage resources Automatically match storage resources with data requirements

14 Optimize Resources with Automated Tiering Isilon SmartPools Single point of management Single file system/single volume Multiple performance tiers Automatic data movement Policy-based tiering management Transparent reallocation NO application changes Optimize storage resources Automatically match storage resources with data requirements Eliminate data migration Files Reduced cost/tb S-Series Performance X-Series Collaboration NL-Series Active archives 14

15 Next Generation Hardware 15

2TB each SSD: up to 6 SSDs, 200GB-800GB each Self-encrypted options available Front-end I/O:

16 S210 Next Generation S Series Specifications CPU: dual, 6-core Ivy Bridge Processors RAM: 32GB to 256GB Drives: 24 X 2.5-inch bays HDD: 2.5-inch SAS, 300GB-1.2TB each SSD: up to 6 SSDs, 200GB-800GB each Self-encrypted options available Front-end I/O: 2x1GbE + 2x10GbE Back-end I/O: QDR Infiniband, 1m-100m cabling Chassis Standard 2U enclosure Dual redundant, hot swappable PSUs 16

5-inch SATA, 1/2/3/4TB each SSD: up to 6 SSDs, 400GB/800GB each Self-encrypted options available

17 X410 Next Generation X Series Specifications CPU: dual, 8-Core Ivy Bridge Processors RAM: 32GB to 256GB Drives: 36 X 3.5-inch bays HDD: 3.5-inch SATA, 1/2/3/4TB each SSD: up to 6 SSDs, 400GB/800GB each Self-encrypted options available Front-end I/O: 2x1GbE + 2x10GbE Back-end I/O: QDR Infiniband, 1m-100m cabling Chassis Standard 4U enclosure Dual redundant, hot swappable PSUs (high line only) 17

18 PERFORMANCE CACHING 18

cache on flash. Data on Flash File Data is stored on flash.

19 Cost Flash Uses L3 Metadata Write Stores all metadata on flash for faster writes and reads (new in OneFS 7.1.1) Metadata Read Intelligently Stores some chooses metadata data on and flash for preferred access meta data to cache on flash. Data on Flash File Data is stored on flash. Combined with either Metadata Read or Metadata Write polices GNA Global Name Acceleration adds flash to existing clusters/nodes that otherwise wouldn t have access Performance 19

20 Caching The importance of caching on OneFS OneFS uses extra RAM to cache frequently used file data and internal structures Blocks are cached at multiple layers L1 RAM L2 - RAM L3 - SSD - New in

21 L3 Cache: Functional Overview L3 cache on SSDs, not in RAM Think of it as an extension of L2 cache (just not in RAM) Durable Unlike L2, no cache loss on reboot Reduce expensive random read I/O from HDDs Caches both metadata and user data, unlike other metadata polices 21

22 Performance SMB 3 - MultiChannel 22

Beginning Of SMB 3.0 - MultiChannel 7.1.1 brings the first SMB 3.0 feature to OneFS SMB 3.

bandwidth aggregation Fault tolerant with multiple network paths 3 configurations can

23 Beginning Of SMB MultiChannel brings the first SMB 3.0 feature to OneFS SMB 3.0 client can establish multiple TCP connections to file servers High performance with bandwidth aggregation Fault tolerant with multiple network paths 3 configurations can benefit: Single RSS-capable NIC Multiple NICs Teamed NICs (LACP) Isilon Cluster SMB 3.0 Client 23

24 SMB 3.0 Multi-Channel Requirements Windows 2012/Windows 8 or later OneFS or later Limited to a single node Interfaces must be the same type Still requires the client and application to be smart about requesting and processing data 24

Isilon Performance. Name

Isilon Performance. Name 1 Isilon Performance Name 2 Agenda Architecture Overview Next Generation Hardware Performance Caching Performance Streaming Reads Performance Tuning OneFS Architecture Overview Copyright 2014 EMC Corporation.