Isilon: Raising The Bar On Performance & Archive Use Cases John Har Solutions Product Manager Unstructured Data Storage Team
What we ll cover in this session Isilon Overview Streaming workflows High ops/s workflows Deep archive workflows NOTE: This session covers Isilon H-series and A-series. See session 59 for Isilon F800 (all-flash) use cases. 2
Isilon Overview
Isilon: the true scale-out NAS Single, scalable namespace 18TB to 65PB, 1GB/s to 140GB/s Distributed filesystem across cluster, up to 144 nodes No bottlenecks, no hot spots Easy to manage - No RAID, LUNS or multiple FS to manage Up to 89% efficiency 4
Scalable performance and capacity Performance Capacity BALANCED EMPTY FULL BALANCED EMPTY FULL BALANCED EMPTY FULL BALANCED EMPTY FULL BALANCED EMPTY 5
Transparent, optimized storage tiering Reduce capital expense Optimize storage Transparent to users and applications Flexible admin defined policies Deduplication High Performance tier Storage tier 6
Isilon Data Lake: store once, process anywhere 7
Enterprise grade data protection & management Data protection and security Data management SnapshotIQ Fast, efficient data backup and recovery SmartPools Policy-based automated tiering SyncIQ Fast and flexible asynchronous replication for disaster recovery protection SmartConnect Policy-based client failover with load balancing SmartLock Policy-based compliance and WORM data protection SmartDedupe Data deduplication to reduce storage requirements and costs SmartQuotas Quota management and thin provisioning InsightIQ Performance monitoring and reporting to manage storage resources CloudPools Seamlessly tier cold or frozen data to a choice of public or private cloud options Access Zones Secure separation of data for different groups or users 8
Introducing Isilon s new generation platforms S-Series F800 Aligned with Business and Workload Requirements Performance High Performance Transactional H600 Hybrid Performance H500 Hybrid Throughput X-Series Extreme Performance & Scalability Highly Versatile Throughput H400 Hybrid Balanced NL-Series A200 Nearline Storage Archive Active Archive HD-Series A2000 High Density Deep Deep Archive Archive Capacity 9
New generation architecture Front (without faceplate) Back Drive Sled Future proofed Drive Technology Drive count Performance-Cost optimized CPU Compute Suitcase Memory Cache SSD Dedicated slots Capacity Count 10
The new platforms at a glance Performance (Per Chassis) Capacity Range (Per Chassis) All-Flash Nodes F800 250K ops/s, <1ms 15 GB/s read 96 TB 924 TB Extreme Performance and Scalability Hybrid Nodes H600 H500 H400 120K ops/s 12 GB/s read 5 GB/s read 3 GB/s read 72 TB 144 TB 120 TB 480 TB 120 TB 480 TB Performance, Capacity and Value Archive Nodes A200 A2000 120 TB 480 TB 800 TB Capacity & Economics 11
Streaming Workloads
Streaming image/video workflows everywhere Typical requirements: >1 GB/s sequential read/write GB-TB sized datasets Low, stable latency <2 ms 13
Example: M&E 4K uncompressed workflows Post-production and visual effects workflow 5-100 artists & editors, 5K-10K core render farm 1.2GB/s per 4K uncompressed stream 73GB/min Sometimes cache on clients data management headache INGEST Production shots VFX data VFX NON-LINEAR EDITING COMPOSITING Render farm Render farm Finished shots 14
Solution: work directly off of Isilon H600 and F800 optimized for many 1-2GB/s streams Can edit and create effects directly off of H600 Eliminate dedicated edit storage and data movements INGEST Production shots VFX data VFX NON-LINEAR EDITING COMPOSITING Seamless tiering with archive in same cluster transparent to clients Render farm Render farm Finished shots 15
Isilon Gen-6 delivers outstanding throughput Number of streams per 4U chassis Format MB/s GB/hr H600 H500 Real-world example: Autodesk Flame 4K, 16-bit, 24fps 1211 4257 6 3 HD, 16-bit, 60fps 747 2626 9* 4* HD, 10-bit, 24fps 190 668 60* 24* *estimated Benefits: Up to 16x increase in 4K streams per 4U Up to 10x increase in HD streams per 4U 16
High IOPS Workloads
IOPS-intensive design, distribution, and search Typical requirements: Millions of small temporary files Heavy on creates & deletes Metadata intensive 18
Example: EDA design Intensive, multi-staged chip design process Thousands of files created (checkout) Millions of temp files created Simulation and verification testing Millions of files deleted 10s to 100s of concurrent projects 19
Solution: performance and density with gen-6 F800 or H600 can simplify the performance tier for active design projects H500 / H400 / A200 can be recent projects or DR site A200 / A2000 can provide TBs to PBs of deep archive 20
New generation accelerates your workflows File IOPS per platform 2X improvement in creates & deletes F800 H600 File IOPS 250,000 120,000 IOPS/client, vs. S210 3x 1.5x IOPS/RU, vs. S210 6x 3x seconds TB/RU vs. S210 2x-30x 2.5x Benefits: Same workload shrink your footprint More workload maintain your footprint 21
Deep Archives
You never know when you ll need that again Typical requirements: 10s 100s of PB Online & few seconds latency Moderate read throughput when data needed 23
Example: Population-scale genomics Per million people: 80 PB of whole genome data Variant calling to extract population-scale insights using traditional HPC or newer Hadoop methods Need performant, deep archives 24
Solution: Gen-6 for each stage of the workflow H-series for single namespace of active processing H600 for continuous ingest, transfers, intense HPC H500/H400 for researchers A2000 for deep archives in same namespace or separate site Continue to tier further down to ECS for geo-collaboration 25
A-series: more efficient deep archive storage Capacity & Performance of A-series A200 A2000 Max raw TB / chassis 480 800 TB/RU, vs. NL & HD >2x <2x MBps / chassis 1500 1500 MBps/RU, vs. NL & HD >2x >2x Benefits: Store more data efficiently in less footprint Always performance ready for big-data analytics A2000 gets better with larger drives in future 26
Closing Thoughts
Summary: Future-proof all your storage needs with Isilon H-series and A-series are future-proofed in performance and capacity to grow with your business Isilon gen-6 delivers the optimal mix of performance, capacity, and densities for every part of your workflows, new and existing Existing Isilon benefits continue: single namespace, scalability, and simplicity Seamless data lake to Dell EMC ECS and public cloud for colder archives Extreme Performance tier Storage tier 28
29
30
31
Dell EMC Services Booth #347 Driving the rapid adoption and optimization of your digital technologies CONSULTING Harness the power of business urgency with help from our consultants DEPLOYMENT Accelerate technology adoption with expert deployment designed for you SUPPORT Maximize productivity with expert support backed by proactive, predictive tools MANAGED SERVICES Gain efficiencies with our hosted cloud, managed applications, storage, archiving, and back-up TRAINING Develop and retain valuable IT talent through continuous learning IT PROVEN Learn how to invest from extreme users such as Dell IT 32
Want to win a Levitating Death Star Speaker? Follow @DellEMCStorage while at Dell EMC World 2 Winners will be chosen daily from Monday May 8 through Thursday May 11 All winners will be notified through Twitter Direct Message NO PURCHASE NECESSARY. Ends 05/11/2017. To enter and for Official Rules, visit http://thecoreblog.emc.com/dell-emc-world-follow-win-sweepstakes-2017/ 33
H600 High Performance H600 Product specs 600 GB and 1.2 TB SAS drives 120 drives per chassis 144 TB per chassis 120K IOPs per chassis Compared to S210 400% More drives 3X Rack Capacity 3X More IOPS 3535
H500 High Throughput, H400 Mid Performance H500/H400 Product specs 2, 4, 8 TB SATA drives 60 drives per chassis 480 TB per chassis 5 GB/sec throughput (H500) 3 GB/sec throughput (H400) Compared to X410 67% More drives 3X More capacity 4X More throughput 3636
A200 Active Archive A200 Product specs 2, 4, 8 TB SATA drives 60 drives per chassis 480 TB per chassis Compared to NL410 67% More drives 2X More capacity 3737
A2000 High Density, Deep Archive A2000 Product specs 10 TB SATA drives 80 drives per chassis 800 TB per chassis Compared to HD400 35% More drives 2X More capacity 3838