BIG DATA STRATEGY FOR TODAY AND TOMORROW RYAN SAYRE, EMC ISILON CTO-AT-LARGE, EMEA

Transcription

1 BIG DATA STRATEGY FOR TODAY AND TOMORROW RYAN SAYRE, EMC ISILON CTO-AT-LARGE, EMEA 1

2 Unstructured Data Growth 67% 74% 80% EB 71 EB 133 EB Total Capacity Shipped, Worldwide Unstructured Data Source: IDC 2

3 Industry Recognition Isilon Systems is a successful acquisition for EMC - Vendor Rating EMC, May 2014 EMC Isilon Outstanding in Critical Capabilities for Scale-Out File - Critical Capabilities for Scale-Out File System Storage, January 2013 IDC Marketscape names EMC Isilon a Leader in Scale-Out File Storage Market - Worldwide Scale-Out File-Based Storage, December

4 The Cost Advantages of EMC Isilon $2 500 $2 000 $1 500 $1 000 Average Annual Cost Per TB in Use $500 REDUCES CAPEX BY 41%, OPEX BY 48% $0 Traditional OPEX IT Staff Isilon CAPEX Source: Quantifying the Business Benefits of Scale-Out NAS Solutions, IDC White Paper, November

5 TRADITIONAL WORKLOADS NEXT-GEN WORKLOADS NAS DAS SAN CLOUD TAPE OBJECT 5

6 TRADITIONAL WORKLOADS NEXT-GEN WORKLOADS NAS DAS SAN Isilon Scale-Out Data Lake CLOUD TAPE OBJECT 6

7 Next-Gen Access Methods FILE Data 7

8 Enterprise-Grade Features DATA PROTECTION Isilon Scale-Out Data Lake DATA MANAGEMENT DATA SECURITY PERFORMANCE MANAGEMENT 8

9 The Components of a Scale-Out Data Lake Applications Protocols NFS SMB HTTP FTP RESTful Web API GET PUT POST DELETE HDFS for Hadoop REST for Object Gigabit & 10 Gig-E Network Client/Application Layer Protocol Ethernet Layer OneFS Operating Environment Intra-cluster Communication 9

10 Optimise Resources: Automated Tiering Isilon SmartPools Single point of management Single file system/single volume Multiple performance tiers Automatic data movement Policy-based tiering management Transparent reallocation NO application changes Optimise storage resources Automatically match storage resources with data requirements Eliminate data migration Files Reduced cost/tb S-Series Performance X-Series Collaboration NL-Series Active archives 10

11 Apps Coexisting: Connecting Today and Tomorrow SMB Node reply NameNode Data NFS SMB HTTP SMB, NFS, HTTP, FTP name node name node name node name node data node HDFS 11

12 Storage Optimise Resources:Scaling Traditional Hadoop HDFS Required performance/ capacity Required Hadoop Cluster Nodes Storage to Compute ratio is fixed Scaling compute means scaling capacity Difficult to provide QoS Compute upgrade is a forklift 3x Raw to Usable Storage Isilon HDFS Compute Scale compute independent of storage Achieve optimal performance balance even as workloads evolve No data migrations, ever! Add new performance as hardware evolves 12

13 Storage Optimise Resources: Isilon Required performance/ capacity Required Hadoop Cluster Nodes Compute Traditional Hadoop HDFS Storage to Compute ratio is fixed Scaling compute means scaling capacity Difficult to provide QoS Compute upgrade is a forklift 3x Raw to Usable Storage Isilon HDFS Scale compute independent of storage Achieve optimal performance balance even as workloads evolve No data migrations, ever! Add new performance as hardware evolves 13

14 Business Critical: Quick Time-to-Results Existing Primary Storage Data Center Network Siloed Hadoop on a Stick Have you ever copied 100TB from Primary Storage to a Hadoop system? How long does it take to copy 100TB from one place to another over a 10GB link? >24 Hours Existing Primary Storage Data Center Network Hadoop Processing Nodes Reading relevant data to analysis Data Copy Analysis In-Place Analysis 14

15 Isilon Scale-Out Data Lake Single file system, single volume, global namespace More than 80% storage utilisation and automated storage tiering Scales from 18 TB to over 20 PB in a single file system Efficient backup and recovery, reliable disaster recovery, and N+1 thru N+4 redundancy Roles-based administration; Authentication Zones; WORM data protection Integrated support for industry-standard protocols including NFS, SMB, HTTP, FTP & HDFS Scale compute and storage independently 15

16 THANK YOU Blog isilonblog.emc.com Think about the role of the data lake in your cloud-enabled data centre Read and join our discussions RYAN SAYRE 16

17