2014 年 3 月 13 日星期四. From Big Data to Big Value Infrastructure Needs and Huawei Best Practice

Transcription

1 2014 年 3 月 13 日星期四 From Big Data to Big Value Infrastructure Needs and Huawei Best Practice

2 Data-driven insight Making better, more informed decisions, faster Raw Data Capture Store Process Insight 1

3 Data Landscape continues to evolve Data Volume Captured and processed Satellite Images Sensors Bio-Informatics Data Velocity Documents M2m Log Files Of ingest and time sensitivity for analysis OLTP Web Logs Social Video Audio Data Variability Data format BUSINESS PROCESS Generated STRUCTURED DATA HUMAN Generated UNSTRUCTURED DATA MACHINE Generated SEMI-STRUCTURED DATA

4 Machine Human OLTP Big data analytics data flows Capture Store Process Insight ERP CRM Terabytes SCM OLTP DB SAN ETL MPP DW Web Logs NAS Petabytes MPP Data Store Converged Compute & Storage Exabytes 3

5 Example For Exabyte requirement "CERN is hitting the technology limits for resource-intensive simulations and analysis. Our collaboration with Huawei shows an exciting new approach, where their novel architecture extends the capabilities in preparation for the Exascale data rates and volumes we expect in the future." said Bob Jones, head of CERN OpenLAB 4

6 Infrastructure Needs Scale-out distributed storage platforms Bring the computation to the data Can t move Petabytes around network High throughput streaming workloads Batch oriented processing Colum-oriented NOSQL and MPP databases Flexible schemas, massive scale Real time analytics requires massive flows New platforms combine real-time with batch Trigger on events and process historical data 5

7 Huawei Strategy on big data Intelligent Application Awareness Multi protocol Interface Openness and cooperation Huawei Strategy Natively support Multi-workload Integrated Storage, analysis and archiving functions Data full life cycle management Infrastructure is Key of Big Data Scale out and X86 architecture, all IP based Fully symmetric and distributed file system Build the Most Efficient Big Data Platform 6

8 Huawei Enterprise-level Big data Platform M&E BANKING TELECOM GOVERMENT ENERGY WORKLOAD High Performance Store and Archive Query and Retrieval for Structured Data Analysis Processing for Unstructured Data EB-level Storage Resource Pool Mgmt STANDARD EXPOSURE OCEANSTO R BIG DATA FRAMEWO RK NFS/CIFS/HDFS SQL MR/HBASE HTTP/S3 DISTRIBUTED RAID MPP DB ENGINE NATIVE INTERFACE LOAD BALANCE ENTERPRISE HADOOP ENGINE QUOTA MGMT OBJECT STORAGE ENGINE World Leading Performance and Scalability Storage Platform as the Infrastructure. HDFS NATIVE INTERFACE Natively Integrated HADOOP, MPP DB, OBJECT Engine, Efficient Data Loading and Processing. STORAGE TIERING End-To-End HIGH SCALABILITY Data Protection DISTRIBUTED and Life Cycle STORAGE Mgmt. SYSTEM 7

9 OceanStor 9000 big data storage No.1 Performance 5,000,000 OPS 5,500,000 4,500,000 5,000,000 OPS 5,000,000 No.1 Scalability 288 Nodes 3,500,000 2,500,000 1,500,000 1,112,705 1,512,784 1,564,404 3,064,602 No.1 Capacity 40 PB 500,000 EMC Isilon NetApp FAS6240 Avere FXT3500 OceanStor N8000 OceanStor x Performance 8

10 Enterprise-level hadoop platform Customized Hadoop Reliability improvements Redundancy, Failover, SPoF elimination Security/privacy improvements Encryption of data and metadata, KERBEROS access control Management simplification GUI platform management tools, role-based admin All Hadoop tools, such as HIVE, PIG, etc. DR site up to 1000km Innovative DR Solution Special VM instances for Hadoop processing 9

11 Manager snapshot Dashboard Overall System Status Service Management Resource Management 10

12 OceanStor Big data PLATFORM High lights NFS/CIFS /HDFS SQL MR/HBASE HTTP/S3 Multi-Workload Scale-Out Storage Platform Leading Storage Efficiency and MPP DB ENGINE HADOOP ENGINE OBJECT ENGINE Scalability NATIVE INTERFACE NATIVE HDFS NATIVE INTERFACE End-To-End Data Protection Enterprise-Level Hadoop Model Native Integrated Hadoop/ MPP- DISTRIBUTED RAID LOAD BALANCE QUOTA MGMT STORAGE TIERING DB/Object DISTRIBUTED STORAGE SYSTEM Unified Management 11

13 OceanStor Series: No.1 Performance Enterprise Storage OceanStor 18500/18800 Secure and Trusted 20X data recovery speed, % availability, missioncritical applications always on Flexible and Efficient Million-level IOPS,2X performance, the stable microsecond latency, and 10X respond speed 1,005,893 SPC-1 IOPS No.1 performance 16 Controller No.1 reliability 7 PB No.1 capacity 3 TB No.1 cache 0.7 ms No.1 stable delay 12

14 Management Huawei IT business coverage Applications Distributed Cloud Data Center Servers Cloud Computing Big Data Storage Converged Infrastructure Data Center Facilities 13

15 Keep your competitive advantage Big data is here Big data presents new challenges to infrastructure Be careful with an open source Hadoop Implementing a robust foundation and careful selection of tools can allow you to benefit from big data 14

16 HUAWEI ENTERPRISE ICT SOLUTIONS A BETTER WAY Copyright 2014 Huawei Technologies Co., Ltd. All Rights Reserved. The information in this document may contain predictive statements including, without limitation, statements regarding the future financial and operating results, future product portfolio, new technology, etc. There are a number of factors that could cause actual results and developments to differ materially from those expressed or implied in the predictive statements. Therefore, such information is provided for reference purpose only and constitutes neither an offer nor an acceptance. Huawei may change the information at any time without notice.