Flashmatrix Technology

Transcription

1 matrix Technology All-flash Super-Converged Platform By Ram Johri Memory Summit 2017 Santa Clara, CA 1

2 Traditional Von Neumann vs. Data Centric Architecture Memory Shared Memory Pool Memory

3 matrix: Data Centric Architecture flash memories in a matrix All Parallel data transfer & processing PCIe FPGA FPGA PCIe FPGA FPGA

4 The Data Challenge of Existing Architectures Conventional Cluster Switching cores carries a latency penalty due to data transfers in storage Clients data a HDD/SSD Performance strongly depends on the physical location of the stored data Switch data b data c HDD/SSD HDD/SSD Performance varies with application work loads There is an All or Nothing scalability

5 Possible Solutions The best way to address the Big Data problem is to enable any core access the entire Storage via Software Defined Storage Shared FLASH Middleware Fabric Clients Compute Storage Network Switch Virtual Compute SW based Storage SW based Network

6 Architecture Clients Shared FLASH Clients Connection Unit () NC Node Module () NC: Node Controller NC Switch Switch NC NC NC NC Ethernet (1G) PCIe Gen2 x1 LVDS (GTX) 1.6Gbps Eliminates Shortcomings of Software Defined Storage Namely: Switching cores latency Performance degradation due to data location and application work loads

7 2D Torus Network Implementation Topology allows for high traffic Data can be transmitted simultaneously from different nodes resulting in high speed and low latency. 16 Scalability achieved without system disturbance & it is theoretically unlimited practically up to 14 enclosures

8 2D Torus Network Implementation Single node failure does not affect data transfers. Presents a more efficient routing & provides better power efficiency due to less data transfers. Removes some of the switches used in a conventional clusters, which are points of failure, thus increases reliability

9 matrix: Super-Converged Platform Intel Atom TM C2758 (8 Core) 16GB x 12 memory 12TB (Physical) Intel Atom TM C2758 (8 Core) 16GB x 12 memory 12TB (Physical) (0,0) (0,1) (0,2) (0,3) NC (1,0) (1,1) (1,2) (1,3) Block Device I/F IO Ctrl (2,0) (2,1) (2,2) (2,3) ConnecNon Unit () (3,0) (3,1) (3,2) (3,3) Node Module () > Orchestrated Containers The Super Orchestra4on Layer (SOL) enables stateless Docker container apps for the edge. SOL seamlessly provisions, de-provisions and resurrects your apps based on system demand. matrix and SOL are co-op4mized for edge compu4ng use cases and workloads. > All 24 terabytes of flash, 24 microservers, 192 cores, all converged in a 2U enclosure. Toshiba s shared everything architecture enables all data to be accessible to all compute. Storage is fully virtualized and integrated into a converged mesh network switch. > Highly Scalable Expand compute and storage to meet your growing demands (14 enclosures in one rack). Grow shared memory and compute without degrada4on in performance.

10 The Hidden Distributed Application Latency Applications requiring multi-node operations carry a hidden latency in todays Non Shared Storage architectures Ingress Operation Virtualization Operation Analytics Operation Egress Operation Time = T T + Tn T+ Tn+1 T+Tn+2 Latency Eliminated By Shared Memory Systems

11 Simplification of the Stack Legacy Virtualization Container Based App A App A App B Bins/ Libs Bins/ Libs Bins/ Libs Guest OS Guest OS Guest OS App A App A Bins/ Libs App B App B App B App B App B Bins/ Libs App B App B App B App B ISVs / App Providers Daisho Core Hypervisor (Type 2) Docker Engine Host OS Host OS Server Server matrix VM Approach Container Approach Optimized for Multiple Microservers in matrix

12 matrix Driving Change in the IT Consumption Model Past 20+ Years Last 5 Years Next 5 Years Horizontal (Mix & Match) Converged (Bundled) Hyper- Converged (Software-Defined) Superconverged (Container-Centric) Servers Servers Compute & Storage Storage Storage Switching Switching Compute & Switching Compute, Storage and Switching

13 matrix Overview Super-Converged for the Edge that s > All 24 terabytes of flash, 24 microservers, 192 cores, all converged in a 2U enclosure. Toshiba s shared everything architecture enables all data to be accessible to all compute. Storage is fully virtualized and integrated into a converged mesh network switch. > Orchestrated Containers Daisho Core enables stateless Docker container apps for the edge. Daisho Core seamlessly provisions, de-provisions and resurrects your apps based on system demand. matrix and Daisho Core are opumized for edge compuung use cases and workloads. > Highly Scalable Seamlessly scale edge mesh networks with 14 enclosures in a single rack Massive capability at the edge with 2,688 cores and 336TB per rack Large data throughput for scalable applicauons and microservices

14 Super-Converged for the Edge: All matrix All Terabytes Shared

15 Super-Converged for the Edge: Orchestrated Containers Daisho Core

16 Terabytes Terabytes Terabytes Terabytes Terabytes Terabytes Terabytes Terabytes Super-Converged for the Edge: Highly Scalable Daisho TOSHIBA matrix All Core TOSHIBA matrix All TOSHIBA matrix All TOSHIBA matrix All Highly Scalable TOSHIBA matrix All TOSHIBA matrix All TOSHIBA matrix All TOSHIBA matrix All Linearly Scalable Shared 14 enclosures in one rack

17 2016 Toshiba America Electronic Components, Inc.