HOW TO BUILD A MODERN AI
|
|
- Elinor Marshall
- 6 years ago
- Views:
Transcription
1 HOW TO BUILD A MODERN AI FOR THE UNKNOWN IN MODERN DATA PURE STORAGE INC.
2 2
3 Official Languages Act (1969/1988) 3 Translation Bureau
4 4
5 5
6 DAWN OF 4 TH INDUSTRIAL REVOLUTION BIG DATA, AI DRIVING CHANGE IN EVERY INDUSTRY 1 st Revolution s Steam Power Rural to Industrial 2 nd Revolution Electricity Industrial to Mass Production 3 rd Revolution PC Mass production to Digital 4 th Revolution 2010-now AI, Big Data & IoT Digital to Intelligence 6
7 DATA IS VITAL TO MACHINE LEARNING OBSERVATION BY PROF. ANDREW NG, AI LUMINARY 7
8 VALUABLE DATA STUCK IN NEUTRAL LEGACY, RETROFIT STORAGE BUILT ON SERIAL TECHNOLOGIES, PERFORMANCE GAP GROWING STORAGE TECHNOLOGY NOT KEEPING UP Gap Will Only Grow Worse LEGACY & RETROFIT STORAGE Built on Decade-Old Serial Technology Deep Learning Compute Required 15x in 2 Years Object Translation Layer NFS Software Stack PERFORMANCE GAP Compute Delivered 10x in 2 Years Newer Technologies Retrofitted SAS (Serial Attached SCSI) SATA Disk Emulation Software Decade-old Protocol & SW SSD/Disk Performance Delivered ~Flat in 2 Years
9 STORAGE FOR AI: BOTH A TRUCK AND A RACE CAR 9 CAPACITY LARGE FILES THROUGHPUT SEQUENTIAL ACCESS CONCURRENCY SMALL FILES LATENCY RANDOM ACCESS
10 SOUL OF DGX-1 IS PARALLEL 10
11 SOUL OF FLASHBLADE IS PARALLEL POWERING 75 BLADE-SCALE IN SINGLE IP WITH PURITY FOR FLASHBLADE NATIVE OBJECT NATIVE NFS/SMB KEY VALUE KEY-VALUE DATABASE STORE FOR DISTRIBUTED PARTITIONS BILLIONS & BILLIONS OF OBJECTS blade feature is subject to GA release
12 THREE ESSENTIAL THINGS FOR AI FRAMEWORKS & APPLICATIONS COMPUTE FROM CPU TO GPU SERVERS STORAGE POWER ENTIRE AI PIPELINE 12
13 WIDE RANGE OF NEEDS IN THE PIPELINE SIGNIFICANT CHALLENGE TO LEGACY STORAGE INGEST CLEAN & TRANSFORM EXPLORE TRAIN From sensors, machines, & user generated CPU Servers GPU Server GPU Production Cluster IO PROFILE 13
14 REAL WORLD PIPELINE IN AN AUTONOMOUS CAR COMPANY INGEST CLEAN, LABEL, RESIZE EXPLORE TRAIN INFERENCE IN VIRTUAL WORLD CPU Servers GPU Server GPU Production Cluster GPU Production Cluster 10 S OF PB COLD STORAGE 14
15 AI SYSTEMS DESIGN PATTERNS GOAL IS TO KEEP THE GPUs 100% BUSY FULL TRAINING WORKFLOW decode scale evaluate forwardpropagation update back-propagation I/O CPU GPU BENCHMARK SETUP Setup #1: DGX-1 with 4x Local SSDs Setup #2: DGX-1 with 1x FlashBlade 15
16 RESULT: FLASHBLADE vs LOCAL SSDs TENSORFLOW TRAINING BENCHMARK WITH RESNET-50 TIME TO SOLUTIONS (HOURS) 1.8 Hours to process 10M images 6% Faster 1.7 Hours to process 10M images 16 NVIDIA DGX-1 + Local SSDs NVIDIA DGX-1 + Pure FlashBlade
17 RESULT: 3X FASTER END-TO-END TENSORFLOW TRAINING BENCHMARK WITH RESNET-50 TIME TO SOLUTIONS (HOURS) 3.4 Hours to load 8TB into SSDs 1.8 Hours to process 10M images 305% Faster 1.7 Hours to process 10M images 17 NVIDIA DGX-1 + Local SSDs NVIDIA DGX-1 + Pure FlashBlade
18 ANALYTICS FOR PRODUCTION DATA TUNED FOR EVERYTHING DATA PLATFORM FOR BOTH TRAINING AND INFERENCING WORKLOADS TRAINING ANALYSIS ON INFERENCE DATA DEPLOY TRAINED MODELS 18
19 19
20 MAKING AUTONOMOUS CARS POSSIBLE BY Zenuity, a joint venture of Volvo and Autoliv, aims to build autonomous driving software for production vehicles by They chose to build their deep learning infrastructure with NVIDIA DGX-1 servers and Pure FlashBlade systems to accelerate their AI initiative.
21 AUTONOMOUS VEHICLE SOFTWARE COMPANY 4 NVIDIA DGX-1 DL Training Cluster 2 PURE FLASHBLADE Over 1 PB of training data w/ performance headroom ENTIRE AI PIPELINE ON A SINGLE HUB Preprocessing, Exploring, and Training on FlashBlade 21
22 AI EXPANDED OUR VIEW OF THE WORLD STRUCTURED (BLOCK, DBs, VMs) DBs & Apps UNSTRUCTURED (FILE, OBJECT, KEY-VALUE CONTAINERS) ALL-FLASH ARRAYS VM Farms Tier2 Apps 22
23 FLASHBLADE INDUSTRY S FIRST DATA HUB PURPOSE-BUILT FOR AI & DEEP LEARNING BLADE PURITY SCALE-OUT FABRIC Powerful, Elastic Data Processing & Storage Unit Massively Distributed Software for Limitless Scale Software-defined fabric that scales linearly with more data & clients blade feature is subject to GA release
24
In partnership with. VelocityAI REFERENCE ARCHITECTURE WHITE PAPER
In partnership with VelocityAI REFERENCE JULY // 2018 Contents Introduction 01 Challenges with Existing AI/ML/DL Solutions 01 Accelerate AI/ML/DL Workloads with Vexata VelocityAI 02 VelocityAI Reference
More informationNew Approach to Unstructured Data
Innovations in All-Flash Storage Deliver a New Approach to Unstructured Data Table of Contents Developing a new approach to unstructured data...2 Designing a new storage architecture...2 Understanding
More informationTECHNICAL WHITE PAPER REAL-WORLD AI DEEP LEARNING PIPELINE POWERED BY FLASHBLADE
TECHNICAL WHITE PAPER REAL-WORLD AI DEEP LEARNING PIPELINE POWERED BY FLASHBLADE TABLE OF CONTENTS INTRODUCTION... 3 LIFECYCLE OF DATA... 3 THE DATA SCIENTIST WORKFLOW... 5 SCALABLE DATASETS... 6 WHY FLASHBLADE...
More informationACCELERATE YOUR ANALYTICS GAME WITH ORACLE SOLUTIONS ON PURE STORAGE
ACCELERATE YOUR ANALYTICS GAME WITH ORACLE SOLUTIONS ON PURE STORAGE An innovative storage solution from Pure Storage can help you get the most business value from all of your data THE SINGLE MOST IMPORTANT
More informationOPERATIONALIZING MACHINE LEARNING USING GPU ACCELERATED, IN-DATABASE ANALYTICS
OPERATIONALIZING MACHINE LEARNING USING GPU ACCELERATED, IN-DATABASE ANALYTICS 1 Why GPUs? A Tale of Numbers 100x Performance Increase Infrastructure Cost Savings Performance 100x gains over traditional
More informationDDN. DDN Updates. DataDirect Neworks Japan, Inc Nobu Hashizume. DDN Storage 2018 DDN Storage 1
1 DDN DDN Updates DataDirect Neworks Japan, Inc Nobu Hashizume DDN Storage 2018 DDN Storage 1 2 DDN A Broad Range of Technologies to Best Address Your Needs Your Use Cases Research Big Data Enterprise
More informationCloud Meets Big Data For VMware Environments
Cloud Meets Big Data For VMware Environments
More informationDeep Learning Performance and Cost Evaluation
Micron 5210 ION Quad-Level Cell (QLC) SSDs vs 7200 RPM HDDs in Centralized NAS Storage Repositories A Technical White Paper Don Wang, Rene Meyer, Ph.D. info@ AMAX Corporation Publish date: October 25,
More informationStorage for HPC, HPDA and Machine Learning (ML)
for HPC, HPDA and Machine Learning (ML) Frank Kraemer, IBM Systems Architect mailto:kraemerf@de.ibm.com IBM Data Management for Autonomous Driving (AD) significantly increase development efficiency by
More informationDDN. DDN Updates. Data DirectNeworks Japan, Inc Shuichi Ihara. DDN Storage 2017 DDN Storage
DDN DDN Updates Data DirectNeworks Japan, Inc Shuichi Ihara DDN A Broad Range of Technologies to Best Address Your Needs Protection Security Data Distribution and Lifecycle Management Open Monitoring Your
More informationIBM SpectrumAI with NVIDIA Converged Infrastructure Solutions for AI workloads
IBM SpectrumAI with NVIDIA Converged Infrastructure Solutions for AI workloads The engine to power your AI data pipeline Introduction: Artificial intelligence (AI) including deep learning (DL) and machine
More informationFAST SQL SERVER BACKUP AND RESTORE
WHITE PAPER FAST SQL SERVER BACKUP AND RESTORE WITH PURE STORAGE TABLE OF CONTENTS EXECUTIVE OVERVIEW... 3 GOALS AND OBJECTIVES... 3 AUDIENCE... 3 PURE STORAGE INTRODUCTION... 4 SOLUTION SUMMARY... 4 FLASHBLADE
More informationAI-accelerated HPC Hardware Infrastructure. Francis Lam Huawei Technologies
AI-accelerated HPC Hardware Infrastructure Francis Lam Huawei Technologies Contents Huawei HPC Momentum Boundless Computing AI accelerating HPC HPC accelerating AI www.huawei.com Huawei Confidential 2
More informationDeep Learning Performance and Cost Evaluation
Micron 5210 ION Quad-Level Cell (QLC) SSDs vs 7200 RPM HDDs in Centralized NAS Storage Repositories A Technical White Paper Rene Meyer, Ph.D. AMAX Corporation Publish date: October 25, 2018 Abstract Introduction
More informationEdge to Core to Cloud Architecture for AI
Technical White Paper Edge to Core to Cloud Architecture for AI Key Considerations for the Development of Deep Learning Environments Sundar Ranganathan, NetApp August 2018 WP-7271 Abstract As organizations
More informationNVIDIA PLATFORM FOR AI
NVIDIA PLATFORM FOR AI João Paulo Navarro, Solutions Architect - Linkedin i am ai HTTPS://WWW.YOUTUBE.COM/WATCH?V=GIZ7KYRWZGQ 2 NVIDIA Gaming VR AI & HPC Self-Driving Cars GPU Computing 3 GPU COMPUTING
More informationBuilding the Most Efficient Machine Learning System
Building the Most Efficient Machine Learning System Mellanox The Artificial Intelligence Interconnect Company June 2017 Mellanox Overview Company Headquarters Yokneam, Israel Sunnyvale, California Worldwide
More informationIsilon: Raising The Bar On Performance & Archive Use Cases. John Har Solutions Product Manager Unstructured Data Storage Team
Isilon: Raising The Bar On Performance & Archive Use Cases John Har Solutions Product Manager Unstructured Data Storage Team What we ll cover in this session Isilon Overview Streaming workflows High ops/s
More informationIBM Spectrum Scale IO performance
IBM Spectrum Scale 5.0.0 IO performance Silverton Consulting, Inc. StorInt Briefing 2 Introduction High-performance computing (HPC) and scientific computing are in a constant state of transition. Artificial
More informationModern Data Warehouse The New Approach to Azure BI
Modern Data Warehouse The New Approach to Azure BI History On-Premise SQL Server Big Data Solutions Technical Barriers Modern Analytics Platform On-Premise SQL Server Big Data Solutions Modern Analytics
More informationUNFAIR ADVANTAGE Your Road to SAP Hana 2016 PURE STORAGE INC.
UNFAIR ADVANTAGE Your Road to SAP Hana 1 1 AGENDA Road to S4 Hana Road to S4 Hana Your Business Opportunity Why is your storage decision important for SAP? Pure Storage and SAP Global Partnership SAP Co-Innovation
More informationScalable AI Infrastructure
Technical Whitepaper Scalable AI Infrastructure Designing For Real-World Deep Learning Use Cases Sundar Ranganathan, NetApp Santosh Rao, NetApp June 2018 WP-7267 In partnership with Executive Summary Deep
More informationDeveloping Low Latency NVMe Systems for HyperscaleData Centers. Prepared by Engling Yeo Santa Clara, CA Date: 08/04/2017
Developing Low Latency NVMe Systems for HyperscaleData Centers Prepared by Engling Yeo Santa Clara, CA 95054 Date: 08/04/2017 Quality of Service IOPS, Throughput, Latency Short predictable read latencies
More informationBuilding the Most Efficient Machine Learning System
Building the Most Efficient Machine Learning System Mellanox The Artificial Intelligence Interconnect Company June 2017 Mellanox Overview Company Headquarters Yokneam, Israel Sunnyvale, California Worldwide
More informationIs your IT Infrastructure Ready for Machine Learning & Artificial Intelligence?
BRKPAR-2955 Is your IT Infrastructure Ready for Machine Learning & Artificial Intelligence? Hoseb Dermanilian, EMEA BDM, NetApp Arnaud BASSALER, CSE, Cisco Systems Agenda Introduction AI, Machine Learning
More informationAccelerate AI with Cisco Computing Solutions
Accelerate AI with Cisco Computing Solutions Data is everywhere. Your data scientists are propelling your business into a future of data-driven intelligence. But how do you deploy and manage artificial
More informationEMC SOLUTION FOR SPLUNK
EMC SOLUTION FOR SPLUNK Splunk validation using all-flash EMC XtremIO and EMC Isilon scale-out NAS ABSTRACT This white paper provides details on the validation of functionality and performance of Splunk
More informationFlash Storage Complementing a Data Lake for Real-Time Insight
Flash Storage Complementing a Data Lake for Real-Time Insight Dr. Sanhita Sarkar Global Director, Analytics Software Development August 7, 2018 Agenda 1 2 3 4 5 Delivering insight along the entire spectrum
More informationEmerging Technologies for HPC Storage
Emerging Technologies for HPC Storage Dr. Wolfgang Mertz CTO EMEA Unstructured Data Solutions June 2018 The very definition of HPC is expanding Blazing Fast Speed Accessibility and flexibility 2 Traditional
More informationDeep Learning Inference on Openshift with GPUs
Deep Learning Inference on Openshift with GPUs OpenShift Commons, Seattle, Dec 10 2018 Tripti Singhal Product Manager, NVIDIA Deep Learning Software Tushar Katarki Product Manager, AI on OpenShift AGENDA
More informationTHE PURE STORAGE DATA PLATFORM
AT A GLANCE ACCELERATE FlashArray for latencysensitive structured data apps, DBs, and VMs; FlashBlade for high-scale, high-bandwidth unstructured data apps and big data analytics CONSOLIDATE all your Tier
More informationOnto Petaflops with Kubernetes
Onto Petaflops with Kubernetes Vishnu Kannan Google Inc. vishh@google.com Key Takeaways Kubernetes can manage hardware accelerators at Scale Kubernetes provides a playground for ML ML journey with Kubernetes
More informationNext Generation Computing Architectures for Cloud Scale Applications
Next Generation Computing Architectures for Cloud Scale Applications Steve McQuerry, CCIE #6108, Manager Technical Marketing #clmel Agenda Introduction Cloud Scale Architectures System Link Technology
More informationCopyright 2012 EMC Corporation. All rights reserved.
1 TRANSFORMING MISSION CRITICAL APPLICATIONS 2 Application Environments Historically Physical Infrastructure Limits Application Value Challenges Different Environments Limits On Performance Underutilized
More informationBest Practices for Validating the Performance of Data Center Infrastructure. Henry He Ixia
Best Practices for Validating the Performance of Data Center Infrastructure Henry He Ixia Game Changers Big data - the world is getting hungrier and hungrier for data 2.5B pieces of content 500+ TB ingested
More informationCloud Analytics and Business Intelligence on AWS
Cloud Analytics and Business Intelligence on AWS Enterprise Applications Virtual Desktops Sharing & Collaboration Platform Services Analytics Hadoop Real-time Streaming Data Machine Learning Data Warehouse
More informationEFFICIENT INFERENCE WITH TENSORRT. Han Vanholder
EFFICIENT INFERENCE WITH TENSORRT Han Vanholder AI INFERENCING IS EXPLODING 2 Trillion Messages Per Day On LinkedIn 500M Daily active users of iflytek 140 Billion Words Per Day Translated by Google 60
More informationA NEW COMPUTING ERA. Shanker Trivedi Senior Vice President Enterprise Business at NVIDIA
A NEW COMPUTING ERA Shanker Trivedi Senior Vice President Enterprise Business at NVIDIA THE ERA OF AI AI CLOUD MOBILE PC 2 TWO FORCES DRIVING THE FUTURE OF COMPUTING 10 7 Transistors (thousands) 10 5 1.1X
More informationNVIDIA DGX SYSTEMS PURPOSE-BUILT FOR AI
NVIDIA DGX SYSTEMS PURPOSE-BUILT FOR AI Overview Unparalleled Value Product Portfolio Software Platform From Desk to Data Center to Cloud Summary AI researchers depend on computing performance to gain
More informationAccelerating Digital Transformation with InterSystems IRIS and vsan
HCI2501BU Accelerating Digital Transformation with InterSystems IRIS and vsan Murray Oldfield, InterSystems Andreas Dieckow, InterSystems Christian Rauber, VMware #vmworld #HCI2501BU Disclaimer This presentation
More informationVMware Virtual SAN Technology
VMware Virtual SAN Technology Today s Agenda 1 Hyper-Converged Infrastructure Architecture & Vmware Virtual SAN Overview 2 Why VMware Hyper-Converged Software? 3 VMware Virtual SAN Advantage Today s Agenda
More informationFast Hardware For AI
Fast Hardware For AI Karl Freund karl@moorinsightsstrategy.com Sr. Analyst, AI and HPC Moor Insights & Strategy Follow my blogs covering Machine Learning Hardware on Forbes: http://www.forbes.com/sites/moorinsights
More informationStorage Class Memory in Scalable Cognitive Systems
Storage Class Memory in Scalable Cognitive Systems Balint Fleischer Chief Research Officer The impact of NVM on the Application/Data architecture Accelerated demanding applications OLTP, Big Data, Etc.
More informationIBM Deep Learning Solutions
IBM Deep Learning Solutions Reference Architecture for Deep Learning on POWER8, P100, and NVLink October, 2016 How do you teach a computer to Perceive? 2 Deep Learning: teaching Siri to recognize a bicycle
More informationFLASHARRAY AT A GLANCE
FLASHARRAY AT A GLANCE ACCELERATE latency sensitive apps, DBs, VMs, virtual desktops CONSOLIDATE all your Tier 1 applications on an All-Flash Cloud TWO YEARS OF PROVEN 99.9999% AVAILABILITY inclusive of
More informationThe Datacentered Future Greg Huff CTO, LSI Corporation
The Datacentered Future Greg Huff CTO, LSI Corporation 1 Tremendous Growth in Connected Data Sources, Consumption Devices, and Services 2 Nearly limitless data depth and breadth needed Execution of millions
More informationFlash Considerations for Software Composable Infrastructure. Brian Pawlowski CTO, DriveScale Inc.
Flash Considerations for Software Composable Infrastructure Brian Pawlowski CTO, DriveScale Inc. LET S TALK COMPOSABLE INFRASTRUCTURE BUT FIRST, YOU MUST DISAGGREGATE WHAT IS IT? SOFTWARE COMPOSABLE INFRASTRUCTURE
More information2013 AWS Worldwide Public Sector Summit Washington, D.C.
2013 AWS Worldwide Public Sector Summit Washington, D.C. EMR for Fun and for Profit Ben Butler Sr. Manager, Big Data butlerb@amazon.com @bensbutler Overview 1. What is big data? 2. What is AWS Elastic
More informationHPE Synergy HPE SimpliVity 380
HPE Synergy HPE SimpliVity 0 Pascal.Moens@hpe.com, Solutions Architect Technical Partner Lead February 0 HPE Synergy Composable infrastructure at HPE CPU Memory Local Storage LAN I/O SAN I/O Power Cooling
More informationHPE Deep Learning Cookbook: Recipes to Run Deep Learning Workloads. Natalia Vassilieva, Sergey Serebryakov
HPE Deep Learning Cookbook: Recipes to Run Deep Learning Workloads Natalia Vassilieva, Sergey Serebryakov Deep learning ecosystem today Software Hardware 2 HPE s portfolio for deep learning Government,
More informationNAS for Server Virtualization Dennis Chapman Senior Technical Director NetApp
NAS for Server Virtualization Dennis Chapman Senior Technical Director NetApp Agenda The Landscape has Changed New Customer Requirements The Market has Begun to Move Comparing Performance Results Storage
More informationFast forward. To your <next>
Fast forward To your Navin Shenoy EXECUTIVE VICE PRESIDENT GENERAL MANAGER, DATA CENTER GROUP CLOUD ECONOMICS INTELLIGENT DATA PRACTICES NETWORK TRANSFORMATION Intel Xeon Scalable Platform The
More informationWHITE PAPER AI AND BIG DATA IN THE SAP WORLD PREPARE YOUR SAP ENVIRONMENT FOR THE FUTURE WITH PURE
WHITE PAPER AI AND BIG DATA IN THE SAP WORLD PREPARE YOUR SAP ENVIRONMENT FOR THE FUTURE WITH PURE TABLE OF CONTENTS INTRODUCTION... 3 ABOUT THIS DOCUMENT... 3 PURE STORAGE PRODUCTS... 4 FlashArray...
More informationIBM Db2 Analytics Accelerator Version 7.1
IBM Db2 Analytics Accelerator Version 7.1 Delivering new flexible, integrated deployment options Overview Ute Baumbach (bmb@de.ibm.com) 1 IBM Z Analytics Keep your data in place a different approach to
More informationTransforming Transport Infrastructure with GPU- Accelerated Machine Learning Yang Lu and Shaun Howell
Transforming Transport Infrastructure with GPU- Accelerated Machine Learning Yang Lu and Shaun Howell 11 th Oct 2018 2 Contents Our Vision Of Smarter Transport Company introduction and journey so far Advanced
More informationAIRI SCALE-OUT AI-READY INFRASTRUCTURE ARCHITECTED BY PURE STORAGE AND NVIDIA WITH ARISTA 7060X SWITCH REFERENCE ARCHITECTURE
REFERENCE ARCHITECTURE AIRI SCALE-OUT AI-READY INFRASTRUCTURE ARCHITECTED BY PURE STORAGE AND NVIDIA WITH ARISTA 7060X SWITCH TABLE OF CONTENTS INTRODUCTION... 3 Accelerating Computation: NVIDIA DGX-1...
More informationPROTECTING MISSION CRITICAL DATA
WHITE PAPER PROTECTING MISSION CRITICAL DATA WITH BACKUP AND REPLICATION FROM PURE STORAGE AND VEEAM TABLE OF CONTENTS INTRODUCTION... 3 ARCHITECTURAL OVERVIEW... 3 TEST PROCESS... 5 VEEAM BACKUP & REPLICATION
More informationVerron Martina vspecialist. Copyright 2012 EMC Corporation. All rights reserved.
Verron Martina vspecialist 1 TRANSFORMING MISSION CRITICAL APPLICATIONS 2 Application Environments Historically Physical Infrastructure Limits Application Value Challenges Different Environments Limits
More informationPivot3 Acuity with Microsoft SQL Server Reference Architecture
Pivot3 Acuity with Microsoft SQL Server 2014 Reference Architecture How to Contact Pivot3 Pivot3, Inc. General Information: info@pivot3.com 221 West 6 th St., Suite 750 Sales: sales@pivot3.com Austin,
More informationAccelerating Data Center Workloads with FPGAs
Accelerating Data Center Workloads with FPGAs Enno Lübbers NorCAS 2017, Linköping, Sweden Intel technologies features and benefits depend on system configuration and may require enabled hardware, software
More informationVeritas NetBackup on Cisco UCS S3260 Storage Server
Veritas NetBackup on Cisco UCS S3260 Storage Server This document provides an introduction to the process for deploying the Veritas NetBackup master server and media server on the Cisco UCS S3260 Storage
More informationWorld s most advanced data center accelerator for PCIe-based servers
NVIDIA TESLA P100 GPU ACCELERATOR World s most advanced data center accelerator for PCIe-based servers HPC data centers need to support the ever-growing demands of scientists and researchers while staying
More informationPouya Kousha Fall 2018 CSE 5194 Prof. DK Panda
Pouya Kousha Fall 2018 CSE 5194 Prof. DK Panda 1 Motivation And Intro Programming Model Spark Data Transformation Model Construction Model Training Model Inference Execution Model Data Parallel Training
More informationCopyright 2012, Oracle and/or its affiliates. All rights reserved.
1 Storage Innovation at the Core of the Enterprise Robert Klusman Sr. Director Storage North America 2 The following is intended to outline our general product direction. It is intended for information
More informationData Movement & Tiering with DMF 7
Data Movement & Tiering with DMF 7 Kirill Malkin Director of Engineering April 2019 Why Move or Tier Data? We wish we could keep everything in DRAM, but It s volatile It s expensive Data in Memory 2 Why
More informationNext Generation Storage for The Software-Defned World
` Next Generation Storage for The Software-Defned World John Hofer Solution Architect Red Hat, Inc. BUSINESS PAINS DEMAND NEW MODELS CLOUD ARCHITECTURES PROPRIETARY/TRADITIONAL ARCHITECTURES High up-front
More informationModern hyperconverged infrastructure. Karel Rudišar Systems Engineer, Vmware Inc.
Modern hyperconverged infrastructure Karel Rudišar Systems Engineer, Vmware Inc. 2 What Is Hyper-Converged Infrastructure? - The Ideal Architecture for SDDC Management SDDC Compute Networking Storage Simplicity
More informationPredicting Service Outage Using Machine Learning Techniques. HPE Innovation Center
Predicting Service Outage Using Machine Learning Techniques HPE Innovation Center HPE Innovation Center - Our AI Expertise Sense Learn Comprehend Act Computer Vision Machine Learning Natural Language Processing
More informationOn-Premises Cloud Platform. Bringing the public cloud, on-premises
On-Premises Cloud Platform Bringing the public cloud, on-premises How Cloudistics came to be 2 Cloudistics On-Premises Cloud Platform Complete Cloud Platform Simple Management Application Specific Flexibility
More informationEnterprise Architectures The Pace Accelerates Camberley Bates Managing Partner & Analyst
Enterprise Architectures The Pace Accelerates Camberley Bates Managing Partner & Analyst Change is constant in IT.But some changes alter forever the way we do things Inflections & Architectures Solid State
More informationSSDs that Think. Noam Mizrahi Vice President, Technology and Architecture CTO Office, Marvell
SSDs that Think Intelligent SSDs Can Handle a Larger Computing Load at the Edge Noam Mizrahi Vice President, Technology and Architecture CTO Office, Marvell People have been mining forever 18xx 19xx Gold
More informationFast forward. To your <next>
Fast forward To your Risk Factors This presentation occurs during Intel s Quiet Period, before Intel announces its financial and operating results for the second quarter of 2017. Therefore, presenters
More informationStorage for High-Performance Computing Gets Enterprise Ready
Storage for High-Performance Computing Gets Enterprise Ready by George Crump High-Performance Computing (HPC) is the proving grounds to test a storage system s ability to handle mixed workloads. While
More informationNVDIA DGX Data Center Reference Design
White Paper NVDIA DGX Data Center Reference Design Easy Deployment of DGX Servers for Deep Learning 2018-07-19 2018 NVIDIA Corporation. Contents Abstract ii 1. AI Workflow and Sizing 1 2. NVIDIA AI Software
More informationAccelerating Real-Time Big Data. Breaking the limitations of captive NVMe storage
Accelerating Real-Time Big Data Breaking the limitations of captive NVMe storage 18M IOPs in 2u Agenda Everything related to storage is changing! The 3rd Platform NVM Express architected for solid state
More informationPerformance Benefits of NVMe over Fibre Channel A New, Parallel, Efficient Protocol
May 2018 Performance Benefits of NVMe over Fibre Channel A New, Parallel, Efficient NVMe over Fibre Channel delivered 58% higher IOPS and 34% lower latency than SCSI FCP. (What s not to like?) Executive
More informationS INSIDE NVIDIA GPU CLOUD DEEP LEARNING FRAMEWORK CONTAINERS
S8497 - INSIDE NVIDIA GPU CLOUD DEEP LEARNING FRAMEWORK CONTAINERS Chris Lamb CUDA and NGC Engineering, NVIDIA John Barco NGC Product Management, NVIDIA NVIDIA GPU Cloud (NGC) overview AGENDA Using NGC
More informationFlashmatrix Technology
matrix Technology All-flash Super-Converged Platform By Ram Johri Memory Summit 2017 Santa Clara, CA 1 Traditional Von Neumann vs. Data Centric Architecture Memory Shared Memory Pool Memory matrix: Data
More informationDEEP NEURAL NETWORKS CHANGING THE AUTONOMOUS VEHICLE LANDSCAPE. Dennis Lui August 2017
DEEP NEURAL NETWORKS CHANGING THE AUTONOMOUS VEHICLE LANDSCAPE Dennis Lui August 2017 THE RISE OF GPU COMPUTING APPLICATIONS 10 7 10 6 GPU-Computing perf 1.5X per year 1000X by 2025 ALGORITHMS 10 5 1.1X
More informationDell EMC PowerEdge R740xd as a Dedicated Milestone Server, Using Nvidia GPU Hardware Acceleration
Dell EMC PowerEdge R740xd as a Dedicated Milestone Server, Using Nvidia GPU Hardware Acceleration Dell IP Video Platform Design and Calibration Lab June 2018 H17250 Reference Architecture Abstract This
More informationNVIDIA T4 FOR VIRTUALIZATION
NVIDIA T4 FOR VIRTUALIZATION TB-09377-001-v01 January 2019 Technical Brief TB-09377-001-v01 TABLE OF CONTENTS Powering Any Virtual Workload... 1 High-Performance Quadro Virtual Workstations... 3 Deep Learning
More informationAgenda. AWS Database Services Traditional vs AWS Data services model Amazon RDS Redshift DynamoDB ElastiCache
Databases on AWS 2017 Amazon Web Services, Inc. and its affiliates. All rights served. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon Web Services,
More informationI/O Acceleration by Host Side Resources
I/O Acceleration by Host Side Resources Chethan Kumar PernixData Story So Far Virtualization has resulted in Longer I/O path Through layers of storage abstraction Exponential growth in the load on the
More informationNVM Express Awakening a New Storage and Networking Titan Shaun Walsh G2M Research
NVM Express Awakening a New Storage and Networking Titan Shaun Walsh G2M Research Acronyms and Definition Check Point Term Definition NVMe Non-Volatile Memory Express NVMe-oF Non-Volatile Memory Express
More informationIBM CORAL HPC System Solution
IBM CORAL HPC System Solution HPC and HPDA towards Cognitive, AI and Deep Learning Deep Learning AI / Deep Learning Strategy for Power Power AI Platform High Performance Data Analytics Big Data Strategy
More informationAN ALTERNATIVE TO ALL- FLASH ARRAYS: PREDICTIVE STORAGE CACHING
AN ALTERNATIVE TO ALL- FLASH ARRAYS: PREDICTIVE STORAGE CACHING THE EASIEST WAY TO INCREASE PERFORMANCE AND LOWER STORAGE COSTS Bruce Kornfeld, Chief Marketing Officer, StorMagic Luke Pruen, Technical
More informationThe Fastest And Most Efficient Block Storage Software (SDS)
The Fastest And Most Efficient Block Storage Software (SDS) StorPool: Product Summary 1. Advanced Block-level Software Defined Storage, SDS (SDS 2.0) Fully distributed, scale-out, online changes of everything,
More informationKey Technology Trends, Marketplace Drivers, & AFA Rankings Jerome M. Wendt President & Founder Ken Clipperton Lead Analyst, Storage
Annual AFA Update Key Technology Trends, Marketplace Drivers, & AFA Rankings By Jerome M. Wendt President & Founder Ken Clipperton Lead Analyst, Storage Key Drivers in the AFA Marketplace What Businesses
More informationAcceĺeŕez vos environnements de bases de donneés/erp
Acceĺeŕez vos environnements de bases de donneés/erp FlashStack Integrated Infrastructure Speakers Thibaud Lenik Bechtle David Scrimitore Pure Storage Charley Eveno - Cisco AGENDA Challenges des environnements
More informationDecentralized Distributed Storage System for Big Data
Decentralized Distributed Storage System for Big Presenter: Wei Xie -Intensive Scalable Computing Laboratory(DISCL) Computer Science Department Texas Tech University Outline Trends in Big and Cloud Storage
More informationHighly Scalable, Non-RDMA NVMe Fabric. Bob Hansen,, VP System Architecture
A Cost Effective,, High g Performance,, Highly Scalable, Non-RDMA NVMe Fabric Bob Hansen,, VP System Architecture bob@apeirondata.com Storage Developers Conference, September 2015 Agenda 3 rd Platform
More informationVirtual SQL Servers. Actual Performance. 2016
@kleegeek davidklee.net heraflux.com linkedin.com/in/davidaklee Specialties / Focus Areas / Passions: Performance Tuning & Troubleshooting Virtualization Cloud Enablement Infrastructure Architecture Health
More informationDell EMC Isilon and NVIDIA DGX-1 servers for deep learning
Dell EMC Isilon and NVIDIA DGX-1 servers for deep learning This document demonstrates how the Dell EMC Isilon F800 All-Flash Scale-out NAS and NVIDIA DGX-1 servers with NVIDIA Tesla V100 GPUs can be used
More informationScality RING on Cisco UCS: Store File, Object, and OpenStack Data at Scale
Scality RING on Cisco UCS: Store File, Object, and OpenStack Data at Scale What You Will Learn Cisco and Scality provide a joint solution for storing and protecting file, object, and OpenStack data at
More informationSharing High-Performance Devices Across Multiple Virtual Machines
Sharing High-Performance Devices Across Multiple Virtual Machines Preamble What does sharing devices across multiple virtual machines in our title mean? How is it different from virtual networking / NSX,
More informationDell EMC Isilon All-Flash
Enterprise Strategy Group Getting to the bigger truth. ESG Lab Validation Dell EMC Isilon All-Flash Scale-out All-flash Storage for Demanding Unstructured Data Workloads By Tony Palmer, Senior Lab Analyst
More informationXTREMIO: TRANSFORMING APPLICATIONS, ENABLING THE AGILE DATA CENTER
1 XTREMIO: TRANSFORMING APPLICATIONS, ENABLING THE AGILE DATA CENTER MAX FISHMAN XTREMIO PRODUCT MANAGEMENT 2 THE ALL FLASH ARRAY REVOLUTION ALL FLASH ARRAY 3 XTREMIO ENABLES THE AGILE DATA CENTER 10%
More informationTransforming IT: From Silos To Services
Transforming IT: From Silos To Services Chuck Hollis Global Marketing CTO EMC Corporation http://chucksblog.emc.com @chuckhollis IT is being transformed. Our world is changing fast New Technologies New
More informationAerospike Scales with Google Cloud Platform
Aerospike Scales with Google Cloud Platform PERFORMANCE TEST SHOW AEROSPIKE SCALES ON GOOGLE CLOUD Aerospike is an In-Memory NoSQL database and a fast Key Value Store commonly used for caching and by real-time
More informationFLASH.NEXT. Zero to One Million IOPS in a Flash. Ahmed Iraqi Account Systems Engineer North Africa
1 FLASH.NEXT Zero to One Million IOPS in a Flash Ahmed Iraqi Account Systems Engineer North Africa 2 The Performance Gap CPU performance increases 100x every decade Hard disk drive performance has stagnated
More information