Building an Operating System for AI
|
|
- Mabel Dickerson
- 5 years ago
- Views:
Transcription
1 Building an Operating System for AI How Microservices and Serverless Computing Enable the Next Generation of Machine Intelligence Diego Oppenheimer, CEO
2 About Me Diego Oppenheimer - Founder and CEO - Algorithmia Product developer, entrepreneur, extensive background in all things data. Microsoft: PowerPivot, PowerBI, Excel and SQL Server. Founder of algorithmic trading startup BS/MS Carnegie Mellon University
3 Make state-of-the-art algorithms discoverable and accessible to everyone.
4 Algorithmia.com AI/ML scalable infrastructure on demand + marketplace Function-as-a-service for Machine & Deep Learning Discoverable, live inventory of AI Monetizable Composable Every developer on earth can make their app intelligent 4
5 There s an algorithm for that! 70K+ DEVELOPERS 5K+ ALGORITHMS
6 How do we do it? ~5,000 algorithms (60k w/ different versions) Each algorithm: 1 to 1,000 calls a second, fluctuates, no devops ~15ms overhead latency Any runtime, any architecture 6
7 Characteristics of AI Two distinct phases: training and inference Lots of processing power Heterogenous hardware (CPUs, GPUs, TPUs, etc.) Limited by compute rather than bandwidth Tensorflow is open source, scaling it is not. - Kenny Daniel
8 TRAINING OWNER: Data Scientists Long compute cycle Fixed load (Inelastic) Stateful Single user 8
9 TRAINING OWNER: Data Scientists Long compute cycle Fixed load (Inelastic) Stateful Single user Analogous to dev tool chain. Building and iterating over a model is similar to building an app. 9
10 Use Case Jian Yang made an app to recognize food SeeFood. Fully trained. Works on his machine. All rights reserved HBO
11 Use Case He deployed his trained model to a GPU-enabled server? GPU-enabled Server
12 Use Case The app is a hit! SeeFood Productivity All rights reserved HBO
13 Use Case and now his server is overloaded.???? xn GPU-enabled Server
14 We ll be talking about Microservices & Serverless Computing MICROSERVICES: the design of a system as independently deployable, loosely coupled services. SERVERLESS: the encapsulation, starting, and stopping of singular functions per request, with a just-in-time-compute model. ADVANTAGES Maintainability Scalability Rolling deployments ADVANTAGES Cost / Efficiency Concurrency built-in Speed of development Improved latency
15 TRAINING OWNER: Data Scientists Long compute cycle Fixed load (Inelastic) Stateful Single user INFERENCE OWNER: DevOps Short compute bursts Elastic Stateless Multiple users Analogous to dev tool chain. Building and iterating over a model is similar to building an app. 15
16 TRAINING OWNER: Data Scientists Long compute cycle Fixed load (Inelastic) Stateful Single user INFERENCE OWNER: DevOps Short compute bursts Elastic Stateless Multiple users Analogous to dev tool chain. Building and iterating over a model is similar to building an app. Analogous to an OS. Running concurrent models requires task scheduling. 16
17 TRAINING OWNER: Data Scientists Long compute cycle Fixed load (Inelastic) Stateful Single user INFERENCE OWNER: DevOps Short compute bursts Elastic Stateless Multiple users Metal or VM Containers 17
18 TRAINING OWNER: Data Scientists Long compute cycle Fixed load (Inelastic) Stateful Single user INFERENCE OWNER: DevOps Short compute bursts Elastic Stateless Multiple users Metal or VM Containers Kubernetes 18
19 TRAINING OWNER: Data Scientists Long compute cycle Fixed load (Inelastic) Stateful Single user INFERENCE OWNER: DevOps Short compute bursts Elastic Stateless Multiple users Metal or VM Containers Kubernetes 19
20 Why Microservices? + + = Elastic Scalable Software agnostic Hardware agnostic 20
21 Why Serverless? Cost / Efficiency Concurrency built-in Improved latency 21
22 Calls per Second GPU Server Instances Why Serverless - Cost Efficiency Jian Yang s SeeFood is most active during lunchtime Max calls/s Avg calls/s 12 AM 02 AM 04 AM 06 AM 08 AM 10 AM 12 PM 02 PM 04 PM 06 PM 08 PM 10 PM
23 Calls per Second GPU Server Instances Traditional Architecture - Design for Maximum 40 machines 24 hours. $648 * 40 = $25,920 per month Max calls/s Avg calls/s 12 AM 02 AM 04 AM 06 AM 08 AM 10 AM 12 PM 02 PM 04 PM 06 PM 08 PM 10 PM
24 Calls per Second GPU Server Instances Autoscale Architecture - Design for Local Maximum 19 machines 24 hours. $648 * 40 = $12,312 per month Max calls/s Avg calls/s 12 AM 02 AM 04 AM 06 AM 08 AM 10 AM 12 PM 02 PM 04 PM 06 PM 08 PM 10 PM
25 Calls per Second GPU Server Instances Serverless Architecture - Design for Minimum Avg. of 21 calls / sec, or equivalent of 6 machines. $648 * 6 = $3,888 per month Max calls/s Avg calls/s 12 AM 02 AM 04 AM 06 AM 08 AM 10 AM 12 PM 02 PM 04 PM 06 PM 08 PM 10 PM
26 Load Balancer Why Serverless - Concurrency??? GPU-enabled Servers
27 Why Serverless - Improved Latency Portability = Low Latency
28 + + ALSO: GPU Memory Management, Job Scheduling, Cloud Abstraction, etc. 28
29 An Operating System for AI
30 Shell & Services Kernel Discoverability, Authentication, Instrumentation, etc. Elastic Scale Runtime Abstraction Cloud Abstraction Prioritize and automatically optimize execution of concurrent short-lived jobs. Support any programming language or framework, including interoperability between mixed stacks. Provide portability to algorithms, including public clouds or private clouds. 30
31 Kernel: Elastic Scale Web Load Balancer Web Servers User API Load Balancer API Servers Cloud Region #1 Cloud Region #2 Worker xn Worker xn Docker(algorithm#1).. Docker(algorithm#n) Docker(algorithm#1).. Docker(algorithm#n) 31
32 Composability Composability is critical for AI workflows because of data processing pipelines and ensembles. Fruit or Veggie Classifier Fruit Classifier Veggie Classifier 32
33 Kernel: Elastic Scale + Intelligent Orchestration FoodClassifier CPU util, GPU util, Memory util, IO util CPU util, GPU util, Memory util, IO util FruitClassifier VeggieClassifier CPU util, GPU util, Memory util, IO util 33
34 Kernel: Elastic Scale + Intelligent Orchestration Knowing that: Algorithm A always calls Algorithm B Algorithm A consumes X CPU, X Memory, etc Algorithm B consumes X CPU, X Memory, etc CPU util, GPU util, Memory util, IO util FoodClassifier Therefore we can slot them in a way that: Reduce network latency Increase cluster utilization Build dependency graphs CPU util, GPU util, Memory util, IO util FruitClassifier VeggieClassifier CPU util, GPU util, Memory util, IO util 34
35 Kernel: Runtime Abstraction FoodClassifier FruitClassifier VeggieClassifier 35
36 Kernel: Cloud Abstraction - Storage # No storage abstraction s3 = boto3.client("s3") obj = s3.get_object(bucket="bucket-name", Key="records.csv") data = obj["body"].read() # With storage abstraction data = Algorithmia().client.file("blob://records.csv").get() s3://foo/bar blob://foo/bar hdfs://foo/bar dropbox://foo/bar etc. 36
37 Kernel: Cloud Abstraction Compute EC2 CE VM Nova Autoscaling Autoscaling Group Autoscaler Scale Set Heat Scaling Policy Load Balancing Elastic Load Balancer Load Balancer Load Balancer LBaaS Remote Storage Elastic Block Store Persistent Disk File Storage Block Storage Partial Source: Sam Ghods, KubeConf
38 Summary - What makes an OS for AI? Stack-agnostic Composable Self-optimizing Auto-scaling Monitorable Discoverability 38
39 Unix Multi-tenancy, Composability GUI (Win/Mac) Accessibility Punched Cards 1970s DOS Hardware Abstraction ios/android Built-in App Store (Discoverability)
40 AI is here Punched Cards 1970s ios/android Built-in App Store (Discoverability)
41 FREE STUFF: Signup with code: NVIDIAGTC18 for $50 on us. Thank you! Diego Oppenheimer
42 more slides
43 The New Moats Source: Jerry Chen, Greylock Ventures 43
44 Punched Cards 1970s GitHub and Heroku Today
45 Kernel: Cloud Abstraction - Storage # init client = Algorithmia.client() # init client = Algorithmia.client() # get data (S3) s3 = boto3.client("s3") obj = s3.get_object(bucket="bucket-name", Key="records.csv") data = obj["body"].read() # get data (anything) data = client.file("blob://records.csv").get() # remove seasonality data = client.algo("ts/removeseasonality").pipe(data).result # remove seasonality data = client.algo("ts/removeseasonality").pipe(data).result # forecast time series data = client.algo("ts/forecastlstm").pipe(data).result # forecast time series data = client.algo("ts/forecastlstm").pipe(data).result 45
46 01 # MY_ALGORITHM.py client = Algorithmia.client() 04 data = client.file("blob://records.csv").get() # remove seasonality 07 data = client.algo("ts/removeseasonality").pipe(data).result # forecast time series 10 data = client.algo("ts/forecastlstm").pipe(data).result 46
47 Kernel: Elastic Scale + Intelligent Orchestration MyAlgorithm # MY_ALGORITHM.py CPU util, GPU util, Memory util, IO util client = Algorithmia.client() data = client.file("blob://records.csv").get() # remove seasonality data = client.algo("ts/removeseasonality").pipe(data).result # forecast time series data = client.algo("ts/forecastlstm").pipe(data).result RemoveSeasonality CPU util, GPU util, Memory util, IO util CPU util, GPU util, Memory util, IO util ForecastLSTM 47
48 Kernel: Elastic Scale + Intelligent Orchestration Knowing that: Algorithm A always calls Algorithm B Algorithm A consumes X CPU, X Memory, etc Algorithm B consumes X CPU, X Memory, etc CPU util, GPU util, Memory util, IO util MyAlgorithm Therefore we can slot them in a way that: Reduce network latency Increase cluster utilization Build dependency graphs RemoveSeasonality CPU util, GPU util, Memory util, IO util CPU util, GPU util, Memory util, IO util ForecastLSTM 48
49 Kernel: Runtime Abstraction MyAlgorithm # MY_ALGORITHM.py client = Algorithmia.client() data = client.file("blob://records.csv").get() # remove seasonality data = client.algo("ts/removeseasonality").pipe(data).result # forecast time series data = client.algo("ts/forecastlstm").pipe(data).result RemoveSeasonality ForecastLSTM 49
50 Challenges Machine learning CPU/GPU/Specialized hardware Multiple frameworks, languages, dependencies Called from different devices/architectures Snowflake environments Unique cloud hardware and services Uncharted territory Not a lot of literature, errors messages sometimes cryptic (can t just stackoverflow) 50
Onto Petaflops with Kubernetes
Onto Petaflops with Kubernetes Vishnu Kannan Google Inc. vishh@google.com Key Takeaways Kubernetes can manage hardware accelerators at Scale Kubernetes provides a playground for ML ML journey with Kubernetes
More informationKnative: Building serverless platforms on top of Kubernetes
Knative: Building serverless platforms on top of Kubernetes Ahmet Alp Balkan @ahmetb Thanks to Mark Chmarny, Ryan Gregg, DeWitt Clinton and Bret McGowen for some of the slides used in this presentation.
More informationKubernetes made easy with Docker EE. Patrick van der Bleek Sr. Solutions Engineer NEMEA
Kubernetes made easy with Docker EE Patrick van der Bleek Sr. Solutions Engineer NEMEA Docker Enterprise Edition is More than Containers + Orchestration... DOCKER ENTERPRISE EDITION Kubernetes integration
More informationWHITEPAPER. Pipelining Machine Learning Models Together
WHITEPAPER Pipelining Machine Learning Models Together Table of Contents Introduction 2 Performance and Organizational Benefits of Pipelining 4 Practical Use Case: Twitter Sentiment Analysis 5 Practical
More informationScaling Up Performance Benchmarking
Scaling Up Performance Benchmarking -with SPECjbb2015 Anil Kumar Runtime Performance Architect @Intel, OSG Java Chair Monica Beckwith Runtime Performance Architect @Arm, Java Champion FaaS Serverless Frameworks
More informationContainerizing GPU Applications with Docker for Scaling to the Cloud
Containerizing GPU Applications with Docker for Scaling to the Cloud SUBBU RAMA FUTURE OF PACKAGING APPLICATIONS Turns Discrete Computing Resources into a Virtual Supercomputer GPU Mem Mem GPU GPU Mem
More informationLogging, Monitoring, and Alerting
Logging, Monitoring, and Alerting Logs are a part of daily life in the DevOps world In security, we focus on particular logs to detect security anomalies and for forensic capabilities A basic logging pipeline
More informationContainers, Serverless and Functions in a nutshell. Eugene Fedorenko
Containers, Serverless and Functions in a nutshell Eugene Fedorenko About me Eugene Fedorenko Senior Architect Flexagon adfpractice-fedor.blogspot.com @fisbudo Agenda Containers Microservices Docker Kubernetes
More informationReal-life technical decision points in using cloud & container technology:
Real-life technical decision points in using cloud & container technology: Modernising the NHS Simon Boichat Ross Smith Ben Coleman - Lead Azure Architect - Technical Evangelist - Cloud Solution Architect
More informationDeploying and Operating Cloud Native.NET apps
Deploying and Operating Cloud Native.NET apps Jenny McLaughlin, Sr. Platform Architect Cornelius Mendoza, Sr. Platform Architect Pivotal Cloud Native Practices Continuous Delivery DevOps Microservices
More informationUsing GPUaaS in Cloud Foundry
Using GPUaaS in Cloud Foundry Agenda Introduction GPUaaS Cloud Foundry Integration 2 Technology Research Innovation Group Innovation Advanced Research Proof of Concept User Feedback Agile Roadmap 3 Technology
More informationPontoon An Enterprise grade serverless framework using Kubernetes Kumar Gaurav, Director R&D, VMware Mageshwaran R, Staff Engineer R&D, VMware
Pontoon An Enterprise grade serverless framework using Kubernetes Kumar Gaurav, Director R&D, VMware Mageshwaran R, Staff Engineer R&D, VMware Serverless: a quick review Enables running back end logic
More informationContainer in Production : Openshift 구축사례로 이해하는 PaaS. Jongjin Lim Specialist Solution Architect, AppDev
Container in Production : Openshift 구축사례로 이해하는 PaaS Jongjin Lim Specialist Solution Architect, AppDev jonlim@redhat.com Agenda Why Containers? Solution : Red Hat Openshift Container Platform Enterprise
More informationCloud & container monitoring , Lars Michelsen Check_MK Conference #4
Cloud & container monitoring 04.05.2018, Lars Michelsen Some cloud definitions Applications Data Runtime Middleware O/S Virtualization Servers Storage Networking Software-as-a-Service (SaaS) Applications
More informationUnify DevOps and SecOps: Security Without Friction
SANS Secure DevOps Summit Unify DevOps and SecOps: Security Without Friction Matt Alderman, CISSP Chief Strategy & Marketing Officer Layered Insight @maldermania Technology Trend #1: Infrastructure Migrates
More informationReactive Microservices Architecture on AWS
Reactive Microservices Architecture on AWS Sascha Möllering Solutions Architect, @sascha242, Amazon Web Services Germany GmbH Why are we here today? https://secure.flickr.com/photos/mgifford/4525333972
More informationOh.. You got this? Attack the modern web
Oh.. You got this? Attack the modern web HELLO DENVER!...Known for more than recreational stuff 2 WARNING IDK 2018 Moses Frost. @mosesrenegade This talk may contain comments or opinions that at times may
More informationZero to Microservices in 5 minutes using Docker Containers. Mathew Lodge Weaveworks
Zero to Microservices in 5 minutes using Docker Containers Mathew Lodge (@mathewlodge) Weaveworks (@weaveworks) https://www.weave.works/ 2 Going faster with software delivery is now a business issue Software
More informationDevOps Course Content
DevOps Course Content 1. Introduction: Understanding Development Development SDLC using WaterFall & Agile Understanding Operations DevOps to the rescue What is DevOps DevOps SDLC Continuous Delivery model
More informationTECHNICAL BRIEF. Scheduling and Orchestration of Heterogeneous Docker-Based IT Landscapes. January 2017 Version 2.0 For Public Use
TECHNICAL BRIEF Scheduling and Orchestration of Heterogeneous Docker-Based IT Landscapes January 2017 Version 2.0 For Public Use Table of Contents 1 Summary... 2 2 Introduction... 2 3 Stonebranch DevOps
More informationApplication Centric Microservices Ken Owens, CTO Cisco Intercloud Services. Redhat Summit 2015
Application Centric Microservices Ken Owens, CTO Cisco Intercloud Services Redhat Summit 2015 Agenda Introduction Why Application Centric Application Deployment Options What is Microservices Infrastructure
More informationIBM Bluemix compute capabilities IBM Corporation
IBM Bluemix compute capabilities After you complete this section, you should understand: IBM Bluemix infrastructure compute options Bare metal servers Virtual servers IBM Bluemix Container Service IBM
More informationImportant DevOps Technologies (3+2+3days) for Deployment
Important DevOps Technologies (3+2+3days) for Deployment DevOps is the blending of tasks performed by a company's application development and systems operations teams. The term DevOps is being used in
More informationFlip the Switch to Container-based Clouds
Flip the Switch to Container-based Clouds B I L L B O R S A R I D I R E C T O R, S Y S T E M S E N G I N E E R I N G 1 November 2017 1 2017 Datera Datera at a Glance Founded 2013 Smart storage for clouds
More informationSão Paulo. August,
São Paulo August, 28 2018 Going Cloud Native with Cloud Foundry Luis Macedo Sr Platform Engineer, Pivotal @luis0macedo What is Cloud Native Platform? - A platform that delivers predictable deployment
More informationBuilding a high-performance, scalable ML & NLP platform with Python. Sheer El Showk CTO, Lore Ai
Building a high-performance, scalable ML & NLP platform with Python Sheer El Showk CTO, Lore Ai www.lore.ai Lore is a small startup focused on developing and applying machine-learning techniques to solve
More information[Docker] Containerization
[Docker] Containerization ABCD-LMA Working Group Will Kinard October 12, 2017 WILL Kinard Infrastructure Architect Software Developer Startup Venture IC Husband Father Clemson University That s me. 2 The
More informationImplementing the Twelve-Factor App Methodology for Developing Cloud- Native Applications
Implementing the Twelve-Factor App Methodology for Developing Cloud- Native Applications By, Janakiram MSV Executive Summary Application development has gone through a fundamental shift in the recent past.
More informationUsing DC/OS for Continuous Delivery
Using DC/OS for Continuous Delivery DevPulseCon 2017 Elizabeth K. Joseph, @pleia2 Mesosphere 1 Elizabeth K. Joseph, Developer Advocate, Mesosphere 15+ years working in open source communities 10+ years
More informationContainers and the Evolution of Computing
Containers and the Evolution of Computing Matt Nowina Solutions Architect 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Scaling Applications Order UI User UI Shipping UI Order
More informationMicroservices. Chaos Kontrolle mit Kubernetes. Robert Kubis - Developer Advocate,
Microservices Chaos Kontrolle mit Kubernetes Robert Kubis - Developer Advocate, Google @hostirosti About me Robert Kubis Developer Advocate Google Cloud Platform London, UK hostirosti github.com/hostirosti
More informationRED HAT OPENSHIFT A FOUNDATION FOR SUCCESSFUL DIGITAL TRANSFORMATION
RED HAT OPENSHIFT A FOUNDATION FOR SUCCESSFUL DIGITAL TRANSFORMATION Stephanos D Bacon Product Portfolio Strategy, Application Platforms Stockholm, 13 September 2017 1 THE PATH TO DIGITAL LEADERSHIP IT
More informationSecure Kubernetes Container Workloads
Secure Kubernetes Container Workloads with Production-Grade Networking Cynthia Thomas Irena Berezovsky Tim Hockin CIA IT operations have top secret apps for their agents, most of which require isolation
More informationTitle DC Automation: It s a MARVEL!
Title DC Automation: It s a MARVEL! Name Nikos D. Anagnostatos Position Network Consultant, Network Solutions Division Classification ISO 27001: Public Data Center Evolution 2 Space Hellas - All Rights
More informationBuilding a Microservices Platform with Kubernetes. Matthew Mark
Building a Microservices Platform with Kubernetes Matthew Mark Miller @DataMiller Cloud Native: Microservices running inside Containers on top of Platforms on any infrastructure Microservice A software
More informationDeep Learning Inference on Openshift with GPUs
Deep Learning Inference on Openshift with GPUs OpenShift Commons, Seattle, Dec 10 2018 Tripti Singhal Product Manager, NVIDIA Deep Learning Software Tushar Katarki Product Manager, AI on OpenShift AGENDA
More informationWhat s New in K8s 1.3
What s New in K8s 1.3 Carter Morgan Background: 3 Hurdles How do I write scalable apps? The App How do I package and distribute? What runtimes am I locked into? Can I scale? The Infra Is it automatic?
More informationGetting Started With Serverless: Key Use Cases & Design Patterns
Hybrid clouds that just work Getting Started With Serverless: Key Use Cases & Design Patterns Jennifer Gill Peter Fray Vamsi Chemitiganti Sept 20, 2018 Platform9 Systems 1 Agenda About Us Introduction
More informationRed Hat Roadmap for Containers and DevOps
Red Hat Roadmap for Containers and DevOps Brian Gracely, Director of Strategy Diogenes Rettori, Principal Product Manager Red Hat September, 2016 Digital Transformation Requires an evolution in... 2 APPLICATIONS
More informationKuberiter White Paper. Kubernetes. Cloud Provider Comparison Chart. Lawrence Manickam Kuberiter Inc
Kuberiter White Paper Kubernetes Cloud Provider Comparison Chart Lawrence Manickam Kuberiter Inc Oct 2018 Executive Summary Kubernetes (K8S) has become the de facto standard for Cloud Application Deployments.
More informationHow to go serverless with AWS Lambda
How to go serverless with AWS Lambda Roman Plessl, nine (AWS Partner) Zürich, AWSomeDay 12. September 2018 About myself and nine Roman Plessl Working for nine as a Solution Architect, Consultant and Leader.
More informationJenkins: A complete solution. From Continuous Integration to Continuous Delivery For HSBC
Jenkins: A complete solution From Integration to Delivery For HSBC Rajesh Kumar DevOps Architect @RajeshKumarIN www.rajeshkumar.xyz Agenda Why Jenkins? Introduction and some facts about Jenkins Supported
More informationAgile CI/CD with Jenkins and/at ZeroStack. Kiran Bondalapati CTO, Co-Founder & Jenkins Admin ZeroStack, Inc. (
Agile CI/CD with Jenkins and/at ZeroStack Kiran Bondalapati CTO, Co-Founder & Jenkins Admin ZeroStack, Inc. (www.zerostack.com) Outline ZeroStack Hybrid Cloud Platform Jenkins and ZeroStack Jenkins at
More informationYOUR APPLICATION S JOURNEY TO THE CLOUD. What s the best way to get cloud native capabilities for your existing applications?
YOUR APPLICATION S JOURNEY TO THE CLOUD What s the best way to get cloud native capabilities for your existing applications? Introduction Moving applications to cloud is a priority for many IT organizations.
More informationWHITE PAPER. RedHat OpenShift Container Platform. Benefits: Abstract. 1.1 Introduction
WHITE PAPER RedHat OpenShift Container Platform Abstract Benefits: Applications are designed around smaller independent components called microservices. Elastic resources: Scale up or down quickly and
More informationPasiruoškite ateičiai: modernus duomenų centras. Laurynas Dovydaitis Microsoft Azure MVP
Pasiruoškite ateičiai: modernus duomenų centras Laurynas Dovydaitis Microsoft Azure MVP 2016-05-17 Tension drives change The datacenter today Traditional datacenter Tight coupling between infrastructure
More informationAlexandre Menezes Cloud Solution Architect
Alexandre Menezes Cloud Solution Architect alexandre.menezes@microsoft.com https://www.linkedin.com/in/alexandremenezes/ You want to adopt cloud technologies for your apps, but Agility Time to market Reduce
More informationContainers & Microservices For Realists. Karthik
Containers & Microservices For Realists Karthik Gaekwad @iteration1 Karthik Gaekwad @iteration1 Principal Member of Technical Staff Oracle Container Cloud Team Previous: 10 years building cloud products
More informationBuilding a Data-Friendly Platform for a Data- Driven Future
Building a Data-Friendly Platform for a Data- Driven Future Benjamin Hindman - @benh 2016 Mesosphere, Inc. All Rights Reserved. INTRO $ whoami BENJAMIN HINDMAN Co-founder and Chief Architect of Mesosphere,
More informationDeploying and Operating Cloud Native.NET apps
Deploying and Operating Cloud Native.NET apps Jenny McLaughlin, Sr. Platform Architect Cornelius Mendoza, Sr. Platform Architect Pivotal Cloud Native Practices Continuous Delivery DevOps Microservices
More informationSunil Shah SECURE, FLEXIBLE CONTINUOUS DELIVERY PIPELINES WITH GITLAB AND DC/OS Mesosphere, Inc. All Rights Reserved.
Sunil Shah SECURE, FLEXIBLE CONTINUOUS DELIVERY PIPELINES WITH GITLAB AND DC/OS 1 Introduction MOBILE, SOCIAL & CLOUD ARE RAISING CUSTOMER EXPECTATIONS We need a way to deliver software so fast that our
More informationCisco CloudCenter Solution with Cisco ACI: Common Use Cases
Cisco CloudCenter Solution with Cisco ACI: Common Use Cases Cisco ACI increases network security, automates communication policies based on business-relevant application requirements, and decreases developer
More informationMesosphere and the Enterprise: Run Your Applications on Apache Mesos. Steve Wong Open Source Engineer {code} by Dell
Mesosphere and the Enterprise: Run Your Applications on Apache Mesos Steve Wong Open Source Engineer {code} by Dell EMC @cantbewong Open source at Dell EMC {code} by Dell EMC is a group of passionate open
More informationBuilding/Running Distributed Systems with Apache Mesos
Building/Running Distributed Systems with Apache Mesos Philly ETE April 8, 2015 Benjamin Hindman @benh $ whoami 2007-2012 2009-2010 - 2014 my other computer is a datacenter my other computer is a datacenter
More informationIndustry-leading Application PaaS Platform
Industry-leading Application PaaS Platform Solutions Transactional Apps Digital Marketing LoB App Modernization Services Web Apps Web App for Containers API Apps Mobile Apps IDE Enterprise Integration
More informationWindows Azure Services - At Different Levels
Windows Azure Windows Azure Services - At Different Levels SaaS eg : MS Office 365 Paas eg : Azure SQL Database, Azure websites, Azure Content Delivery Network (CDN), Azure BizTalk Services, and Azure
More informationFixing the "It works on my machine!" Problem with Docker
Fixing the "It works on my machine!" Problem with Docker Jared M. Smith @jaredthecoder About Me Cyber Security Research Scientist at Oak Ridge National Lab BS and MS in Computer Science from the University
More informationAccelerate AI with Cisco Computing Solutions
Accelerate AI with Cisco Computing Solutions Data is everywhere. Your data scientists are propelling your business into a future of data-driven intelligence. But how do you deploy and manage artificial
More informationAzure Highlights. Randy Pagels Sr. Developer Technology Specialist US DX Developer Tools - Central Region
Azure Highlights Randy Pagels Sr. Developer Technology Specialist US DX Developer Tools - Central Region IaaS vs PaaS Introduction to Microsoft Azure IaaS, PaaS and SaaS Self-Service Provisioning Global
More informationCONTAINERS AND MICROSERVICES WITH CONTRAIL
CONTAINERS AND MICROSERVICES WITH CONTRAIL Scott Sneddon Sree Sarva DP Ayyadevara Sr. Director Sr. Director Director Cloud and SDN Contrail Solutions Product Line Management This statement of direction
More informationCLOUD-NATIVE APPLICATION DEVELOPMENT/ARCHITECTURE
JAN WILLIES Global Kubernetes Lead at Accenture Technology jan.willies@accenture.com CLOUD-NATIVE APPLICATION DEVELOPMENT/ARCHITECTURE SVEN MENTL Cloud-native at Accenture Technology ASG sven.mentl@accenture.com
More informationIntroduction to virtualisation, hardware, cloud, containers, unikernels, microkernels. and everything else
Introduction to virtualisation, hardware, cloud, containers, unikernels, microkernels. and everything else What s driving us? Smaller Faster Efficient Secure Cloud, infrastructure and virtualisation Smaller,
More informationPrzyspiesz tworzenie aplikacji przy pomocy Openshift Container Platform. Jarosław Stakuń Senior Solution Architect/Red Hat CEE
Przyspiesz tworzenie aplikacji przy pomocy Openshift Container Platform Jarosław Stakuń Senior Solution Architect/Red Hat CEE jstakun@redhat.com Monetize innovation http://www.forbes.com/innovative-companies/list/
More informationThe intelligence of hyper-converged infrastructure. Your Right Mix Solution
The intelligence of hyper-converged infrastructure Your Right Mix Solution Applications fuel the idea economy SLA s, SLA s, SLA s Regulations Latency Performance Integration Disaster tolerance Reliability
More informationLessons Learned: Deploying Microservices Software Product in Customer Environments Mark Galpin, Solution Architect, JFrog, Inc.
Lessons Learned: Deploying Microservices Software Product in Customer Environments Mark Galpin, Solution Architect, JFrog, Inc. Who s speaking? Mark Galpin Solution Architect @jfrog magalpin Microservices
More informationRunning MarkLogic in Containers (Both Docker and Kubernetes)
Running MarkLogic in Containers (Both Docker and Kubernetes) Emma Liu Product Manager, MarkLogic Vitaly Korolev Staff QA Engineer, MarkLogic @vitaly_korolev 4 June 2018 MARKLOGIC CORPORATION Source: http://turnoff.us/image/en/tech-adoption.png
More informationAlteryx Technical Overview
Alteryx Technical Overview v 1.5, March 2017 2017 Alteryx, Inc. v1.5, March 2017 Page 1 Contents System Overview... 3 Alteryx Designer... 3 Alteryx Engine... 3 Alteryx Service... 5 Alteryx Scheduler...
More informationTaming your heterogeneous cloud with Red Hat OpenShift Container Platform.
Taming your heterogeneous cloud with Red Hat OpenShift Container Platform martin@redhat.com Business Problem: Building a Hybrid Cloud solution PartyCo Some Bare Metal machines Mostly Virtualised CosPlayUK
More informationSpark and Flink running scalable in Kubernetes Frank Conrad
Spark and Flink running scalable in Kubernetes Frank Conrad Architect @ apomaya.com scalable efficient low latency processing 1 motivation, use case run (external, unknown trust) customer spark / flink
More informationDisclaimer This presentation may contain product features that are currently under development. This overview of new technology represents no commitme
CNA1612BU Deploying real-world workloads on Kubernetes and Pivotal Cloud Foundry VMworld 2017 Fred Melo, Director of Technology, Pivotal Merlin Glynn, Sr. Technical Product Manager, VMware Content: Not
More informationBuild Cloud like Rackspace with OpenStack Ansible
Build Cloud like Rackspace with OpenStack Ansible https://etherpad.openstack.org/p/osa-workshop-01 Jirayut Nimsaeng DevOps & Cloud Architect 2nd Cloud OpenStack-Container Conference and Workshop 2016 Grand
More informationNVIDIA DGX SYSTEMS PURPOSE-BUILT FOR AI
NVIDIA DGX SYSTEMS PURPOSE-BUILT FOR AI Overview Unparalleled Value Product Portfolio Software Platform From Desk to Data Center to Cloud Summary AI researchers depend on computing performance to gain
More informationRed Hat Containers Roadmap. Red Hat A panel of product directors
Red Hat Containers Roadmap Red Hat A panel of product directors Joe Fernandes Sr. Director Product Mgmt, Red Hat Rich Sharples Sr. Director of Product Mgmt, Red Hat Sayan Saha Sr. Manager of Product Mgmt,
More informationDIY Hosting for Online Privacy. Shoumik Palkar and Matei Zaharia Stanford University
DIY Hosting for Online Privacy Shoumik Palkar and Matei Zaharia Stanford University Before: A Federated Internet The Internet and its protocols were designed to be federated Organizations would host own
More informationSUSE s vision for agile software development and deployment in the Software Defined Datacenter
From Git to Cloud SUSE s vision for agile software development and deployment in the Software Defined Datacenter Joachim Werner Senior Product Manager joe@suse.com Peter Chadwick Director Product Management
More informationAMD EPYC Delivers Linear Scalability for Docker with Bare-Metal Performance
Solution Brief February, 2019 AMD EPYC Delivers Linear Scalability for Docker with Bare-Metal Performance The AMD EPYC SoC brings a new balance to the datacenter. Utilizing x86 architecture, the AMD EPYC
More informationS INSIDE NVIDIA GPU CLOUD DEEP LEARNING FRAMEWORK CONTAINERS
S8497 - INSIDE NVIDIA GPU CLOUD DEEP LEARNING FRAMEWORK CONTAINERS Chris Lamb CUDA and NGC Engineering, NVIDIA John Barco NGC Product Management, NVIDIA NVIDIA GPU Cloud (NGC) overview AGENDA Using NGC
More informationWelcome to Docker Birthday # Docker Birthday events (list available at Docker.Party) RSVPs 600 mentors Big thanks to our global partners:
Docker Birthday #3 Welcome to Docker Birthday #3 2 120 Docker Birthday events (list available at Docker.Party) 7000+ RSVPs 600 mentors Big thanks to our global partners: Travel Planet 24 e-food.gr The
More informationOPENSTACK: THE OPEN CLOUD
OPENSTACK: THE OPEN CLOUD Anuj Sehgal (s.anuj@jacobs-university.de) AIMS 2012 Labs 04 June 2012 1 Outline What is the cloud? Background Architecture OpenStack Nova OpenStack Glance 2 What is the Cloud?
More informationMesosphere and Percona Server for MongoDB. Jeff Sandstrom, Product Manager (Percona) Ravi Yadav, Tech. Partnerships Lead (Mesosphere)
Mesosphere and Percona Server for MongoDB Jeff Sandstrom, Product Manager (Percona) Ravi Yadav, Tech. Partnerships Lead (Mesosphere) Mesosphere DC/OS MICROSERVICES, CONTAINERS, & DEV TOOLS DATA SERVICES,
More informationMesosphere and Percona Server for MongoDB. Peter Schwaller, Senior Director Server Eng. (Percona) Taco Scargo, Senior Solution Engineer (Mesosphere)
Mesosphere and Percona Server for MongoDB Peter Schwaller, Senior Director Server Eng. (Percona) Taco Scargo, Senior Solution Engineer (Mesosphere) Mesosphere DC/OS MICROSERVICES, CONTAINERS, & DEV TOOLS
More informationIntegrated Management of OpenPOWER Converged Infrastructures. Revolutionizing the Datacenter
Integrated Management of OpenPOWER Converged Infrastructures Marcelo Perazolo, Architect IBM Systems Revolutionizing the Datacenter Join the Conversation #OpenPOWERSummit Converged Infrastructure Systems
More informationCreating a Hybrid Gateway for API Traffic. Ed Julson API Platform Product Marketing TIBCO Software
Creating a Hybrid Gateway for API Traffic Ed Julson API Platform Product Marketing TIBCO Software Housekeeping Webinar Recording Today s webinar is being recorded and a link to the recording will be emailed
More informationScaling DreamFactory
Scaling DreamFactory This white paper is designed to provide information to enterprise customers about how to scale a DreamFactory Instance. The sections below talk about horizontal, vertical, and cloud
More informationDocker and Oracle Everything You Wanted To Know
Docker and Oracle Everything You Wanted To Know June, 2017 Umesh Tanna Principal Technology Sales Consultant Oracle Sales Consulting Centers(SCC) Bangalore Safe Harbor Statement The following is intended
More informationThis document (including, without limitation, any product roadmap or statement of direction data) illustrates the planned testing, release and
Download the App to download the TIBCO NOW App visit now.tibco.com/2018/mobile-app 2 Mashery Local The Cloud Native API Platform for your Unique Environment Beerinder Rodey - Product Murty Gurajada - Senior
More informationCisco Tetration Analytics
Cisco Tetration Analytics Enhanced security and operations with real time analytics John Joo Tetration Business Unit Cisco Systems Security Challenges in Modern Data Centers Securing applications has become
More informationContainers Infrastructure for Advanced Management. Federico Simoncelli Associate Manager, Red Hat October 2016
Containers Infrastructure for Advanced Management Federico Simoncelli Associate Manager, Red Hat October 2016 About Me Kubernetes Decoupling problems to hand out to different teams Layer of abstraction
More informationWhat s New in K8s 1.3
What s New in K8s 1.3 Carter Morgan Background: 3 Hurdles How do I write scalable apps? The App How do I package and distribute? What runtimes am I locked into? Can I scale? The Infra Is it automatic?
More informationHow to Put Your AF Server into a Container
How to Put Your AF Server into a Container Eugene Lee Technology Enablement Engineer 1 Technology Challenges 2 Cloud Native bring different expectations 3 We are becoming more impatient Deploy Code Release
More informationContinuous Delivery for Cloud Native Applications
Continuous Delivery for Cloud Native Applications Cyrille Le Clerc, Director, Product Management at CloudBees Bjorn Boe, Senior Field Engineer at Pivotal Software Speakers /Cyrille Le Clerc Product Manager
More informationDeveloping Enterprise Cloud Solutions with Azure
Developing Enterprise Cloud Solutions with Azure Java Focused 5 Day Course AUDIENCE FORMAT Developers and Software Architects Instructor-led with hands-on labs LEVEL 300 COURSE DESCRIPTION This course
More informationAzure Certification BootCamp for Exam (Developer)
Azure Certification BootCamp for Exam 70-532 (Developer) Course Duration: 5 Days Course Authored by CloudThat Description Microsoft Azure is a cloud computing platform and infrastructure created for building,
More informationHow to Keep UP Through Digital Transformation with Next-Generation App Development
How to Keep UP Through Digital Transformation with Next-Generation App Development Peter Sjoberg Jon Olby A Look Back, A Look Forward Dedicated, data structure dependent, inefficient, virtualized Infrastructure
More information利用 Mesos 打造高延展性 Container 環境. Frank, Microsoft MTC
利用 Mesos 打造高延展性 Container 環境 Frank, Microsoft MTC About Me Developer @ Yahoo! DevOps @ HTC Technical Architect @ MSFT Agenda About Docker Manage containers Apache Mesos Mesosphere DC/OS application = application
More informationDocker II - Judgement Day
Docker II - Judgement Day PUG Challenge Americas 2016 Thomas Hansen whogloo, Inc. Introduction Thomas Hansen CEO & Co-Founder of whogloo, Inc. Working with OpenEdge since 1995 Working with Docker since
More informationContainer-Native Storage
Container-Native Storage Solving the Persistent Storage Challenge with GlusterFS Michael Adam Manager, Software Engineering José A. Rivera Senior Software Engineer 2017.09.11 WARNING The following presentation
More informationSecuring Microservices Containerized Security in AWS
Securing Microservices Containerized Security in AWS Mike Gillespie, Solutions Architect, Amazon Web Services Splitting Monoliths Ten Years Ago Splitting Monoliths Ten Years Ago XML & SOAP Splitting Monoliths
More informationKubernetes The Path to Cloud Native
Kubernetes The Path to Cloud Native Eric Brewer VP, Infrastructure @eric_brewer August 28, 2015 ACM SOCC Cloud Na*ve Applica*ons Middle of a great transition unlimited ethereal resources in the Cloud an
More informationFast and Easy Persistent Storage for Docker* Containers with Storidge and Intel
Solution brief Intel Storage Builders Storidge ContainerIO TM Intel Xeon Processor Scalable Family Intel SSD DC Family for PCIe*/NVMe Fast and Easy Persistent Storage for Docker* Containers with Storidge
More information