Cluster management at Google john wilkes / Principal Software Engineer
|
|
- Angela Manning
- 5 years ago
- Views:
Transcription
1 Cluster management at Google john wilkes / johnwilkes@google.com Principal Software Engineer
2 For the past 15 years, Google has been building out the world s fastest, most powerful, highest quality cloud infrastructure on the planet. Images by Connie Zhou
3 Hello World job hello_world = { runtime = { cell = 'ic' } // What cluster should we run in? binary = '.../hello_world_webserver' // What program are we to run? args = { port = '%port%' } // Command line parameters requirements = { // Resource requirements ram = 100M disk = 100M cpu = 0.1 } replicas = // Number of tasks }
4 Hello World > borgcfg.../hello_world_webserver.borg up... About to affect tasks and 1 packages on cell IC. Do you wish to continue (yes/no) [no]? yes ==== Staging package hello_world_webserver.63ce1b965155c75e/johnwilkes on ic... SUCCESS ==== Making package hello_world_webserver.63ce1b965155c75e/johnwilkes on ic... SUCCESS ==== Starting job hello_world on ic... SUCCESS
5 Hello World
6 Binary Hello World Config file webbrowsers browsers web borgcfg What just happened? Cell BorgMaster BorgMaster UIshard shard BorgMaster UI BorgMaster UI shard read/ui BorgMaster UI shard shard persistent store (Paxos) Scheduler scheduler linkshard shard link link shard linkshard shard link Borglet Borglet Borglet Borglet
7 Hello World Images by Connie Zhou
8 Hello World
9 Failures task-eviction rates and causes 9
10 A 2000-machine service will have >10 machine crashes per day DRAM errors (1% AFR) Disk failures (2-10% AFR) crashes (~2/year) OS upgrades (2-6/year) Images by Connie Zhou
11 A 2000-machine service will have >10 machine crashes per day This is normal; not a problem DRAM errors (1% AFR) Disk failures (2-10% AFR) crashes (~2/year) OS upgrades (2-6/year) Images by Connie Zhou
12 Efficiency Advanced binpacking algorithms Experimental placement of production VM workload, July 2014
13 Efficiency Advanced binpacking algorithms nice round numbers There are no obvious bucket sizes (cf. cloud VMs) gaming the system 13
14 Efficiency CDF Advanced binpacking algorithms Batch jobs Service jobs Heterogeneous workloads, May 2011 Omega paper, EuroSys 2013 Job runtime [log]
15 Efficiency Utilization: sharing clusters between prod/batch helps 15
16 Efficiency Utilization: sharing clusters between prod/batch helps 16
17 Efficiency Advanced binpacking algorithms Data from a cluster with 12k machines, May 2011 Trace is publicly available Heterogeneity and dynamicity of clouds at scale: Google trace analysis. SoCC 12
18 Efficiency Resource reclamation could be more aggressive Nov/Dec
19 Efficiency Multiple applications per machine tasks/machine CPI^2 paper, EuroSys 2013 threads/machine
20 Efficiency Multiple applications per machine CPI^2 paper, EuroSys Gather CPI for all the tasks in a job Find outliers Take action μ μ+σ μ + 2σ μ + 3σ task CPI outliers => victims
21 Achieving desired behavior Exposing mechanisms is fragile Better: declarative intents
22 Achieving desired behavior Service level objective (SLO) Examples: availability obtainability reliability velocity freshness? accuracy? security? an SLO
23 A few other moving parts Config file webbrowsers browsers web borgcfg Cell UI BorgMaster UI BorgMaster UI BorgMaster UI shard BorgMaster read/ui shard BorgMaster shard shard shard persistent store (Paxos) Scheduler scheduler linkshard shard link link shard linkshard shard link Borglet Borglet Borglet Borglet
24 A few other moving parts job config master agent app
25 A few other moving parts storage job config master agent app
26 A few other moving parts storage job config master agent app
27 A few other moving parts system config storage job config master agent app
28 A few other moving parts system config storage job config master agent app monitoring
29 A few other moving parts system config storage job config master agent app monitoring binaries + data distribution
30 A few other moving parts system config security storage job config master agent app monitoring binaries + data distribution
31 A few other moving parts system config security accounting/planning storage job config master agent app monitoring binaries + data distribution Diagram from an original by Cody Smith.
32 A few other moving parts system config security accounting/billing storage job config master agent app monitoring binaries + data distribution Diagram from an original by Cody Smith.
33 s Everything at Google runs in a container -- including our VMs s give us: resource isolation execution isolation CPU QoS We start over 2 billion containers per week. Image: "" glynlowe CC-BY-2.0
34 Kubernetes κυβερνήτης: Greek for pilot or helmsman of a ship The open source cluster manager from Google.
35 Kubernetes Web server Log roller
36 Pods Web server Kubernetes master/scheduler Log roller
37 Labels FE FE FE FE FE Kubernetes master/scheduler
38 Label selectors FE FE labels: role: frontend FE FE FE Kubernetes master/scheduler
39 Label selectors FE FE labels: role: frontend stage: production FE FE FE Kubernetes master/scheduler
40 Replica controller FE FE replicas: 3 template:... labels: role: frontend FE Kubernetes - Master/Scheduler
41 Replica controller FE FE FE replicas: 4 template:... labels: role: frontend FE Kubernetes - Master/Scheduler
42 Service id: frontend-service port: 9000 labels: role: frontend frontend-service FE FE FE FE Kubernetes - Master/Scheduler
43 Kubernetes The open source cluster manager from Google. Pods: groups of containers Labels Replica controller Services
44 resources Pulling it all together Do it yourself? Sure. offered load
45
46
47 Pulling it all together We choose to go to the roof not because it is glamorous, but because it is right there!... the bulk of our success is the result of the methodical, relentless, persistent pursuit of 1.32x opportunities -- what I have come to call "roofshots". -- Luiz Barroso
48 Pulling it all together Porsche doesn't make cars: it designs and assembles them 1H2014: 1.7% (89k) of VW group's vehicles 23% ( 1.4b) of its profits Data: Volkswagen, Image: john wilkes
49 Pulling it all together Cloud system providers are getting better at everything... capacity management monitoring storage + networking reliability software development tooling... Wouldn't you like to stand on others' shoulders?
50 Three rules of thumb: 1. Resiliency is more important than performance. 2. Relax. Let go. Build on what others have done. 3. Do more monitoring. Images by Connie Zhou
51
52 Achieving desired behavior Service level agreement (SLA) SLA = SLOs + consequences of achieving or missing them Example: if availability > 99.95% (SLO) user pays xx/cpu-week else gets a 30% refund an SLO
53 For the past 15 years, Google has been building out the world s fastest, most powerful, highest quality cloud infrastructure on the planet. Images by Connie Zhou
Large-scale cluster management at Google with Borg
Large-scale cluster management at Google with Borg Abhishek Verma, Luis Pedrosa, Madhukar Korupolu, David Oppenheimer, Eric Tune, John Wilkes Google Inc. Slides heavily derived from John Wilkes s presentation
More informationMicroservices. Chaos Kontrolle mit Kubernetes. Robert Kubis - Developer Advocate,
Microservices Chaos Kontrolle mit Kubernetes Robert Kubis - Developer Advocate, Google @hostirosti About me Robert Kubis Developer Advocate Google Cloud Platform London, UK hostirosti github.com/hostirosti
More informationSo, I have all these containers! Now what?
So, I have all these containers! Now what? Image by Connie Zhou Developer View job hello_world = { runtime = { cell = 'ic' } // Cell (cluster) to run in binary = '.../hello_world_webserver' // Program
More information@briandorsey #kubernetes #GOTOber
1 Kubernetes Changing the way we think and talk about computing GOTO Berlin - December 2015 2 What is this talk? Container 3 Brian Dorsey Developer Advocate - Google Cloud platform +BrianDorsey @briandorsey
More informationKubernetes The Path to Cloud Native
Kubernetes The Path to Cloud Native Eric Brewer VP, Infrastructure @eric_brewer August 28, 2015 ACM SOCC Cloud Na*ve Applica*ons Middle of a great transition unlimited ethereal resources in the Cloud an
More informationCONTAINERS AND MICROSERVICES WITH CONTRAIL
CONTAINERS AND MICROSERVICES WITH CONTRAIL Scott Sneddon Sree Sarva DP Ayyadevara Sr. Director Sr. Director Director Cloud and SDN Contrail Solutions Product Line Management This statement of direction
More informationKey aspects of cloud computing. Towards fuller utilization. Two main sources of resource demand. Cluster Scheduling
Key aspects of cloud computing Cluster Scheduling 1. Illusion of infinite computing resources available on demand, eliminating need for up-front provisioning. The elimination of an up-front commitment
More informationKey aspects of cloud computing. Towards fuller utilization. Two main sources of resource demand. Cluster Scheduling
Key aspects of cloud computing Cluster Scheduling 1. Illusion of infinite computing resources available on demand, eliminating need for up-front provisioning. The elimination of an up-front commitment
More informationPreemptive, Low Latency Datacenter Scheduling via Lightweight Virtualization
Preemptive, Low Latency Datacenter Scheduling via Lightweight Virtualization Wei Chen, Jia Rao*, and Xiaobo Zhou University of Colorado, Colorado Springs * University of Texas at Arlington Data Center
More informationEverything You Ever Wanted To Know About Resource Scheduling... Almost
logo Everything You Ever Wanted To Know About Resource Scheduling... Almost Tim Hockin Senior Staff Software Engineer, Google @thockin Who is thockin? Founding member of Kubernetes
More informationKuberiter White Paper. Kubernetes. Cloud Provider Comparison Chart. Lawrence Manickam Kuberiter Inc
Kuberiter White Paper Kubernetes Cloud Provider Comparison Chart Lawrence Manickam Kuberiter Inc Oct 2018 Executive Summary Kubernetes (K8S) has become the de facto standard for Cloud Application Deployments.
More informationWhat s New in K8s 1.3
What s New in K8s 1.3 Carter Morgan Background: 3 Hurdles How do I write scalable apps? The App How do I package and distribute? What runtimes am I locked into? Can I scale? The Infra Is it automatic?
More informationLarge-scale cluster management at Google with Borg
Large-scale cluster management at Google with Borg Abhishek Verma Luis Pedrosa Madhukar Korupolu David Oppenheimer Eric Tune John Wilkes Google Inc. Abstract Google s Borg system is a cluster manager that
More informationHPC in Cloud. Presenter: Naresh K. Sehgal Contributors: Billy Cox, John M. Acken, Sohum Sohoni
HPC in Cloud Presenter: Naresh K. Sehgal Contributors: Billy Cox, John M. Acken, Sohum Sohoni 2 Agenda What is HPC? Problem Statement(s) Cloud Workload Characterization Translation from High Level Issues
More informationKubernetes 101. Doug Davis, STSM September, 2017
Kubernetes 101 Doug Davis, STSM September, 2017 Today's Agenda What is Kubernetes? How was Kubernetes created? Where is the Kubernetes community? Technical overview What's the current status of Kubernetes?
More informationDisclaimer This presentation may contain product features that are currently under development. This overview of new technology represents no commitme
CNA2080BU Deep Dive: How to Deploy and Operationalize Kubernetes Cornelia Davis, Pivotal Nathan Ness Technical Product Manager, CNABU @nvpnathan #VMworld #CNA2080BU Disclaimer This presentation may contain
More informationBeyond 1001 Dedicated Data Service Instances
Beyond 1001 Dedicated Data Service Instances Introduction The Challenge Given: Application platform based on Cloud Foundry to serve thousands of apps Application Runtime Many platform users - who don
More informationIntroduction to Kubernetes Storage Primitives for Stateful Workloads
September 12, 2017 Introduction to Kubernetes Storage Primitives for Stateful Workloads Saad Ali Google @the_saad_ali Chris Duchesne {code} @ChrisDuchesne Agenda Presentation Quick intro to Kubernetes
More informationManaging Compute and Storage at Scale with Kubernetes. Dan Paik / Google
Managing Compute and Storage at Scale with Kubernetes Dan Paik / Google Have You Recently... played a hit mobile game? shopped at an online marketplace? followed breaking news? attended a concert? filed
More informationΕΠΛ372 Παράλληλη Επεξεργάσια
ΕΠΛ372 Παράλληλη Επεξεργάσια Warehouse Scale Computing and Services Γιάννος Σαζεϊδης Εαρινό Εξάμηνο 2014 READING 1. Read Barroso The Datacenter as a Computer http://www.morganclaypool.com/doi/pdf/10.2200/s00193ed1v01y200905cac006?cookieset=1
More informationAn Introduction to Kubernetes
8.10.2016 An Introduction to Kubernetes Premys Kafka premysl.kafka@hpe.com kafkapre https://github.com/kafkapre { History }???? - Virtual Machines 2008 - Linux containers (LXC) 2013 - Docker 2013 - CoreOS
More informationThe Elasticity and Plasticity in Semi-Containerized Colocating Cloud Workload: a view from Alibaba Trace
The Elasticity and Plasticity in Semi-Containerized Colocating Cloud Workload: a view from Alibaba Trace Qixiao Liu* and Zhibin Yu Shenzhen Institute of Advanced Technology Chinese Academy of Science @SoCC
More informationRunning MarkLogic in Containers (Both Docker and Kubernetes)
Running MarkLogic in Containers (Both Docker and Kubernetes) Emma Liu Product Manager, MarkLogic Vitaly Korolev Staff QA Engineer, MarkLogic @vitaly_korolev 4 June 2018 MARKLOGIC CORPORATION Source: http://turnoff.us/image/en/tech-adoption.png
More informationMesosphere and Percona Server for MongoDB. Jeff Sandstrom, Product Manager (Percona) Ravi Yadav, Tech. Partnerships Lead (Mesosphere)
Mesosphere and Percona Server for MongoDB Jeff Sandstrom, Product Manager (Percona) Ravi Yadav, Tech. Partnerships Lead (Mesosphere) Mesosphere DC/OS MICROSERVICES, CONTAINERS, & DEV TOOLS DATA SERVICES,
More informationMesosphere and Percona Server for MongoDB. Peter Schwaller, Senior Director Server Eng. (Percona) Taco Scargo, Senior Solution Engineer (Mesosphere)
Mesosphere and Percona Server for MongoDB Peter Schwaller, Senior Director Server Eng. (Percona) Taco Scargo, Senior Solution Engineer (Mesosphere) Mesosphere DC/OS MICROSERVICES, CONTAINERS, & DEV TOOLS
More informationWhat s New in K8s 1.3
What s New in K8s 1.3 Carter Morgan Background: 3 Hurdles How do I write scalable apps? The App How do I package and distribute? What runtimes am I locked into? Can I scale? The Infra Is it automatic?
More informationKubernetes: What s New
Kubernetes: What s New LISA 15 Tim Hockin Senior Staff Software Engineer @thockin This is Kubernetes 201 If you re lost, I m happy to answer questions later or at the BoF tonight Obligatory
More informationImportant DevOps Technologies (3+2+3days) for Deployment
Important DevOps Technologies (3+2+3days) for Deployment DevOps is the blending of tasks performed by a company's application development and systems operations teams. The term DevOps is being used in
More informationDeclarative Modeling for Cloud Deployments
Declarative Modeling for Cloud Deployments Giuseppe Attardi Department of Distributed Computing & Storage OpenStack Day Italia Roma 21/9/2018 GARR Federated Cloud Computing Platform Objectives GARR Offer
More informationIBM Planning Analytics Workspace Local Distributed Soufiane Azizi. IBM Planning Analytics
IBM Planning Analytics Workspace Local Distributed Soufiane Azizi IBM Planning Analytics IBM Canada - Cognos Ottawa Lab. IBM Planning Analytics Agenda 1. Demo PAW High Availability on a Prebuilt Swarm
More informationCloud & container monitoring , Lars Michelsen Check_MK Conference #4
Cloud & container monitoring 04.05.2018, Lars Michelsen Some cloud definitions Applications Data Runtime Middleware O/S Virtualization Servers Storage Networking Software-as-a-Service (SaaS) Applications
More informationStandalone to SQL Server HA Clusters in Minutes.
Standalone to SQL Server HA Clusters in Minutes Connor.Cox@DH2i.com Failover Cluster Instances Instance- level failover Applica:on, OS, and infrastructure protec:on Fast, automated failover Free hdps://technet.microsog.com/en-
More informationKuber-what?! Learn about Kubernetes
DEVNET-1999 Kuber-what?! Learn about Kubernetes Ashley Roach, Principal Engineer Evangelist Agenda Objectives A brief primer on containers The problems with running containers at scale Orchestration systems
More informationVirtual Datacenter Automation
Virtual Datacenter Automation Koh Eng Kheng Regional Director ASEAN Phase 0: Server Consolidation Hypervisor Hypervisor 2 Virtualization: Phase 1 Add VMotion Live Virtual Machine Migration Hypervisor Hypervisor
More informationRay Tsang Developer Advocate Google Cloud Platform
Ray Tsang Developer Advocate Google Cloud Platform @saturnism +RayTsang Ray Tsang Developer Architect Traveler Photographer flickr.com/saturnism Writing a Kubernetes Autoscaler Kubernetes API - In Depth
More informationOpenShift Roadmap Enterprise Kubernetes for Developers. Clayton Coleman, Architect, OpenShift
OpenShift Roadmap Enterprise Kubernetes for Developers Clayton Coleman, Architect, OpenShift What Is OpenShift? Application-centric Platform INFRASTRUCTURE APPLICATIONS Use containers for efficiency Hide
More informationKubernetes: Twelve KeyFeatures
Kubernetes: Twelve KeyFeatures Kubernetes is a Greek word which means helmsman, or the pilot of a ship. It is an open source project that was started by Google and derived from Borg, which is used inside
More informationChoosing the Right Container Infrastructure for Your Organization
WHITE PAPER Choosing the Right Container Infrastructure for Your Organization Container adoption is accelerating rapidly. Gartner predicts that by 2018 more than 50% of new workloads will be deployed into
More informationContainer 2.0. Container: check! But what about persistent data, big data or fast data?!
@unterstein @joerg_schad @dcos @jaxdevops Container 2.0 Container: check! But what about persistent data, big data or fast data?! 1 Jörg Schad Distributed Systems Engineer @joerg_schad Johannes Unterstein
More informationInvestigating Containers for Future Services and User Application Support
Investigating Containers for Future Services and User Application Support JLAB CNI NLIT 2018 () Overview JLAB scope What is a container? Why are we interested? Platform-as-a-Service (PaaS) for orchestration
More informationKubernetes 101: Pods, Nodes, Containers, andclusters
Kubernetes 101: Pods, Nodes, Containers, andclusters Kubernetes is quickly becoming the new standard for deploying and managing software in the cloud. With all the power Kubernetes provides, however, comes
More informationVitess on Kubernetes. followed by a demo of VReplication. Jiten Vaidya
Vitess on Kubernetes followed by a demo of VReplication Jiten Vaidya jiten@planetscale.com A word about me... Jiten Vaidya - Managed teams that operationalized Vitess at Youtube CEO at PlanetScale Founded
More informationBuilding Kubernetes cloud: real world deployment examples, challenges and approaches. Alena Prokharchyk, Rancher Labs
Building Kubernetes cloud: real world deployment examples, challenges and approaches Alena Prokharchyk, Rancher Labs Making a right choice is not easy The illustrated children guide to Kubernetes https://www.youtube.com/watch?v=4ht22rebjno
More informationKubernetes Autoscaling on Azure. Pengfei Ni Microsoft Azure
Kubernetes Autoscaling on Azure Pengfei Ni Microsoft Azure Abstract Why autoscaling Autoscaling in Kubernetes Practice on Azure Q&A Why autoscaling Autoscaling Adjust computational resources automatically
More informationWHITE PAPER. RedHat OpenShift Container Platform. Benefits: Abstract. 1.1 Introduction
WHITE PAPER RedHat OpenShift Container Platform Abstract Benefits: Applications are designed around smaller independent components called microservices. Elastic resources: Scale up or down quickly and
More informationIBM Bluemix compute capabilities IBM Corporation
IBM Bluemix compute capabilities After you complete this section, you should understand: IBM Bluemix infrastructure compute options Bare metal servers Virtual servers IBM Bluemix Container Service IBM
More informationINTRODUCING CONTAINER-NATIVE VIRTUALIZATION
INTRODUCING CONTAINER-NATIVE VIRTUALIZATION Cats and Dogs Living Together Stephen Gordon Principal Product Manager Red Hat Fabian Deutsch Manager, Software Engineering Red Hat sgordon@redhat.com / @xsgordon
More informationThe Elements of Kubernetes. Aaron Schlesinger Microsoft Azure Containers Lead, SIG-Service-Catalog
The Elements of Kubernetes Aaron Schlesinger Microsoft Azure Containers Lead, SIG-Service-Catalog Why we re here Kubernetes is growing fast Usage, development, projects We re in the wild west Building
More informationMINION ENTERPRISE FEATURES LIST
MINION ENTERPRISE FEATURES LIST Minion Enterprise is an automation and management tool for SQL Server. It provides you with the 10,000- foot view, detailed view, and fine-grained alerting and controls
More informationBuilding a Microservices Platform with Kubernetes. Matthew Mark
Building a Microservices Platform with Kubernetes Matthew Mark Miller @DataMiller Cloud Native: Microservices running inside Containers on top of Platforms on any infrastructure Microservice A software
More informationProxy Providers versus Embedded Providers (SMI-S)
Proxy Providers versus Embedded Providers (SMI-S) Srinivasa Reddy Gandlaparthi NetApp Overview Embedded Providers Proxy Providers Differences between Embedded and Proxy providers Design Considerations
More informationBuilding warehouse-scale computers or what s it like to supply exponential growth. john wilkes
Building warehouse-scale computers or what s it like to supply exponential growth john wilkes 2018-10 Video: https://youtu.be/m7uig8qfgmi You re all Some of you are thinking too small Scale has been the
More informationContainer Orchestration on Amazon Web Services. Arun
Container Orchestration on Amazon Web Services Arun Gupta, @arungupta Docker Workflow Development using Docker Docker Community Edition Docker for Mac/Windows/Linux Monthly edge and quarterly stable
More informationHéctor Fernández and G. Pierre Vrije Universiteit Amsterdam
Héctor Fernández and G. Pierre Vrije Universiteit Amsterdam Cloud Computing Day, November 20th 2012 contrail is co-funded by the EC 7th Framework Programme under Grant Agreement nr. 257438 1 Typical Cloud
More informationUnderstanding and Evaluating Kubernetes. Haseeb Tariq Anubhavnidhi Archie Abhashkumar
Understanding and Evaluating Kubernetes Haseeb Tariq Anubhavnidhi Archie Abhashkumar Agenda Overview of project Kubernetes background and overview Experiments Summary and Conclusion 1. Overview of Project
More informationWelcome to the. Migrating SQL Server Databases to Azure
Welcome to the 1 Migrating SQL Server Databases to Azure Migrating SQL Server Databases to Azure Agenda Overview of SQL Server in Microsoft Azure Getting started with SQL Server in an Azure virtual machine
More informationWindows Azure Services - At Different Levels
Windows Azure Windows Azure Services - At Different Levels SaaS eg : MS Office 365 Paas eg : Azure SQL Database, Azure websites, Azure Content Delivery Network (CDN), Azure BizTalk Services, and Azure
More informationwhat is cloud computing?
what is cloud computing? (Private) Cloud Computing with Mesos at Twi9er Benjamin Hindman @benh scalable virtualized self-service utility managed elastic economic pay-as-you-go what is cloud computing?
More informationContinuous delivery while migrating to Kubernetes
Continuous delivery while migrating to Kubernetes Audun Fauchald Strand Øyvind Ingebrigtsen Øvergaard @audunstrand @oyvindio FINN Infrastructure History Kubernetes at FINN Agenda Finn Infrastructure As
More informationImplementing a Software-Defined DataCenter
Course 20745: Implementing a Software-Defined DataCenter Page 1 of 6 Implementing a Software-Defined DataCenter Course 20745: 4 days; Instructor-Led Introduction This four-day course explains how to implement
More informationSQL Server on Linux and Containers
http://aka.ms/bobwardms https://github.com/microsoft/sqllinuxlabs SQL Server on Linux and Containers A Brave New World Speaker Name Principal Architect Microsoft bobward@microsoft.com @bobwardms linkedin.com/in/bobwardms
More informationCode: Slides:
Workshop Resources Code: https://github.com/beekpr/public-workshops Slides: https://tinyurl.com/yc2uo3wk Make sure minikube and kubectl is setup (labs/1-setup-cluster.md has some instructions) Kubernetes
More informationConsolidating Complementary VMs with Spatial/Temporalawareness
Consolidating Complementary VMs with Spatial/Temporalawareness in Cloud Datacenters Liuhua Chen and Haiying Shen Dept. of Electrical and Computer Engineering Clemson University, SC, USA 1 Outline Introduction
More informationCouchbase Architecture Couchbase Inc. 1
Couchbase Architecture 2015 Couchbase Inc. 1 $whoami Laurent Doguin Couchbase Developer Advocate @ldoguin laurent.doguin@couchbase.com 2015 Couchbase Inc. 2 2 Big Data = Operational + Analytic (NoSQL +
More informationKubernetes Integration with Virtuozzo Storage
Kubernetes Integration with Virtuozzo Storage A Technical OCTOBER, 2017 2017 Virtuozzo. All rights reserved. 1 Application Container Storage Application containers appear to be the perfect tool for supporting
More informationTaming Distributed Pets with Kubernetes
Taming Distributed Pets with Kubernetes Matthew Bates & James Munnelly QCon London 2018 jetstack.io Who are Jetstack? We are a UK-based company that help enterprises in their path to modern cloud-native
More informationSAMPLE CHAPTER. Marko Lukša MANNING
SAMPLE CHAPTER Marko Lukša MANNING Kubernetes in Action by Marko Lukša Chapter 1 Copyright 2018 Manning Publications brief contents PART 1 OVERVIEW 1 Introducing Kubernetes 1 2 First steps with Docker
More informationYour Speakers. Iwan e1 Rahabok Linkedin.com/in/e1ang
Your Speakers Iwan e1 Rahabok virtual-red-dot.info e1@vmware.com @e1_ang Linkedin.com/in/e1ang 9119 9226 Sunny Dua vxpresss.blogspot.com duas@vmware.com @sunny_dua Linkedin.com/in/duasunny 2 Need more
More informationMinimum-cost Cloud Storage Service Across Multiple Cloud Providers
Minimum-cost Cloud Storage Service Across Multiple Cloud Providers Guoxin Liu and Haiying Shen Department of Electrical and Computer Engineering, Clemson University, Clemson, USA 1 Outline Introduction
More informationAzure Webinar. Resilient Solutions March Sander van den Hoven Principal Technical Evangelist Microsoft
Azure Webinar Resilient Solutions March 2017 Sander van den Hoven Principal Technical Evangelist Microsoft DX @svandenhoven 1 What is resilience? Client Client API FrontEnd Client Client Client Loadbalancer
More informationComparison of Service Description and Composition for Complex 3-tier Cloud-based Services
Date: 2017. 08. 28 Place: Dalian, China Comparison of Service Description and Composition for Complex 3-tier Cloud-based Services Asia Pacific Advanced Network (APAN) Cloud Working Group Meeting 2017 Moonjoong
More informationContainers and the Evolution of Computing
Containers and the Evolution of Computing Matt Nowina Solutions Architect 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Scaling Applications Order UI User UI Shipping UI Order
More informationSafe Harbor Statement
Safe Harbor Statement The following is intended to outline the general direction of Pivotal's offerings. It is intended for information purposes only and may not be incorporated into any contract. Any
More informationovirt and Docker Integration
ovirt and Docker Integration October 2014 Federico Simoncelli Principal Software Engineer Red Hat 1 Agenda Deploying an Application (Old-Fashion and Docker) Ecosystem: Kubernetes and Project Atomic Current
More informationIntroduction to Kubernetes
Introduction to Kubernetes Neil Peterson @nepeters #ITDEVCONNECTIONS Session Topics - Quick primer on containers - Container mgmt solutions - Kubernetes basics - Kubernetes deeper dive - Kubernetes beyond
More informationAZURE CONTAINER INSTANCES
AZURE CONTAINER INSTANCES -Krunal Trivedi ABSTRACT In this article, I am going to explain what are Azure Container Instances, how you can use them for hosting, when you can use them and what are its features.
More information[Docker] Containerization
[Docker] Containerization ABCD-LMA Working Group Will Kinard October 12, 2017 WILL Kinard Infrastructure Architect Software Developer Startup Venture IC Husband Father Clemson University That s me. 2 The
More informationServers & Developers. Julian Nadeau Production Engineer
Servers & Developers Julian Nadeau Production Engineer Provisioning & Orchestration of Servers Setting a server up Packer - one server at a time Chef - all servers at once Containerization What are Containers?
More informationSpark and Flink running scalable in Kubernetes Frank Conrad
Spark and Flink running scalable in Kubernetes Frank Conrad Architect @ apomaya.com scalable efficient low latency processing 1 motivation, use case run (external, unknown trust) customer spark / flink
More informationThe Software Driven Datacenter
The Software Driven Datacenter Three Major Trends are Driving the Evolution of the Datacenter Hardware Costs Innovation in CPU and Memory. 10000 10 µm CPU process technologies $100 DRAM $/GB 1000 1 µm
More informationExam : Implementing a Cloud Based Infrastructure
Exam 70-414: Implementing a Cloud Based Infrastructure Course Overview This course teaches students about creating the virtualization infrastructure, planning and deploying virtual machines, monitoring,
More informationContainers, Serverless and Functions in a nutshell. Eugene Fedorenko
Containers, Serverless and Functions in a nutshell Eugene Fedorenko About me Eugene Fedorenko Senior Architect Flexagon adfpractice-fedor.blogspot.com @fisbudo Agenda Containers Microservices Docker Kubernetes
More informationViryaOS RFC: Secure Containers for Embedded and IoT. A proposal for a new Xen Project sub-project
ViryaOS RFC: Secure Containers for Embedded and IoT A proposal for a new Xen Project sub-project Stefano Stabellini @stabellinist The problem Package applications for the target Contain all dependencies
More informationTechnical Overview. Jack Smith Sr. Solutions Architect
Technical Overview Jack Smith Sr. Solutions Architect Liquidware Labs Methodology Production Environments Assess Design POCs/Pilots Stratusphere FIT Stratusphere UX Validate Migrate ProfileUnity FlexApp
More informationAzure SQL Database for Gaming Industry Workloads Technical Whitepaper
Azure SQL Database for Gaming Industry Workloads Technical Whitepaper Author: Pankaj Arora, Senior Software Engineer, Microsoft Contents 1 Introduction... 2 2 Proven Platform... 2 2.1 Azure SQL Database
More informationRedis for Pivotal Cloud Foundry Docs
Redis for Pivotal Cloud Foundry Docs Version 1.4 User's Guide 2018 Pivotal Software, Inc. Table of Contents Table of Contents Redis for Pivotal Cloud Foundry Redis for Pivotal Cloud Foundry Resource requirements
More informationKnative: Building serverless platforms on top of Kubernetes
Knative: Building serverless platforms on top of Kubernetes Ahmet Alp Balkan @ahmetb Thanks to Mark Chmarny, Ryan Gregg, DeWitt Clinton and Bret McGowen for some of the slides used in this presentation.
More informationIBM Compose Managed Platform for Multiple Open Source Databases
IBM Compose Managed Platform for Multiple Source Databases Source for Source for Data Layer Blueprint with Compose Source for Comprehensive Catalogue for Simplified Scoping Scalable Platform for FutureProof
More informationHPC over Cloud. July 16 th, SCENT HPC Summer GIST. SCENT (Super Computing CENTer) GIST (Gwangju Institute of Science & Technology)
HPC over Cloud July 16 th, 2014 2014 HPC Summer School @ GIST (Super Computing CENTer) GIST (Gwangju Institute of Science & Technology) Dr. JongWon Kim jongwon@nm.gist.ac.kr Interplay between Theory, Simulation,
More informationData Centers and Cloud Computing
Data Centers and Cloud Computing CS677 Guest Lecture Tim Wood 1 Data Centers Large server and storage farms 1000s of servers Many TBs or PBs of data Used by Enterprises for server applications Internet
More informationData Centers and Cloud Computing. Slides courtesy of Tim Wood
Data Centers and Cloud Computing Slides courtesy of Tim Wood 1 Data Centers Large server and storage farms 1000s of servers Many TBs or PBs of data Used by Enterprises for server applications Internet
More informationWhat s New in Hyper-V 2016/1709/1803/2019
What s New in Hyper-V 2016/1709/1803/2019 Jan Marek Head of CDM & ATOM Architect @ KPCS CZ MVP: Cloud and Datacenter Management MCC MCT MCSE marek@kpcs.cz www.atom.ms Agenda SAC vs. LTSC Hyper-V and System
More information70-414: Implementing an Advanced Server Infrastructure Course 01 - Creating the Virtualization Infrastructure
70-414: Implementing an Advanced Server Infrastructure Course 01 - Creating the Virtualization Infrastructure Slide 1 Creating the Virtualization Infrastructure Slide 2 Introducing Microsoft System Center
More informationKubernetes introduction. Container orchestration
Kubernetes introduction Container orchestration Container Orchestration Why we need container orchestration? Restart containers if they are not healthy. Provide private container network. Service discovery.
More informationAllowing Users to Run Services at the OLCF with Kubernetes
Allowing Users to Run Services at the OLCF with Kubernetes Jason Kincl Senior HPC Systems Engineer Ryan Adamson Senior HPC Security Engineer This work was supported by the Oak Ridge Leadership Computing
More informationRed Hat OpenShift Roadmap Q4 CY16 and H1 CY17 Releases. Lutz Lange Solution
Red Hat OpenShift Roadmap Q4 CY16 and H1 CY17 Releases Lutz Lange Solution Architect @AtomicContainer OpenShift Roadmap OpenShift Container Platform 3.2 Kubernetes 1.2 & Docker 1.9
More informationCohesity DataPlatform Protecting Individual MS SQL Databases Solution Guide
Cohesity DataPlatform Protecting Individual MS SQL Databases Solution Guide Abstract This solution guide outlines the workflow for creating backups with Microsoft SQL Server databases and Cohesity Data
More informationDisclaimer This presentation may contain product features that are currently under development. This overview of new technology represents no commitme
CNA1612BU Deploying real-world workloads on Kubernetes and Pivotal Cloud Foundry VMworld 2017 Fred Melo, Director of Technology, Pivotal Merlin Glynn, Sr. Technical Product Manager, VMware Content: Not
More informationContainerizing GPU Applications with Docker for Scaling to the Cloud
Containerizing GPU Applications with Docker for Scaling to the Cloud SUBBU RAMA FUTURE OF PACKAGING APPLICATIONS Turns Discrete Computing Resources into a Virtual Supercomputer GPU Mem Mem GPU GPU Mem
More informationResiliency Replication Appliance Installation Guide Version 7.2
Resiliency Replication Appliance Installation Guide Version 7.2 DISCLAIMER IBM believes that the information in this publication is accurate as of its publication date. The information is subject to change
More information