Follow me!

Size: px
Start display at page:

Download "Follow me!"

Transcription

1

2 Stuff I do

3 Follow me!

4 About this talk 1. Maintaining your Build Stack 2. Orchestrating your Cluster 3. Pitfalls and Recommendations

5 About this talk 1. Maintaining your Build Stack 2. Orchestrating your Cluster 3. Pitfalls and Recommendations

6 About this talk 1. Maintaining your Build Stack 2. Orchestrating your Cluster 3. Pitfalls and Recommendations

7 Maintaining your Build Stack How Docker Images are Built

8 Maintaining your Build Stack How Docker Images are Built FROM ubuntu:16.04

9 Maintaining your Build Stack How Docker Images are Built FROM ubuntu:16.04 RUN apt-get install...

10 Maintaining your Build Stack How Docker Images are Built FROM ubuntu:16.04 RUN apt-get install... COPY files/etc /etc

11 Maintaining your Build Stack How Docker Images are Built FROM ubuntu:16.04 RUN apt-get install... COPY files/etc /etc COPY init.sh /init.sh

12 Maintaining your Build Stack How Docker Images are Built FROM ubuntu:16.04 RUN apt-get install... COPY files/etc /etc COPY init.sh /init.sh CMD /init.sh

13 Maintaining your Build Stack How Docker Images are Built FROM ubuntu:16.04 RUN apt-get install... COPY files/etc /etc COPY init.sh /init.sh CMD /init.sh e87eea c90c59c c6577f f1c4 9e54da99b80c

14 Maintaining your Build Stack How Docker Images are Built latest FROM ubuntu:16.04 RUN apt-get install... COPY files/etc /etc COPY init.sh /init.sh CMD /init.sh e87eea c90c59c c6577f f1c4 9e54da99b80c

15 Maintaining your Build Stack Server Your Laptop

16 Maintaining your Build Stack Docker Image Server Your Laptop

17 Maintaining your Build Stack Docker Image Docker Image Server Your Laptop

18 Maintaining your Build Stack Docker Image Docker Image Server Your Laptop

19 Maintaining your Build Stack Registry Docker Image Server Your Laptop

20 Maintaining your Build Stack Docker Image Registry docker push Docker Image Server Your Laptop

21 Maintaining your Build Stack Docker Image Registry Docker Image Docker Image Server Your Laptop

22 Maintaining your Build Stack Docker Image Registry Docker Image Docker Container Server Docker Image Your Laptop

23 Follow me! Problems:

24 Follow me! Problems: High Bandwidth Usage

25 Follow me! Problems: High Bandwidth Usage Different Hashes on Different Machines

26 Maintaining your Build Stack Registry CI Server Git Server Dockerfile Server Your Laptop

27 Maintaining your Build Stack Dockerfile Registry CI Server Git Server Dockerfile Server Your Laptop

28 Maintaining your Build Stack Dockerfile Dockerfile Registry CI Server Git Server Dockerfile Server Your Laptop

29 Maintaining your Build Stack Registry Dockerfile Docker Image CI Server Dockerfile Git Server Dockerfile Server Your Laptop

30 Maintaining your Build Stack Docker Image Registry Dockerfile Docker Image CI Server Dockerfile Git Server Dockerfile Server Your Laptop

31 Maintaining your Build Stack Docker Image Registry Dockerfile Docker Image CI Server Dockerfile Git Server Docker Image Dockerfile Server Your Laptop

32 Maintaining your Build Stack Docker Image Registry Dockerfile Docker Image CI Server Dockerfile Git Server Docker Image Docker Container Server Dockerfile Your Laptop

33 Maintaining your Build Stack CI server YES YES YES YES YES Docker Repository YES YES YES YES

34 Orchestrating your Cluster How do you run a Docker image?

35 Orchestrating your Cluster How do you run a Docker image? ssh youruser@example.com "docker run yourcontainer"

36 Orchestrating your Cluster How do you run a Docker image? ssh youruser@example.com "docker run yourcontainer"

37 Orchestrating your Cluster Orchestration tools

38 Orchestrating your Cluster Orchestration tools Where is my service?

39 Orchestrating your Cluster Orchestration tools Where is my service? Rolling updates

40 Orchestrating your Cluster Orchestration tools Where is my service? Rolling updates Scaling

41 Orchestrating your Cluster Orchestration tools Where is my service? Rolling updates Scaling Virtual networks

42 Orchestrating your Cluster Orchestration tools Where is my service? Rolling updates Scaling Virtual networks...

43 Orchestrating your Cluster Orchestration tools AWS EC2 Container Service Docker Swarm Kubernetes...

44 Orchestrating your Cluster EC2 Container Service

45 Orchestrating your Cluster EC2 Container Service + Integrated with AWS

46 Orchestrating your Cluster EC2 Container Service + Integrated with AWS + Autoscaling (limited)

47 Orchestrating your Cluster EC2 Container Service + Integrated with AWS + Autoscaling (limited) + Integrated registry

48 Orchestrating your Cluster EC2 Container Service + Integrated with AWS - Using the ELB is a must + Autoscaling (limited) + Integrated registry

49 Orchestrating your Cluster EC2 Container Service + Integrated with AWS + Autoscaling (limited) - Using the ELB is a must - No built-in DNS server + Integrated registry

50 Orchestrating your Cluster EC2 Container Service + Integrated with AWS + Autoscaling (limited) + Integrated registry - Using the ELB is a must - No built-in DNS server - Slow rollout

51 Orchestrating your Cluster EC2 Container Service + Integrated with AWS + Autoscaling (limited) + Integrated registry - Using the ELB is a must - No built-in DNS server - Slow rollout - No overlay network

52 Orchestrating your Cluster EC2 Container Service + Integrated with AWS + Autoscaling (limited) + Integrated registry - Using the ELB is a must - No built-in DNS server - Slow rollout - No overlay network - Outdated

53 Orchestrating your Cluster Docker Swarm

54 Orchestrating your Cluster Docker Swarm + (Very) Simple

55 Orchestrating your Cluster Docker Swarm + (Very) Simple + Overlay Networks

56 Orchestrating your Cluster Docker Swarm + (Very) Simple + Overlay Networks + Built-in DNS server and LB

57 Orchestrating your Cluster Docker Swarm + (Very) Simple + Overlay Networks + Built-in DNS server and LB + Fast rollout

58 Orchestrating your Cluster Docker Swarm + (Very) Simple - Very young (YMMV) + Overlay Networks + Built-in DNS server and LB + Fast rollout

59 Orchestrating your Cluster Docker Swarm + (Very) Simple + Overlay Networks - Very young (YMMV) - No Autoscaling + Built-in DNS server and LB + Fast rollout

60 Orchestrating your Cluster Docker Swarm + (Very) Simple + Overlay Networks + Built-in DNS server and LB - Very young (YMMV) - No Autoscaling - Monolithic (no plugins) + Fast rollout

61 Orchestrating your Cluster Kubernetes + Overlay networks

62 Orchestrating your Cluster Kubernetes + Overlay networks + Autoscaling

63 Orchestrating your Cluster Kubernetes + Overlay networks + Autoscaling + Rack awareness

64 Orchestrating your Cluster Kubernetes + Overlay networks + Autoscaling + Rack awareness + Plugins, everywhere

65 Orchestrating your Cluster Kubernetes + Overlay networks + Autoscaling + Rack awareness + Plugins, everywhere + Makes you coffee

66 Orchestrating your Cluster Kubernetes + Overlay networks - Complex to set up + Autoscaling + Rack awareness + Plugins, everywhere + Makes you coffee

67 Orchestrating your Cluster Kubernetes + Overlay networks + Autoscaling + Rack awareness - Complex to set up - Setup scripts and docs are beta / unstable / outdated + Plugins, everywhere + Makes you coffee

68 Pitfalls and Recommendations Oops...

69 Pitfalls and Recommendations Multiple services in one container?

70 Pitfalls and Recommendations Multiple services in one container? DON T!

71 Pitfalls and Recommendations supervisord nginx PHP-FPM

72 Pitfalls and Recommendations supervisord nginx PHP-FPM

73 Pitfalls and Recommendations supervisord nginx

74 Pitfalls and Recommendations Sidecar services

75 Pitfalls and Recommendations supervisord PHP-FPM nullmailer

76 Pitfalls and Recommendations supervisord PHP-FPM nullmailer manage-supervisord

77 Pitfalls and Recommendations supervisord PHP-FPM nullmailer manage-supervisord

78 Pitfalls and Recommendations supervisord PHP-FPM manage-supervisord

79 Pitfalls and Recommendations supervisord PHP-FPM manage-supervisord

80 Pitfalls and Recommendations Shell script in CMD?

81 Pitfalls and Recommendations Shell script in CMD? BE CAREFUL!

82 Pitfalls and Recommendations #!/bin/bash # Other stuff here /usr/sbin/nginx -g "daemon off;" exit $?

83 Pitfalls and Recommendations bash -c /init.sh nginx

84 Pitfalls and Recommendations SIGTERM bash -c /init.sh nginx

85 Pitfalls and Recommendations SIGTERM bash -c /init.sh YOLO! nginx

86 Pitfalls and Recommendations SIGKILL! bash -c /init.sh nginx

87 Pitfalls and Recommendations #!/bin/bash # Other stuff here exec /usr/sbin/nginx -g "daemon off;"

88 Pitfalls and Recommendations bash -c /init.sh

89 Pitfalls and Recommendations nginx

90 Pitfalls and Recommendations Don t update your containers!

91 Pitfalls and Recommendations Shared data?

92 Pitfalls and Recommendations Container Server

93 Pitfalls and Recommendations /srv/mysql Container bind mount Server

94 Pitfalls and Recommendations /srv/mysql Container Server Server

95 Pitfalls and Recommendations Healthchecks?

96 Pitfalls and Recommendations Dockerfile: HEALTHCHECK \ --interval=10s \ --timeout=3s \ CMD /usr/local/bin/healthcheck healthcheck: #!/bin/bash test $(SCRIPT_NAME=/status SCRIPT_FILENAME=/status REQUEST_METHOD=GET cgi-fcgi -bind -connect :9000 grep pool cut -d: -f2 sed 's/ //g') == www exit 1

97 Pitfalls and Recommendations healthcheck: #!/bin/bash test $(SCRIPT_NAME=/status SCRIPT_FILENAME=/status REQUEST_METHOD=GET cgi-fcgi -bind -connect :9000 grep pool cut -d: -f2 sed 's/ //g') == www exit 1

98 Pitfalls and Recommendations Docker Swarm: HEALTHCHECK \ --interval=10s \ --timeout=3s \ CMD /usr/local/bin/healthcheck

99 Pitfalls and Recommendations Kubernetes: spec: containers: - name: yourpod livenessprobe: exec: command: - /usr/local/bin/healthcheck initialdelayseconds: 5 periodseconds: 5 readinessprobe:...

100 Pitfalls and Recommendations TEST YO CONTAINERS!

101 Pitfalls and Recommendations docker-compose.test.yml version: '3.2' services: mysql: container_name: mysql build:.... sut: build:./test...

102 Pitfalls and Recommendations DO NOT HARD-CODE CREDENTIALS!

103 Pitfalls and Recommendations VERSION YOUR IMAGES!

104 Pitfalls and Recommendations CAREFUL WITH 3RD PARTY IMAGES!

105 Pitfalls and Recommendations opsbears/base opsbears/supervisord opsbears/nginx opsbears/mysql opsbears/nullmailer opsbears/php-fpm

106 Pitfalls and Recommendations REMOVE DEV STUFF!

107 That s all! Questions? Many thanks to Bence Sántha, Gábor Vereb, Dávid Papp for their inspiration and feedback.

Follow me!

Follow me! Stuff I do Follow me! https://pasztor.at @janoszen About this talk 1. The problem with CDNs About this talk 1. The problem with CDNs 2. How does a CDN work? About this talk 1. The problem with CDNs 2.

More information

DEPLOYMENT MADE EASY!

DEPLOYMENT MADE EASY! DEPLOYMENT MADE EASY! Presented by Hunde Keba & Ashish Pagar 1 DSFederal Inc. We provide solutions to Federal Agencies Our technology solutions connect customers to the people they serve 2 Necessity is

More information

Cloud providers, tools and best practices in running Magento on Kubernetes. Adrian Balcan MindMagnet Software

Cloud providers, tools and best practices in running Magento on Kubernetes. Adrian Balcan MindMagnet Software Cloud providers, tools and best practices in running Magento on Kubernetes Adrian Balcan DevOps @ MindMagnet Software About Me Companies Projects Adrian Balcan contact@adrianbalcan.com Agenda Magento on

More information

Deliver Docker Containers Continuously on AWS. Philipp

Deliver Docker Containers Continuously on AWS. Philipp Deliver Docker Containers Continuously on AWS Philipp Garbe @pgarbe Azure Container Services So many choices... Google Container Engine Cloud Foundry s Diego Amazon ECS Kubernetes Mesosphere Marathon Docker

More information

Best Practices for Developing & Deploying Java Applications with Docker

Best Practices for Developing & Deploying Java Applications with Docker JavaOne 2017 CON7957 Best Practices for Developing & Deploying Java Applications with Docker Eric Smalling - Solution Architect, Docker Inc. @ericsmalling Who Am I? Eric Smalling Solution Architect Docker

More information

/ Cloud Computing. Recitation 5 February 14th, 2017

/ Cloud Computing. Recitation 5 February 14th, 2017 15-319 / 15-619 Cloud Computing Recitation 5 February 14th, 2017 1 Overview Administrative issues Office Hours, Piazza guidelines Last week s reflection Project 2.1, OLI Unit 2 modules 5 and 6 This week

More information

Docker on VDS. Aurelijus Banelis

Docker on VDS. Aurelijus Banelis Docker on VDS Aurelijus Banelis Aurelijus Banelis Software developer aurelijus.banelis.lt aurelijus@banelis.lt Docker on VDS You will learn Why VDS? Why docker? What is docker? Is it possible? Why not?

More information

Arup Nanda VP, Data Services Priceline.com

Arup Nanda VP, Data Services Priceline.com Jumpstarting Docker Arup Nanda VP, Data Services Priceline.com My application worked in Dev but not in QA Will it work in production? I need an environment right now No, I can t wait for 2 weeks I just

More information

UP! TO DOCKER PAAS. Ming

UP! TO DOCKER PAAS. Ming UP! TO DOCKER PAAS Ming Jin(mjin@thoughtworks.com) March 15, 2015 1 WHO AM I Ming Jin Head of Cloud Solutions of ThoughtWorks China Architect, Agile Consulting Solutions and Consulting on DevOps & Cloud

More information

A Hands on Introduction to Docker

A Hands on Introduction to Docker A Hands on Introduction to Docker Len Bass A Hands on introduction Introduction to to Docker May 2017 1 4, Len 2017 Bass 2017 Len Bass 1 Setting expectations This is an introduction to Docker intended

More information

Ellexus Container Checker user manual

Ellexus Container Checker user manual Ellexus Container Checker user manual (Version 2.11.0) Ellexus Container Checker automatically generates an I/O report for your Docker application. Quick start Step 1: Purchase a Container Checker AMI

More information

GitLab-CI and Docker Registry

GitLab-CI and Docker Registry GitLab-CI and Docker Registry Oleg Fiksel Security Consultant @ CSPI GmbH oleg.fiksel@cspi.com oleg@fiksel.info Matrix: @oleg:fiksel.info FrOSCon 2017 AGENDA ABOUT INTRODUCTION GitLab 101 Deploying on-premise

More information

Con$nuous Deployment with Docker Andrew Aslinger. Oct

Con$nuous Deployment with Docker Andrew Aslinger. Oct Con$nuous Deployment with Docker Andrew Aslinger Oct 9. 2014 Who is Andrew #1 So#ware / Systems Architect for OpenWhere Passion for UX, Big Data, and Cloud/DevOps Previously Designed and Implemented automated

More information

Tricks of the Captains. Adrian Mouat. Chief Scientist Container Solutions

Tricks of the Captains. Adrian Mouat. Chief Scientist Container Solutions Tricks of the Captains Adrian Mouat Chief Scientist Container Solutions Tricks of the Captains A hodgepodge of tips for Docker nirvana compiled from the brains in the Docker Captains program. And me. Who

More information

CONTINUOUS INTEGRATION; TIPS & TRICKS

CONTINUOUS INTEGRATION; TIPS & TRICKS CONTINUOUS INTEGRATION; TIPS & TRICKS BIO I DO TECH THINGS I DO THINGS I DO THINGS BLUE OCEAN BEEP BEEP REFACTOR PEOPLE S HOUSES MY TIPS & TRICKS FOR CI - CI Infrastructure - CI Architecture - Pipeline

More information

Wrapp. Powered by AWS EC2 Container Service. Jude D Souza Solutions Wrapp Phone:

Wrapp. Powered by AWS EC2 Container Service. Jude D Souza Solutions Wrapp Phone: Containers @ Wrapp Powered by AWS EC2 Container Service Jude D Souza Solutions Architect @ Wrapp Phone: +46 767085740 Email: jude@wrapp.com About Me Jude D Souza Stockholm, Sweden ß Karachi, Pakistan jude@wrapp.com

More information

USING DOCKER FOR MXCUBE DEVELOPMENT AT MAX IV

USING DOCKER FOR MXCUBE DEVELOPMENT AT MAX IV USING DOCKER FOR MXCUBE DEVELOPMENT AT MAX IV Fredrik Bolmsten, Antonio Milán Otero K.I.T.S. Group at Max IV - 2017 1 OVERVIEW What is Docker? How does it work? How we use it for MxCUBE How to create a

More information

DevOps Course Content

DevOps Course Content DevOps Course Content 1. Introduction: Understanding Development Development SDLC using WaterFall & Agile Understanding Operations DevOps to the rescue What is DevOps DevOps SDLC Continuous Delivery model

More information

Dockerfile Best Practices

Dockerfile Best Practices Dockerfile Best Practices OpenRheinRuhr 2015 November 07th, 2015 1 Dockerfile Best Practices Outline About Dockerfile Best Practices Building Images This work is licensed under the Creative Commons Attribution-ShareAlike

More information

Midterm Presentation Schedule

Midterm Presentation Schedule Midterm Presentation Schedule October 18 th Aurora, Bash, Sangam October 20 th Flash, Omega, CodeRing October 25th Omni, Aviato, NPComplete Mid Term Presentation Format 25 minutes Be prepared to use the

More information

The Long Road from Capistrano to Kubernetes

The Long Road from Capistrano to Kubernetes The Long Road from Capistrano to Kubernetes Tobias Schwab, Co-Founder of PhraseApp Slides: http://bit.ly/cap-to-kube How to deploy Ruby on Rails? Deploying Ruby on Rails required on all servers: OS + system

More information

/ Cloud Computing. Recitation 5 September 26 th, 2017

/ Cloud Computing. Recitation 5 September 26 th, 2017 15-319 / 15-619 Cloud Computing Recitation 5 September 26 th, 2017 1 Overview Administrative issues Office Hours, Piazza guidelines Last week s reflection Project 2.1, OLI Unit 2 modules 5 and 6 This week

More information

Splunk N Box. Splunk Multi-Site Clusters In 20 Minutes or Less! Mohamad Hassan Sales Engineer. 9/25/2017 Washington, DC

Splunk N Box. Splunk Multi-Site Clusters In 20 Minutes or Less! Mohamad Hassan Sales Engineer. 9/25/2017 Washington, DC Splunk N Box Splunk Multi-Site Clusters In 20 Minutes or Less! Mohamad Hassan Sales Engineer 9/25/2017 Washington, DC Forward-Looking Statements During the course of this presentation, we may make forward-looking

More information

agenda PAE Docker Docker PAE

agenda PAE Docker Docker PAE Docker 2016.03.26 agenda PAE Docker Docker PAE 2 3 PAE PlCloud APP Engine Docker Docker Caas APP 4 APP APP volume images 5 App 6 APP Show Time 7 8 Docker Public DockerHup Private registry push pull AUFS

More information

Container Orchestration on Amazon Web Services. Arun

Container Orchestration on Amazon Web Services. Arun Container Orchestration on Amazon Web Services Arun Gupta, @arungupta Docker Workflow Development using Docker Docker Community Edition Docker for Mac/Windows/Linux Monthly edge and quarterly stable

More information

Setting up Kubernetes with Day 2 in Mind. Angela Chin, Senior Software Engineer, Pivotal Urvashi Reddy, Senior Software Engineer, Pivotal

Setting up Kubernetes with Day 2 in Mind. Angela Chin, Senior Software Engineer, Pivotal Urvashi Reddy, Senior Software Engineer, Pivotal Setting up Kubernetes with Day 2 in Mind Angela Chin, Senior Software Engineer, Pivotal Urvashi Reddy, Senior Software Engineer, Pivotal About Us Angela Software Engineer @ Pivotal Based in Santa Monica,

More information

Introduction to Containers

Introduction to Containers Introduction to Containers Shawfeng Dong Principal Cyberinfrastructure Engineer University of California, Santa Cruz What are Containers? Containerization, aka operating-system-level virtualization, refers

More information

Asterisk & the Docker revolution Some lessons from the trenches

Asterisk & the Docker revolution Some lessons from the trenches Asterisk & the Docker revolution Some lessons from the trenches Asterisk Africa Johannesburg - March 14, 2018 Presented by: Lenz Emilitri Founder, Loway @lenz Today s presentation Docker Benefits How it

More information

Getting Started With Containers

Getting Started With Containers DEVNET 2042 Getting Started With Containers Matt Johnson Developer Evangelist @mattdashj Cisco Spark How Questions? Use Cisco Spark to communicate with the speaker after the session 1. Find this session

More information

SQL Server inside a docker container. Christophe LAPORTE SQL Server MVP/MCM SQL Saturday 735 Helsinki 2018

SQL Server inside a docker container. Christophe LAPORTE SQL Server MVP/MCM SQL Saturday 735 Helsinki 2018 SQL Server inside a docker container Christophe LAPORTE SQL Server MVP/MCM SQL Saturday 735 Helsinki 2018 Christophe LAPORTE ~ since 1997 : SQL 6.5 / WinNT4 christophe_laporte@hotmail.fr http://conseilit.wordpress.com/

More information

Creating pipelines that build, test and deploy containerized artifacts Slides: Tom Adams

Creating pipelines that build, test and deploy containerized artifacts Slides:   Tom Adams Creating pipelines that build, test and deploy containerized artifacts Slides: https://goo.gl/2mzfe6 Tom Adams tadams@thoughtworks.com 1 Who I am Tom Adams Tech Lead tadams@thoughtworks.com http://tadams289.blogspot.com

More information

Automating the Build Pipeline for Docker Container

Automating the Build Pipeline for Docker Container Automating the Build Pipeline for Docker Container Nikolai Reed, Jürgen Walter, and Samuel Kounev University of Würzburg November 9-10, 2017 SSP 2017 Karlsruhe, Germany 08.11.17 2 Reproducibility Problem

More information

DevOps in the Cloud A pipeline to heaven?! Robert Cowham BCS CMSG Vice Chair

DevOps in the Cloud A pipeline to heaven?! Robert Cowham BCS CMSG Vice Chair DevOps in the Cloud A pipeline to heaven?! Robert Cowham BCS CMSG Vice Chair Agenda Definitions, History & Background Cloud intro DevOps Pipelines Docker containers Examples 2 Definitions DevOps Agile

More information

Important DevOps Technologies (3+2+3days) for Deployment

Important DevOps Technologies (3+2+3days) for Deployment Important DevOps Technologies (3+2+3days) for Deployment DevOps is the blending of tasks performed by a company's application development and systems operations teams. The term DevOps is being used in

More information

INDIGO PAAS TUTORIAL. ! Marica Antonacci RIA INFN-Bari

INDIGO PAAS TUTORIAL. ! Marica Antonacci RIA INFN-Bari INDIGO PAAS TUTORIAL RIA-653549! Marica Antonacci!! marica.antonacci@ba.infn.it! INFN-Bari INDIGO PAAS Tutorial Introductory Concepts TOSCA Ansible Docker Orchestrator APIs INDIGO TOSCA custom types and

More information

/ Cloud Computing. Recitation 5 September 27 th, 2016

/ Cloud Computing. Recitation 5 September 27 th, 2016 15-319 / 15-619 Cloud Computing Recitation 5 September 27 th, 2016 1 Overview Administrative issues Office Hours, Piazza guidelines Last week s reflection Project 2.1, OLI Unit 2 modules 5 and 6 This week

More information

Parallelizing CI using Docker Swarm-Mode

Parallelizing CI using Docker Swarm-Mode Open Source Summit Japan (June 1, 2017) Last update: June 1, 2017 Parallelizing CI using Docker Swarm-Mode Akihiro Suda NTT Software Innovation Center github.com/akihirosuda

More information

Installing and Using Docker Toolbox for Mac OSX and Windows

Installing and Using Docker Toolbox for Mac OSX and Windows Installing and Using Docker Toolbox for Mac OSX and Windows One of the most compelling reasons to run Docker on your local machine is the speed at which you can deploy and build lab environments. As a

More information

Building a Global-Scale Multi- Tenant Cloud Platform on AWS and Docker: Lessons Learned

Building a Global-Scale Multi- Tenant Cloud Platform on AWS and Docker: Lessons Learned Building a Global-Scale Multi- Tenant Cloud Platform on AWS and Docker: Lessons Learned Felix Gessert, Florian Bücklers {fg,fb}@baqend.com @baqendcom Part One Part Two Part Three Baqend & Our Infrastructure

More information

OpenShift 3 Technical Architecture. Clayton Coleman, Dan McPherson Lead Engineers

OpenShift 3 Technical Architecture. Clayton Coleman, Dan McPherson Lead Engineers OpenShift 3 Technical Architecture Clayton Coleman, Dan McPherson Lead Engineers Principles The future of *aas Redefine the Application Networked components wired together Not just a web frontend anymore

More information

Think Small to Scale Big

Think Small to Scale Big Think Small to Scale Big Intro to Containers for the Datacenter Admin Pete Zerger Principal Program Manager, MVP pete.zerger@cireson.com Cireson Lee Berg Blog, e-mail address, title Company Pete Zerger

More information

By: Jeeva S. Chelladhurai

By: Jeeva S. Chelladhurai CI CD By: Jeeva S. Chelladhurai Tools SCM: www.github.com CI/CD: Jenkins 2.0 Important Plugins: Pipeline (for Jenkinsfile), git, github, SSH Slaves (for build slave) Platform: docker Container Orchestration:

More information

Red Hat Containers Cheat Sheet

Red Hat Containers Cheat Sheet Red Hat Containers Cheat Sheet Table of Contents Introduction Commands Key 1. Container Runtime Engine 1.A) Container Related Commands 1.B) Image Related Commands 1.C) Network Related Commands 1.D) Registry

More information

@briandorsey #kubernetes #GOTOber

@briandorsey #kubernetes #GOTOber 1 Kubernetes Changing the way we think and talk about computing GOTO Berlin - December 2015 2 What is this talk? Container 3 Brian Dorsey Developer Advocate - Google Cloud platform +BrianDorsey @briandorsey

More information

DevOps Technologies. for Deployment

DevOps Technologies. for Deployment DevOps Technologies for Deployment DevOps is the blending of tasks performed by a company's application development and systems operations teams. The term DevOps is being used in several ways. In its most

More information

Docker Cheat Sheet. Introduction

Docker Cheat Sheet. Introduction Docker Cheat Sheet Introduction Containers allow the packaging of your application (and everything that you need to run it) in a "container image". Inside a container you can include a base operational

More information

Container-based virtualization: Docker

Container-based virtualization: Docker Università degli Studi di Roma Tor Vergata Dipartimento di Ingegneria Civile e Ingegneria Informatica Container-based virtualization: Docker Corso di Sistemi Distribuiti e Cloud Computing A.A. 2018/19

More information

Dockerfile Documentation

Dockerfile Documentation Dockerfile Documentation Release Florian Tatzel Feb 04, 2018 Contents 1 Introduction 3 1.1 What are the Dockerfile for?....................................... 3 2 Docker images 5 2.1 webdevops/ansible............................................

More information

An introduction to Docker

An introduction to Docker An introduction to Docker Ing. Vincenzo Maffione Operating Systems Security Container technologies on Linux Several light virtualization technologies are available for Linux They build on cgroups, namespaces

More information

Advanced Continuous Delivery Strategies for Containerized Applications Using DC/OS

Advanced Continuous Delivery Strategies for Containerized Applications Using DC/OS Advanced Continuous Delivery Strategies for Containerized Applications Using DC/OS ContainerCon @ Open Source Summit North America 2017 Elizabeth K. Joseph @pleia2 1 Elizabeth K. Joseph, Developer Advocate

More information

Docker for Sysadmins: Linux Windows VMware

Docker for Sysadmins: Linux Windows VMware Docker for Sysadmins: Linux Windows VMware Getting started with Docker from the perspective of sysadmins and VM admins Nigel Poulton This book is for sale at http://leanpub.com/dockerforsysadmins This

More information

Dockerfile Documentation

Dockerfile Documentation Dockerfile Documentation Release Florian Tatzel May 15, 2017 Contents 1 Introduction 3 1.1 What are the Dockerfile for?....................................... 3 2 Docker images 5 2.1 webdevops/ansible............................................

More information

Network softwarization Lab session 2: OS Virtualization Networking

Network softwarization Lab session 2: OS Virtualization Networking Network softwarization Lab session 2: OS Virtualization Networking Nicolas Herbaut David Bourasseau Daniel Negru December 16, 2015 1 Introduction 1.1 Discovering docker 1.1.1 Installation Please launch

More information

Sunil Shah SECURE, FLEXIBLE CONTINUOUS DELIVERY PIPELINES WITH GITLAB AND DC/OS Mesosphere, Inc. All Rights Reserved.

Sunil Shah SECURE, FLEXIBLE CONTINUOUS DELIVERY PIPELINES WITH GITLAB AND DC/OS Mesosphere, Inc. All Rights Reserved. Sunil Shah SECURE, FLEXIBLE CONTINUOUS DELIVERY PIPELINES WITH GITLAB AND DC/OS 1 Introduction MOBILE, SOCIAL & CLOUD ARE RAISING CUSTOMER EXPECTATIONS We need a way to deliver software so fast that our

More information

The Galaxy Docker Project. our hands-on tutorial

The Galaxy Docker Project. our hands-on tutorial The Galaxy Docker Project our hands-on tutorial Preparation docker pull quay.io/bgruening/galaxy:gcc2016 docker pull quay.io/bgruening/galaxy-docs-slurm:gcc2016 git clone -b gcc2016 https://github.com/bgruening/dockergalaxy-stable.git

More information

Fixing the "It works on my machine!" Problem with Docker

Fixing the It works on my machine! Problem with Docker Fixing the "It works on my machine!" Problem with Docker Jared M. Smith @jaredthecoder About Me Cyber Security Research Scientist at Oak Ridge National Lab BS and MS in Computer Science from the University

More information

Orchestration in Docker

Orchestration in Docker Orchestration in Docker Swarm mode, Docker services and declarative application deployment Mike Goelzer & Victor Vieux Docker Orchestration Overview Mike Goelzer / mgoelzer@docker.com / gh: mgoelzer Orchestration

More information

SUSE s vision for agile software development and deployment in the Software Defined Datacenter

SUSE s vision for agile software development and deployment in the Software Defined Datacenter From Git to Cloud SUSE s vision for agile software development and deployment in the Software Defined Datacenter Joachim Werner Senior Product Manager joe@suse.com Peter Chadwick Director Product Management

More information

Using DC/OS for Continuous Delivery

Using DC/OS for Continuous Delivery Using DC/OS for Continuous Delivery DevPulseCon 2017 Elizabeth K. Joseph, @pleia2 Mesosphere 1 Elizabeth K. Joseph, Developer Advocate, Mesosphere 15+ years working in open source communities 10+ years

More information

Zero to Microservices in 5 minutes using Docker Containers. Mathew Lodge Weaveworks

Zero to Microservices in 5 minutes using Docker Containers. Mathew Lodge Weaveworks Zero to Microservices in 5 minutes using Docker Containers Mathew Lodge (@mathewlodge) Weaveworks (@weaveworks) https://www.weave.works/ 2 Going faster with software delivery is now a business issue Software

More information

Docker task in HPC Pack

Docker task in HPC Pack Docker task in HPC Pack We introduced docker task in HPC Pack 2016 Update1. To use this feature, set the environment variable CCP_DOCKER_IMAGE of a task so that it could be run in a docker container on

More information

DevOps Foundations : Infrastructure as Code

DevOps Foundations : Infrastructure as Code DevOps Foundations : Infrastructure as Code Ernest Mueller, James Wickett DevOps Fundamentals 1 1. Infrasturcture automation 2. Continuous Delivery 3. Reliability Engineering Infrastructure as Code There

More information

Dockerfile & docker CLI Cheat Sheet

Dockerfile & docker CLI Cheat Sheet Dockerfile & docker CLI Cheat Sheet Table of Contents Introduction 1 1. docker CLI Engine 2 1.1 Container Related s 2 1.2 Image Related s 4 1.3 Network Related s 5 1.4 Registry Related s 6 1.5 Volume Related

More information

Cloud & container monitoring , Lars Michelsen Check_MK Conference #4

Cloud & container monitoring , Lars Michelsen Check_MK Conference #4 Cloud & container monitoring 04.05.2018, Lars Michelsen Some cloud definitions Applications Data Runtime Middleware O/S Virtualization Servers Storage Networking Software-as-a-Service (SaaS) Applications

More information

HOW TO STAND OUT IN DEVOPS

HOW TO STAND OUT IN DEVOPS HOW TO STAND OUT IN DEVOPS Exam Guide for Linux Professional Institute DevOps Tools Engineer Certification www.lpi.org Contents 1. Why you need DevOps Tools certification 3 2. The type of experience you

More information

the road to cloud native applications Fabien Hermenier

the road to cloud native applications Fabien Hermenier the road to cloud native applications Fabien Hermenier 1 cloud ready applications single-tiered monolithic hardware specific cloud native applications leverage cloud services scalable reliable 2 Agenda

More information

Docker at Lyft Speeding up development Matthew #dockercon

Docker at Lyft Speeding up development Matthew #dockercon Docker at Lyft Speeding up development Matthew Leventi @mleventi #dockercon Lyft Engineering Lyft Engineering Organization - Rapidly growing headcount - Fluid teams - Everyone does devops Technology -

More information

Set up, Configure, and Use Docker on Local Dev Machine

Set up, Configure, and Use Docker on Local Dev Machine Set up, Configure, and Use Docker on Local Dev Machine Table of Contents Set up, Configure, and Use Docker on Local Dev Machine... 1 1. Introduction... 2 1.1 Major Docker Components... 2 1.2 Tools Installed

More information

containerization: more than the new virtualization

containerization: more than the new virtualization containerization: more than the new virtualization Jérôme Petazzoni (@jpetazzo) Grumpy French DevOps - Go away or I will replace you with a very small shell script Runs everything in containers - Docker-in-Docker

More information

Docker & why we should use it

Docker & why we should use it Docker & why we should use it Vicențiu Ciorbaru Software Engineer @ MariaDB Foundation * * Agenda What is Docker? What Docker brings to the table compared to KVM and Vagrant? Docker tutorial What is Docker

More information

NGINX: From North/South to East/West

NGINX: From North/South to East/West NGINX: From North/South to East/West Reducing Complexity with API and Microservices Traffic Management and NGINX Plus Speakers: Alan Murphy, Regional Solution Architect, APAC September, 2018 About NGINX,

More information

Containers, Serverless and Functions in a nutshell. Eugene Fedorenko

Containers, Serverless and Functions in a nutshell. Eugene Fedorenko Containers, Serverless and Functions in a nutshell Eugene Fedorenko About me Eugene Fedorenko Senior Architect Flexagon adfpractice-fedor.blogspot.com @fisbudo Agenda Containers Microservices Docker Kubernetes

More information

Kuber-what?! Learn about Kubernetes

Kuber-what?! Learn about Kubernetes DEVNET-1999 Kuber-what?! Learn about Kubernetes Ashley Roach, Principal Engineer Evangelist Agenda Objectives A brief primer on containers The problems with running containers at scale Orchestration systems

More information

Travis Cardwell Technical Meeting

Travis Cardwell Technical Meeting .. Introduction to Docker Travis Cardwell Tokyo Linux Users Group 2014-01-18 Technical Meeting Presentation Motivation OS-level virtualization is becoming accessible Docker makes it very easy to experiment

More information

Microsoft Cloud Workshop. Containers and DevOps Hackathon Learner Guide

Microsoft Cloud Workshop. Containers and DevOps Hackathon Learner Guide Microsoft Cloud Workshop Containers and DevOps Hackathon Learner Guide September 2017 2017 Microsoft Corporation. All rights reserved. This document is confidential and proprietary to Microsoft. Internal

More information

Red Hat OpenShift Roadmap Q4 CY16 and H1 CY17 Releases. Lutz Lange Solution

Red Hat OpenShift Roadmap Q4 CY16 and H1 CY17 Releases. Lutz Lange Solution Red Hat OpenShift Roadmap Q4 CY16 and H1 CY17 Releases Lutz Lange Solution Architect @AtomicContainer OpenShift Roadmap OpenShift Container Platform 3.2 Kubernetes 1.2 & Docker 1.9

More information

A REFERENCE ARCHITECTURE FOR DEPLOYING WSO2 MIDDLEWARE ON KUBERNETES

A REFERENCE ARCHITECTURE FOR DEPLOYING WSO2 MIDDLEWARE ON KUBERNETES A REFERENCE ARCHITECTURE FOR DEPLOYING WSO2 BY FRANK LEYMANN MIDDLEWARE ON KUBERNETES BY IMESH GUNARATNE SENIOR TECHNICAL LEAD, WSO2 WSO2 REST API DESIGN GUIDELINES TABLE OF CONTENTS 1. An Introduction

More information

Developing and Testing Java Microservices on Docker. Todd Fasullo Dir. Engineering

Developing and Testing Java Microservices on Docker. Todd Fasullo Dir. Engineering Developing and Testing Java Microservices on Docker Todd Fasullo Dir. Engineering Agenda Who is Smartsheet + why we started using Docker Docker fundamentals Demo - creating a service Demo - building service

More information

Multi-Cloud and Application Centric Modeling, Deployment and Management with Cisco CloudCenter (CliQr)

Multi-Cloud and Application Centric Modeling, Deployment and Management with Cisco CloudCenter (CliQr) Multi-Cloud and Application Centric Modeling, Deployment and Management with Cisco CloudCenter (CliQr) Jeremy Oakey - Sr. Director, Technical Marketing & Integrations BRKCLD-2008 Agenda Introduction Architecture

More information

Android meets Docker. Jing Li

Android meets Docker. Jing Li Android meets Docker Jing Li 1 2 > 50 cities in Europe 3 Developer Story 4 Pain in the Admin provision machines ( e.g. mobile CI ) 5 Containerization vs Virtualization 6 Why Docker? Docker Vagrant Resource

More information

DCCN Docker Swarm Cluster Documentation

DCCN Docker Swarm Cluster Documentation DCCN Docker Swarm Cluster Documentation Release 1.0.0 Hurng-Chun Lee Sep 12, 2017 Contents 1 Introduction to Docker Swarm 1 1.1 Docker in a Nutshell........................................... 1 1.2 Docker

More information

Build your dev environment with Docker.

Build your dev environment with Docker. Build your dev environment with Docker Jonathan Brinley 2 What does your dev environment look like? 3 What does your production environment look like? 4 add_action( 'init', function () { remove_post_type_support(

More information

Precursor Steps & Storage Node

Precursor Steps & Storage Node Precursor Steps & Storage Node In a basic HPC cluster, the head node is the orchestration unit and possibly the login portal for your end users. It s one of the most essential pieces to get working appropriately.

More information

Running MarkLogic in Containers (Both Docker and Kubernetes)

Running MarkLogic in Containers (Both Docker and Kubernetes) Running MarkLogic in Containers (Both Docker and Kubernetes) Emma Liu Product Manager, MarkLogic Vitaly Korolev Staff QA Engineer, MarkLogic @vitaly_korolev 4 June 2018 MARKLOGIC CORPORATION Source: http://turnoff.us/image/en/tech-adoption.png

More information

AALOK INSTITUTE. DevOps Training

AALOK INSTITUTE. DevOps Training DevOps Training Duration: 40Hrs (8 Hours per Day * 5 Days) DevOps Syllabus 1. What is DevOps? a. History of DevOps? b. How does DevOps work anyways? c. Principle of DevOps: d. DevOps combines the best

More information

Lassoing the Clouds: Best Practices on AWS. Brian DeShong May 26, 2017

Lassoing the Clouds: Best Practices on AWS. Brian DeShong May 26, 2017 Lassoing the Clouds: Best Practices on AWS Brian DeShong May 26, 2017 Who am I? Who am I? Who am I? Who am I? Agenda Agenda Running web servers Agenda Running web servers Serving static content Agenda

More information

Developing Kubernetes Services

Developing Kubernetes Services / MARCH 2019 / CON LONDON Developing Kubernetes Services at Airbnb Scale What is kubernetes? @MELAN IECEBULA Who am I? A BRIEF HISTORY Why Microservices? 4000000 3000000 MONOLITH LOC 2000000 1000000 0

More information

DevOps Workflow. From 0 to kube in 60 min. Christian Kniep, v Technical Account Manager, Docker Inc.

DevOps Workflow. From 0 to kube in 60 min.   Christian Kniep, v Technical Account Manager, Docker Inc. DevOps Workflow From 0 to kube in 60 min http://qnib.org/devops-workflow Christian Kniep, v2018-02-20 Technical Account Manager, Docker Inc. Motivation Iteration barriers Works on my Laptop! Why is DevOps

More information

Lassoing the Clouds: Best Practices on AWS. Brian DeShong May 26, 2017

Lassoing the Clouds: Best Practices on AWS. Brian DeShong May 26, 2017 Lassoing the Clouds: Best Practices on AWS Brian DeShong May 26, 2017 Who am I? Agenda Running web servers Serving static content Security-related concerns Databases Logging Regions + Availability Zones

More information

docker & HEP: containerization of applications for development, distribution and preservation

docker & HEP: containerization of applications for development, distribution and preservation docker & HEP: containerization of applications for development, distribution and preservation Sébastien Binet LAL/IN2P3 2015-04-13 S. Binet (LAL) docker-hep 2015-04-13 1 / 16 Docker: what is it? http://www.docker.io/

More information

SCREENING TEST & TELEPHONIC

SCREENING TEST & TELEPHONIC INTERVIEW QUESTIONS IN ACCENTURE 1 ST ROUND TELEPHONIC 1. Current roles & responsibilities? 2. What is Docker compose? 3. What is Docker server version? 4. What are the advantages of Docker? 5. How do

More information

Well, That Escalated Quickly! How abusing the Docker API Led to Remote Code Execution, Same Origin Bypass and Persistence in the Hypervisor via

Well, That Escalated Quickly! How abusing the Docker API Led to Remote Code Execution, Same Origin Bypass and Persistence in the Hypervisor via Well, That Escalated Quickly! How abusing the Docker API Led to Remote Code Execution, Same Origin Bypass and Persistence in the Hypervisor via Shadow Containers. Michael Cherny @chernymi Sagie Dulce @SagieSec

More information

Clocker. Deploying Complex Applica3ons on Docker using Apache Brooklyn

Clocker. Deploying Complex Applica3ons on Docker using Apache Brooklyn Clocker Deploying Complex Applica3ons on Docker using Apache Brooklyn Deploying Complex Applica1ons on Docker using Apache Brooklyn Andrew Kennedy @grkvlt ApacheCon, November 2014 Budapest, Hungary Introduc1on

More information

Container Security and new container technologies. Dan

Container Security and new container technologies. Dan Container Security and new container technologies Dan Walsh @rhatdan Please Stand Please read out loud all text in RED I Promise To say Container Registries Rather than Docker registries I Promise To say

More information

Buenos Aires 31 de Octubre de 2018

Buenos Aires 31 de Octubre de 2018 Buenos Aires 31 de Octubre de 2018 VMware NSX Data Center & Containers in the Dell EMC Ecosystem Gonzalo Atienza Sr Systems Engineer, Network & Security Business Unit, VMware Containers are Here to stay!

More information

Who is Docker and how he can help us? Heino Talvik

Who is Docker and how he can help us? Heino Talvik Who is Docker and how he can help us? Heino Talvik heino.talvik@seb.ee heino.talvik@gmail.com What is Docker? Software guy view: Marriage of infrastucture and Source Code Management Hardware guy view:

More information

DGX-1 DOCKER USER GUIDE Josh Park Senior Solutions Architect Contents created by Jack Han Solutions Architect

DGX-1 DOCKER USER GUIDE Josh Park Senior Solutions Architect Contents created by Jack Han Solutions Architect DGX-1 DOCKER USER GUIDE 17.08 Josh Park Senior Solutions Architect Contents created by Jack Han Solutions Architect AGENDA Introduction to Docker & DGX-1 SW Stack Docker basic & nvidia-docker Docker image

More information

Code: Slides:

Code:   Slides: Workshop Resources Code: https://github.com/beekpr/public-workshops Slides: https://tinyurl.com/yc2uo3wk Make sure minikube and kubectl is setup (labs/1-setup-cluster.md has some instructions) Kubernetes

More information

Dockerizing CS50. From Cluster to Cloud to Appliance to Container. David J. Malan Dan Armendariz

Dockerizing CS50. From Cluster to Cloud to Appliance to Container. David J. Malan Dan Armendariz Dockerizing CS50 From Cluster to Cloud to Appliance to Container David J. Malan malan@harvard.edu Dan Armendariz danallan@cs.harvard.edu CS50 800 students at Harvard College 350 students at Yale College

More information

DevOps + Infrastructure TRACK SUPPORTED BY

DevOps + Infrastructure TRACK SUPPORTED BY DevOps + Infrastructure TRACK SUPPORTED BY About me Nils Peeters DevOps Engineer nils@scalecity.io https://www.linkedin.com/in/nilspeeters/ www.scalecity.io Containerized Drupal, Kubernetes and blue/green

More information