Docker on VDS. Aurelijus Banelis

Size: px
Start display at page:

Download "Docker on VDS. Aurelijus Banelis"

Transcription

1 Docker on VDS Aurelijus Banelis

2 Aurelijus Banelis Software developer aurelijus.banelis.lt

3 Docker on VDS

4 You will learn Why VDS? Why docker? What is docker? Is it possible? Why not? Dev/prod and configs Testing and debugging Version control and state

5 Wanted new technologies on my old Virtual Dedicated Server Version control and state Testing and debugging Dev/prod and configs Is it possible? Why not? Why VDS? Why docker? What is docker? Why VDS? Why docker?

6

7

8 Markdown documentation Very smart bash script Provision with puppet Provision with saltstack

9 Markdown documentation Very smart bash script Provision with puppet Provision with saltstack

10 User-friendly containerization tools Version control and state Testing and debugging Dev/prod and configs What is docker? Is it possible? Why not? What is docker? Why VDS? Why docker?

11 What is docker? Source:

12 One line to run docker-compose up *Docker-compose is a docker wrapper, written in Python

13 Isolated apps

14 Tools: docker-compose $ docker run --name some-nginx -v /some/nginx.conf: /etc/nginx/nginx.conf -d -p 8080:80 nginx docker-compose.yml services: image: nginx volumes: -./some/nginx.conf:/etc/nginx/nginx.conf ports: - "8080:80"

15 Testing and debugging Possible on some VDS, but mine used bad kernel Dev/prod and configs Is it possible? Why not? Is it possible? Why not always? Version control and state What is docker? Why VDS? Why docker? Docker on VDS

16 One line to run docker-compose up

17 One line to run docker-compose up If docker is installed *Docker-compose is a docker wrapper, written in Python. There was less problems installing it, than docker itself

18 Old distribution?

19 Install from.deb on Ubuntu Old distribution? Not linux?

20 Install from.deb on Ubuntu Old distribution? Native for OSX and Win Not linux? Newest kernel Your Linux kernel version stab can be unstable running docker. Please upgrade your kernel to

21 Ended up on AWS

22 Ended up on AWS Stable HDD

23 Ended up on AWS Stable HDD Static IP

24 Ended up on AWS Stable HDD Static IP Similar price

25 Using multiple docker-compose.yml Version control and state Testing and debugging Dev/prod and configs Is it possible? Why not? Dev and prod environments What is docker? Why VDS? Why docker?

26 Via multiple files docker-compose -f docker-compose.yml -f docker-compose.stage.yml -f docker-compose.live.yml up -d docker-compose.live.yml services: web: environment: - PHP_AB_LT_HOST=aurelijus.banelis.lt - JAVA_WEBSITE_HOST=auginte.com - JAVA_DEMOAPP_HOST=demo.auginte.com php_ab_lt: environment: - DB_PASSWORD=h2Jk_PHP_IMPRESS_qIefEgtjeSFlA

27 Update on run docker-compose..yml volumes: -./my-nginx/run.sh:/custom/run.sh command: - "/custom/run.sh" Do not use envsubst - to not change $uri, $document_root,... run.sh #... sed -e "s#\${$in}#$out#g" < ${CFG_TMP} > ${CFG_DEST} #... nginx -g 'daemon off;'

28 Availability docker-compose..yml web: ports: - " :1380:80" - " :13443:443" Ports not colliding with default applications Friends in same WiFi will not see your work

29 Availability docker-compose..yml web: ports: - " :1380:80" - " :13443:443" Ports not colliding with default applications Friends in same WiFi will not see your work docker-compose..stage.yml web: ports: - " :80:80" - " :443:443" restart: always Open to the users Auto-restart, if application crashes

30 Usually docker command-line Version control and state Testing and debugging Dev/prod and configs Is it possible? Why not? Testing and debugging What is docker? Why VDS? Why docker?

31 docker ps -a STATUS PORTS Up 9 days 3306/tcp Exited (0) 9 days ago NAMES mysql_ab_lt mysql_ab_lt_provision

32 docker ps -a STATUS PORTS Up 9 days 3306/tcp Exited (0) 9 days ago NAMES mysql_ab_lt mysql_ab_lt_provision docker logs -f mysql_ab_lt_provision

33 docker ps -a STATUS PORTS Up 9 days 3306/tcp Exited (0) 9 days ago NAMES mysql_ab_lt mysql_ab_lt_provision docker logs -f mysql_ab_lt_provision docker exec -it web sh

34 Insert bash in entrypoint script

35 Insert bash in entrypoint script Docker inspect docker inspect -f '{{.Name}} - {{.NetworkSettings.Networks.docker_default.IPAddress }}' $(docker ps -aq)

36 Insert bash in entrypoint script Docker inspect docker inspect -f '{{.Name}} - {{.NetworkSettings.Networks.docker_default.IPAddress }}' $(docker ps -aq) SSH & Port forwarding ssh -i ~/.ssh/secret.pem -L :18081: :8081 ec2-user@

37 .gitignore raw data, add fields for provisioning Version control and state Testing and debugging Dev/prod and configs Is it possible? Why not? Version control and state What is docker? Why VDS? Why docker?

38 Mount vs Build container_name: web image: nginx: alpine volumes: -../releases/php-ab-lt/$rev/install:/releases/php_ab_lt/$rev/install -../releases/php-ab-lt/$rev/ip:/releases/php_ab_lt/$rev/ip -../releases/php-ab-lt/$rev/plugin:/releases/php_ab_lt/$rev/plugin -../releases/php-ab-lt/$rev/theme:/releases/php_ab_lt/$rev/theme -../releases/php-ab-lt/$rev/vendor:/releases/php_ab_lt/$rev/vendor -../releases/php-ab-lt/$rev/admin.php:/releases/php_ab_lt/$rev/admin.php -../releases/php-ab-lt/$rev/favicon.ico:/releases/php_ab_lt/$rev/favicon.ico -../releases/php-ab-lt/$rev/index.php:/releases/php_ab_lt/$rev/index.php -../releases/php-ab-lt/$rev/robots.txt:/releases/php_ab_lt/$rev/robots.txt

39 Mount vs Build docker-php-ext-install mbstring pdo_mysql gd

40 Mount vs Build

41 Data: dump/merge mysql_ab_lt: volumes: - /custom/data/mysql-ab-lt/stage:/var/lib/mysql mysql_ab_lt_provision: environment: - MYSQL_ROOT_PASSWORD=h2JfESFlA - IMPORT_DBNAME=ab_lt_stage - IMPORT_FILE=/custom/dumps/aurelijusb_ip.sql - REPLACE_FROM=aurelijus.banelis.lt - REPLACE_TO=aurelijus.banelis.stage

42 Data: dump/merge mysql_ab_lt: volumes: - /custom/data/mysql-ab-lt/stage:/var/lib/mysql mysql_ab_lt_provision: environment: - MYSQL_ROOT_PASSWORD=h2JfESFlA - IMPORT_DBNAME=ab_lt_stage - IMPORT_FILE=/custom/dumps/aurelijusb_ip.sql - REPLACE_FROM=aurelijus.banelis.lt - REPLACE_TO=aurelijus.banelis.stage bin/auginte-server -Dprovision=${PROVISION}

43 You have learned Why VDS? Why docker? What is docker? Is it possible? Why not? Dev/prod and configs Testing and debugging Version control and state

44 You have learned That s it. Questions? Why VDS? Why docker? What is docker?? Is it possible? Why not? Dev/prod and configs Testing and debugging Slides hosted using Docker: Version control and state

Arup Nanda VP, Data Services Priceline.com

Arup Nanda VP, Data Services Priceline.com Jumpstarting Docker Arup Nanda VP, Data Services Priceline.com My application worked in Dev but not in QA Will it work in production? I need an environment right now No, I can t wait for 2 weeks I just

More information

By: Jeeva S. Chelladhurai

By: Jeeva S. Chelladhurai CI CD By: Jeeva S. Chelladhurai Tools SCM: www.github.com CI/CD: Jenkins 2.0 Important Plugins: Pipeline (for Jenkinsfile), git, github, SSH Slaves (for build slave) Platform: docker Container Orchestration:

More information

Follow me!

Follow me! Stuff I do Follow me! https://pasztor.at @janoszen About this talk 1. Maintaining your Build Stack 2. Orchestrating your Cluster 3. Pitfalls and Recommendations About this talk 1. Maintaining your Build

More information

Technical Manual. Software Quality Analysis as a Service (SQUAAD) Team No.1. Implementers: Aleksandr Chernousov Chris Harman Supicha Phadungslip

Technical Manual. Software Quality Analysis as a Service (SQUAAD) Team No.1. Implementers: Aleksandr Chernousov Chris Harman Supicha Phadungslip Technical Manual Software Quality Analysis as a Service (SQUAAD) Team No.1 Implementers: Aleksandr Chernousov Chris Harman Supicha Phadungslip Testers: Kavneet Kaur Reza Khazali George Llames Sahar Pure

More information

Introduction to Containers

Introduction to Containers Introduction to Containers Shawfeng Dong Principal Cyberinfrastructure Engineer University of California, Santa Cruz What are Containers? Containerization, aka operating-system-level virtualization, refers

More information

Container-based virtualization: Docker

Container-based virtualization: Docker Università degli Studi di Roma Tor Vergata Dipartimento di Ingegneria Civile e Ingegneria Informatica Container-based virtualization: Docker Corso di Sistemi Distribuiti e Cloud Computing A.A. 2018/19

More information

Index. Bessel function, 51 Big data, 1. Cloud-based version-control system, 226 Containerization, 30 application, 32 virtualize processes, 30 31

Index. Bessel function, 51 Big data, 1. Cloud-based version-control system, 226 Containerization, 30 application, 32 virtualize processes, 30 31 Index A Amazon Web Services (AWS), 2 account creation, 2 EC2 instance creation, 9 Docker, 13 IP address, 12 key pair, 12 launch button, 11 security group, 11 stable Ubuntu server, 9 t2.micro type, 9 10

More information

It s probably the most popular containerization technology on Linux these days

It s probably the most popular containerization technology on Linux these days Docker & Perl What is docker? It s probably the most popular containerization technology on Linux these days It s somewhere between chroot jails and virtual machines. Effectively lightweight virtual machines

More information

Docker for Development: Getting Started

Docker for Development: Getting Started Docker for Development: Getting Started Lisa H. Ridley Savas Labs DrupalCamp Chattanooga November 5, 2016 Who am I? Lisa Ridley, Director of Client Success, Savas Labs Lead Developer and Project Manager

More information

A Hands on Introduction to Docker

A Hands on Introduction to Docker A Hands on Introduction to Docker Len Bass A Hands on introduction Introduction to to Docker May 2017 1 4, Len 2017 Bass 2017 Len Bass 1 Setting expectations This is an introduction to Docker intended

More information

Containers. Pablo F. Ordóñez. October 18, 2018

Containers. Pablo F. Ordóñez. October 18, 2018 Containers Pablo F. Ordóñez October 18, 2018 1 Welcome Song: Sola vaya Interpreter: La Sonora Ponceña 2 Goals Containers!= ( Moby-Dick ) Containers are part of the Linux Kernel Make your own container

More information

containerization: more than the new virtualization

containerization: more than the new virtualization containerization: more than the new virtualization Jérôme Petazzoni (@jpetazzo) Grumpy French DevOps - Go away or I will replace you with a very small shell script Runs everything in containers - Docker-in-Docker

More information

Advanced Continuous Delivery Strategies for Containerized Applications Using DC/OS

Advanced Continuous Delivery Strategies for Containerized Applications Using DC/OS Advanced Continuous Delivery Strategies for Containerized Applications Using DC/OS ContainerCon @ Open Source Summit North America 2017 Elizabeth K. Joseph @pleia2 1 Elizabeth K. Joseph, Developer Advocate

More information

" Qué me estás container?" Docker for dummies

 Qué me estás container? Docker for dummies " Qué me estás container?" Docker for dummies Sara Arjona @sara_arjona Pau Ferrer @crazyserver Developer at Moodle HQ Moodle Mobile developer at Moodle HQ #MootES18 Who uses Docker for development? Who

More information

CONTINUOUS INTEGRATION; TIPS & TRICKS

CONTINUOUS INTEGRATION; TIPS & TRICKS CONTINUOUS INTEGRATION; TIPS & TRICKS BIO I DO TECH THINGS I DO THINGS I DO THINGS BLUE OCEAN BEEP BEEP REFACTOR PEOPLE S HOUSES MY TIPS & TRICKS FOR CI - CI Infrastructure - CI Architecture - Pipeline

More information

/ Cloud Computing. Recitation 5 February 14th, 2017

/ Cloud Computing. Recitation 5 February 14th, 2017 15-319 / 15-619 Cloud Computing Recitation 5 February 14th, 2017 1 Overview Administrative issues Office Hours, Piazza guidelines Last week s reflection Project 2.1, OLI Unit 2 modules 5 and 6 This week

More information

docker & HEP: containerization of applications for development, distribution and preservation

docker & HEP: containerization of applications for development, distribution and preservation docker & HEP: containerization of applications for development, distribution and preservation Sébastien Binet LAL/IN2P3 2015-04-13 S. Binet (LAL) docker-hep 2015-04-13 1 / 16 Docker: what is it? http://www.docker.io/

More information

Deploying Rails with Kubernetes

Deploying Rails with Kubernetes Deploying Rails with Kubernetes AWS Edition Pablo Acuña This book is for sale at http://leanpub.com/deploying-rails-with-kubernetes This version was published on 2016-05-21 This is a Leanpub book. Leanpub

More information

The Long Road from Capistrano to Kubernetes

The Long Road from Capistrano to Kubernetes The Long Road from Capistrano to Kubernetes Tobias Schwab, Co-Founder of PhraseApp Slides: http://bit.ly/cap-to-kube How to deploy Ruby on Rails? Deploying Ruby on Rails required on all servers: OS + system

More information

Creating pipelines that build, test and deploy containerized artifacts Slides: Tom Adams

Creating pipelines that build, test and deploy containerized artifacts Slides:   Tom Adams Creating pipelines that build, test and deploy containerized artifacts Slides: https://goo.gl/2mzfe6 Tom Adams tadams@thoughtworks.com 1 Who I am Tom Adams Tech Lead tadams@thoughtworks.com http://tadams289.blogspot.com

More information

Think Small to Scale Big

Think Small to Scale Big Think Small to Scale Big Intro to Containers for the Datacenter Admin Pete Zerger Principal Program Manager, MVP pete.zerger@cireson.com Cireson Lee Berg Blog, e-mail address, title Company Pete Zerger

More information

Code: Slides:

Code:   Slides: Workshop Resources Code: https://github.com/beekpr/public-workshops Slides: https://tinyurl.com/yc2uo3wk Make sure minikube and kubectl is setup (labs/1-setup-cluster.md has some instructions) Kubernetes

More information

Splunk N Box. Splunk Multi-Site Clusters In 20 Minutes or Less! Mohamad Hassan Sales Engineer. 9/25/2017 Washington, DC

Splunk N Box. Splunk Multi-Site Clusters In 20 Minutes or Less! Mohamad Hassan Sales Engineer. 9/25/2017 Washington, DC Splunk N Box Splunk Multi-Site Clusters In 20 Minutes or Less! Mohamad Hassan Sales Engineer 9/25/2017 Washington, DC Forward-Looking Statements During the course of this presentation, we may make forward-looking

More information

/ Cloud Computing. Recitation 5 September 26 th, 2017

/ Cloud Computing. Recitation 5 September 26 th, 2017 15-319 / 15-619 Cloud Computing Recitation 5 September 26 th, 2017 1 Overview Administrative issues Office Hours, Piazza guidelines Last week s reflection Project 2.1, OLI Unit 2 modules 5 and 6 This week

More information

Deployability. of Python. web applications

Deployability. of Python. web applications Deployability of Python web applications Bruno Renié EuroPython 2013 Deployability, n The extent to which something is deployable Disclaimer Most of this isn't python-specific or even web-specific Oriented

More information

Developing and Testing Java Microservices on Docker. Todd Fasullo Dir. Engineering

Developing and Testing Java Microservices on Docker. Todd Fasullo Dir. Engineering Developing and Testing Java Microservices on Docker Todd Fasullo Dir. Engineering Agenda Who is Smartsheet + why we started using Docker Docker fundamentals Demo - creating a service Demo - building service

More information

Kubernetes The Path to Cloud Native

Kubernetes The Path to Cloud Native Kubernetes The Path to Cloud Native Eric Brewer VP, Infrastructure @eric_brewer August 28, 2015 ACM SOCC Cloud Na*ve Applica*ons Middle of a great transition unlimited ethereal resources in the Cloud an

More information

Build, test and release your python packages

Build, test and release your python packages Build, test and release your python packages Using DevPI, Docker and Jenkins David Melamed PyWeb #55-1st August 2016 A word about me Moved to Israel 8 years ago PhD in BioInformatics Senior Research Engineer

More information

DevOps Workflow. From 0 to kube in 60 min. Christian Kniep, v Technical Account Manager, Docker Inc.

DevOps Workflow. From 0 to kube in 60 min.   Christian Kniep, v Technical Account Manager, Docker Inc. DevOps Workflow From 0 to kube in 60 min http://qnib.org/devops-workflow Christian Kniep, v2018-02-20 Technical Account Manager, Docker Inc. Motivation Iteration barriers Works on my Laptop! Why is DevOps

More information

Docker und IBM Digital Experience in Docker Container

Docker und IBM Digital Experience in Docker Container Docker und IBM Digital Experience in Docker Container 20. 21. Juni 2017 IBM Labor Böblingen 1 What is docker Introduction VMs vs. containers Terminology v Docker components 2 6/22/2017 What is docker?

More information

DevOps Foundations : Infrastructure as Code

DevOps Foundations : Infrastructure as Code DevOps Foundations : Infrastructure as Code Ernest Mueller, James Wickett DevOps Fundamentals 1 1. Infrasturcture automation 2. Continuous Delivery 3. Reliability Engineering Infrastructure as Code There

More information

Singularity: Containers for High-Performance Computing. Grigory Shamov Nov 21, 2017

Singularity: Containers for High-Performance Computing. Grigory Shamov Nov 21, 2017 Singularity: Containers for High-Performance Computing Grigory Shamov Nov 21, 2017 Outline Software and High Performance Computing: Installation/Maintenance of the HPC Software stack Why containers and

More information

Running Databases in Containers.

Running Databases in Containers. Running Databases in Containers. How to Overcome the Challenges of Data Frank Stienhans CTO Prepared for Evolution of Enterprise IT Subjective Perspective CONTAINERS 1. More Choices CLOUD 2. Faster Delivery

More information

diskimage-builder: Building Linux Images for Cloud / Virtualization / Container

diskimage-builder: Building Linux Images for Cloud / Virtualization / Container diskimage-builder: Building Linux Images for Cloud / Virtualization / Container Let s start with a little bit of history: Once upon a time... About the Author Andreas Florath andreas@florath.net Mathematician

More information

Build your dev environment with Docker.

Build your dev environment with Docker. Build your dev environment with Docker Jonathan Brinley 2 What does your dev environment look like? 3 What does your production environment look like? 4 add_action( 'init', function () { remove_post_type_support(

More information

Cluster of Web-Servers with AWS

Cluster of Web-Servers with AWS Cluster of Web-Servers with AWS Cloud Computing Mauricio Altamirano Silva Julia Johnson Sefer Ul November, 2018 Agenda AWS Create EC2 (Elastic Compute Cloud) Create EBS (Elastic Block Storage) Cloning

More information

An introduction to Docker

An introduction to Docker An introduction to Docker Ing. Vincenzo Maffione Operating Systems Security Container technologies on Linux Several light virtualization technologies are available for Linux They build on cgroups, namespaces

More information

DevOps Course Content

DevOps Course Content DevOps Course Content 1. Introduction: Understanding Development Development SDLC using WaterFall & Agile Understanding Operations DevOps to the rescue What is DevOps DevOps SDLC Continuous Delivery model

More information

Dockerize Your IT! Centrale Nantes Information Technology Department Yoann Juet Dec, 2018

Dockerize Your IT! Centrale Nantes Information Technology Department Yoann Juet Dec, 2018 Dockerize Your IT! Centrale Nantes Information Technology Department Yoann Juet Dec, 2018 1 A Brief History of Containers UNIX CHROOT BSD JAIL LINUX VSERVER LINUX NAMESPACES LINUX OPENVZ 1979 2000 2001

More information

Docker for People. A brief and fairly painless introduction to Docker. Friday, November 17 th 11:00-11:45

Docker for People. A brief and fairly painless introduction to Docker. Friday, November 17 th 11:00-11:45 Docker for People A brief and fairly painless introduction to Docker Friday, November 17 th 11:00-11:45 Greg Gómez Sung-Hee Lee The University of New Mexico IT NM TIE 2017 1 Docker for People Agenda: Greg:

More information

Installing and Using Docker Toolbox for Mac OSX and Windows

Installing and Using Docker Toolbox for Mac OSX and Windows Installing and Using Docker Toolbox for Mac OSX and Windows One of the most compelling reasons to run Docker on your local machine is the speed at which you can deploy and build lab environments. As a

More information

Midterm Presentation Schedule

Midterm Presentation Schedule Midterm Presentation Schedule October 18 th Aurora, Bash, Sangam October 20 th Flash, Omega, CodeRing October 25th Omni, Aviato, NPComplete Mid Term Presentation Format 25 minutes Be prepared to use the

More information

CONTINUOUS DELIVERY WITH DC/OS AND JENKINS

CONTINUOUS DELIVERY WITH DC/OS AND JENKINS SOFTWARE ARCHITECTURE NOVEMBER 15, 2016 CONTINUOUS DELIVERY WITH DC/OS AND JENKINS AGENDA Presentation Introduction to Apache Mesos and DC/OS Components that make up modern infrastructure Running Jenkins

More information

Cloud Computing with APL. Morten Kromberg, CXO, Dyalog

Cloud Computing with APL. Morten Kromberg, CXO, Dyalog Cloud Computing with APL Morten Kromberg, CXO, Dyalog Cloud Computing Docker with APL Morten Kromberg, CXO, Dyalog 2 Cloud Computing: Definitions 3 Cloud Computing: Definitions Cloud Computing = "Using

More information

Getting Started With Containers

Getting Started With Containers DEVNET 2042 Getting Started With Containers Matt Johnson Developer Evangelist @mattdashj Cisco Spark How Questions? Use Cisco Spark to communicate with the speaker after the session 1. Find this session

More information

Run containerized applications from pre-existing images stored in a centralized registry

Run containerized applications from pre-existing images stored in a centralized registry Introduction This examination is based upon the most critical job activities a Docker Certified Associate performs. The skills and knowledge certified by this examination represent a level of expertise

More information

Running Blockchain in Docker Containers Prerequisites Sign up for a LinuxONE Community Cloud trial account Deploy a virtual server instance

Running Blockchain in Docker Containers Prerequisites Sign up for a LinuxONE Community Cloud trial account Deploy a virtual server instance Running Blockchain in Docker Containers The following instructions can be used to install the current hyperledger fabric, and run Docker and blockchain code in IBM LinuxONE Community Cloud instances. This

More information

Applying Container Technology to the Virtualized Ground System

Applying Container Technology to the Virtualized Ground System Applying Container Technology to the Virtualized Ground System GSAW 2017 Looking Beyond the Horizon Richard Monteleone 2017 by RT LOGIC Inc. Published by The Aerospace Corporation with permission All brands

More information

Flatpak and your distribution. Simon McVittie

Flatpak and your distribution. Simon McVittie Flatpak and your distribution Simon McVittie smcv@{collabora.com,debian.org} 2018-02-04 Introduction to Flatpak tl;dr edition A sandboxed app framework for desktop Linux GUI, desktop apps, as in /usr/share/applications,

More information

Docker 101 Workshop. Eric Smalling - Solution Architect, Docker

Docker 101 Workshop. Eric Smalling - Solution Architect, Docker Docker 101 Workshop Eric Smalling - Solution Architect, Docker Inc. @ericsmalling Who Am I? Eric Smalling Solution Architect Docker Customer Success Team ~25 years in software development, architecture,

More information

/ Cloud Computing. Recitation 5 September 27 th, 2016

/ Cloud Computing. Recitation 5 September 27 th, 2016 15-319 / 15-619 Cloud Computing Recitation 5 September 27 th, 2016 1 Overview Administrative issues Office Hours, Piazza guidelines Last week s reflection Project 2.1, OLI Unit 2 modules 5 and 6 This week

More information

Cloud & container monitoring , Lars Michelsen Check_MK Conference #4

Cloud & container monitoring , Lars Michelsen Check_MK Conference #4 Cloud & container monitoring 04.05.2018, Lars Michelsen Some cloud definitions Applications Data Runtime Middleware O/S Virtualization Servers Storage Networking Software-as-a-Service (SaaS) Applications

More information

Investigating Containers for Future Services and User Application Support

Investigating Containers for Future Services and User Application Support Investigating Containers for Future Services and User Application Support JLAB CNI NLIT 2018 () Overview JLAB scope What is a container? Why are we interested? Platform-as-a-Service (PaaS) for orchestration

More information

MySQL operations with Docker A quick guide for the uninitiated

MySQL operations with Docker A quick guide for the uninitiated MySQL operations with Docker A quick guide for the uninitiated Giuseppe Maxia Quality Assurance Architect at VMware @datacharmer 1 About me Who s this guy? Giuseppe Maxia, a.k.a. "The Data Charmer" QA

More information

Amazon EC2 Container Service: Manage Docker-Enabled Apps in EC2

Amazon EC2 Container Service: Manage Docker-Enabled Apps in EC2 Amazon EC2 Container Service: Manage Docker-Enabled Apps in EC2 Ian Massingham AWS Technical Evangelist @IanMmmm 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved Agenda Containers

More information

SCALING DRUPAL TO THE CLOUD WITH DOCKER AND AWS

SCALING DRUPAL TO THE CLOUD WITH DOCKER AND AWS SCALING DRUPAL TO THE CLOUD WITH DOCKER AND AWS Dr. Djun Kim Camp Pacific OUTLINE Overview Quick Intro to Docker Intro to AWS Designing a scalable application Connecting Drupal to AWS services Intro to

More information

Puppet on the AWS Cloud

Puppet on the AWS Cloud Puppet on the AWS Cloud Quick Start Reference Deployment AWS Quick Start Reference Team March 2016 This guide is also available in HTML format at http://docs.aws.amazon.com/quickstart/latest/puppet/. Contents

More information

Introduction to containers

Introduction to containers Introduction to containers Nabil Abdennadher nabil.abdennadher@hesge.ch 1 Plan Introduction Details : chroot, control groups, namespaces My first container Deploying a distributed application using containers

More information

Con$nuous Deployment with Docker Andrew Aslinger. Oct

Con$nuous Deployment with Docker Andrew Aslinger. Oct Con$nuous Deployment with Docker Andrew Aslinger Oct 9. 2014 Who is Andrew #1 So#ware / Systems Architect for OpenWhere Passion for UX, Big Data, and Cloud/DevOps Previously Designed and Implemented automated

More information

swiftenv Documentation

swiftenv Documentation swiftenv Documentation Release 1.3.0 Kyle Fuller Sep 27, 2017 Contents 1 The User Guide 3 1.1 Installation................................................ 3 1.2 Getting Started..............................................

More information

Securing Microservices Containerized Security in AWS

Securing Microservices Containerized Security in AWS Securing Microservices Containerized Security in AWS Mike Gillespie, Solutions Architect, Amazon Web Services Splitting Monoliths Ten Years Ago Splitting Monoliths Ten Years Ago XML & SOAP Splitting Monoliths

More information

puppet-diamond Documentation

puppet-diamond Documentation puppet-diamond Documentation Release 0.3.0 Ian Dennis Miller Mar 21, 2017 Contents 1 Overview 3 2 Introduction 5 3 User Guide 9 4 About 15 i ii Puppet-Diamond is framework for creating and managing an

More information

DCCN Docker Swarm Cluster Documentation

DCCN Docker Swarm Cluster Documentation DCCN Docker Swarm Cluster Documentation Release 1.0.0 Hurng-Chun Lee Sep 12, 2017 Contents 1 Introduction to Docker Swarm 1 1.1 Docker in a Nutshell........................................... 1 1.2 Docker

More information

what's in it for me? Ian Truslove :: Boulder Linux User Group ::

what's in it for me? Ian Truslove :: Boulder Linux User Group :: what's in it for me? Ian Truslove :: Boulder Linux User Group :: 2014-03-13 First: the end Docker: What s in it for me? Devs: http://xkcd.com/303/ DevOps: http://xkcd.com/149/ Docker: What s in it for

More information

Network softwarization Lab session 2: OS Virtualization Networking

Network softwarization Lab session 2: OS Virtualization Networking Network softwarization Lab session 2: OS Virtualization Networking Nicolas Herbaut David Bourasseau Daniel Negru December 16, 2015 1 Introduction 1.1 Discovering docker 1.1.1 Installation Please launch

More information

Working with Ubuntu Linux. Track 2 Workshop June 2010 Pago Pago, American Samoa

Working with Ubuntu Linux. Track 2 Workshop June 2010 Pago Pago, American Samoa Working with Ubuntu Linux Track 2 Workshop June 2010 Pago Pago, American Samoa Assumptions You are comfortable with the following: Core Linux concepts - Shells - Permissions - Graphical user interface

More information

The Galaxy Docker Project. our hands-on tutorial

The Galaxy Docker Project. our hands-on tutorial The Galaxy Docker Project our hands-on tutorial Preparation docker pull quay.io/bgruening/galaxy:gcc2016 docker pull quay.io/bgruening/galaxy-docs-slurm:gcc2016 git clone -b gcc2016 https://github.com/bgruening/dockergalaxy-stable.git

More information

Singularity: container formats

Singularity: container formats Singularity Easy to install and configure Easy to run/use: no daemons no root works with scheduling systems User outside container == user inside container Access to host resources Mount (parts of) filesystems

More information

At Course Completion Prepares you as per certification requirements for AWS Developer Associate.

At Course Completion Prepares you as per certification requirements for AWS Developer Associate. [AWS-DAW]: AWS Cloud Developer Associate Workshop Length Delivery Method : 4 days : Instructor-led (Classroom) At Course Completion Prepares you as per certification requirements for AWS Developer Associate.

More information

INDIGO PAAS TUTORIAL. ! Marica Antonacci RIA INFN-Bari

INDIGO PAAS TUTORIAL. ! Marica Antonacci RIA INFN-Bari INDIGO PAAS TUTORIAL RIA-653549! Marica Antonacci!! marica.antonacci@ba.infn.it! INFN-Bari INDIGO PAAS Tutorial Introductory Concepts TOSCA Ansible Docker Orchestrator APIs INDIGO TOSCA custom types and

More information

Getting Started with Hadoop

Getting Started with Hadoop Getting Started with Hadoop May 28, 2018 Michael Völske, Shahbaz Syed Web Technology & Information Systems Bauhaus-Universität Weimar 1 webis 2018 What is Hadoop Started in 2004 by Yahoo Open-Source implementation

More information

Containers Infrastructure for Advanced Management. Federico Simoncelli Associate Manager, Red Hat October 2016

Containers Infrastructure for Advanced Management. Federico Simoncelli Associate Manager, Red Hat October 2016 Containers Infrastructure for Advanced Management Federico Simoncelli Associate Manager, Red Hat October 2016 About Me Kubernetes Decoupling problems to hand out to different teams Layer of abstraction

More information

Docker Container Logging

Docker Container Logging Docker Container Logging Default logging behavior Docker natively streams STDOUT and STDERR from a container into a built-in logging service. In order to make use of this services, applications must be

More information

Quick Prototyping+CI with LXC and Puppet

Quick Prototyping+CI with LXC and Puppet Quick Prototyping+CI with LXC and Puppet Ben Kero 2014-05-04 Introduction Ben Kero Release Engineer Responsible for version control systems: CVS, SVN, BZR, Darcs, RCS, Git, Mercurial Before at Mozilla

More information

Improving your Drupal 8 Development Workflow. by Jesus Manuel Olivas / WeKnow

Improving your Drupal 8 Development Workflow. by Jesus Manuel Olivas / WeKnow Improving your Drupal 8 Development Workflow by Jesus Manuel Olivas / WeKnow WHO AM I? Jesus Manuel Olivas jmolivas@weknowinc.com jmolivas jmolivas drupal.org/u/jmolivas jmolivas.weknowinc.com What we

More information

Dockerfile Best Practices

Dockerfile Best Practices Dockerfile Best Practices OpenRheinRuhr 2015 November 07th, 2015 1 Dockerfile Best Practices Outline About Dockerfile Best Practices Building Images This work is licensed under the Creative Commons Attribution-ShareAlike

More information

for Devs Christopher M. Judd

for Devs Christopher M. Judd for Devs Christopher M. Judd Christopher M. Judd CTO and Partner at leader lab Docker hub daemon nuez nuez nuez-db nuez-db tomcat 8 user mysql nuez:1.0 nuez-db:1.0 mysql tomcat tomcat 8 tomcat 7 https://github.com/cjudd/nuez

More information

CONTINUOUS DELIVERY WITH MESOS, DC/OS AND JENKINS

CONTINUOUS DELIVERY WITH MESOS, DC/OS AND JENKINS APACHE MESOS NYC MEETUP SEPTEMBER 22, 2016 CONTINUOUS DELIVERY WITH MESOS, DC/OS AND JENKINS WHO WE ARE ROGER IGNAZIO SUNIL SHAH Tech Lead at Mesosphere @rogerignazio Product Manager at Mesosphere @ssk2

More information

Red Hat OpenShift Roadmap Q4 CY16 and H1 CY17 Releases. Lutz Lange Solution

Red Hat OpenShift Roadmap Q4 CY16 and H1 CY17 Releases. Lutz Lange Solution Red Hat OpenShift Roadmap Q4 CY16 and H1 CY17 Releases Lutz Lange Solution Architect @AtomicContainer OpenShift Roadmap OpenShift Container Platform 3.2 Kubernetes 1.2 & Docker 1.9

More information

Important DevOps Technologies (3+2+3days) for Deployment

Important DevOps Technologies (3+2+3days) for Deployment Important DevOps Technologies (3+2+3days) for Deployment DevOps is the blending of tasks performed by a company's application development and systems operations teams. The term DevOps is being used in

More information

Be smart. Think open source.

Be smart. Think open source. Foreman Basics Be smart. Think open source. Foreman - Basics Lifecycle management of physical and virtual machines made easy! Agenda Introduction to Foreman Architecture Setup Provisioning Configuration

More information

Unix / Linux Overview

Unix / Linux Overview Unix / Linux Overview Jonathan Brewer Network Startup Resource Center jon@nsrc.org These materials are licensed under the Creative Commons Attribution-NonCommercial 4.0 International license (http://creativecommons.org/licenses/by-nc/4.0/)

More information

TECHNICAL BRIEF. Scheduling and Orchestration of Heterogeneous Docker-Based IT Landscapes. January 2017 Version 2.0 For Public Use

TECHNICAL BRIEF. Scheduling and Orchestration of Heterogeneous Docker-Based IT Landscapes. January 2017 Version 2.0 For Public Use TECHNICAL BRIEF Scheduling and Orchestration of Heterogeneous Docker-Based IT Landscapes January 2017 Version 2.0 For Public Use Table of Contents 1 Summary... 2 2 Introduction... 2 3 Stonebranch DevOps

More information

HTTP/2 Out Of The Box

HTTP/2 Out Of The Box HTTP/2 Out Of The Box Can you get it with stable Linux? Sergej Kurakin HTTP/2 was published at May 14, 2015 HTTP 1.1 was standardized in 1997 - it s 18 years old! HTTP/2 was published at May 14, 2015

More information

python-docker-machine Documentation

python-docker-machine Documentation python-docker-machine Documentation Release 0.2.4 Gijs Molenaar Aug 25, 2017 Contents 1 Introduction 3 2 installation 5 3 Usage 7 4 Indices and tables 11 Python Module Index 13 i ii python-docker-machine

More information

Beyond 1001 Dedicated Data Service Instances

Beyond 1001 Dedicated Data Service Instances Beyond 1001 Dedicated Data Service Instances Introduction The Challenge Given: Application platform based on Cloud Foundry to serve thousands of apps Application Runtime Many platform users - who don

More information

Dockerfile Documentation

Dockerfile Documentation Dockerfile Documentation Release Florian Tatzel May 15, 2017 Contents 1 Introduction 3 1.1 What are the Dockerfile for?....................................... 3 2 Docker images 5 2.1 webdevops/ansible............................................

More information

Linux Systems Security. Logging and Network Monitoring NETS1028 Fall 2016

Linux Systems Security. Logging and Network Monitoring NETS1028 Fall 2016 Linux Systems Security Logging and Network Monitoring NETS1028 Fall 2016 Monitoring Monitoring can take many forms, from passive periodic inspection to realtime intrusion detection For this unit, we will

More information

Improving the Yocto Project Developer Experience. How New Tools Will Enable a Better Workflow October 2016 Henry Bruce

Improving the Yocto Project Developer Experience. How New Tools Will Enable a Better Workflow October 2016 Henry Bruce Improving the Yocto Project Developer Experience How New Tools Will Enable a Better Workflow October 2016 Henry Bruce (henry.bruce@intel.com) Introduction We ll be talking about developer workflow improvements

More information

TEN LAYERS OF CONTAINER SECURITY. Kirsten Newcomer Security Strategist

TEN LAYERS OF CONTAINER SECURITY. Kirsten Newcomer Security Strategist TEN LAYERS OF CONTAINER SECURITY Kirsten Newcomer Security Strategist WHAT ARE CONTAINERS? Containers change how we develop, deploy and manage applications INFRASTRUCTURE Sandboxed application processes

More information

DevOps Technologies. for Deployment

DevOps Technologies. for Deployment DevOps Technologies for Deployment DevOps is the blending of tasks performed by a company's application development and systems operations teams. The term DevOps is being used in several ways. In its most

More information

CLIs and Developers The Secret Sauce to a Brighter Mainframe. Chris Boehm Software Engineer CA Technologies

CLIs and Developers The Secret Sauce to a Brighter Mainframe. Chris Boehm Software Engineer CA Technologies CLIs and Developers The Secret Sauce to a Brighter Mainframe Chris Boehm Software Engineer CA Technologies Agenda 1 2 3 4 5 6 API ENABLEMENT THE WORLD OF A DEVELOPER TODAY COMMAND LINE INTERFACE - CLI

More information

CIS : Computational Reproducibility

CIS : Computational Reproducibility CIS 602-01: Computational Reproducibility Containers and Reproducibility Dr. David Koop The Problem Matrix [Docker, Inc., 2016] 2 Shipping Analogy [Docker, Inc., 2016] 3 The Solution: Containers [Docker,

More information

Engineering Robust Server Software

Engineering Robust Server Software Engineering Robust Server Software Containers Isolation Isolation: keep different programs separate Good for security Might also consider performance isolation Also has security implications (side channel

More information

MySQL and Docker Strategies Patrick Galbraith Giuseppe Maxia

MySQL and Docker Strategies Patrick Galbraith Giuseppe Maxia MySQL and Docker Strategies Patrick Galbraith Giuseppe Maxia About the speakers Patrick Galbraith (patg@patg.net) HP Advanced Technology Group Has worked at Blue Gecko, MySQL AB, Classmates, Slashdot,

More information

Zero to Microservices in 5 minutes using Docker Containers. Mathew Lodge Weaveworks

Zero to Microservices in 5 minutes using Docker Containers. Mathew Lodge Weaveworks Zero to Microservices in 5 minutes using Docker Containers Mathew Lodge (@mathewlodge) Weaveworks (@weaveworks) https://www.weave.works/ 2 Going faster with software delivery is now a business issue Software

More information

KickSoccer Coin Masternode Setup Guide

KickSoccer Coin Masternode Setup Guide KickSoccer Coin Masternode Setup Guide Contents... 1 Introduction... 1 First the basic requirements... 1 Configuration... 2 VPS Remote wallet install... 3 Config file configuration... 4 Start your masternode...

More information

Docker for HPC? Yes, Singularity! Josef Hrabal

Docker for HPC? Yes, Singularity! Josef Hrabal Docker for HPC? Yes, Singularity! Josef Hrabal IT4Innovations josef.hrabal@vsb.cz support@it4i.cz Virtual Machine Hardware (CPU, Memory, NIC, HDD) Host OS (Windows, Linux, MacOS) Hypervisor (VirtualBox,

More information

Managing Deep Learning Workflows

Managing Deep Learning Workflows Managing Deep Learning Workflows Deep Learning on AWS Batch treske@amazon.de September 2017 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Business Understanding Data Understanding

More information

Stephan Hochdörfer //

Stephan Hochdörfer // From dev to prod with GitLab CI Stephan Hochdörfer // 21.06.2018 About me Stephan Hochdörfer Head of Technology, bitexpert AG (Mannheim, Germany) S.Hochdoerfer@bitExpert.de @shochdoerfer #PHP, #DevOps,

More information