Sunil Shah SECURE, FLEXIBLE CONTINUOUS DELIVERY PIPELINES WITH GITLAB AND DC/OS Mesosphere, Inc. All Rights Reserved.

Similar documents
Advanced Continuous Delivery Strategies for Containerized Applications Using DC/OS

AGILE DEVELOPMENT AND PAAS USING THE MESOSPHERE DCOS

Deploying Applications on DC/OS

I keep hearing about DevOps What is it?

SCALING LIKE TWITTER WITH APACHE MESOS

Using DC/OS for Continuous Delivery

A DEVOPS STATE OF MIND. Chris Van Tuin Chief Technologist, West

How to Keep UP Through Digital Transformation with Next-Generation App Development

A DEVOPS STATE OF MIND. Chris Van Tuin Chief Technologist, West

Containerization Dockers / Mesospere. Arno Keller HPE

Azure DevOps. Randy Pagels Intelligent Cloud Technical Specialist Great Lakes Region

CONTINUOUS DELIVERY WITH DC/OS AND JENKINS

Continuous Delivery for Cloud Native Applications

Red Hat Roadmap for Containers and DevOps

Industry-leading Application PaaS Platform

WHITE PAPER. RedHat OpenShift Container Platform. Benefits: Abstract. 1.1 Introduction

Continuous Integration and Delivery with Spinnaker

Containers & Microservices For Realists. Karthik

利用 Mesos 打造高延展性 Container 環境. Frank, Microsoft MTC

In-cluster Open Source Testing Framework

Welcome to Docker Birthday # Docker Birthday events (list available at Docker.Party) RSVPs 600 mentors Big thanks to our global partners:

CONTINUOUS DELIVERY WITH MESOS, DC/OS AND JENKINS

Mesosphere and the Enterprise: Run Your Applications on Apache Mesos. Steve Wong Open Source Engineer {code} by Dell

Docker CaaS. Sandor Klein VP EMEA

TM DevOps Use Case. 2017TechMinfy All Rights Reserved

Building a Data-Friendly Platform for a Data- Driven Future

@unterstein #bedcon. Operating microservices with Apache Mesos and DC/OS

Amir Zipory Senior Solutions Architect, Redhat Israel, Greece & Cyprus

Test Automation Strategies in Continuous Delivery. Nandan Shinde Test Automation Architect (Tech CoE) Cognizant Technology Solutions

WHITEPAPER. Embracing Containers & Microservices for future-proof application modernization

Performance Testing in a Containerized World. Paola Rossaro

Scale your Docker containers with Mesos

DevOps and Continuous Delivery USE CASE

Openshift: Key to modern DevOps

Javaentwicklung in der Oracle Cloud

Container Orchestration on Amazon Web Services. Arun

Containers, Serverless and Functions in a nutshell. Eugene Fedorenko

Orchestrating the Continuous Delivery Process

Disclaimer This presentation may contain product features that are currently under development. This overview of new technology represents no commitme

Continuous Integration Ensemble / HealthShare Health Connect

DevOps Anti-Patterns. Have the Ops team deal with it. Time to fire the Ops team! Let s hire a DevOps unit! COPYRIGHT 2019 MANICODE SECURITY

The SMACK Stack: Spark*, Mesos*, Akka, Cassandra*, Kafka* Elizabeth K. Dublin Apache Kafka Meetup, 30 August 2017.

Enabling Developers with Open Source Nicholas Parks, Cloud Architect, Kenzan

TM DevOps Use Case TechMinfy All Rights Reserved

DevOps Tooling from AWS

Container 2.0. Container: check! But what about persistent data, big data or fast data?!

Building/Running Distributed Systems with Apache Mesos

Strengthen and Scale security using DevSecOps

Cisco CloudCenter Use Case Summary

@joerg_schad Nightmares of a Container Orchestration System

Deploying and Operating Cloud Native.NET apps

Mesosphere and Percona Server for MongoDB. Peter Schwaller, Senior Director Server Eng. (Percona) Taco Scargo, Senior Solution Engineer (Mesosphere)

SUSE s vision for agile software development and deployment in the Software Defined Datacenter

CloudCenter for Developers

Mesosphere and Percona Server for MongoDB. Jeff Sandstrom, Product Manager (Percona) Ravi Yadav, Tech. Partnerships Lead (Mesosphere)

How to Build an Appium Continuous Testing Pipeline

A DEVOPS STATE OF MIND WITH DOCKER AND KUBERNETES. Chris Van Tuin Chief Technologist, West

Taming your heterogeneous cloud with Red Hat OpenShift Container Platform.

TEN LAYERS OF CONTAINER SECURITY

Going cloud-native with Kubernetes and Pivotal

DEPLOY MODERN APPS WITH KUBERNETES AS A SERVICE

ContainerOps - DevOps Orchestration. Quanyi Ma

ebook ADVANCED LOAD BALANCING IN THE CLOUD 5 WAYS TO SIMPLIFY THE CHAOS

[Docker] Containerization

DEPLOY MODERN APPS WITH KUBERNETES AS A SERVICE

Docker and Oracle Everything You Wanted To Know

Container in Production : Openshift 구축사례로 이해하는 PaaS. Jongjin Lim Specialist Solution Architect, AppDev

Cloud Native Java with Kubernetes

MODERN APPLICATION ARCHITECTURE DEMO. Wanja Pernath EMEA Partner Enablement Manager, Middleware & OpenShift

Continuous Integration and Deployment (CI/CD)

EASILY DEPLOY AND SCALE KUBERNETES WITH RANCHER

ACCELERATE APPLICATION DELIVERY WITH OPENSHIFT. Siamak Sadeghianfar Sr Technical Marketing Manager, April 2016

Linux System Management with Puppet, Gitlab, and R10k. Scott Nolin, SSEC Technical Computing 22 June 2017

How to re-invent your IT Architecture. André Christ, Co-CEO LeanIX

Microservices with Red Hat. JBoss Fuse

Accelerate at DevOps Speed With Openshift v3. Alessandro Vozza & Samuel Terburg Red Hat

Jenkins: A complete solution. From Continuous Integration to Continuous Delivery For HSBC

CONTAINERS AND MICROSERVICES WITH CONTRAIL

Go Faster: Containers, Platforms and the Path to Better Software Development (Including Live Demo)

RED HAT OPENSHIFT A FOUNDATION FOR SUCCESSFUL DIGITAL TRANSFORMATION

Zabbix on a Clouds. Another approach to a building a fault-resilient, scalable monitoring platform

OpenStack Enabling DevOps Shannon McFarland CCIE #5245 Distinguished DEVNET-1104

Hitachi Enterprise Cloud Container Platform

DevOps Course Content

YOUR APPLICATION S JOURNEY TO THE CLOUD. What s the best way to get cloud native capabilities for your existing applications?

The four forces of Cloud Native

Patching and Updating your VM SUSE Manager. Donald Vosburg, Sales Engineer, SUSE

Przyspiesz tworzenie aplikacji przy pomocy Openshift Container Platform. Jarosław Stakuń Senior Solution Architect/Red Hat CEE

Disclaimer This presentation may contain product features that are currently under development. This overview of new technology represents no commitme

DevOps Made Easy. Shireesh Thanneru, Platform Architect. Intel. Linoy Alexander, Director, DevOps

AGILE RELIABILITY WITH RED HAT IN THE CLOUDS YOUR SOFTWARE LIFECYCLE SPEEDUP RECIPE. Lutz Lange - Senior Solution Architect Red Hat

FROM VSTS TO AZURE DEVOPS

Red Hat Container Strategy Ahmed El-Rayess

How Can Testing Teams Play a Key Role in DevOps Adoption?

HP APPs v.12 Solutions for Dev-Ops

Introduction to Mesos and the Datacenter Operating System

Docker Universal Control Plane Deploy and Manage On-Premises, Your Dockerized Distributed Applications

Implementing the Twelve-Factor App Methodology for Developing Cloud- Native Applications

Application Centric Microservices Ken Owens, CTO Cisco Intercloud Services. Redhat Summit 2015

What I ll be talking about. About me & bol.com The CI/CD bol.com Current setup. The future in the cloud

Transcription:

Sunil Shah SECURE, FLEXIBLE CONTINUOUS DELIVERY PIPELINES WITH GITLAB AND DC/OS 1

Introduction MOBILE, SOCIAL & CLOUD ARE RAISING CUSTOMER EXPECTATIONS We need a way to deliver software so fast that our customers don t have time to change their minds Application development and DevOps teams are under increasing pressure. Releasing stable quality code (much) more frequently, with similar or less resources Maintaining uptime while supporting faster release cycle 2

Introduction WHY BOTHER? Why is continuous delivery interesting now? Google Trends for continuous delivery (blue) and continuous deployment (red) 3

Introduction WHY BOTHER? 1. It s much easier to get compute resources nowadays! Doesn t cost much EVERY platform has an API 4

Introduction WHY BOTHER? 1. It s much easier to get compute resources nowadays! 2. Container orchestration lets you sleep Container orchestrators take the manual pain out of waking up and rebooting an application (to varying degrees of success) Let your devs dev and ops sleep! 5

Introduction WHY BOTHER? 1. It s much easier to get compute resources nowadays! 2. Container orchestration lets you sleep 3. Containers mean you can! Containers encapsulate everything your application needs to run No need for painful and tedious manual intervention anymore 6

ABOUT DC/OS 7

DC/OS: THE DEFINITIVE PLATFORM FOR MODERN APPS 2000 2010 2013 2015 DCOS Launched 2016 DC/OS OSS Project Mesosphere Proprietary Borg & Omega Apache Mesos Project Tupperware & Bistro 2015 Mesosphere, Inc. All Rights Reserved.

DC/OS CAPABILITIES ENABLING DEVELOPER AGILITY 1. One platform for next-gen development technologies 2. Reduced risk of failed deployments 3. Reliable, simplified CI/CD integration 4. One API, deploy anywhere DC/OS capabilities simplify and accelerate application development lifecycle

MESOSPHERE ENTERPRISE DC/OS, SIMPLIFYING THE OPERATION OF NEXT GENERATION TECHNOLOGIES, AT MASSIVE SCALE Services & Containers Your favorite services, container formats, and those yet to come. OVER 30 OTHERS! Mesosphere Enterprise DC/OS Runs distributed apps anywhere as simply as running apps on your laptop. Any Infrastructure Build Apps once in DC/OS, and run it anywhere 10

MESOSPHERE ENTERPRISE DC/OS IS THE BEST WAY TO BUILD AND RUN MODERN APPLICATIONS Microservices The Modern Enterprise App Data Services Composed of stateless processes & stateful backing services. Docker Container Enterprise DC/OS The only supported platform that elastically runs the full Modern Enterprise App. Security Advanced Operations Management & Monitoring Tools Stateless code Analytics Database DC/OS Container Orchestration Stateless Microservices Stateful Data Services Message Queue Multitenancy Adv. Network & Storage Apps Universe Apache Mesos Any Infrastructure Containerized workloads are scheduled across resources in your private datacenter or in the cloud. 11

About GitLab

Collaborating with Git Modern Platform Distributed version control Code and commit offline Workflow designed around open-source

An integrated set of tools Repository Management Code Review Tools Access Control Issue Tracker and Wiki

An integrated set of tools Merge Conflict Resolution Built-in Continuous Integration Built-in Container Registry

History of GitLab The Product - Started in 2011 The Website - Started in 2012 The Company - Joined forces in 2013, incorporated in 2014

Benefits of GitLab An integrated set of tools that scale Open Source and updated monthly Easy to Install and supports many environments Great technical support Tons of features and a public roadmap: https://about.gitlab.com/direction/

GITLAB ON DC/OS 18

CONTINUOUS DELIVERY: MAIN COMPONENTS Continuous Delivery Pipeline Version Control System Continuous Integration Container Orchestrator Production Environment Load Balancer git push Container Registry DC/OS 19

GITLAB AS SCM, CI & REGISTRY Continuous Delivery Pipeline GitLab GitLab Marathon Mesos Marathon-lb git push GitLab DC/OS 20

GitLab on DC/OS BENEFITS Easy installation: set up a highly available deployment within minutes Deploy multiple instances of GitLab with ease Fault-tolerant: DC/OS keeps GitLab running and your data safe Run all of your CI/CD infrastructure in one place 21

CONTINUOUS DELIVERY USING GITLAB ON DC/OS 22

CD using GitLab on DC/OS BASICS How to set up a continuous delivery pipeline: 1) 2) 3) 4) 5) Install and configure our tools Set up our project configuration Set up our pipeline configuration??? Profit 23

CD using GitLab on DC/OS 1. INSTALL & CONFIGURE TOOLS We will use GitLab and Jenkins: 1. Set up CNAMEs for each service jenkins-demo.mesosphere.com gitlab-demo.mesosphere.com 2. Install each of the packages from the DC/OS Universe and configure them to use these CNAMEs 3. (Optional) Configure Jenkins to talk to an insecure registry 2015 Mesosphere, Inc. All Rights Reserved. 24

CD using GitLab on DC/OS 2. SET UP PROJECT Our project contains two files that describe how to build and run our application. 1. A Dockerfile Encapsulates the dependencies required by your application 2. A marathon.json Describes resources required How many instances to run What command to run How to check health 2015 Mesosphere, Inc. All Rights Reserved. 25

CD using GitLab on DC/OS 3. CONFIGURE PIPELINE Finally, we can set up the pipeline itself. 1. Set up GitLab to trigger a Jenkins build 2. Jenkins should be configured with the credentials and certificates required to talk to GitLab 3. Add a post build step that triggers a Marathon deployment Marathon will perform a rolling upgrade of your application so that instances remain available while being upgraded 2015 Mesosphere, Inc. All Rights Reserved. 26

GITLAB ON DC/OS: AVAILABLE 15/9 27

Q&A Email me at sunil@mesosphere.io See https://mesosphere.com and https://dcos.io 28