利用 Mesos 打造高延展性 Container 環境. Frank, Microsoft MTC

Similar documents
Introduction to Docker. Antonis Kalipetis Docker Athens Meetup

Circle IT: Microsoft Update 2016

Scale your Docker containers with Mesos

Midterm Presentation Schedule

Advantages of using DC/OS Azure infrastructure and the implementation architecture Bill of materials used to construct DC/OS and the ACS clusters

Pritam Pabla Technology Solutions Specialist Hybrid Cloud

Deploying Applications on DC/OS

@joerg_schad Nightmares of a Container Orchestration System

Container Orchestration on Amazon Web Services. Arun

CONTINUOUS DELIVERY WITH MESOS, DC/OS AND JENKINS

Using DC/OS for Continuous Delivery

CONTINUOUS DELIVERY WITH DC/OS AND JENKINS

Advanced Continuous Delivery Strategies for Containerized Applications Using DC/OS

SCALING LIKE TWITTER WITH APACHE MESOS

Building a Data-Friendly Platform for a Data- Driven Future

The SMACK Stack: Spark*, Mesos*, Akka, Cassandra*, Kafka* Elizabeth K. Dublin Apache Kafka Meetup, 30 August 2017.

Sunil Shah SECURE, FLEXIBLE CONTINUOUS DELIVERY PIPELINES WITH GITLAB AND DC/OS Mesosphere, Inc. All Rights Reserved.

Think Small to Scale Big

Building/Running Distributed Systems with Apache Mesos

Windows Azure Services - At Different Levels

Container 2.0. Container: check! But what about persistent data, big data or fast data?!

AGILE DEVELOPMENT AND PAAS USING THE MESOSPHERE DCOS

Large-Scale Software Development. Tools and Methods

Distributed Data on Distributed Infrastructure. Claudius Weinberger & Kunal Kusoorkar, ArangoDB Jörg Schad, Mesosphere

Introduction to Mesos and the Datacenter Operating System

Mesosphere and the Enterprise: Run Your Applications on Apache Mesos. Steve Wong Open Source Engineer {code} by Dell

A Whirlwind Tour of Apache Mesos

Large-Scale Software Development. Tools and Methods

Ruby in the Sky with Diamonds. August, 2014 Sao Paulo, Brazil

The Emergence of the Datacenter Developer. Tobi Knaup, Co-Founder & CTO at

Mesosphere and Percona Server for MongoDB. Jeff Sandstrom, Product Manager (Percona) Ravi Yadav, Tech. Partnerships Lead (Mesosphere)

Mesosphere and Percona Server for MongoDB. Peter Schwaller, Senior Director Server Eng. (Percona) Taco Scargo, Senior Solution Engineer (Mesosphere)

@unterstein #bedcon. Operating microservices with Apache Mesos and DC/OS

Zabbix on a Clouds. Another approach to a building a fault-resilient, scalable monitoring platform

How to Keep UP Through Digital Transformation with Next-Generation App Development

NVMe over Fabrics (NVMe-oF) For Containers

SAMPLE CHAPTER IN ACTION. Roger Ignazio. FOREWORD BY Florian Leibert MANNING

Kubernetes: Integration vs Native Solution

Containers, Serverless and Functions in a nutshell. Eugene Fedorenko

Cloud I - Introduction

Welcome to Docker Birthday # Docker Birthday events (list available at Docker.Party) RSVPs 600 mentors Big thanks to our global partners:

FROM MONOLITH TO DOCKER DISTRIBUTED APPLICATIONS

Apache Ignite TM - In- Memory Data Fabric Fast Data Meets Open Source

[MS10992]: Integrating On-Premises Core Infrastructure with Microsoft Azure

MQ High Availability and Disaster Recovery Implementation scenarios

Ingest. Aaron Mildenstein, Consulting Architect Tokyo Dec 14, 2017

Personal Statement. Skillset I MongoDB / Cassandra / Redis / CouchDB. My name is Dale-Kurt Murray. I'm a Solutiof

Continuous Delivery for Cloud Native Applications

Developing Microsoft Azure Solutions

P a g e 1. Teknologisk Institut. Online kursus k SysAdmin & DevOps Collection

Network Function Virtualization over Open DC/OS Yung-Han Chen

Kontejneri u Azureu uz pomoć Kubernetesa što i kako? Tomislav Tipurić Partner Technology Strategist Microsoft

70-532: Developing Microsoft Azure Solutions

An Introduction to Kubernetes

Go Faster: Containers, Platforms and the Path to Better Software Development (Including Live Demo)

The four forces of Cloud Native

Microservices. Chaos Kontrolle mit Kubernetes. Robert Kubis - Developer Advocate,

Networking & Security for Mesos

Ingest. David Pilato, Developer Evangelist Paris, 31 Janvier 2017

IBM Planning Analytics Workspace Local Distributed Soufiane Azizi. IBM Planning Analytics

SBB. Java User Group 27.9 & Tobias Denzler, Philipp Oser

Use Case: Scalable applications

Distributed CI: Scaling Jenkins on Mesos and Marathon. Roger Ignazio Puppet Labs, Inc. MesosCon 2015 Seattle, WA

STATE OF MODERN APPLICATIONS IN THE CLOUD

Cloud & container monitoring , Lars Michelsen Check_MK Conference #4

Application Centric Microservices Ken Owens, CTO Cisco Intercloud Services. Redhat Summit 2015

#techsummitch

Revamped and Automated the infrastructure for NTN Buzztime

Containerization Dockers / Mesospere. Arno Keller HPE

Index. Raul Estrada and Isaac Ruiz 2016 R. Estrada and I. Ruiz, Big Data SMACK, DOI /

Designing MQ deployments for the cloud generation

Important DevOps Technologies (3+2+3days) for Deployment

[Docker] Containerization

CONTAINERS AND MICROSERVICES WITH CONTRAIL

what is cloud computing?

70-532: Developing Microsoft Azure Solutions

Nevin Dong 董乃文 Principle Technical Evangelist Microsoft Cooperation

Using the SDACK Architecture to Build a Big Data Product. Yu-hsin Yeh (Evans Ye) Apache Big Data NA 2016 Vancouver

Docker and Oracle Everything You Wanted To Know

Developing Microsoft Azure Solutions: Course Agenda

Running MarkLogic in Containers (Both Docker and Kubernetes)

DATA SCIENCE USING SPARK: AN INTRODUCTION

Jupyter and Spark on Mesos: Best Practices. June 21 st, 2017

Microsoft Azure Stack Hybrid Cloud. The Modern System Architecture

Kuber-what?! Learn about Kubernetes

How we built a highly scalable Machine Learning platform using Apache Mesos

Web and API Apps in Azure

Techno Expert Solutions

Deploy Like A Boss Oliver Nicholas

One year of Deploying Applications for Docker, CoreOS, Kubernetes and Co.

Issues Fixed in DC/OS

Implementing a Software-Defined DataCenter

MANAGING MESOS, DOCKER, AND CHRONOS WITH PUPPET

Course Outline. Lesson 2, Azure Portals, describes the two current portals that are available for managing Azure subscriptions and services.

There's More to Docker than the Container The Docker Platform

YOUR APPLICATION S JOURNEY TO THE CLOUD. What s the best way to get cloud native capabilities for your existing applications?

DISTRIBUTED SYSTEMS [COMP9243] Lecture 8a: Cloud Computing WHAT IS CLOUD COMPUTING? 2. Slide 3. Slide 1. Why is it called Cloud?

Kubernetes The Path to Cloud Native

Architecting Microsoft Azure Solutions (proposed exam 535)

CS-580K/480K Advanced Topics in Cloud Computing. Container III

Transcription:

利用 Mesos 打造高延展性 Container 環境 Frank, Microsoft MTC

About Me Developer @ Yahoo! DevOps @ HTC Technical Architect @ MSFT

Agenda About Docker Manage containers Apache Mesos Mesosphere DC/OS

application = application code + infrastructure code

Multiplicity of hardware environments Multiplicity of Stacks Static website nginx 1.5 + modsecurity + openssl + bootstrap 2 Background workers Python 3.0 + celery + pyredis + libcurl + ffmpeg + libopencv + nodejs + phantomjs User DB postgresql + pgv8 + v8 Web frontend Ruby + Rails + sass + Unicorn Queue Redis + redis-sentinel Analytics DB hadoop + hive + thrift + OpenJDK API endpoint Do services and apps interact appropriately? Python 2.7 + Flask + pyredis + celery + psycopg + postgresql-client Development VM Customer Data Center QA server Public Cloud Disaster recovery Production Servers Production Cluster Contributor s laptop Can I migrate smoothly and quickly?

About Docker Docker allows you to package an application with all of its dependencies into a standardized unit for software development. Light weight Quick scale Secure

Virtual machine VS. Container

The underlying technology Namespaces Control group Union file system

Images and Layers

Demo Run Jenkins container with persistent and sharable volume docker run -t -d -p 80:8080 -p 50000:50000 -v /tmp/my_jenkins_home:/var/jenkins_home jenkins

Docker & Microsoft ASP.NET 5 Windows Container

ASP.NET 5 ASP.NET 5 is a new open-source and cross-platform framework for building modern cloud-based Web applications using.net

Demo Running ASP.NET with linux docker container

Windows Container Window Container & Hyper-V Container Manage by Docker/PowerShell

Ways for Container management Docker Compose Docker Swarm Mesosphere DC/OS

Docker Compose Compose is a tool for defining and running multi-container Docker applications.

Apache Mesos A distributed systems kernel Provides applications (e.g., Hadoop, Spark, Kafka, Elastic Search) with API s for resource management and scheduling across entire datacenter and cloud environments.

Apache Mesos Features Scalability to 10,000s of nodes Fault-tolerant replicated master and slaves using ZooKeeper Support for Docker containers Native isolation between tasks with Linux Containers Multi-resource scheduling (memory, CPU, disk, and ports) Java, Python and C++ APIs for developing new parallel applications Web UI for viewing cluster state

Mesos frameworks Apache Aurora Chronos Marathon There are more

Mesosphere DC/OS The Datacenter Operating System (DC/OS) is a distributed operating system based on theapache Mesos distributed systems kernel. It integrates several battle-tested open-source components to enable the management of multiple machines as if they were a single computer.

Azure Container Service Create an optimized container hosting solution Manage container application with familiar tools: DC/OS or Docker Swarm

Marathon Marathon is a production-grade container orchestration platform for Mesosphere's Datacenter Operating System (DCOS) and Apache Mesos.

orchestrates both apps and frameworks Scaling and fault recovery 1. Scale out search service & rails 2. Fault recovery when underlying resource failure

Marathon Feature High Availability Multiple Container runtimes (mesos container & docker) UI & APIs Stateful apps Constraints Service Discovery & load balancing Event Subscription

Demo: Deploy Stateless app Deploy nginx container with Marathon Rolling update when restart Scale containers

Demo: Deploy nginx to public Agent Deploy nginx container with Marathon on ResourceRole: slave_public and port 80 constraint

Demo: Deploy Stateful application Deploy PostgreSQL with persistent volume

Demo: Service Discovery mesos-dns marathon-lb

Marathon: Healthy Checks

Summarization Get Start with Azure Container Service Explore more with Mesos, DC/OS and Marathon Build your own application PaaS

Q & A

Thank you!