利用 Mesos 打造高延展性 Container 環境. Frank, Microsoft MTC

Transcription

1 利用 Mesos 打造高延展性 Container 環境 Frank, Microsoft MTC

2 About Me Yahoo! HTC Technical MSFT

3 Agenda About Docker Manage containers Apache Mesos Mesosphere DC/OS

4 application = application code + infrastructure code

5 Multiplicity of hardware environments Multiplicity of Stacks Static website nginx modsecurity + openssl + bootstrap 2 Background workers Python celery + pyredis + libcurl + ffmpeg + libopencv + nodejs + phantomjs User DB postgresql + pgv8 + v8 Web frontend Ruby + Rails + sass + Unicorn Queue Redis + redis-sentinel Analytics DB hadoop + hive + thrift + OpenJDK API endpoint Do services and apps interact appropriately? Python Flask + pyredis + celery + psycopg + postgresql-client Development VM Customer Data Center QA server Public Cloud Disaster recovery Production Servers Production Cluster Contributor s laptop Can I migrate smoothly and quickly?

6 About Docker Docker allows you to package an application with all of its dependencies into a standardized unit for software development. Light weight Quick scale Secure

7 Virtual machine VS. Container

8

9 The underlying technology Namespaces Control group Union file system

10 Images and Layers

11

12 Demo Run Jenkins container with persistent and sharable volume docker run -t -d -p 80:8080 -p 50000: v /tmp/my_jenkins_home:/var/jenkins_home jenkins

13 Docker & Microsoft ASP.NET 5 Windows Container

14 ASP.NET 5 ASP.NET 5 is a new open-source and cross-platform framework for building modern cloud-based Web applications using.net

15 Demo Running ASP.NET with linux docker container

16 Windows Container Window Container & Hyper-V Container Manage by Docker/PowerShell

17 Ways for Container management Docker Compose Docker Swarm Mesosphere DC/OS

18 Docker Compose Compose is a tool for defining and running multi-container Docker applications.

19 Apache Mesos A distributed systems kernel Provides applications (e.g., Hadoop, Spark, Kafka, Elastic Search) with API s for resource management and scheduling across entire datacenter and cloud environments.

20 Apache Mesos Features Scalability to 10,000s of nodes Fault-tolerant replicated master and slaves using ZooKeeper Support for Docker containers Native isolation between tasks with Linux Containers Multi-resource scheduling (memory, CPU, disk, and ports) Java, Python and C++ APIs for developing new parallel applications Web UI for viewing cluster state

21

22 Mesos frameworks Apache Aurora Chronos Marathon There are more

23 Mesosphere DC/OS The Datacenter Operating System (DC/OS) is a distributed operating system based on theapache Mesos distributed systems kernel. It integrates several battle-tested open-source components to enable the management of multiple machines as if they were a single computer.

24

25

26 Azure Container Service Create an optimized container hosting solution Manage container application with familiar tools: DC/OS or Docker Swarm

27

28

29 Marathon Marathon is a production-grade container orchestration platform for Mesosphere's Datacenter Operating System (DCOS) and Apache Mesos.

30 orchestrates both apps and frameworks Scaling and fault recovery 1. Scale out search service & rails 2. Fault recovery when underlying resource failure

31 Marathon Feature High Availability Multiple Container runtimes (mesos container & docker) UI & APIs Stateful apps Constraints Service Discovery & load balancing Event Subscription

32 Demo: Deploy Stateless app Deploy nginx container with Marathon Rolling update when restart Scale containers

33 Demo: Deploy nginx to public Agent Deploy nginx container with Marathon on ResourceRole: slave_public and port 80 constraint

34 Demo: Deploy Stateful application Deploy PostgreSQL with persistent volume

35 Demo: Service Discovery mesos-dns marathon-lb

36

37 Marathon: Healthy Checks

38 Summarization Get Start with Azure Container Service Explore more with Mesos, DC/OS and Marathon Build your own application PaaS

39 Q & A

40 Thank you!