MANAGING MESOS, DOCKER, AND CHRONOS WITH PUPPET

Transcription

1 Roger Ignazio PuppetConf 2015 MANAGING MESOS, DOCKER, AND CHRONOS WITH PUPPET 2015 Mesosphere, Inc. All Rights Reserved. 1

2 $(whoami) ABOUT ME Roger Ignazio Infrastructure Automation Mesosphere, Inc. All Rights Reserved. 2

3 $(whoami) MESOS IN ACTION mesosinaction.com Code: ctwpuppet 2015 Mesosphere, Inc. All Rights Reserved. 3

4 AGENDA Getting started Deploying a Mesos cluster Building a Docker image Creating a Chronos job Demo Provisioning infrastructure bare-metal and cloud Q & A 2015 Mesosphere, Inc. All Rights Reserved. 4

5 AUDIENCE POLL 2015 Mesosphere, Inc. All Rights Reserved. 5

6 GETTING STARTED ABOUT MESOS, DOCKER, AND CHRONOS Mesos Represent many machines (thousands) as a single entity Advertise resources directly to applications Docker Easily package and deploy apps (with dependencies) Analogous to VMs, but minus the overhead* Chronos Distributed, highly available Cron for Mesos Run scheduled tasks in cgroups, Docker containers 2015 Mesosphere, Inc. All Rights Reserved. 6

7 GETTING STARTED ABOUT PUPPET Declare desired state for your infrastructure Wide range of OS support Idempotent Extensible (via custom facts, types, providers) Open source Apache License, version Mesosphere, Inc. All Rights Reserved. 7

8 GETTING STARTED PUPPET S ROLE Mesos Apps ( Frameworks ) (Chronos, Marathon, etc) Mesos Operating System (RHEL, Ubuntu, Windows, etc) Virtual Infrastructure and IaaS (vsphere, OpenStack, AWS, Azure, etc) Physical Infrastructure (Cisco, Dell, HP, etc) 2015 Mesosphere, Inc. All Rights Reserved. 8

9 GETTING STARTED PUPPET S ROLE If Mesos is the abstraction layer for your applications, Puppet is the abstraction layer for infrastructure management 2015 Mesosphere, Inc. All Rights Reserved. 9

10 GETTING STARTED PUPPET S ROLE If Mesos is the abstraction layer for your applications, Puppet is the abstraction layer for infrastructure management But it can also be more Mesosphere, Inc. All Rights Reserved. 10

11 GETTING STARTED PUPPET S ROLE Custom types and providers can interact with external services (AWS, Chronos,...) Chronos API Chronos Node Puppet Master AWS Coordinator Node AWS API 2015 Mesosphere, Inc. All Rights Reserved. 11

12 DEPLOYING MESOS, DOCKER, AND CHRONOS 2015 Mesosphere, Inc. All Rights Reserved. 12

13 DEPLOYING MESOS, DOCKER, AND CHRONOS DEPLOYMENT OVERVIEW Install/configure Mesos, ZooKeeper, Docker Stage a Docker image on the Mesos agents Install and configure Chronos Create a Chronos job (that runs in a Docker container) 2015 Mesosphere, Inc. All Rights Reserved. 13

14 DEPLOYING MESOS, DOCKER, AND CHRONOS DEPLOYMENT OVERVIEW Chronos ZK Mesos Master Mesos Agent Mesos Agent Mesos Agent Docker Engine Docker Engine Docker Engine 2015 Mesosphere, Inc. All Rights Reserved. 14

15 DEPLOYING MESOS, DOCKER, AND CHRONOS DEPLOYMENT OVERVIEW Puppet s roles/profiles pattern Using the following Puppet modules deric-zookeeper deric-mesos garethr-docker puppetlabs-chronos All of these modules are open source and available via the Puppet Forge: Mesosphere, Inc. All Rights Reserved. 15

16 DEPLOYING MESOS, DOCKER, AND CHRONOS DEPLOYING MESOS (MASTER) class role::mesos::master { include profile::base include profile::chronos include profile::mesos::master include profile::zookeeper } 2015 Mesosphere, Inc. All Rights Reserved. 16

17 DEPLOYING MESOS, DOCKER, AND CHRONOS DEPLOYING MESOS (MASTER) class profile::mesos::master { include profile::mesos::common class { '::mesos::master': # From deric-mesos listen_address => $::ipaddress_eth0, work_dir => '/var/lib/mesos', options => { log_dir => '/var/log/mesos', quorum => '1', }, } } 2015 Mesosphere, Inc. All Rights Reserved. 17

18 DEPLOYING MESOS, DOCKER, AND CHRONOS DEPLOYING ZOOKEEPER class profile::zookeeper { include java # Include defaults from puppetlabs-java } class { '::zookeeper': # From deric-zookeeper client_ip => $::ipaddress_eth0, id => '1', repo => 'cloudera', require => Class['java'], } 2015 Mesosphere, Inc. All Rights Reserved. 18

19 DEPLOYING MESOS, DOCKER, AND CHRONOS DEPLOYING MESOS (AGENT) class role::mesos::agent { include profile::base include profile::docker include profile::mesos::agent } 2015 Mesosphere, Inc. All Rights Reserved. 19

20 DEPLOYING MESOS, DOCKER, AND CHRONOS DEPLOYING MESOS (AGENT) class profile::mesos::agent { include profile::mesos::common } class { '::mesos::slave': # From deric-mesos listen_address => $::ipaddress_eth0, work_dir => '/var/lib/mesos', options => { log_dir => '/var/log/mesos', }, } 2015 Mesosphere, Inc. All Rights Reserved. 20

21 DEPLOYING MESOS, DOCKER, AND CHRONOS DEPLOYING MESOS (COMMON) class profile::mesos::common { class { '::mesos': # From deric-mesos repo => 'mesosphere', zookeeper => 'zk:// :2181/mesos', } } 2015 Mesosphere, Inc. All Rights Reserved. 21

22 DEPLOYING MESOS, DOCKER, AND CHRONOS DEPLOYING DOCKER include ::docker # Include defaults from garethr-docker class { '::mesos::slave': # Let s reconfigure the Mesos agent... options => { containerizers => 'docker,mesos', isolation => 'cgroups/cpu,cgroups/mem', executor_registration_timeout => '5mins', }, } 2015 Mesosphere, Inc. All Rights Reserved. 22

23 DEPLOYING MESOS, DOCKER, AND CHRONOS DEPLOYING CHRONOS class profile::chronos { include ::chronos # Include defaults from puppetlabs-chronos } 2015 Mesosphere, Inc. All Rights Reserved. 23

24 BUILDING DOCKER IMAGES WITH PUPPET 2015 Mesosphere, Inc. All Rights Reserved. 24

25 BUILDING DOCKER IMAGES WITH PUPPET GETTING STARTED WITH PUPPET AND DOCKER Synopsis: Build a Docker image declaratively Two approaches: puppet agent pre-shared key to use existing Puppet infra puppet apply directly apply manifests during build 2015 Mesosphere, Inc. All Rights Reserved. 25

26 BUILDING DOCKER IMAGES WITH PUPPET GETTING STARTED WITH PUPPET AND DOCKER Synopsis: Build a Docker image declaratively Two approaches: puppet agent pre-shared key to use existing Puppet infra puppet apply directly apply manifests during build 2015 Mesosphere, Inc. All Rights Reserved. 26

27 BUILDING DOCKER IMAGES WITH PUPPET GETTING STARTED WITH PUPPET AND DOCKER FROM debian:wheezy MAINTAINER Roger Ignazio WORKDIR /tmp RUN curl -sol RUN dpkg -i puppetlabs-release-wheezy.deb RUN apt-get update RUN apt-get -y install puppet COPY *./ RUN puppet apply example.pp 2015 Mesosphere, Inc. All Rights Reserved. 27

28 BUILDING DOCKER IMAGES WITH PUPPET GETTING STARTED WITH PUPPET AND DOCKER package { ['ruby', 'ruby-dev', 'build-essential']: ensure => installed, } package { 'httparty': ensure => installed, provider => gem, } file { '/usr/bin/query_mesos': ensure => file, mode => '0755', source => '/tmp/query_mesos.rb', } 2015 Mesosphere, Inc. All Rights Reserved. 28

29 BUILDING DOCKER IMAGES WITH PUPPET GETTING STARTED WITH PUPPET AND DOCKER Step 10 : RUN puppet apply example.pp ---> Running in 12eda5e24ff8 Notice: Compiled catalog for 90c88c41cdaa.bad in environment production in 0.16 seconds Notice: Package[build-essential]/ensure: ensure changed 'purged' to 'present' Notice: File[/usr/bin/query_mesos]/ensure: defined content as '{md5} e44268ac8e31f75f1aeee961d0ebe36b' Notice: Package[ruby-dev]/ensure: ensure changed 'purged' to 'present' Notice: Package[httparty]/ensure: created Notice: Finished catalog run in seconds ---> 1a8fefd724ee Removing intermediate container 12eda5e24ff8 Successfully built 1a8fefd724ee 2015 Mesosphere, Inc. All Rights Reserved. 29

30 BUILDING DOCKER IMAGES WITH PUPPET STAGING DOCKER IMAGES ON NODES Using the garethr-docker Puppet module docker::image { 'rogerignazio/basic-puppet-example': image_tag => 'latest', } Equivalent to $ docker pull rogerignazio/basic-puppet-example:latest 2015 Mesosphere, Inc. All Rights Reserved. 30

31 MANAGING CHRONOS JOBS WITH PUPPET 2015 Mesosphere, Inc. All Rights Reserved. 31

32 MANAGING CHRONOS JOBS WITH PUPPET A CUSTOM TYPE AND PROVIDER Bundled with a module Found at lib/puppet/type and lib/puppet/provider Model the API of an external service as Puppet code Chronos API Puppet Master Chronos Node 2015 Mesosphere, Inc. All Rights Reserved. 32

33 MANAGING CHRONOS JOBS WITH PUPPET A CUSTOM TYPE AND PROVIDER chronos_job { 'fetch_mesos_master_metrics': command => 'query_mesos ', job_schedule => 'R/ T00:00:00.000Z/PT1M', container => { type => 'DOCKER', image => 'rogerignazio/basic-puppet-example', }, cpus => 0.5, mem => 256, owner => 'roger@mesosphere.com', } 2015 Mesosphere, Inc. All Rights Reserved. 33

34 DEMO 2015 Mesosphere, Inc. All Rights Reserved. 34

35 PROVISIONING INFRASTRUCTURE 2015 Mesosphere, Inc. All Rights Reserved. 35

36 PROVISIONING INFRASTRUCTURE CLOUD PROVISIONING WITH AWS Declare AWS infrastructure as Puppet resources Custom types and providers hit the AWS API Ensures resources are in desired state Puppet Master AWS Coordinator Node AWS API 2015 Mesosphere, Inc. All Rights Reserved. 36

37 PROVISIONING INFRASTRUCTURE CLOUD PROVISIONING WITH AWS ec2_instance { 'mesos-slave-nn': ensure => present, region => 'us-west-2', # US West (Oregon) image_id => 'ami-4dbf9e7d', # AWS RHEL 7.1 image instance_type => 'c4.xlarge', # 4 CPUs, 7.5 GB mem security_groups => ['mesos-aws-secgrp'], } 2015 Mesosphere, Inc. All Rights Reserved. 37

38 PROVISIONING INFRASTRUCTURE CLOUD PROVISIONING WITH AWS Some of the available resource types: ec2_instance ec2_securitygroup ec2_vpc elb_loadbalancer route53_a_record A more complete example: Mesosphere, Inc. All Rights Reserved. 38

39 PROVISIONING INFRASTRUCTURE BARE-METAL PROVISIONING WITH RAZOR Auto-discover inventory Policy-based provisioning Pluggable brokers Razor is open source Apache License, v Mesosphere, Inc. All Rights Reserved. 39

40 PROVISIONING INFRASTRUCTURE BARE-METAL PROVISIONING WITH RAZOR Ubuntu ISO RHEL ISO PXE Boot Razor Microkernel Razor Server Razor Client (Admin) Policy (Facts, IPMI, LLDP) role::mesos::master role::mesos::agent Puppet Master Mesosphere, Inc. All Rights Reserved. 40

41 PROVISIONING INFRASTRUCTURE BARE-METAL PROVISIONING WITH RAZOR For more information, check out Mesosphere, Inc. All Rights Reserved. 41

42 Q & A puppetconf_talk { 'managing_mesos': ensure => presented, speaker => 'Roger Ignazio', => 'roger@mesosphere.com', twitter => '@rogerignazio', } 2015 Mesosphere, Inc. All Rights Reserved. 42