An Introduction to the Puppet Ecosystem

Transcription

1 An Introduction to the Puppet Ecosystem Trevor Vaughan - Onyx Point, Inc. License: Attribution-ShareAlike 3.0 Unported (CC BY-SA 3.0) 0

2 Onyx Point, Inc. Puppet Labs and Red Hat Partner Government Contracting Systems Automation Consulting Strong Open Source Supporters Hiring Geeks to build ALL THE THINGS Enough Shameless Promotion

3 The Year was And WindowMaker was AMAZING!

4 But Systems Automation Was a Mess Home rolled scripts Cross-system wars Everything was a networked filesystem Life was fun...but difficult to repeat and share reliably Then, I found Infrastructures.org In particular, the Push/Pull argument

5 Fast Forward to Today-ish

6 Puppet Written in 2005 as a solution to issues with existing automation tools The front-runner in the current pack of systems automation utilities Available in both Open Source and Enterprise flavors

7 Who is the Target Audience? Designed to speak like a Systems Administrator but appeal to Developers The ScriptRock Puppet vs. Chef Infographic sums things up nicely

8 Why Use Puppet You have numerous systems that you need to keep under control You may want to repeat your system configuration again exactly at some other time This applies particularly for rapidly evolving OSs like Fedora You need to manage many different flavors of OSs Linux - Red Hat, Ubuntu, Gentoo, etc... UNIX - Mac OS X, Solaris, AIX, HP-UX Microsoft Windows (yeah, them too)

9 Ways to Use Puppet Server/Client (puppet agent) Traditional Model Provides for Server Controlled System Isolation PKI Communication Protection Can also make all nodes a server! Standalone (puppet apply) Apply a manifest locally to the system Precompiled Catalog (puppet apply) Apply a compiled catalog locally to a system

10 Puppet Basics - Model Driven Create a model of your system Let the system figure out how to get you there

11 Resources package { 'openssh-server': notify => File['/etc/ssh/sshd_config'] } file { '/etc/ssh/sshd_config': notify => Service['sshd'] } service { 'sshd': ensure => 'running' }

12 Classes and Definitions Building Blocks of Reusable Functionality Classes - Singletons => Can Inherit Defines - Multiple => Cannot Inherit

13 Classes class 'ssh' ( $enable_service => true, $port => '22' ){ file { '/etc/ssh/sshd_config': content => template('modules/ssh/sshd_config.erb') } service { 'sshd': enable => $enable_service, subscribe => File['/etc/ssh/sshd_config'] } } include 'ssh'

14 define mkusr ( $uid ) { group { $name: gid => $uid } Defines user { $name: uid => $uid, gid => $name } } mkusr { 'bob': uid => '1111' } mkusr { 'alice': uid => '1112' } mkusr { 'eve': uid => '1337' }

15 Facter Over 120 Facts on most systems $::osfamily => RedHat $::lsbdistid => Fedora $::lsbdistrelease => 20 $::interfaces => em1,lo,virbr0

16 Hiera /ˈhī(ә)ˌrä/ Useful for separating data from logic Can use facts and interpolation to generate more powerful hierarchies See my custom patch for interpolating hashes and arrays YAML or JSON input JSON does not support comments

17 Sample Hierarchy Config File: /etc/puppet/hiera.yaml --- :backends: - yaml :yaml: :datadir: /etc/puppet/hieradata :hierarchy: - %{fqdn}.yaml - top.yaml

18 Sample Hierarchy File: /etc/puppet/hieradata/top.yaml --- classes: - 'foo' foo::var1: 'foo' foo::var2: %{'foo::var1'} foo::var3: 'bar' File: /etc/puppet/hieradata/my.f.q.d.n.yaml --- foo::var3: 'baz'

19 Example class foo ($var1 = 'one', $var2 = 'two', $var3 = 'three', $var4 = { notice("var1 = $var1") notice("var2 = $var2") notice("var3 = $var3") notice("var4 = $var4") } Var1 = foo Var2 = foo Var3 = baz Var4 = four Var1 = foo Var2 = foo Var3 = *bar* Var4 = four Hostname: my.f.q.d.n Hostname: other.f.q.d.n

20 What Puppet Is Not...Yet A cross-system orchestration framework Systems are not aware of other system configurations Some additional tools can be used to fill this gap Ideas have been passed around regarding methods for greater awareness That's pretty much it, I haven't found anything else that can't be done

21 Where to get Started The Module Forge Great resource for pre-built modules Don't expect them all to work together seamlessly Even if it doesn't work for you out of the box, it's a great place to start and learn The Docs! The Learning Puppet Series The Drive-Thru Cheat Sheets

22 Puppet Lint Checks for syntax correctness against the Puppet Style Guide Rspec Puppet Uses Rspec to evaluate the correctness of your manifests as compiled Can masquerade facts and parameters Can use Mocks and Stubs Will save you countless hours of trivial debugging time

23 Puppet Friends!

24 Close Friends

25 Geppetto An Eclipse-based IDE for Puppet Modules Takes care of a LOT of the learning and management of your codebase Written by the primary author of the future parser in Puppet - Henrik Lindberg

26 The Puppet Labs solution to cross-system orchestration Excellent Security Model MCollective Uses AMQP middleware to broadcast commands as quickly as possible Simple to extend using Ruby Supports both Puppet, Chef, Facter, and Ohai for metadata collection

27 PuppetDB A data collection service for Puppet Enables the inventory service and exported resources Contains the most recent facts and catalog for all nodes Can retain multiple run reports for all nodes

28 A system lifecycle management tool Allows for provisioning and management of physical and virtual hosts Can act as an external node classifier (ENC) for Puppet Besides Puppet Enterprise, the most powerful management and reporting utility

29

30 Puppetboard A new reporting interface for PuppetDB Still VERY young but shows promise

31 Puppet Dashboard The original Puppet Dashboard Now 100% community maintained

32 Razor A bare-metal/vm auto-provisioning tool New technology Attempts to generically solve the pre-automation phase

33 Friendly Neighbors

34 An alternate method for ordered cross-system orchestration Often used alongside Puppet for one-off events across a cluster of systems Uses SSH as opposed to agents YAML as opposed to DSL Written in Python

35 Yet another method for ordered cross-system orchestration Also used alongside Puppet for one-off events across a cluster of systems Has an agent on each node for execution YAML as opposed to DSL Written in Python

36 Passing Acquaintances

37 Similar to Puppet in terms of focus Much more developer focused, no DSL Operations are strictly ordered and failures are immediate Ruby rescue statements can be used to bypass failure states Cookbooks are pulled onto the various nodes and executed independently

38 One of the oldest configuration management systems Written in C for speed Uses a type of DSL that feels similar to C Unlike Puppet or Chef, requires more low-level programming understanding to modify the core

39 Presentation Information This presentation was made possible by: Reveal.js by Hakim El Hattab Reveal.js Modifications by José Manuel Ciges Regueiro