Micro-Service Applications for Infrastructure People

Transcription

1

2 Micro-Service Applications for Infrastructure People Hank Preston, NetDevOps Evangelist ccie 38336,

3 Cisco Spark How Questions? Use Cisco Spark to communicate with the speaker after the session 1. Find this session in the Cisco Live Mobile App 2. Click Join the Discussion 3. Install Spark or go directly to the space 4. Enter messages/questions in the space 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

4 Micro-Service Applications for Infrastructure People Users and Developers DevOps Engineers Architects and Operators Development Environment Delivery Pipeline Scheduling and Placement Container Layer Applications and Middleware Cloud Management and Automation Operating System Infrastructure Client/Server vs Micro-Service Designing and Building the Minimum Viable Product (MVP) A Day in the Life of a Developer Code Repositories Containers Development Environment Supporting Micro-Services Load Balancer/Proxy Message Queues con t Caching Object Storage Development Process Traditional Development Continuous Development Managing Micro-Services Infrastructure The Stack IaaS vs PaaS The DevOps Engineer 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

5 Why are we here today? Today, Applications define the business. Understanding cloud native application design and development is critical for Infrastructure Engineers if we are to successfully become relevant to Application Developers Cisco and/or its affiliates. All rights reserved. Cisco Public 5

6 Key Learning Objectives At the end of the today, you should be able to: Describe a Micro-service style application architecture Understand common building blocks like Containers, Proxies, Queues, Caches, etc Understand why Traditional Infrastructure Platforms (x86 Virtualization) don t meet the needs of Modern Applications 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 6

7 Play along at Cisco and/or its affiliates. All rights reserved. Cisco Public 7

8 Client/Server vs Micro-Service Applications

9 Client/Server Application Architecture Client Server Database Small and Known Number of Users Small Number of Complex Components Single Transactional Data Source 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 9

10 Building Modern Applications 12Factor.net Conway s Law Werner Vogel Amazon CTO 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 10

11 Micro-Service Application Architecture Request Layer Client Request Microservice Big Data Microservice Microservice Microservice Ever Changing Type and Number of Users Message Bus Large Number of Simple Components Many Sources, Types, and Locations of Data 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 11

12 Building Blocks Virtual Machines Serverless Databases Proxies Queues Containers Object Storage Caches Load balancers 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 12

13 The Birth of an Application Creating the MVP

14 Once upon a time (January 2015) We sure are talking a lot about Hybrid Cloud... I m being told.. Go talk about Hybrid Cloud! We need something better than Hello World for demos 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 14

15 Minimal Viable Product (MVP) as defined by Eric Ries, is a learning vehicle. It allows you to test an idea by exposing an early version of your product to the target users and customers, to collect the relevant data, and to learn from it. Read more and lots of other places 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 15

16 MyHero Demo Application MVP Cisco and/or its affiliates. All rights reserved. Cisco Public 16

17 MVP Application Architecture It was Web / App / Data Structure Virtual Machines Deployable in the Cloud It was NOT Cloud Native or Micro-service DevOps-ie 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 17

18 Moving Beyond MVP MyHero v1.0

19 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 19

20 A Day in the Life of a Developer

21 Code Repositories Git (/ɡɪt/) is a version control system that is widely used for software development and other version control tasks. It is a distributed revision control system with an emphasis on speed, data integrity, and support for distributed, non-linear workflows. Git (software) - Wikipedia, the free encyclopedia 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 21

22 Distributed Version Control 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 22

23 Keep Code Clean, Repo per service A repo should contain everything for the service* Code, Issues, Releases, Documentation A Single "Application" may leverage many services and repos * - Repository design and layout is an active discussion area... There is no right answer 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 23

24 Application Containers containers wrap up a piece of software in a complete filesystem that contains everything it needs to run: code, runtime, system tools, system libraries anything you can install on a server. This guarantees that it will always run the same, regardless of the environment it is running in Cisco and/or its affiliates. All rights reserved. Cisco Public 24

25 Docker Containers Per Service Containers "can" make life easier Dockerfile = container image definition Automate building Container Images from Code Cisco and/or its affiliates. All rights reserved. Cisco Public 25

26 Basic Docker File Each line becomes a "layer" in the image Source from known good foundation (steal from others) Expose Service Ports Run the code 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 26

27 Basic Docker File Each line becomes a "layer" in the image Source from known good foundation (steal from others) Expose Service Ports Run the code Built Image Run Application Add Code Dependencies Port 80 Owner: Hank Base: nginx 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 27

28 A Sidebar about Application Environments Containers need to be stateless, run anywhere Dev, Test, Prod -> Same Code 12 Factor* Principle Environment provides details, not code * Cisco and/or its affiliates. All rights reserved. Cisco Public 28

29 Development Environment working environment of individual developers, programming pairs, or individual feature teams. The purpose of this environment is for the developer/pair/team to work in seclusion enabling them to make and validate changes without having to worry about adversely affecting [others] xes.html 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 29

30 The Application Development Environment The code should be the complicated part, not the test environment Local development typical preferred Vagrant by Hashicorp commonly used 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 30

31 The MyHero Development Environment Include Vagrantfile in repo Clone -> Vagrant up to get started Runs Docker Container locally to mimic production deployment myhero_data\ $ vagrant global-status id name provider state directory a40ab default docker running /Users/hapresto/coding/myhero_data c6e6372 default docker running /Users/hapresto/coding/myhero-ui 3ff9b07 default docker running /Users/hapresto/coding/myhero_app 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 31

32 Demo Time! Let s be a Developer!

33 A Cast of Supporting Micro-Services

34 Load Balancing and Proxy load balancing improves the distribution of workloads across multiple computing resources en.wikipedia.org/wiki/load_balancing_(comput ing) a reverse proxy is a type of proxy server that retrieves resources on behalf of a client from one or more servers Cisco and/or its affiliates. All rights reserved. Cisco Public 34

35 Load balancing is a simple function of distributing requests across a number of potential servers. Load Balancing and Proxy Reverse proxies can provide additional services such as security features, caching, acceleration. Definitions by Hank 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 35

36 Leveraging 100s of Instances Both scale and resiliency will mean lots of containers Easy for Users to access Automatic adjustment up and down Cisco and/or its affiliates. All rights reserved. Cisco Public 36

37 Micro Service Platforms Provide ingress Services Operate at Layer 3, 4, or 7 Often based on Open Source Tools ex: nginx, Traefik, HAProxy Also leverage Cloud Services ex: AWS ELB or GCE Load Balancer Part of app definition - No extra work needed by developer to use!!! $ kubectl describe ingress myhero Name: myhero-ingress Namespace: hapresto Address: X.X.X.X Rules: Host Path Backends api.myhero.imapex.io /* myhero-app:80 spark.myhero.imapex.io /* myhero-spark:80 myhero.imapex.io /* myhero-ui: Cisco and/or its affiliates. All rights reserved. Cisco Public 37

38 Updated MyHero Application Architecture Each Application Layer Containerized Web and App layers easily scale horizontally 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 38

39 Message Queuing Message queues provide an asynchronous communications protocol, meaning that the sender and receiver of the message do not need to interact with the message queue at the same time. ueue 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 39

40 Making Services Resilient and Independent Bursty patterns, or slow processes can impact services Need a way to keep application and users moving forward Client Client Queue Server Message Queues allow each service to run at own speed Client MQTT Publish MQTT Subscribe Server 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 40

41 Better Vote Processing with Message Queue We don't have to wait for our vote to be counted before leaving a polling location We shouldn't expect our users to wait in MyHero either 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 41

42 Caching Services often used to speed up dynamic database-driven websites by caching data and objects in RAM to reduce the number of times an external data source (such as a database or API) must be read Cisco and/or its affiliates. All rights reserved. Cisco Public 42

43 Data Access is slow and intensive Often data doesn't change Sometimes older data is okay Caching can help improve performance by saving data in memory 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 43

44 Boosting MyHero Performance with Caching Voting Options rarely change Provide results up to 1 minute old < HTTP/ OK < Access-Control-Allow-Origin: * < Date: Tue, 02 Jan :43:03 GMT < Server: Werkzeug/ Python/ < data_timestamp: :38:03 < Content-Length: 449 < Content-Type: application/json < Connection: keep-alive < 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 44

45 Object Storage a storage architecture that manages data as objects, as opposed to other storage architectures like file systems which manage data as a file hierarchy and block storage which manages data as blocks within sectors and tracks Cisco and/or its affiliates. All rights reserved. Cisco Public 45

46 Object Storage in Cloud Applications REST API Usage Highly Scalable Shared across other services Low Cost 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 46

47 Future MyHero Feature Store Hero Pics centrally to use across services (locked to UI now) Serve Static Web Content Optimize UI micro-service for dynamic content Bucket: Pics Bucket: Static.css.js 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 47

48 Demo Time! A look under the hood of Micro- Service Applications

49 us er in ter face Expanded User Interfaces noun: user interface; plural noun: user interfaces the means by which the user and a computer system interact, in particular the use of input devices and software. user interface definition - Google Search 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 49

50 Apps so much more than just "Web" Developers need to consider all ways users might want to work Web, Mobile, Wearable, Chat, Voice, etc A good service architecture should enable easy additions What is the Twitter App? 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 50

51 MyHero Anywhere! MyHero on the Web *New and improved UI!!! Chat your vote with Cisco Spark Bot TXT in your vote with Cisco Tropo Speak your vote with Amazon Alexa 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 51

52 Current MyHero Application Architecture 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 52

53 Demo Time! Let s test our application!

54 Play along at Cisco and/or its affiliates. All rights reserved. Cisco Public 54

55 Development Process

56 System Integration System integration is defined as the process of bringing together the component... the process of linking together different computing systems and software applications physically or functionally, to act as a coordinated whole Cisco and/or its affiliates. All rights reserved. Cisco Public 56

57 Integration Phase Bring together individual developers code Compile/Build components Execute Tests 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 57

58 Software Delivery Software Delivery is the process of getting a software product to market. Your particular market and product could be: An alpha product to an early adopter. The next release of an internal operations product. A first release of a main product for a major company Cisco and/or its affiliates. All rights reserved. Cisco Public 58

59 Delivery Phase On tested and working code Create final artifacts Make available for usage 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 59

60 Software Deployment Software deployment is all of the activities that make a software system available for use. The general deployment process consists of several interrelated activities with possible transitions between them. These activities can occur at the producer side or at the consumer side or both Cisco and/or its affiliates. All rights reserved. Cisco Public 60

61 Deployment Phase Install application Configure for use 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 61

62 Continuous Development (or CICD) Continuous development is the natural progression of iteration times shrinking into insignificance. Through heavy use of automation, flexible infrastructure and modular architecture, software development leaders have come to the point where each code change is its own deployment. uide/next-generation-agile-guide-to-continuousdevelopment 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 62

63 Continuous Development Process Flow Continuous Integration Merging of development work with code base constantly so that automated testing can catch problems early Continuous Delivery Software package delivery mechanism for releasing code to staging for review and inspection Continuous Deployment Relies on CI and CD to automatically release code into production as soon as it is ready. Constant flow of new features into production 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 63

64 Continuous Development with MyHero 1 Code Commit 8 Read Message github.com 2 Notify CICD Server ciscospark.com 7 Status Message 6 Deploy App drone.io 3 - Integrate and Test 4 - Build Container Image 5 - Push Image to Registry kubernetes.io 6.5 Pull Image hub.docker.com 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 64

65 Managing a Micro-Service Infrastructure (or what does it take to build applications like this?)

66 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 67

67 The Cloud You Plan to Build 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 68

68 The Cloud You Plan to Build The Cloud You End Up With 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 69

69 The Modern Application Stack Development Environment Vagrant, Docker, Vim, Slack, Spark, Git Users and Developers Operating System CoreOS, Rancher, RedHat, Ubuntu, Microsoft Architects and Operators Infrastructure UCS/ACI, HP, vsphere/nsx 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 70

70 The Modern Application Stack Users and Developers Development Environment Delivery Pipeline Vagrant, Docker, Vim, Slack, Spark, Git GitHub, BitBucket, Jenkins, Team City, Drone, Puppet, Ansible, Chef Cloud Management and Automation UCS Director, vrealize, OpenStack, AWS, CloudCenter Operating System CoreOS, Rancher, RedHat, Ubuntu, Microsoft Architects and Operators Infrastructure UCS/ACI, HP, vsphere/nsx 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 71

71 The Modern Application Stack Users and Developers Development Environment Delivery Pipeline Scheduling and Placement Container Layer Applications and Middleware Cloud Management and Automation Vagrant, Docker, Vim, Slack, Spark, Git GitHub, BitBucket, Jenkins, Team City, Drone, Puppet, Ansible, Chef Docker/Swarm, Kubernetes, Mesosphere, Tectonic, Rancher, Rocket HAProxy, Cassandra, RabbitMQ, Hadoop, Consul UCS Director, vrealize, OpenStack, AWS, CloudCenter Operating System CoreOS, Rancher, RedHat, Ubuntu, Microsoft Architects and Operators Infrastructure UCS/ACI, HP, vsphere/nsx 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 72

72 The Modern Application Stack Users and Developers DevOps Engineers Development Environment Delivery Pipeline Scheduling and Placement Container Layer Applications and Middleware Cloud Management and Automation Vagrant, Docker, Vim, Slack, Spark, Git GitHub, BitBucket, Jenkins, Team City, Drone, Puppet, Ansible, Chef Docker/Swarm, Kubernetes, Mesosphere, Tectonic, Rancher, Rocket HAProxy, Cassandra, RabbitMQ, Hadoop, Consul UCS Director, vrealize, OpenStack, AWS, CloudCenter Operating System CoreOS, Rancher, RedHat, Ubuntu, Microsoft Architects and Operators Infrastructure UCS/ACI, HP, vsphere/nsx 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 73

73 The Modern Application Stack IaaS PaaS Users and Developers DevOps Engineers Architects and Operators Development Environment Delivery Pipeline Scheduling and Placement Container Layer Applications and Middleware Cloud Management and Automation Operating System Infrastructure Vagrant, Docker, Vim, Slack, Spark, Git GitHub, BitBucket, Jenkins, Team City, Drone, Puppet, Ansible, Chef Docker/Swarm, Kubernetes, Mesosphere, Tectonic, Rancher, Rocket HAProxy, Cassandra, RabbitMQ, Hadoop, Consul UCS Director, vrealize, OpenStack, AWS, CloudCenter CoreOS, Rancher, RedHat, Ubuntu, Microsoft UCS/ACI, HP, vsphere/nsx Apprenda Pivotal/CloudFoundry OpenShift BlueMix Heroku AWS Azure GCE AWS Azure Softlayer GCE 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 74

74

75 Summary

76 Key Learning Objectives Can you? Describe a Micro-service style application architecture Understand common building blocks like Containers, Proxies, Queues, Caches, etc Understand why Traditional Infrastructure Platforms (x86 Virtualization) don t meet the needs of Modern Applications MyHero Demo on GitHub Cisco and/or its affiliates. All rights reserved. Cisco Public 77

77 Got more questions? Stay in touch! Hank facebook.com/ciscodevnet/ Cisco and/or its affiliates. All rights reserved. Cisco Public

78 Q & A

79 Complete Your Online Session Evaluation Give us your feedback and receive a Cisco Live 2018 Cap by completing the overall event evaluation and 5 session evaluations. All evaluations can be completed via the Cisco Live Mobile App. Don t forget: Cisco Live sessions will be available for viewing on demand after the event at Cisco and/or its affiliates. All rights reserved. Cisco Public

80 Thank you

81