Micro-Service Applications for Infrastructure People

Transcription

1 #CLUS

2 Micro-Service Applications for Infrastructure People Hank Preston, Principal Engineer NetDevOps Evangelist ccie R/S #CLUS

3 Cisco Webex Teams Questions? Use Cisco Webex Teams (formerly Cisco Spark) to chat with the speaker after the session How Find this session in the Cisco Events App Click Join the Discussion Install Webex Teams or go directly to the team space Enter messages/questions in the team space Webex Teams will be moderated by the speaker until June 18, cs.co/ciscolivebot#brkcld-1009 #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 3

4 Micro-Service Applications for Infrastructure People Development Environment Client/Server vs Micro- Service con t Caching Users and Developers DevOps Engineers Delivery Pipeline Scheduling and Placement Container Layer Applications and Middleware Cloud Management and Automation Operating System Designing and Building the Minimum Viable Product (MVP) A Day in the Life of a Developer Code Repositories Containers Development Environment Object Storage Development Process Traditional Development Continuous Development Managing Micro-Services Infrastructure The Stack Architects and Operators Infrastructure Supporting Micro-Services Load Balancer/Proxy Message Queues IaaS vs PaaS The DevOps Engineer #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public

5 Why are we here today? Today, Applications define the business. Understanding cloud native application design and development is critical for Infrastructure Engineers if we are to successfully become relevant to Application Developers. BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 5

6 Key Learning Objectives At the end of the today, you should be able to: Describe a Micro-service style application architecture Understand common building blocks like Containers, Proxies, Queues, Caches, etc. Understand why Traditional Infrastructure Platforms (x86 Virtualization) don t meet the needs of Modern Applications #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 6

7 Play along at #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 7

8 Client/Server vs Micro- Service Applications

9 Client/Server Application Architecture Client Server Database Small and Known Number of Users Small Number of Complex Components Single Transactional Data Source #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 9

10 Building Modern Applications 12Factor.net Conway s Law Werner Vogel Amazon CTO #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 10

11 Micro-Service Application Architecture Request Layer Client Request Microservice Big Data Microservice Microservice Microservice Ever Changing Type and Number of Users Message Bus Large Number of Simple Components Many Sources, Types, and Locations of Data #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 11

12 Building Blocks Virtual Machines Serverless Databases Proxies Queues Containers Object Storage Caches Load balancers #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 12

13 The Birth of an Application Creating the MVP

14 Once upon a time (January 2015) We sure are talking a lot about Hybrid Cloud... I m being told.. Go talk about Hybrid Cloud! We need something better than Hello World for demos #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 14

15 Minimal Viable Product (MVP) as defined by Eric Ries, is a learning vehicle. It allows you to test an idea by exposing an early version of your product to the target users and customers, to collect the relevant data, and to learn from it. Read more -viable-product-and-minimal-marketableproduct/ and lots of other places BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 15

16 MyHero Demo Application MVP #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 16

17 MVP Application Architecture It was Web / App / Data Structure Virtual Machines Deployable in the Cloud It was NOT Cloud Native or Micro-service DevOps-ie #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 17

18 Moving Beyond MVP MyHero v1.0

19 #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 19

20 A Day in the Life of a Developer

21 Code Repositories Git (/ɡɪt/) is a version control system that is widely used for software development and other version control tasks. It is a distributed revision control system with an emphasis on speed, data integrity, and support for distributed, non-linear workflows. Git (software) - Wikipedia, the free encyclopedia BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 21

22 Distributed Version Control #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 22

23 Keep Code Clean, Repo per service A repo should contain everything for the service* Code, Issues, Releases, Documentation A Single "Application" may leverage many services and repos * - Repository design and layout is an active discussion area... There is no right answer #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 23

24 Application Containers containers wrap up a piece of software in a complete filesystem that contains everything it needs to run: code, runtime, system tools, system libraries anything you can install on a server. This guarantees that it will always run the same, regardless of the environment it is running in. t-docker BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 24

25 Docker Containers Per Service Containers "can" make life easier Dockerfile = container image definition Automate building Container Images from Code #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 25

26 Basic Docker File Each line becomes a "layer" in the image Source from known good foundation (steal from others) Expose Service Ports Run the code #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 26

27 Basic Docker File Each line becomes a "layer" in the image Source from known good foundation (steal from others) Expose Service Ports Run the code Built Image Run Application Add Code Dependencies Port 80 Owner: Hank Base: nginx #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 27

28 A Sidebar about Application Environments Containers need to be stateless, run anywhere Dev, Test, Prod -> Same Code 12 Factor* Principle Environment provides details, not code * - #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 28

29 Development Environment working environment of individual developers, programming pairs, or individual feature teams. The purpose of this environment is for the developer/pair/team to work in seclusion enabling them to make and validate changes without having to worry about adversely affecting [others] ys/sandboxes.html BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 29

30 The Application Development Environment The code should be the complicated part, not the test environment Local development typical preferred Vagrant by Hashicorp commonly used #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 30

31 The MyHero Development Environment Include Vagrantfile in repo Clone -> Vagrant up to get started Runs Docker Container locally to mimic production deployment myhero_data\ $ vagrant global-status id name provider state directory a40ab default docker running /Users/hapresto/coding/myhero_data c6e6372 default docker running /Users/hapresto/coding/myhero-ui 3ff9b07 default docker running /Users/hapresto/coding/myhero_app #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 31

32 Demo Time! Let s be a Developer!

33 A Cast of Supporting Micro-Services

34 Load Balancing and Proxy load balancing improves the distribution of workloads across multiple computing resources en.wikipedia.org/wiki/load_balancing_ (computing) a reverse proxy is a type of proxy server that retrieves resources on behalf of a client from one or more servers. everse_proxy BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 34

35 Load Balancing and Proxy Load balancing is a simple function of distributing requests across a number of potential servers. Reverse proxies can provide additional services such as security features, caching, acceleration. Definitions by Hank BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 35

36 Leveraging 100s of Instances Both scale and resiliency will mean lots of containers Easy for Users to access Automatic adjustment up and down #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 36

37 Micro Service Platforms Provide ingress Services Operate at Layer 3, 4, or 7 Often based on Open Source Tools ex: nginx, Traefik, HAProxy Also leverage Cloud Services ex: AWS ELB or GCE Load Balancer Part of app definition - No extra work needed by developer to use!!! $ kubectl describe ingress myhero Name: myhero-ingress Namespace: hapresto Address: X.X.X.X Rules: Host Path Backends api.myhero.imapex.io /* myhero-app:80 spark.myhero.imapex.io /* myhero-spark:80 myhero.imapex.io /* myhero-ui:80 #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 37

38 Updated MyHero Application Architecture Each Application Layer Containerized Web and App layers easily scale horizontally #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 38

39 Message Queuing Message queues provide an asynchronous communications protocol, meaning that the sender and receiver of the message do not need to interact with the message queue at the same time. ki/message_queue BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 39

40 Making Services Resilient and Independent Bursty patterns, or slow processes can impact services Need a way to keep application and users moving forward Message Queues allow each service to run at own speed Client Client Client MQTT Publish Queue MQTT Subscribe Server Server #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 40

41 Better Vote Processing with Message Queue We don't have to wait for our vote to be counted before leaving a polling location We shouldn't expect our users to wait in MyHero either #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 41

42 Caching Services often used to speed up dynamic database-driven websites by caching data and objects in RAM to reduce the number of times an external data source (such as a database or API) must be read. ed BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 42

43 Data Access is slow and intensive Often data doesn't change Sometimes older data is okay Caching can help improve performance by saving data in memory #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 43

44 Boosting MyHero Performance with Caching Voting Options rarely change Provide results up to 1 minute old < HTTP/ OK < Access-Control-Allow-Origin: * < Date: Tue, 02 Jan :43:03 GMT < Server: Werkzeug/ Python/ < data_timestamp: :38:03 < Content-Length: 449 < Content-Type: application/json < Connection: keep-alive < #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 44

45 Updated MyHero Application Architecture #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 45

46 Object Storage a storage architecture that manages data as objects, as opposed to other storage architectures like file systems which manage data as a file hierarchy and block storage which manages data as blocks within sectors and tracks. orage BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 46

47 Object Storage in Cloud Applications REST API Usage Highly Scalable Shared across other services Low Cost #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 47

48 Future MyHero Feature Store Hero Pics centrally to use across services (locked to UI now) Serve Static Web Content Optimize UI micro-service for dynamic content Bucket: Pics Bucket: Static.css.js #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 48

49 Demo Time! A look under the hood of Micro-Service Applications

50 Expanded User Interfaces us er in ter face noun: user interface; plural noun: user interfaces the means by which the user and a computer system interact, in particular the use of input devices and software. user interface definition - Google Search BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 50

51 Apps so much more than just "Web" Developers need to consider all ways users might want to work Web, Mobile, Wearable, Chat, Voice, etc A good service architecture should enable easy additions What is the Twitter App? #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 51

52 MyHero Anywhere! MyHero on the Web *New and improved UI!!! Chat your vote with Webex Teams Bot TXT in your vote with Cisco Tropo Speak your vote with Amazon Alexa #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 52

53 Serverless the new big thing! #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 53

54 Serverless Computing Serverless computing allows you to build and run applications and services without thinking about servers. Serverless applications don't require you to provision, scale, and manage any servers. BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 54

55 Why Serverless for Applications? Developers can really focus on code Efficiency code only runs when needed Built in scaling Price $$$$ Event Container Code Reality: Automatic containerization Data Objects #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 55

56 Using Serverless for MyHero Alexa Interface Suggested development platform for Alexa Simplest option for developers and simple = good Very similar Python code from other bots/interfaces No more need to package as container Working with Lambda offered own new challenges #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 56

57 Current MyHero Application Architecture #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 57

58 Demo Time! Let s test our application!

59 Play along at #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 59

60 Development Process

61 System Integration System integration is defined as the process of bringing together the component... the process of linking together different computing systems and software applications physically or functionally, to act as a coordinated whole #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 62

62 Software Delivery Software Delivery is the process of getting a software product to market. Your particular market and product could be: An alpha product to an early adopter. The next release of an internal operations product. A first release of a main product for a major company. #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 65

63 Software Deployment Software deployment is all of the activities that make a software system available for use. The general deployment process consists of several interrelated activities with possible transitions between them. These activities can occur at the producer side or at the consumer side or both. #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 68

64 Continuous Development (or CICD) Continuous development is the natural progression of iteration times shrinking into insignificance. Through heavy use of automation, flexible infrastructure and modular architecture, software development leaders have come to the point where each code change is its own deployment. echtarget.com/essentialguide/ Next-generation-Agile- Guide-to-continuousdevelopment BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 70

65 Continuous Development Process Flow Continuous Integration Merging of development work with code base constantly so that automated testing can catch problems early Continuous Delivery Software package delivery mechanism for releasing code to staging for review and inspection Continuous Deployment Relies on CI and CD to automatically release code into production as soon as it is ready. Constant flow of new features into production #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 71

66 Continuous Development with MyHero 1 Code Commit 8 Read Message github.com 2 Notify CICD Server Webex Teams 7 Status Message 6 Deploy App drone.io 3 - Integrate and Test 4 - Build Container Image 5 - Push Image to Registry kubernetes.io 6.5 Pull Image hub.docker.com #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 72

67 Managing a Micro- Service Infrastructure (or what does it take to build applications like this?)

68 #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 75

69 The Cloud You Plan to Build #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 76

70 The Cloud You Plan to Build The Cloud You End Up With #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 77

71 The Modern Application Stack Development Environment Vagrant, Docker, Vim, Slack, Spark, Git Users and Developers Operating System CoreOS, Rancher, RedHat, Ubuntu, Microsoft Architects and Operators Infrastructure UCS/ACI, HP, vsphere/nsx #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 78

72 The Modern Application Stack Users and Developers Development Environment Delivery Pipeline Vagrant, Docker, Vim, Slack, Spark, Git GitHub, BitBucket, Jenkins, Team City, Drone, Puppet, Ansible, Chef Cloud Management and Automation UCS Director, vrealize, OpenStack, AWS, CloudCenter Architects and Operators Operating System Infrastructure CoreOS, Rancher, RedHat, Ubuntu, Microsoft UCS/ACI, HP, vsphere/nsx #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 79

73 The Modern Application Stack Users and Developers Development Environment Delivery Pipeline Scheduling and Placement Container Layer Vagrant, Docker, Vim, Slack, Spark, Git GitHub, BitBucket, Jenkins, Team City, Drone, Puppet, Ansible, Chef Docker/Swarm, Kubernetes, Mesosphere, Tectonic, Rancher, Rocket Applications and Middleware Cloud Management and Automation HAProxy, Cassandra, RabbitMQ, Hadoop, Consul UCS Director, vrealize, OpenStack, AWS, CloudCenter Architects and Operators Operating System Infrastructure CoreOS, Rancher, RedHat, Ubuntu, Microsoft UCS/ACI, HP, vsphere/nsx #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 80

74 The Modern Application Stack Users and Developers Development Environment Delivery Pipeline Scheduling and Placement Container Layer Vagrant, Docker, Vim, Slack, Spark, Git GitHub, BitBucket, Jenkins, Team City, Drone, Puppet, Ansible, Chef Docker/Swarm, Kubernetes, Mesosphere, Tectonic, Rancher, Rocket DevOps Engineers Applications and Middleware Cloud Management and Automation HAProxy, Cassandra, RabbitMQ, Hadoop, Consul UCS Director, vrealize, OpenStack, AWS, CloudCenter Architects and Operators Operating System Infrastructure CoreOS, Rancher, RedHat, Ubuntu, Microsoft UCS/ACI, HP, vsphere/nsx #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 81

75 The Modern Application Stack IaaS PaaS Users and Developers DevOps Engineers Architects and Operators Development Environment Delivery Pipeline Scheduling and Placement Container Layer Applications and Middleware Cloud Management and Automation Operating System Infrastructure Vagrant, Docker, Vim, Slack, Spark, Git GitHub, BitBucket, Jenkins, Team City, Drone, Puppet, Ansible, Chef Docker/Swarm, Kubernetes, Mesosphere, Tectonic, Rancher, Rocket HAProxy, Cassandra, RabbitMQ, Hadoop, Consul UCS Director, vrealize, OpenStack, AWS, CloudCenter CoreOS, Rancher, RedHat, Ubuntu, Microsoft UCS/ACI, HP, vsphere/nsx Apprenda Pivotal/CloudFoundry OpenShift BlueMix Heroku AWS Azure GCE AWS Azure Softlayer GCE #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 82

76 #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 83

77 Summary

78 Key Learning Objectives Can you? Describe a Micro-service style application architecture Understand common building blocks like Containers, Proxies, Queues, Caches, etc Understand why Traditional Infrastructure Platforms (x86 Virtualization) don t meet the needs of Modern Applications MyHero Demo on GitHub #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 85

79 Got more questions? Stay in touch! Hank facebook.com/ciscodevnet/ #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 86

80 Q & A

81 Continue your education Demos in the Cisco campus Walk-in self-paced labs Meet the engineer 1:1 meetings Related sessions #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 88

82 Complete your online session evaluation Give us your feedback to be entered into a Daily Survey Drawing. Complete your session surveys through the Cisco Live mobile app or on Don t forget: Cisco Live sessions will be available for viewing on demand after the event at #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 89

83 Continue the Conversation Check out other Cisco Cloud activities at Cisco Live Orlando! Invite customers & partners to Cloud Day Monday, Jun 11 2:00 p.m. - 5:30 p.m. Rosen Centre Executive Ballroom I, Level 1 Get your Multicloud Assessment Visit the Embrace a Multicloud World Zone World of Solutions Attend Kip s italk Tuesday, Jun 12 3:45 p.m. - 4:15 p.m. World of Solutions Theater Attend PSO Sessions PSOCLD-1008: SAP Data Hub and Cisco Container Platform PSOCLD-1003: Production-Grade Kubernetes PSOCLD-1007: Cisco Hybrid Cloud Platform for Google Cloud PSOCLD-1010: The Multicloud Approach #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 90

84 Are you Multicloud Ready? newbie ninja Get your personalized Multicloud Assessment in the Embrace the Multicloud World Zone. Just follow-the signs to the Cisco Cloud booth.

85 Have your customers and partners Cisco Live Orlando Visit the Embrace a Multicloud World Zone World of Solutions Get your Multicloud Assessment Visit the Embrace a Multicloud World Zone World of Solutions Attend Kip s italk Tuesday, Jun 12 3:45 p.m. - 4:15 p.m. World of Solutions Theater Attend PSO Sessions PSOCLD-1008: SAP Data Hub and Cisco Container Platform PSOCLD-1003: Production-Grade Kubernetes PSOCLD-1007: Cisco Hybrid Cloud Platform for Google Cloud PSOCLD-1010: The Multicloud Approach #CLUS BRKCLD Cisco and/or its affiliates. All rights reserved. Cisco Public 92

86 Thank you #CLUS

87 #CLUS