Cloud and DevOps with Linux on z Systems

Transcription

1 Cloud and DevOps with Linux on z Systems Sébastien LLaurency IT Integration Architect Linux & Cloud zats IBM Client Center Montpellier, France

2 Q1 Why Cloud with Linux on z System?

3 CLOUD «LinuxONE Systems & Linux on z Systems» At your fingerprint Change for MORE Security Think WIDE Do it FAST Scalability Speed Reduce MASSIVELY Costs 3

4 Cloud Enabled Born In The Cloud 4

5 Cloud Enabled Systems of Record Run mission critical systems that need "always up, always on" stability. These tend to run on dedicated infrastructure for highly predictable, high volume workloads Born In The Cloud Drives Need Drives Investment Systems of Record Secure Data Systems of Engagement Knowledge Sharing Dynamic Infrastructure Engagement Models On-demand Self-service Anywhere, Anytime Mobile HR CRM ERP DB Optimize Our IT Infrastructure, Data and Processes Social Existing Middleware Workloads + Integrate Emerging Platform Workloads Innovate How We Engage, Make Decisions and Work New methods of interacting with Clients Systems of Engagement Cloud-based systems and technology but, with the proper methods and technologies, it may also reside on-premises (think IBM Cloud Builder, Bluemix local, ICO, Urban Code Deploy, Cast Iron, Mobile integration, etc...) System of Insights Analysis systems that facilitate gathering, mining, organizing, transforming, consuming, and analyzing diverse sets of data from SoR & SoE Bi Modal IT or 2 speed IT The notion that hybrid applications have components that are delivered at different speeds. One part (Steady Speed) being the "traditional IT" responsible for delivering enterprise grade IT services, While the other part (Fast Speed) is already taking advantage of the new digital business and API economy. 5

6 Private Cloud Environments Dev & Test Sandbox / PoC / Pilot Production overflow Ad hoc analytics Training & roll-out Collaboration Platorm aas Bare Metal Infrastructure aas Workloads Each Workload Typically Requires Processor core(s) Memory Disk space Network connection [Hypervisor] OS (Linux) Application Server or runtime Storage & backup Java JavaScript / Node.js Data repository or database Flat files, CLOBs, BLOBs, RDBMS NoSQL Messaging 6

7 LinuxONE Systems provides choices for your workloads LPAR Memory Disk space Network connection z/vm or KVM SLES, RHEL, Ubuntu, CentOS (ClefOS) Application Server or runtime IBM Cloud Manager Java JavaScript / Node.js Data repository or database Flat files, CLOBs, BLOBs, RDBMS NoSQL Messaging (Optional) More than 1,000 customers are running Oracle DB on Linux on z / LinuxONE Systems 7

8 8

9 IBM s z/vm Cloud Stack approach Cloud Manager Appliance Single guest that includes xcat and OpenStack distro All necessary pieces of OpenStack are included to be an OpenStack Compute Platorm (compute, network, block storage, identity, orchestration, etc) Included with z/vm, no separate fees for service and support Allows customers to try out cloud, without risk Can only manage z/vm, can be integrated as part of a larger solution When running it as xcat, can be part of SUSE OpenStack Cloud 6 When running as xcat+openstack, can be part of VMWare vrealize or IBM Cloud Orchestrator CMA can only manage z/vm Cloud enablement solution Works in conjunction with hypervisor management tools 9

10 CMA Newton The next major release of our appliance is OpenStack Newton Items proposed Logging enhancements Ubuntu guest support Switch to IUCV instead of SSH as the communication path between CMA and the guests Installation simplification Continued OpenStack community support Ongoing security support 10

11 Flexible options to address the challenges of Today's IT Stronger Isolation Dedicated LPAR with dedicated cores and I/O channels creates standalone-like air gaps z/os A Linux A LPAR LPAR Dedicated Cores Dedicated Cores Greater Flexibility Superior utilization of white space in the enterprise with sharing and virtualization of physical resources Options that allow different blends of isolation and flexibility of resource management Li n u x B Li n u x C Li n u x D z/ T P F A z/ V S E A z/ O S B Li nu x E Li n u x F Li n u x G Li nu x H Li n u x I Lin ux J Lin ux K Ability to easily test new levels of software, even of the hypervisor, with recursive virtualization Lin ux L z/vm z/vm KVM z/vm LPAR LPAR LPAR Shared Cores IBM z Systems A fully configured z13 allows for 1000s of Linux systems to be supported in a small footprint. Upgrade the hardware on 1000s of Linux systems in hours with a push-pull on the IBM server A hardware architecture where forward compatibility is foundational and protects investment. Virtualization preserving the purity of the architecture allows running an OS at any virtualization level without massive re-testing and running different OSes on the same footprint Network simplification and enhancement with: HiperSockets between logical partitions Virtual Switches provided by z/vm Security Evaluation Assurance Levels (EAL) PR/SM LPAR with EAL 5+ z/vm 6.4 with EAL 4+ 11

12 Virtualize IBM z/vm 6.4 Support more virtual servers than any other platform in a single footprint Integrated OpenStack support IBM Wave for z/vm A graphical interface tool that simplifies the management and administration of z/vm and Linux environments KVM Hypervisor alternative especially for Linux on IBM z Systems Differentiation Standardize OpenStack Cloud Management Dashboard A simple, entry level cloud management stack Based on OpenStack Can be run from z System environment ( managed-from ) Advanced Cloud VMware vrealize Automation Hybrid Cloud New! IBM Bluemix and z Systems API Management & z/os Connect New! API Connect DevOps IBM Cloud Orchestrator Builds on functionality of OpenStack and adds runbook automation and middleware pattern support for workload deployment System z support as managed-to Formerly known as SmartCloud Orchestrator Service Lifecycle Management IBM UrbanCode Deploy with Patterns is a full-stack environment management and deployment solution that enables users to design, deploy and update full-stack environments to multiple clouds IBM UrbanCode Deploy automates the deployment of applications, databases and configurations into development, test and production environments, helping to drive down cost, speed time to market with reduced risk. 12

13 DevOps is a philosophy, a cultural shift operations with development and demands a that merges linked toolchain of technologies to facilitate collaborative change. (Gartner)

14 Where Dev came from Time? User feedback? 14

15 Q2 Who is doing it?

16 Companies that mastered DevOps Created in 1994, 75 Billions$ in2013 Average time between deployments: 11.6s Max deployment in one hour: 1079 Average host machines number: Bought OneOps for accelerating App Deployment Adopt Open Source technologies Deploy OpenStack cores for their private cloud 16

17 Q3 Why DevOps requires Speed and Agility?

18 Because of them! The Uber syndrome where a competitor with a completely different business model enters your industry and flattens you. Judy Lemke, CIO, Schneider, United States 18 54% In the next 3-5 years, of CxOs expect challenges from competitors outside their industry. 18

19 19 Most enterprises need multiple DevOps patterns Accelerate Innovation Think Code Deliver Run iv Systems of engagement Coordinating different teams working at different speeds Production API Catalog Digital Applications Balancing between agility and stability Systems of Record Enterprise Applications Operational Excellence Think Code Deliver Run iv Shared Services Production DevOps for Hybrid Cloud supports multi-speed IT 19

20 Workload styles vary, but not release methodology Traditional IT Cloud-Enabled Applications + Web Servers Applications + App Servers Cloud-Native + Database Web Servers Services Applications Services + App Servers Database Managed Runtimes 20

21 The classic story Back-end Teams Operations responsibilities IT buying Installation of server hardware and OS Configuration of servers, networks, storage, etc Monitoring of servers Respond to outages IT security Managing phone systems, network Change control Backup and disaster recovery planning Manage active directory Asset tracking I can t keep up with your insane demands! Shared Development & Operations duties Software deployments Application support Development Team Why do you slow me down? 21

22 DevOps tools periodic table Source: 22

23 Most used tools for DevOps Code-driven approach gives you more control and flexibility over your configurations It has the most mature interface and runs on nearly every OS SSH-based, so it doesn t require installing any agents on remote nodes. 23

24 Example using Ansible on Linux z System 1. Provision a Linux Virtual machine from your openstack cloud dashboard to create the ansible server. 2. Build Ansible. Instructions here: &cm_mc_sid_ = Generate ssh-keys for the ansible server: ssh-keygen -t rsa -N "" 4. Provision two others linux guests (targeta and targetb) and copy the ssh keys to this guest using : ssh-copy-id userid@targetipadress 5. Create an inventory file : vi /etc/ansible/hosts and add the following lines ([test servers] defines a logical group) : 1. [test-servers] 2. TargetAipadress 3. [database-servers] 4. targetbipadress 6. Check all targets are responding (remember to exchange the ssh keys) with: 1. ansible -m ping GroupName or 2. ansible -m ping -all 7. Check you can execute remote commands with : 1. ansible -m command -a "df -h" all 24

25 Create and use an Ansible Playbook Ansible playbooks are written in the YAML data serialization format. Th file is space sensitive, do not use tabs. Create the following example : http.yml file --- hosts: droplets tasks: - name: Installs http web server yum: name=httpd state=latest notify: - start http handlers: - name: start http service: name=httpd state=started (in /etc/ansible/playbooks for example) Mandatory for YAML interpretation Plays are basically groups of tasks. The «-» means a list item A set of tasks to execute Options use by Ansible : ansible -m apt -a 'whatever' all Reference to handlers Handlers definition. A handler ca nonly run when a task tells so. (a state changed on the client side) Run your playbook : ansible-playbook http.yml 25

26 Q4 What s the IBM answer to DevOps?

27 World-class tooling and the broadest catalog of composable services DevOps Productivity + Runtimes Hybrid Containers Data Services Mobile Microservices + NEW The Best The Broadest The Most Choices Tools Catalog for Delivery Model DevOps Services 27

28 Timing is critical Today s apps must keep up with the speed of the app revolution. Infrastructure as a Service Benefits Customer Managed Service Provider Managed Most control in the cloud. Necessary for some solutions Infrastructure managed by SP. Code Data Runtime Middleware OS Virtualization Time Commitment Minutes to provision VM. Time to configure software and apps varies. Maintenance/upgrades of OS, middleware, runtime. Servers Storage Networking Time to initial deployment IBM SoftLayer Core IT ~ Weeks ~ Days ~ Minutes 28

29 Timing is critical Today s apps must keep up with the speed of the app Platform revolution. as a Service Customer Managed Service Provider Managed Code Data Runtime Middleware OS Virtualization Benefits Setup environments and deploy apps very quickly. Infrastructure and platform managed by Service Provider. Time Commitment Minutes to setup and deploy. Focus on your apps and their data. Servers Storage Networking Time to initial deployment Core IT ~ Weeks IBM Bluemix IaaS ~ Days ~ Minutes 29

30 IBM Cloud Delivery Models Public Shared public cloud services managed by IBM, hosted in an IBM datacenter Platform Services Bluemix Dedicated Local Self Managed Private cloud services managed by IBM, hosted in an IBM datacenter Private cloud services managed by IBM and hosted in a client data center Private cloud infrastructure managed by IT in a client data center Bluemix Bluemix Infrastructure Services IBM z System Client Data Center Off-Premises Cloud On-Premises Cloud IBM Corporation

31 IBM Bluemix Garage Method & DevOps Open Tool Chain Strategy Rapidly setup and manage an integrated toolchain following DevOps best practices Open ToolChain Optimize ly Google Analytics Coremetric s TeaLeaf Track & Plan Rational Team Concert Jazz SCM GitHub Issues GitHu b Web IDE Pingdom Autoscalin Logmet g IBM Alert Notification Uptime Hipchat Integrations to IBM Bluemix Services and IBM Cloud Marketplace Partners and other 3rd party Services Monitoring and Analytics & IBM Performance Hub Globalizati on Pipeline Mobile Quality Assurance Canary Advisor Delivery Pipeline Active Deploy Jenkins UrbanCode Deploy 31

32 How quickly can you get an idea to production? Typical delivery pipeline challenges: Stovepipe portfolio plans with little project feedback Development Document driven waterfall development practices SCM Collaborative Development and Continuous Integration Scheduled deliveries, manual integrations and periodic builds are resource intensive Build Package Repo Backlog of errors and integration challenges in SIT and QA Deploy Deployment and provisioning processes produce inconsistent environments inducing errors Test Little to no feedback from monitoring and instrumentation into development Stage Production Continuous Delivery Shift Left Test Shift Left Ops IBM Corporation 33

33 How quickly can you get an idea to production? Development SCM Build Package Repo Deploy Test Stage Production IBM Corporation 34

34 IBM UrbanCode Deploy

35 UrbanCode Deploy: Anywhere to Anywhere IBM Corporation 36

36 UrbanCode Deploy Blueprints as an answer to Multi-speed IT IBM Corporation 37

37 AWAP Application Live Demo A Cognitve Applicaton to demonstrate LinuxONE Systems & Linux z Systems capabilities «AWAP Branch-Use Case» : 'Cloud with OpenStack on IBM LinuxONE System' + «Manual demonstraton» Hybrid Cloud Services using Docker in IBM BLuemix IBM Corporation 38

38 Working with Hybrid Cloud Services IBM Bluemix Workspace «dev» Bluemix Service : IBM Watson Conversation Service Interface: Conversation Tooling + REST APIs IBM Bluemix Workspace «Engage_Linux» Bluemix Services : Docker containers Integration Service (Secure Gw) Interface: Node.js application (awap) IBM Bluemix organisation «My IBM id» Use Case: Deployment of Node.js application in a Docker container in IBM Bluemix. Deploying Cloud Service on IBM LinuxONE System Virtual Machines Linux (Redhat, SUSE, Ubuntu, ClefOS,.) Custom Provisioning On-Prem. AWAP Secure Gateway client OpenAudel Node.js Application Linux Ubuntu Openstack Services Service catalog Cloud Manager Appliance VMware VRealize Automation z/vm 6.4 on IBM LinuxONE System ESX on x86 IBM Corporation 39

39 Improve your IT lifecycle with IBM s Hybrid Cloud Portfolio Provide self-service access to environment provisioning Workload planning and placement assistance Visibility & management across multiple providers Marketplace Provider Management Management Orchestrate configuration changes across all data center (or cloud) components Control changes with custom approval workflows Service Delivery Billing across Legacy Management and Cloud Pattern Deploy patterns for IBM and non-ibm software IBM Cloud Orchestrator Orchestration Orchestration Dev Dev Pattern QA QA Pattern Prod Prod Open Patterns Adopt hybrid cloud with integrated systems, existing hardware (on-premise), or cloud (off-premise) Automated Deployment Automate, version, and audit application changes across the development pipeline Optimize continuous delivery throughput 2015 IBM Corporation Page 42 by automating infrastructure in the cloud Inventory Application changes Components UrbanCode Deploy Composite Application

40 Take away DevOps efficiency is proven Ops need to delegate more power to Dev Dev needs to understand Ops constraints IBM Bluemix is the innovative platform Open by design IBM UrbanCode with Bluemix for managing the continuous deployment on an Hybrid Cloud To get started: IBM Bluemix Garage and Design Studio

41 Website: ibm.com/ibm/clientcenter/montpellier/ Follow us! YouTube: IBM Client Center Montpellier Pinterest: ibm-client-center-montpellier IBM connections: w3-connections.ibm.com/communities/community/ibmccmpl 2016 IBM Corporation Page 44

42 Questions Captured Questions 45