State of OpenShift on Bare Metal

Transcription

1 State of OpenShift on Bare Metal OpenShift Commons Gathering - Seattle Jose Palafox, Technical Program Manager for CNCF, Intel Jeremy Eder, Senior Principal Performance Engineer, Red Hat Dave Cain, Senior Architect, Red Hat December 10th, 2018

2 Agenda 1. Background and why 2. Futures and where we re going 3. Coming soon in OpenShift 4. What you can consume today 2

3 Background Bare Metal Cloud Market $26.21 billion by 2025; CAGR: ~40% AWS, IBM, Oracle, and other cloud providers offering BM Driven by demand for performance and latency sensitive applications that take advantage of low-level hardware features

4 Growing interest and adoption Majority of Containers and Kubernetes environments run on/in VMs OpenStack, AWS/Azure/Google, vsphere OpenShift on bare metal interest growing, driven by multiple factors Reducing VM sprawl and cost (software/infra expense) Application workload & performance requirements driven (accelerators) Device Manager 4

5 Intel and Hardware Accelerators Deep Learning Multi use FPGA and Smart NIC FPGAs QuickAssist for TLS and Compression offload Discrete GPU 5

6 Futures and where we re going 6

7 Hardware Accelerated Services Expose Accelerator or Data Center Device to Kubernetes Identify target use use cases Create provisioning and management tools Enable Developer Self Service 7

8 End to End Enablement Service Catalog Publish Optimized Service Catalog Extension Deployment Engine Create service broker for on premise services Templating/Deployment/ Upgrades/Policy and Sizing Drive community standardization around Redis Operator Optimized workload Kubernetes OS Differentiated Hardware or CSP IaaS Modify Redis Upstream to use Persistent Memory Expose Persistent Memory to the scheduler via CSI-Driver Ensure Persistent Memory is exposed to the Kernel in RHEL and RHEL Variants Create Optane for DC and Ensure OxM Support 8

9 End to End Enablement Templating/Deployment/ Upgrades/Policy and Sizing Optimized workload Kubernetes OS Differentiated Hardware or CSP IaaS Build community around hardware accelerated TLS offload with Istio and Envoy Modify Envoy to use Intel QAT Expose Intel QAT via Intel QAT Device Plugin Ensure resource Isolation and allocation via OS Create Intel QuickAssist Technology Current PR: 9

10 Coming soon in OpenShift Container Platform 10

11 11

12 NFV So much overlap Coordinate, and plumb these generically Machine Learning HPC ISVs Big Data 12 FSI Animation

13 Use-cases for High Performance Networking Use-case/Vertical Separate Control/Data Fast Data Plane SR-IOV (no overlay) Kernel Bypass Telco/NFV Financial Services Maybe Video Streaming Maybe Software Defined Storage Maybe No KubeVirt Maybe Maybe Technology Availability Bare Metal AWS Azure GCE OpenStack VMware Separate Control/Data SR-IOV No (virtio only) Additional NICs Kernel Bypass Maybe No No 13

14 The Path to High Performance Networking Use-case debates in sig-network Work on multus v1 and v2 Weekly Intel+RH engineering meetings, shared Trello board for work on Multus Red Hat leads creation of NPWG CRD Spec STAC Benchmark for Stock Trading KubeCon 2017 end Multus 3.0 w/crd spec, CNI plugins and SR-IOV device plugin planned for integration with OpenShift SDN Network Operator in OpenShift 4.0 2H H 2018 OpenShift 4.0 Red Hat-led NPWG CRD Spec, approved Aug 18 sig-network begins multiple network discussions (Joji Document) Intel founds Multus project Intel + RH f2f on Multus development and road to inclusion in OpenShift Red Hat adds NPWG CRD Spec to Multus v3 Network Plumbing Working Group Kickoff KubeCon 2018 Booth demo ONS Amsterdam Demo 14

15 Intel + Red Hat Open Source Collaboration sig-node Resource Management Working Group Device Plugins, CPU Pinning, NUMA/Topology Node Feature Discovery sig-network Network Plumbing Working Group Multi-Network CRD Specification Multus (multiple networks) 15

16 What you can consume today 16

17 Intel / Red Hat Solution Goals A fully integrated container application platform (CaaS/PaaS) with enterprise grade Kubernetes and infrastructure management, simplified for on-premises deployment, management, and scale Capable of deployment in about an hour, with high availability and persistent storage, automated with Red Hat Ansible, and configured to be horizontally scalable to multiple racks Turnkey, easy to order solution (pre-loaded hardware and software), interconnected via a leaf-spine network topology Differentiation: A bare-metal on-premises solution purpose-built for dev-test use cases, optimized for high performance and durability, utilizing hardware infrastructure including Intel Xeon Scalable processors, Intel Solid State Drive (SSD) technology, and Intel Network Interface Cards (NICs) A fast method of releasing cloud-based, stateful (persistent) containerized applications to a target audience, providing customers with an enterprise grade solution 17

18 Solution Launch (December 2017) Reference Architecture (24 pages) Solution Brief (2 pages) 18

19 Solution Deployment Workflow New hardware, racked and wired 19

20 Solution Deployment Workflow Identify management node for the bastion 20

21 Solution Deployment Workflow Configure and provision bastion node, subscribe, and download ansible playbooks bastion 21

22 Solution Deployment Workflow Provision networking infrastructure bastion 22

23 Solution Deployment Workflow Baremetal server preparation with RHEL deployed bastion 23

24 Deployment Workflow Define OpenShift Nodes: Master, Infrastructure, Application, and Storage bastion Master Nodes Infrastructure Nodes Application Nodes 24

25 Deployment Workflow Launch openshift-ansible playbooks bastion Master Nodes Infrastructure Nodes Application Nodes 25

26 Deployment Workflow Deployed OpenShift Container Platform Management node bastion Master Nodes OpenShift Cluster Infrastructure Nodes Application Nodes 26

27 Deployment Workflow Deployed OpenShift Container Platform 27

28 Available Today Lenovo Reference Architecture: Cisco CVD Design Guide: Cisco CVD Deployment Guide: Dell EMC: 28

29 Drive Use Case Based Optimized Hardware Solutions Validated best known hardware configurations Available for build by OEM of choice Fully integrated with use case based benchmarks, deployment tooling, user guides, etc. 29

30 Thank you intel.com/redhat redhat.com/intel openshiftcommons.slack.com