Road to Private Cloud mit OpenStack Projekterfahrungen Andreas Kress Enterprise Architect Oracle Sales Consulting DOAG Regio Nürnberg/Franken 20. April 2017
Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle s products remains at the sole discretion of Oracle. Copyright 2016, Oracle and/or its affiliates. All rights reserved. DOAG Regio Nürnberg/Franken 3
OpenStack Short Introduction 4
Cloud Computing: State of the Enterprise What s Driving Enterprises to Cloud Systems? Cloud Benefits IT Consumers Agility through self-service automation On-demand provides OpEx vs. CapEx options Cloud Benefits IT Providers Better capacity planning and asset utilization Centralized monitoring and reporting Manage IT as a collection of provided services Not surprising: Many Enterprises have, or are looking to either deploy new clouds, or shift to cloud based management for existing infrastructure 5
OpenStack Overview What is OpenStack? Open source cloud software Generic solution for IaaS, PaaS and SaaS Modular architecture Web portal for cloud admins and self-service users Cloud services exposed through APIs CLI, Python libraries,... Combines compute, network and storage resources Self-service dashboard Services exposed through REST APIs Single Management Pane VM VM VM Virtualized Data Center Resources 6
OpenStack in Action 7
OpenStack in Action 8
Drivers for OpenStack Cloud Infrastructure What s exciting customers about OpenStack? Broad Industry Adoption and Participation in the Community Over 400 companies involved! Rich technology Ecosystem Provides choice / freedom to leverage underlying, Storage, Networking Infrastructure Standardized Cloud API layer Abstracts higher level Cloud Software & Services from Undercloud infrastructure specifics 9
OpenStack Use Cases Heterogeneous IaaS Consolidate Oracle Solaris and SPARC in existing OpenStack cloud Oracle Solaris Zones Based SPARC and x86 Centralized management 10
What OpenStack is not Out-of-the-Box Ready to Use Lots of work to configure underlying infrastructure Overall Integration Lots of moving parts Dependent on expertise, experience, vendors, maturing technology Mature Aggressive release cycle; short support lifespan Update capability is limited, often rip and replace However, it is improving Free OpenSource does not mean free Large investment to set up and support environment 11
OpenStack Services Overview of Core Components Component Description Nova virtualization Cinder Block storage Neutron Software defined networking Keystone Authentication between cloud services Glance Image management and deployment Horizon Web based dashboard Swift Object storage Heat OpenStack Orchestration 12
OpenStack Logical Architecture with Service Names Horizon Neutron Nova Glance Swift Cinder Keystone 13
OpenStack Basic Picture Horizon Cloud Management Nova Virtualization Neutron Cloud Networking Cinder/Swift Cloud Storage Glance Image Deployment 14
Agenda 1 2 3 4 Motivation Road to the Cloud Technical Architecture Solution Design Challenges Exemplary Project Plan Lessons Learned A 15
Motivation Multiple Cloud Strategy Reduce Deployment Time and Efforts Enable Self-Service Standardization and Reduce of Complexity Provisioning of Multiple Heterogenous Clouds One Management Tool for Multiple Clouds Unified Application Deployment Model Reduce Costs A 16
Further Requirements Standardize API Interfaces Complete. Pre-Assembled. Preconfigured. Vendor Certified and Guaranteed Interoperability One Support Contract for all Components Secure by Default Isolated Cloud with Dedicated Secured Entry Points Optimized for Oracle Workload A 17
Target Design Private Cloud Vision DBaaS Example Create, Clone/ Snap, Terminate Future Option Public/ Hybrid Cloud Self-Provision Database Service Private Cloud Converged Infrastructure Cost Allocation & Chargeback Monitor Dedicated Cloud for Oracle DBaaS A 18
Private Clouds with Oracle OpenStack Engineered Systems Standardized Cloud Mgmt SW Common API DIY Infrastructure Best-of-Breed DIY Infrastructure DIY Cloud Mgmt SW DIY API Ready-Made Stack Purpose-Built System Best Performance 19
Road to the Cloud Planning the Cloud (Architecture) Designing the HW Infrastructure Orchestration HA-/DR-Konzept Performance Other Challenges and more 20
Use Cases User Access Cloud Networking Flat Networking Ressource Assignment - Example: Storage Shared Storage Local Storage (Segregation) Workload Type Data Driven (High IOPS Demand) e.g. Database Intensive (High CPU Demand) e.g. HPC Transactional Workload (High Memory Demand) - e.g. Application Server 21
Converged Cloud Architecture Cloud Networking with Shared Storage Public Network Network Cloud Network Storage Network Shared Storage D 22
OpenStack Network Converged Cloud Architecture Cloud Networking with Shared Storage Public Network Network and Cloud Controller Cloud Network OpenStack Controller Storage Network Utilities Controller Shared Storage 23
Converged Cloud Architecture Cloud Networking with Shared Storage Public Network Network Cloud Network Storage Network Shared Storage 24
Flat Cloud Architecture Flat Networking with Shared Storage Public Public and Cloud Network Network Cloud Network Storage Network Shared Storage D 25
Flat Cloud Architecture Flat Networking with Local Storage Public and Cloud Network Storage Network Shared Storage D 26
Road to the Cloud Planning the Cloud (Architecture) Designing the HW Infrastructure Orchestration HA-/DR-Konzept Performance Other Challenges and more A 27
Converged Infrastructure Source: https://en.wikipedia.org/wiki/converged_infrastructure Grouping Multiple Information Technology Components One Single, Optimized Computing Package Components may include Networking Equipment Data-Storage Devices Servers IT Infrastructure Management Automation Orchestration A 28
CCI Infrastructure with Oracle Design Decisions 40 Server SPARC Server x86 Server Operating System Oracle Solaris Oracle Linux 30 Network 10 GbE Infiniband 20 10 Cloud Mgnt Package Storage DAS NAS SAN Patch Panel Patch Panel Patch Panel Patch Panel A 29
OpenStack Network Public & Cloud NW CCI Infrastructure Logical View Flat Cloud Architecture Public and Cloud Network Cloud Mgnt Pack Mgnt s s VM VM... Storage NW CCI Rack Storage Shared s Storage * System Management Network not shown A 30
Private Cloud Appliance Integrated Hardware Accelerates Time to Value Infrastructure Scalable from 2-25 nodes Up to 19.2TB aggregate memory drives VM density Optimized for Oracle Applications Supports any Linux, Oracle Solaris and Windows applications Network Infrastructure High speed low latency networking between all components Fully configured fabric networking, no setup required Integrates with existing Ethernet and Storage networks Management Infrastructure Pre-configured, redundant management servers Oracle VM templates downloadable ZFS storage system for Management Storage s Fabric Interconnect Ethernet Switch Infiniband Expansion Infiniband Expansion Fabric Interconnect s Management s Management Storage Networking Management 31
Multi-Rack Scaling Expansion with Identical Racks Expansion with and Storage Racks Network Network Network Network Network Storage Storage Storage Storage Storage Storage Rack 4 Rack 2 Base Rack 3 Base Rack Expansion Expansion Rack Storage Expansion 32
Design Considerations Make it Secure and Easy to Maintain Build a Cloud with Oracle Solaris OpenStack Fully Supported, Enterprise Ready Software Stack Optimized for Oracle Database Workload Lock-Down the Cloud Public Network Access Restricted to OpenStack Instances Separated Access to Infrastructure Components and Control Logic (The Undercloud) Virtualize the Workload. Virtualize the Control Logic Power the Infrastructure and the Workloads with Solaris Zones D 33
OpenStack Logical Architecture A Short Recap Horizon Neutron Nova Glance Swift Cinder Keystone D 34
Oracle OpenStack for Oracle Solaris Havana (11.2), Juno (11.2 SRU10), Kilo (11.3 SRU9) Ironic Bare Metal Deployment SPARC/x86 Horizon Cloud Management Heat Orchestration Unified Archives Nova Virtualization Neutron Cloud Networking Cinder/Swift Cloud Storage Glance Image Deployment Zones & Kernel Zones Elastic Virtual Switch ZFS File System Unified Archives 35
Road to the Cloud Planning the Cloud (Architecture) Designing the HW Infrastructure Orchestration HA-/DR-Konzept Performance Other Challenges and more D 36
Orchestration of an Oracle Solaris OpenStack Cloud Creating a Replicable Setup Automate the "Undercloud" Infrastructure Creation (AI) Automate and Standardize the "Undercloud" (= OpenStack) Configuration Enable Cloud LifeCycyle Management with Boot Environments (BE) Setup and Configure the Cloud in Minutes not Days D 37
Road to the Cloud Planning the Cloud (Architecture) Designing the HW Infrastructure Orchestration HA-/DR-Concepts HA-/DR-Konzept Cloud Control Pane Application A 38
High Availabilty of the Undercloud Make the Infrastructure High Available Failover Cluster Clustered Services Solaris Kernel Zones Failover Zones with Oracle Solaris Cluster OpenStack Controller Utilities Controller Management Failover Cluster Failover Cluster Oracle Solaris Cluster OpenStack Controller Utilities Controller Management Scalable Services Distributed Services Solaris Kernel Zones Client Driven Service Selection OpenStack Controller Utilities Controller Management Loadbalancer OpenStack Controller Utilities Controller Management A 39
High Availabilty of the Application Make the Service High Available Run Multiple Independent Clouds Example: Oracle Database Replication via Oracle Active Data Guard DB Prod Cloud Primary Data Center Data Guard DB DR Cloud Failover Data Center Traffic Manager Example: Oracle Weblogic Weblogic internal Cluster Functionality Web Web Web Web Web Web Primary Data Center Replication Failover Data Center A 40
Road to the Cloud Planning the Cloud (Architecture) Designing the HW Infrastructure Orchestration HA-/DR-Concepts Performance Performance Network Access Concept Other Storage Challenges Access Concept and more D 41
Performance Aspects of Cloud Architectures Cloud Network Access Cloud Networking Flat Networking D 42
Performance Aspects of Cloud Architectures Cloud Storage Access Shared Storage Local Storage D 43
Further Performance Aspects Networking and Storage Network Virtualization VxLAN or Tagged VLAN Virtualization Type for Guests Non-Global Zones, Kernel Zones, LDoms Storage Considerations iscsi or NFS Shared Storage Access DIY or Buy Storage D 44
Road to the Cloud Planning the Cloud (Architecture) Designing the HW Infrastructure Orchestration HA-/DR-Concepts Performance Further Challenges to Consider D 45
Exemplary Project Plan Learning Learning Learning Learning PoC Test/Dev PreProd Production Schedule Depends on: Knowledge Level: Customer, Vendor, Partner Target Design (Technology) Level of Corporate IT Maturity Commitment and Engagement of the Users Ability to Adapt Changes 46
Lessons Learned Start with a Clear Vision Establish a Team Project Sponsor, Customer (IT Dept & Users), Vendor and Partner Proof of Concept Matters Check what Really Works and Constantly Rethink and Rework Concepts Match Expectations, Requirements and Cloud Features The Road to Cloud is more than just Creating the Cloud Infrastructure Creating Images, Defining Flavors/Shapes, Software Deployment "Cloudifying" Internal Processes Engage and Convince the Prospective Users Early Teamwork 47
Backup Slides 48
Private Cloud: Deploy with Engineered Systems Apps/Middlewar e Storage Network Servers Management SW Integrated Platform Systems (Exadata, Exalogic, Exalytics) High-Performance Middleware, Database, Apps Integrated Infrastructure Systems (Private Cloud Appliance) General-Purpose Distributed Workloads Integrated Server/Storage/Network/Management Single Vendor Sale and Support Single SKU/Complete System/Support 49
Private Cloud Appliance Integrated Hardware Accelerates Time to Value Infrastructure Scalable from 2-25 nodes Up to 19.2TB aggregate memory drives VM density Optimized for Oracle Applications Supports any Linux, Oracle Solaris and Windows applications Network Infrastructure High speed low latency networking between all components Fully configured fabric networking, no setup required Integrates with existing Ethernet and Storage networks Management Infrastructure Pre-configured, redundant management servers Oracle VM templates downloadable ZFS storage system for Management Storage s Fabric Interconnect Ethernet Switch Infiniband Expansion Infiniband Expansion Fabric Interconnect s Management s Management Storage Networking Management 50
Elastic Infrastructure for Multi-Tenancy Integrated Software Defined Networking Wire Once Infrastructure Connect any VM dynamically to any IO resource Prewired for simplicity, add compute nodes on demand Dynamically create up to 8 networks per Tenant-Group Increased Flexibility Deploy and grow applications as your needs change Create isolated groups for applications Improve app to app communication Software Defined Network Software Upgradable System Appliance features added as SW, no HW changes needed System managed as a single resource to patch and upgrade 51
Private Cloud Appliance Orchestration s Enterprise Manager Cloud management (self service, metering and chargeback, etc.) for one or multiple PCAs Hardware resource management Database, middleware, apps management Software management, configuration and compliance management Plugin with Oracle VM Manager for full stack management Fabric Interconnect Ethernet Switch Infiniband Expansion Infiniband Expansion Fabric Interconnect Networking OVM Manager VM and hypervisor (Xen) resource management VM network / storage configuration s Management s Management Storage Management Dual, redundant PCA management nodes with automatic failover PCA Controller Orchestrated Hardware Bringup Inserts all servers in an Oracle VM Manager server pool Configures external networking (set IP address, etc.) Performs periodic back-up of Private Cloud Appliance Copyright 2016, Oracle and/or its affiliates. All rights reserved. DOAG Regio Nürnberg/Franken 52
53