3 years of OpenStack with Intel IT

Transcription

1 3 years of OpenStack with Intel IT Das Kamhout Principal Engineer, Cloud Greg Bunce Automation and Integration Lead Sridhar Mahankali Cloud Architect

2 100,000 Intel Employees changing traditional thinking 164 Intel Sites across 63 Countries 6,500 IT Employees inspire employees 59 IT sites globally 68 Data Centers service reliability 25% reduction with virtualization IT is business 150,000 Connected Systems 40,000 Handheld Devices Intel Con fidential

3 Intel Data Center Pro file Intel has five major groups currently driving individual data center requirements (DOMES): D Design Design Computing Supports chip design community O M E S Office General Purpose Manufacturing Enterprise Services Supports typical IT and customer services Supports fabrication and assembly Enterprise applications supporting e Business and ERP External facing applications

4 Cloud: Experience from our Design Computing Grid IT Learnings Abstracted the hardware Abstracted the location Service management Service provisioning Of floading Design Workloads to Virtual Linux* Clusters Data Center Virtualization 80% Utilization and an estimated $200M Value 59% 0.99M 63% 1.18M $0M $33M 70% 1.85M 78% 2.31M $25M H Source: Intel IT internal analysis. Savings from DCV expected to deliver net present value over 8 years. Intel IT white paper: Intel IT Data Center Solutions: Strategies to Improve Efficiency DOC Source. Intel IT white paper on projected Intel net present value. Realizing Data Center Savings with an Accelerated Server Refresh Strategy

5 Hosting Business Goals Velocity <1hr for VMs Velocity Idea to Production in <1 day Reduce Incidents Scheduled Downtimes the norm Sustain Operations Zero Downtime Always On for Apps/Services Grow with Flat Budget Increase in Engineer:Server and TB Ratio Increase Velocity, Zero Downtime, Grow with Flat Budget

6 Server Landing Process (before Q4 2010) Requestor/ Customer Account Manager (AM) MAS Technologist DIS IHS Customer enters Request in RADAR hosting.intel.com Review all Requests in HUM meeting. Assign server requests (Virtual & Dedicated) to SERVER AM 2009 Assign LUNs; Create cutsheet for VM Reassess Requirements Gather App and Server Requirements at Discovery Meeting with Customer; discuss EA/Costs Analyze Further and Design Solution Location (Customer, AM, Technologist Involvement) 90 days physical 24 days virtual Validate Capacity in SHERPA Capacity Mgmt Worksheet AM Updates Customer of Status Standard Request? No Yes No Solution Possible? Got Capacity? Enter forecast in SHERPA/CPS Forecasting Tool Yes Check Capacity Request Backup setup for VM if needed Create Engagement Agreement (EA) Sherpa/CPA Forecast Validate Configuration in SHERPA <3hrs virtual 2 weeks for networks IPRO Pick-up VM Requests Enter KCDB escalation info Notify Customer of Server Availability Physical or Virtual? Customer Accepts No Address Server Issues Implement EA Yes Server Request Fulfilled Related Decommission <30 minutes compute storage and network No Decommission Request Yes ADS Procureme nt Cutsheet IPRO Create IPRO Requests for Dedicated Server Landing Assign Existing or Purchase Server Pick-up Approved Dedicated Server Requests DC Operations Pickup/Create IPRO and/or Cutsheet Landing Request Assign to Site DC Ops Representative Request Network Addresses (Primary/Backup) Install OS Using Altiris Configure Backup NIC on all VMs Enroll VM in ISD Care Patching (Sat 8-2) Install Heartbeat Monitoring for the VM Next up Idea to Production Service in < 1 day Post Build Verification Grant User Permissions Close IPRO Ticket Notify AM

7 Private Cloud Economics Rent the Spike Performance Predictability Own the Base 7

8 Intel IT Cloud Strategic Direction Deliver the necessary changes in how we expose applications/data to improve end user productivity Drive the transformation to a large-scale automated Hybrid Cloud infrastructure Accelerate the transformation of the Enterprise IT industry to Cloud

9 9 History and Path to Open Cloud

10 Intel IT Cloud Quick History Design Grid since 1990 s 60k servers across 60+ datacenters Cloud s Uncle Enterprise Private Cloud k VMs across 10 datacenters 75% of Enterprise Server Requests 80% virtualized Open Source Private Cloud k VMs across 2 datacenters Running cloud-aware and some traditional apps

11 Vision: Federated, Interoperable, Open Hybrid Cloud Federated: IT manages one set of identities, authorizations, and set of security review processes. Users get seamless integration with systems and apps. Interoperable: Standard service orchestration and management, enabling elastic operation and flexibility, while minimizing lock-in. Open: Includes open source and open standards. Common APIs and abstraction layers to rapidly consume cloud services among providers. Public Cloud Service Provider Enterprise Private Cloud IaaS, PaaS, and/or Saas Public Cloud Service Provider App components will run across public and private clouds 11

12 Enterprise Adoption Roadmap - Path to Open Cloud Ecosystem Consumers End User App Dev App Owner IT Ops Legacy Applications on dedicated Infrastructure Start Year 1 Year 2 Year 3 Year 4 Year 5 Simple SaaS Enterprise Legacy Apps Simple Compute IaaS Compute, Storage, and Network Simple SaaS Cloud Aware Apps Enterprise Legacy Apps Complex Compute IaaS Simple Compute IaaS Compute, Storage, and Network Complex SaaS Cloud Aware Apps Legacy Apps Private PaaS Full Private IaaS Hybrid SaaS Cloud Aware Apps Legacy Apps Hybrid PaaS Hybrid IaaS Federated, Interoperable, and Open Cloud

13 Intel IT Pre-OpenStack Private Cloud Gen 1 Consumers End User App Dev App Owner IT Ops Legacy Applications on dedicated Infrastructure Start Year 1 Year 2 Enterprise Legacy Apps Simple Compute IaaS Compute, Storage, and Network Cloud Aware Apps Enterprise Legacy Apps Complex Compute IaaS Simple Compute IaaS Compute, Storage, and Network Provides Self-Service to App Teams Connect to ALL available infrastructure $14M savings through resource pooling Internal Code for logic/gui But Cloud-aware app teams needed more Too much technical debt to create full IaaS

14 Intel IT Post-OpenStack Private Cloud Gen2 Consumers End User App Dev App Owner IT Ops Legacy Applications on dedicated Infrastructure Start Year 1 Year 2 Year 3 Enterprise Legacy Apps Simple Compute IaaS Compute, Storage, and Network Cloud Aware Apps Enterprise Legacy Apps Complex Compute IaaS Simple Compute IaaS Compute, Storage, and Network Cloud Aware Apps Legacy Apps Private PaaS Full Private IaaS 2011 investigated all open and proprietary solutions Analysis led to decision: OpenStack for Private IaaS June 2012 online for production cloud-aware apps But Need a public cloud solution Legacy apps need love too

15 Intel IT OpenStack Hybrid Cloud and the future Consumers End User App Dev App Owner IT Ops Legacy Applications on dedicated Infrastructure Start Year 3 Year 4 Year 5 Cloud Aware Apps Legacy Apps Private PaaS Full Private IaaS Cloud Aware Apps Legacy Apps Private PaaS Hybrid IaaS Federated, Interoperable, and Open Cloud Live Migration Enabled Single Control Plane 2 POCs for Hybrid OpenStack in progress Very close to our year 5 goal

16 Our Choices and Architectural Implementation 16

17 Key Concepts Abstract users from underlying Cloud providers while exposing key HW features Support multiple cloud providers, both private and public Common identity and entitlement services for reuse across interfaces Open Source first, minimize proprietary API lock-in Minimize internal technical debt, be part of the community to scale Stay pragmatic, as we expand not always 100% greenfield Support cloud-aware and traditional apps

18 Technical Strategy (AS IS) On Premise Internal Network App Owner/ Developer PaaS & DBaaS IaaS Firewall Exclave PaaS & DBaaS IaaS Started in 2010 Use our own capacity before paying an external provider Intel IT at Service Provider size Use public cloud for speci fic purpose (SaaS, some IaaS) Public Clouds

19 Technical Strategy (TO BE) On Premise Internal Network Exclave App Owner/ Developer Orchestration PaaS & DBaaS IaaS Smart orchestration layer Move apps/data among clouds via policies Deliver security, capacity and cost optimization Firewall Burst Public Clouds

20 Why Intel IT Selected OpenStack for its IaaS Control Plane Velocity: Yields direct control over the capabilities that business demands and is forwardleaning in terms of application / service development, delivery, and operations Geared toward Agile Methodologies, DevOps, and Continuous Integration / Continuous Delivery (CI/CD) & Deployment Capability: OpenStack automation platform which is de fined by its APIs Provide granular on-demand services which seed innovation by satisfying simpleto-complex use cases to deliver at the pace business demands Ef ficiency & Quality: We leverage the same tool-chain used by the OpenStack community for developing, building, validating, and deploying our data center operating system 20

21 Phase Open Stack Control Plane manages Mixed Infrastructure 2. Absorbing all existing VM Lifecycle management Active Directory Self-Serve and Admin UI GUI CLI API Heat Ceilometer Open Stack Control Plane Keystone Auth Nova Cinder Swift Neutron Service Management Existing Infrastructure SDN SN/NAS Hypervisor A Managed Infrastructure Open Source HW/SW Stack (KVM, Ceph) 10 Internal Data Centers 2 External Data Centers All VMs controlled by OpenStack

22 Areas to Close for Enterprise Keep VMs up for traditional/legacy apps: 1. Shared Block Storage for boot volumes, and data 2. Live Migration for maintenance of hosts working in some implementations 3. Restart of instances when host fails 4. Disaster Recovery 5. Connect to Infrastructure where this already works Enable a federated Hybrid cloud environment: 1. End users interface allowing for seamless use across zones, regions, and across clouds 2. Identity federated across instances and clouds 3. Orchestration across global/multiple instances Highly Available Infrastructure Services (cloud built as cloud) Rolling Upgrades initial improvements in Icehouse Secure, Auditable Role Based Access, Regulatory Compliance, Audit Trails

23 Items for 2013 Completion Compute Always on VMs - Boot From Volume (Block) þ Live Migration þ Restart on Failure API Endpoint Encryption (SSL for all API communication) þ Highly Available % APIs Storage Object Storage Proxy Highly Available þ Harden open distributed block storage solution Networking Self-Service Network Services þ SDN Network Integration þ Load Balancer as a Service (temp internal only solution in place) Support Enterprise and Cloud Aware Workloads Transforming entire Datacenter to Software Exposed

24 2014 Focus Areas Rolling Upgrades no tenant downtime for resources or services Connection into ALL existing infrastructure Single Control Plane Disaster Recovery between sites for VM tenants Restart of VM when host fails Hybrid Cloud enabled through Horizon Use OpenStack to do traditional work Backup and Recovery, Bare Metal Provisioning, LB, FW, and more Use OpenStack to replace internal code DBaaS, LBaaS 24

25 25 People

26 Simplify Integrate and Collaborate Specialists/Silo s HW Centric 38 Roles 66% SW Centric 13 Roles Creativity Development Software Automation Operations Physical Infrastructure Procedure Dev Ops 26

27 Major Workforce Shifts Training IT Sysadmins retrained for CLI and Scripting fundamentals All developers put into the ops fire take tickets, root cause, and learn hands on Key technologies taught broadly; OpenStack *, Linux *, Python * Scope From Technical Depth to Technical Breadth Sysadmins understand and can solve issues in compute, storage, network and tenant operations/tasks DevOps as the working model Small team of experts Automate everything vs. Knowledge Base articles IT shifts away from being the STOP sign bearers Broad changes to skills and methods

28 28 Change or become Irrelevant

29 Intel IT Open Cloud: Result Agility Automation Ef ficiency 29

30 Are you involved? Join us on Wednesday at 2pm in Room B407 For the Enterprise BoF Kick-Off Hear more from Intel IT at 5:20pm on Wednesday in B312 Help us create blueprints Go Community!!!!

31 Wrap Up - Summary Our Direction = Federated, Interoperable and Open Cloud Strong success with our Enterprise Private Cloud (Gen1) Open Cloud (Gen2) in production Connecting our existing infrastructure to single control plane (OpenStack) Lots of space and opportunity for us all to contribute Changes required to run cloud at scale Culture Skills Business processes Technology

32 32