LinuxCon Japan 2014 OpenPOWER Technical Overview. Jeff Scheel Chief Engineer Linux on Power May 21, IBM Corporation

Transcription

1 LinuxCon Japan 2014 OpenPOWER Technical Overview Jeff Scheel Chief Engineer Linux on Power May 21, 2014

2 Agenda 1. OpenPOWER Foundation Overview 2. OpenPOWER Hardware Technologies 3. OpenPOWER System Software Architecture 2

3 OpenPOWER Foundation Overview

4 Industry trends The number of companies designing & building servers is increasing Traditionally there have been few companies designing systems: HP, IBM, SUN, Dell, etc. Today there are many more: Google, Microsoft, Facebook, Rackspace, Huawei, Sugon, Inspur, etc. A fairly mature ecosystem including the Taiwanese ODMs is a key enabler of this trend Numerous disruptive forces are impacting these custom system designs and driving designers to consider new ways of innovating Ability to handle rapid growth in Big Data & Analytics based solutions Choice and Innovation CPU SOC integration drive need for chip development These trends create a need for a server targeted chip-systemsoftware ecosystem IBM has technology and a software stack ready to meet these needs IBM recognizes the need to work with partners to create this ecosystem IBM recognizes the need for choice and options in processor sourcing 4 OpenPOWER Foundation 2014

5 OpenPOWER Foundation Structure OpenPOWER is an industry foundation based on the POWER architecture, enabling an Open community for development and opportunity for member differentiation and growth 5 OpenPOWER Foundation 2014

6 OpenPOWER drives industry innovation The goal of the OpenPOWER Foundation is to create an open ecosystem, using the POWER Architecture to share expertise, investment, and server-class intellectual property to serve the evolving needs of customers. Opening the architecture to give the industry the ability to innovate across the full Hardware and Software stack Simplify system design with alternative architecture Includes SOC design, Bus Specifications, Reference Designs, FW OS and Open Source Hypervisor Little Endian Linux to ease the migration of software to POWER Driving an expansion of enterprise class Hardware and Software stack for the data center Building a complete ecosystem to provide customers with the flexibility to build servers best suited to the Power architecture 6 OpenPOWER Foundation 2014

7 Building collaboration and innovation at all levels System/Software/Services I/O, Storage, Acceleration Boards/Systems Chip/SOC Welcoming new members in all areas of the ecosystem 100+ inquiries and numerous active dialogues underway 7 OpenPOWER Foundation 2014

8 Proposed Work Groups and Projects Work Group System Software (Open Source) Projects Linux LE KVM Firmware Participants Public Public Public OpenPOWER FW interface Application Software (Open Source) POWER LE ABI Public System Operating Environment Public OpenPOWER Software ecosystem enablement Toolchain Open Server Development Platform Power 8 Developer Board Member POWER 8 Reference Design Member Hardware Architecture OpenPOWER profile of architecture Member Compliance 8 Public Power8 ISA Book 1, 2, 3 Coherent Accelerator Interface Architecture (CAIA) Member Compliance Member OpenPOWER Foundation 2014

9 OpenPOWER Innovation Roadmap Domain Participants Chip design ISA Standard Products/ SOCs IBM, Suzhou Power Corp Systems CM/ODM/OEM models Tyan, Servergy, Inspur, ZTE, ChuangHe,IBM, Hitachi Memory Processor - Memory Interface optimizations Hynix, Micron, Samsung I/O Network Optimization - RDMA Performance - tightly coupled NIC-processor Mellanox Storage Optimization Fusion I/O Tightly coupled custom FPGA accelerators Xilinx, Altera Enterprise & HPC Workloads NVIDIA Cloud Optimized Firmware Stack & LE Linux Google, Canonical, IBM Acceleration Software 9 Project OpenPOWER Foundation 2014

10 OpenPOWER System Software Overview Draft charter proposes working group to be stewards, incubators, and drivers (when feasible) of system software enablement for OpenPOWER Foundation hardware Open to any members of the foundation Key workgroup products include: OpenPOWER Foundation web presence Creation of new open source communities Complete open source software stack from firmware to system management software Documentation of key community interfaces including LE ABI, firmware specifications, and virtualization APIs Jointly works with HW Architecture and Compliance workgroups to: Define and manage the POWER ISA Ensure compliance to software interfaces Implement/exploit new technology such as CAPI 10 OpenPOWER Foundation 2014

11 OpenPOWER Hardware Technologies

12 POWER8 Processor Technology 22nm SOI, edram, 15 ML 650mm2 Cores 12 cores (SMT8) 8 dispatch, 10 issue, 16 exec pipe 2X internal data flows/queues Enhanced prefetching 64K data cache, 32K instruction cache The Register: the Power8 is so clearly engineered for midrange and enterprise systems for running applications on a giant shared memory space, backed by lots of cores and threads. Power8 does not belong in a smartphone unless you want one the size of a shoebox that weighs 20 pounds. But it most certainly does belong in a badass server, and Power8 is by far one of the most elegant chips that Big Blue has ever created, based on the initial specs. Accelerators Crypto & memory expansion Transactional Memory VMM assist Data Move / VM Mobility Caches 512 KB SRAM L2 / core 96 MB edram shared L3 Up to 128 MB edram L4 (off-chip) 12 ComputerWorld: To make the chip faster, IBM has turned to a more advanced manufacturing process, increased the clock speed and added more cache memory, but perhaps the biggest change heralded by the Power8 cannot be found in the specifications. After years of restricting Power processors to its servers, IBM is throwing open the gates and will be licensing Power8 to third-party chip and component makers. Energy Management On-chip Power Management Micro-controller Integrated Per-core VRM Critical Path Monitors Bus Interfaces Durable open memory attach interface Memory Integrated PCIe Gen3 Up to 230 GB/s SMP Interconnect sustained bandwidth CAPI (Coherent Accelerator Processor Interface) Source: Hotchips presentation PCWorld: With Power8, IBM has more than doubled the sustained memory bandwidth from the Power7 and Power7+, to 230 GB/s, as well as I/O speed, to 48 GB/s. Put another way, Watson s ability to look up and respond to information has more than doubled as well. Microprocessor report: Called Power8, the new chip delivers impressive numbers, doubling the performance of its already powerful predecessor, Power7+. Oracle currently leads in server-processor performance, but IBM s new chip will crush those records. The Power8 specs are mind boggling. OpenPOWER Foundation 2014

13 POWER8 CAPI Coherent Accelerator Processor Interface (CAPI) Virtual Addressing Accelerator can work with same memory addresses that the processors use Pointers de-referenced same as the host application Removes OS & device driver overhead Hardware Managed Cache Coherence Enables the accelerator to participate in Locks as a normal thread Lowers Latency over IO communication model Custom Hardware Application POWER8 Coherence Bus CAPP PCIe Gen 3 Transport for encapsulated messages PSL FPGA or ASIC POWER8 Processor Service Layer (PSL) Present robust, durable interfaces to applications Offload complexity / content from CAPP Customizable Hardware Application Accelerator Specific system SW, middleware, or user application Written to durable interface provided by PSL 13 OpenPOWER Foundation 2014

14 Coherent Accelerator Processor Interface (CAPI) Overview CAPI FPGA IBM Supplied POWER Service Layer Function n Function 2 PCIe Function 1 Function 0 CAPP POWER8 Processor Typical I/O Model Flow DD Call Copy or Pin Source Data MMIO Notify Accelerator Acceleration Poll / Int Completion Copy or Unpin Result Data Ret. From DD Completion Flow with a Coherent Model Shared Mem. Notify Accelerator 14 Acceleration Shared Memory Completion

15 Example: Innovative In-Memory NoSQL/KVS Integrated Solution - via POWER8 CAPI-attached Flash Today s NoSQL in memory (x86) WWW Differentiated NoSQL (POWER8 + CAPI Flash) 10Gb Uplink Load Balancer WWW 500GB Cache Node 500GB Cache Node 500GB Cache Node 500GB Cache Node 500GB Cache Node 500GB Cache Node 10Gb Uplink POWER8 Server Flash Array w/ up to 40TB Backup Node Infrastructure Attributes - Infrastructure Requirements Large Distributed (Scale out) - Large Memory per node Networking Bandwidth Needs - Load Balancing 192 threads in 4U Server drawer 40 TB of memory based Flash per 4U Drawer - Shared Memory & Cache for dynamic tuning - Elimination of I/O and Network Overhead - Cluster solution in a box 5X Cost Reduction with equivalent performance Power CAPI-attached Flash model for NoSQL offers dramatic (24:1) density advantage 15

16 New IBM Power Systems based on POWER8 Power Systems S824 Power Systems S822 Power Systems 2-socket, 2U S822L Power Systems All Operating Systems 2-socket, 2U S812L Linux Only 16 1-socket, 2U Linux Only Power Systems S824L Power Systems 2-socket, 4U S814 Linux Only 1-socket, 4U All Operating Systems 2-socket, 4U All Operating Systems SOD ockets S 2 & 1

17 Non-IBM POWER8 products The Tyan reference (ATX) board, SP010, measures 12 by 9.6 one single-chip module (SCM) four DDR3 memory slots four 6 Gb/sec SATA peripheral connectors two USB 3.0 ports two Gigabit Ethernet network interfaces keyboard and video intended for developers The Google reference board two single-chip module (SCM) four modified SATA ports Google use only 17

18 OpenPOWER System Software Architecture

19 Software OpenPOWER Proposed Ecosystem Enablement Power Open Source Software Stack Components Cloud Existing Software Open Standard Operating Source XCAT Environment Software (System Mgmt) Communitie s Operating System / KVM Firmware OpenPOWER Firmware Hardware OpenPOWER Technology New OSS Community Multiple Options to Design with POWER Technology Within OpenPOWER Industry IP License Model CAPP CAPI over PCIe Standard POWER Products Framework to Integrate System IP on Chip PCIe Hardware POWER8 Customizable Custom POWER SoC Future OpenPOWER Foundation 2014

20 KVM and OpenStack enable defacto APIs for integration Standard interfaces Openstack controller services Host OS Qemu VM1 Linux VM2 Linux Browser Or Client Openstack compute node components Linux Userspace Project Kimchi Libvirt API & virsh CLI VM3 Linux Console Shell CLI Linux Kernel xcat Chef Puppet Custom scripts KVM OpenPOWER FW Power8 Platform Service Processor IPMI Note: ovirt has been enabled in version 3.4 for Linux on Power. 20

21 Integrating POWER into a datacenter In general Bring base components in parity with KVM on x86 KVM should be KVM Co-exists peacefully with other end-points, whenever makes sense. Enables hybrid clouds with common management environments OpenStack Custom Scripts Manage Platform Management - Custom management - Cloud based Provision Deploy Procure 21 xcat Puppet Chef Custom Scripts PXE IPMI H/W Management - Custom scripting - Heavily Automated - Open technologies

22 OpenPOWER Enables Hybrid Cloud OpenPOWER software commonality Linux to provide commonality for: Operating system management Operating system feature Application programming model Little Endian to provide source code and data commonality KVM to provide virtualization management and feature commonality Firmware interfaces to provide platform management commonality Migrating software to OpenPOWER Software written in interpreted languages (Javascript, PHP, Perl, Python, Ruby, Java, etc.) Generally, no work is required. Software written in compiled languages (C/C++, Fortran, etc.) Generally, this requires just a simple recompile for POWER. Rarely, dependencies on specific behaviors can require source code modification: Multi-threaded applications that don t use standard synchronization models and depend upon specific memory ordering behavior (unusual) Applications that depend upon specific memory page sizes (rare) 22 OpenPOWER Foundation 2014

23 POWER8 supports little endian data access, like x86 POWER8 processors support execution in both big endian (BE) and little endian mode (LE) Today's POWER operating systems run the processors in BE mode Linux, AIX, and IBM i Most compiled open source software is designed (defacto) to run in little endian mode. Linux on Power has chosen to exploit little endian (LE) processor mode based on OpenPOWER partner feedback. 23 Eases the migration of applications from Linux on x86. Enables simple data migration from Linux on x86. Simplifies data sharing (interoperability) with Linux on x86. Improves Power I/O offerings with modern I/O adapters and devices, e.g. GPUs. Creating LE OS for Linux on Power means creating a whole new operating system platform (ppc64le). LE distributions for Linux on Power does NOT mean x86 applications magically run: applications must still be compiled for Power. BE and LE are simply different ways of ordering of how data is stored. Important in Not as important in Market has moved.

24 Wrap-up

25 Where to find more information? 25

26 Summary: 1.The OpenPOWER Foundation provides a framework for open innovation on hardware and software 2.The system software structure embraces many key open source technologies KVM, OpenStack, and other 3.Opportunities abound for hardware innovation with the POWER8 processor as a foundation Q&A 26