Software Architecture for Next- Generation Multicore Processors Built on Layerscape Architecture

Transcription

1 Software Architecture for Next- Generation Multicore Processors Built on Layerscape Architecture FTF-SDS-F0253 Rob Oshana Director, Software R&D, Digital Networking APR.2014 TM External Use

2 Agenda Overview of Digital Networking software Software development kit (SDK) architecture Layerscape software concepts Virtualization Open source software development model External Use 1

3 Digital Networking Software Strategy Best-in-Class Multicore Software and Debug Solution Invest Development Tools Stacks VortiQa Apps APIs/Libraries OSs Schedulers Drivers/BSPs/HAL Partner Key Software Acquisitions & Investments 1999: Metrowerks 2002: AMC, Lineo 2003: Freescale Professional Services 2005: Seaway Networks 2008: Intoto 2009: MQX Runtime Platform 2010: Processor Expert, Chipwerks 2013: Launch Digital Networking Services Multicore Silicon Comm Processors and DSP + Open Ecosystem of Partners Investment in silicon optimized software IP across our Multicore portfolio Over 1000 in-house software resources Run-time technologies Application and Platform Stand-alone base tools built around standard platforms In-house resources & IP plus Partners provide open choices for vertical solutions and tools Optimized solutions, reference designs and greater application performance Peace of mind that software IP will not be locked in Freescale Professional Services where needed External Use 2

4 Overview: Software and Solutions for Networking Investment in R&D, emerging technologies, acquisitions Several production-ready solutions Professional services for time to market Over 700 software experts in networking domain Touchpad Appliance Professional Services NSSG Mobile Notebook GPS Home Entertainment Production Ready Networking Software Software teams: > 700 SW engineers VortiQa R&D, Development, Acquisitions and Partnerships External Use 3

5 Software & Solutions: Freescale s Value Proposition Comprehensive Solutions for many market segments SDK, Tools, Middleware, Acceleration SW for rapid development Reference solutions for time to market Production ready software for emerging technologies Services and support from experts Digital Networking Software Solutions Silicon (QorIQ, LS) Enablement SW / Middleware / Acceleration Kits Freescale Application Software Reference Solution and Open Source Software and Ecosystem support Freescale Application Software Software Support & Professional services Reference Solutions Enterprise Tools Cloud and Data Center Wireless & Service Provider Enablement Software Development Tools SDK Middleware Acceleration Kits Freescale QorIQ and Layerscape Silicon External Use 4

6 Freescale Track Record with ARM i.mx Application Processors Your Interface to the World. Kinetis Microcontrollers Design Potential. Realized Vybrid Controller Solutions Rich Apps in Real Time. QorIQ Processors built on Layerscape Architecture Accelerating the Network s IQ Tools Code Warrior, GNU, 3 rd Party ARM Compiler Technology Custom/Segment ARM Tooling Eclipse: Processor Expert, DDR Tuner, JTAG/COP, etc Operating System Linux, Android, Ubuntu Founding Member of Linaro, Linux Foundation, Kronos, Continua Windows Embedded RTOS: MQX, QNX, FreeRTOS 3 rd Party Mentor, Wind River, Greenhills, QNX, IAR, Kiel, Adobe, Bquare Enablement: NetComm Tool Suite, PEG GUI, RTOS, etc Freescale has the industry s broadest range of solutions built on ARM technology for automotive, industrial, consumer and in the future networking applications 2001 Scalable Industry Standard Solutions, Software and Development Ecosystem 2013 External Use 5

7 Software Development Kit (SDK) Architecture External Use 6

8 Next Generation Multi-core Platform: Layerscape 4 Turn Key Software Linux SMP, KVM, Fast Path Module, Eclipse Tools CPU 64b CPU 64b 3 Task Scheduler 2 CPU 64b CPU 64b C-prog Accelerated Packet Processor Security Engine CPU 64b Load Balance Engine Ethernet 100/40/10/1G CPU 64b Pattern Match Engine SERDES DSP Switching & TM DSP Reassembly Table Look Up PCI- Express Ease of Use (EoU) Facilities CPU 64b DSP 1 1- Core Agnostic (ARM, Power Arch) ARM V8 Product Roadmap Small / Large footprints 2- Scalable Acceleration Elements Sized to Application Needs Turn key or C-programmable Wire rate I/O switching & TM 3- Ease of Use Real Time Monitoring / Debug SW Management utility I/O virtualization 4- Turn-key Software Fast path modules Linux / BSP Hypervisor: KVM Eclipse-based Tools Layerscape: Networking 64b Multicore SoC Platform a) Industry standard Tools & C-programmability b) Abstracts I/O and Acceleration c) Turn-key / Production-quality SW External Use 7

9 OS Apps & Tools OpenWRT RT-test ip, tc, iptables, ifconfig Network Stack RT Security Ethernet Str-swan dns,dhcpd httpd, ftpd smbd Linux Middleware Filesystem PM Virtu/KVM/Contnrs Kernel Drivers PEX SATA Customer Apps Reference Software Frameworks Linux System call (API) USB Scheduler memory, timers, threads SRIO VFIO TDM, IFC, UART, SPI, SDHC, I2C, DIU, I2S Low Level Drivers GPP Customer App OF Sw IPSec NAT GRO/G Resource Manage Base SW Foundation Libraries Network Drivers Dev Kit - Open-Source - Upstream NW Object + LS-Bus API - Std features & performance NW Objects NI / NIC L2-Sw AI Aggr DP-I/O WRIOP QM/BM SEC PME DCE Customer Customer Customer Customer VortiQa Common Control/Data-Path Common API Control/Data-Path /NADK API API /NADK API External Use 8 Customer Application Packages - Highly optimized for key application & HW - Licensable & customizable - More features and performance Customer App SO CAPWAP Customer App IPfwd QoS MAC E-OAM OF ACL VPLS Switch Load NAPT PDCP Balnce Common APIs - Controls network components sync-i/o timers interfaces mem/buffers (NADK) -DPDK compliant Rsrc Mgmt LS Bus Controller DPAA Init Customer App Accelerator Drivers Rsrc Mgmt Layerscape DPAA blocks VortiQa App Mgmt Complex NW Svcs NW I/O IFP ctlu Portals WRIOP QM/BM SEC PME DCE AIOP MACs FQs Pools Network Components - Highly optimized middleware - Either on GPP or AIOP -Customer can stitch together OF Sw IPSec NAT GRO/G Acc I/O SO CAPWAP AIOP NW App Dev Kit - Common services, drivers - API for advanced features & performance tuning. NF Infra Service Layer API C Runtime Entry-pts Utils Abstract Network Objects - Simple NW devices - Central Rsrc Mgmt - Bus assign/discover IPfwd MAC ACL VPLS Load Balnce Init/Shut Debug Events QoS E-OAM PDCP.. Service Layer Service Layer - Common services, drivers - Abstraction of programming environment Layerscape HW - Powerful, Flexible - Complex, distributed

10 Base Software Development Kit OS Apps & Tools OpenWRT RT-test ip, tc, iptables, ifconfig Str-swan bind, dhcpd httpd, ftpd smbd Customer Apps Targeted for General SW development (a.k.a. everyone) May include NW Applications Everything is upstream No deviations Network Stack Linux Middleware Filesystem RT KVM PM Security Ethernet Linux System call (API) Kernel Drivers PEX SATA USB TDM, IFC, UART, SPI, SDHC, I2C, DIU, I2S Foundation Libraries Scheduler memory, timers, threads SRIO VFIO Don't invest in middleware Don t force HW features into middleware framework (QoS, LAG) Don t add new middleware (e.g. ASF) Optimize within bounds of middleware Invest in drivers Ensure F-Lib compliance Ensure middleware compliance Evaluate and migrate non-compliances to user-space e.g. ASF, L2-switch External Use 9

11 Layerscape Software Concepts External Use 10

12 Isolated interconnect Layerscape offers efficient, isolated, high-functionality interconnect between separate control / management planes, data plane, the services / functions, and physical network. This offloads pure SW-based interconnect. Augmented virtual switching and network virtual functions Shared network access available to applications/containers via virtual network interfaces Bump-in-the-wire offloads available as inline accelerated offloads on switch ports (VNIs) Fully virtualized access to datapath offloads container* container* DP 3 rd party or Cisco 3 rd party or Cisco vnic vnic vnic Function iface Function vnic iface Host stack Linux * Container may be Linux containers or some other form of VM. vnic rfs VPN NAT/fw Accel tun Virtual L2+ Ethernet Switch Hardware tun eth External Use 11 eth

13 Accelerators in Network Virtual Functions New functions may be items such as IDS/IPS that could benefit from accelerators because they are decoupled from IOS functionality and are less monolithic. Layerscape provides virtualized and isolated access to accelerators: SEC, PME, DCE. container* container* DP 3 rd party or Cisco 3 rd party or Cisco Function Function vnic vnic vnic iface vnic iface Host stack Linux * Container may be Linux containers or some other form of VM. vnic vnet vnet vnet VEB Virtual L2+ Ethernet Switch Hardware rfs Accel eth External Use 12 eth

14 Layerscape I/O Virtualization / Resource Management Layerscape Object Abstraction Std User Space Application Application driver skt Container Application driver net stack Application skt KVM Guest Application driver skt net stack driver Management Complex: Layerscape objects abstract the hardware as these NIC driver NIC Host Kernel NIC NIC NIC L2 Switch Packet Engine (AIOP) Accelerators BMan QMan Packet Express Buffer Network WRIOP MAC MAC MAC MAC Hardware based virtual switching and NICs via LS Objects: SW mediated encapsulations of HW resources for a specific task. Network External Use 13

15 Mgmt Complex-- Objects Formed from HW Resources L2 Switch Example WRIOP L2 Sw Assist QMan BMan IFP MAC port TLU Addr Learn SW portal channel FQ shaper WQ Bpool Cong Note L2 Switch Runtime View Management Complex and Framework Objects Initial object Set API object discover Boot time API object create destroy GPPs API API API API API object Manage Mgmt Complex API object use Mgmt Complex composes complex atom resources into easier objects that abstract underlying HW. AIOPs API object use External Use 14

16 Standard Linux Includes Virtualization Std User Space Application Application driver skt Container Application driver Application skt KVM Guest Application driver skt net stack driver HW devices can be directly accessed by containers, VMs, and processes not just the host kernel. It means load/store to device, use DMAs, etc. driver net stack Host Kernel Increased performance via host kernel bypass. Hardware Virtualization support in standard Linux KVM Containers Access isolation Performance isolation (via name spaces, cgroups, etc) Direct assignment of devices for performance To containers To KVM guests To standard user space processes Isolation via IO-MMU External Use 15 Emerging in standard embedded Linux, an area of Freescale strength

17 Programming Layerscape GPPs run OS like Linux and are, programmable in C and many other languages Freescale provide the LS objects and many APIs AIOP is programmed in C. Freescale provides ready-to-use software, but it is open. GPP - Runs conventional OS - Freescale and OS-provides APIs - Drivers use LS objects NIC NIC Cmd Object NIC AIOP Application AIOP Service Layer C-Programmable AIOP has many built-in accelerators such as for table lookups, ordering and atomicity, timers, frame and context presentation, statistics, etc. Accelerators accessed via simple synchronous API calls. Service layer is like the OS layer, but the AIOP s scheduler is in hardware. It does not run a conventional OS. Network External Use 16

18 Packet Processor (AIOP) may be used in three ways 1. Can be a resource used to create a Layerscape object. Entirely transparent to GPP software; AIOP owned by management complex Example: Advanced NIC AIOP is black box. 2. Vortiqa-Datapath Applications Kit product GPP sees AIOP as an engine running a specific offload image. GPP has control API for the image AIOP and GPP have network interfaces (via LS objects) AIOP is white box. Software is ready-to-use, but customers have access. 3. Program via service layer and using objects AIOP is open Customer provides AIOP image, programming in C above the service Layer. External Use 17

19 Layerscape Packet Processing Modules Package Name Principal Data Acceleration Kit Functions Routing IP FWD Firewall IPSEC QoS SDN/Openflow Openflow-DP VxLAN NVGRE Switch Supplement IP FWD Firewall IPSEC QoS BFD Eth-OAM Netflow sflow Wireless access IP FWD Firewall IPSEC QoS CAPWAP DTLS MACSEC External Use 18

20 Virtualization External Use 19

21 Freescale and ARMv8 Virtualization Technologies Virtualization technologies, including KVM and Linux Containers (LXC) will be fully supported on Freescale s Layerscape platforms. LAYERSCAPE Build in Hardware Virtualization Unique Freescale Network Architecture for Packet Offloading VFIO/IOMMU support by Linaro for device virtualization in emulated environments GICv3 next gen interupt controller. Support for message based interrupts and KVM. Linaro provides PMU support for measuring the performance of guest OSs SMMU support by ARM providing memory virtualization services in hardware reduces the software interventions needed, minimizing hypervisor overheads and ensuring system performance approaches the optimum. External Use 20

22 Freescale Software Virtualization Technologies Our strategy is to enable and offer standard Linux-based virtualization technologies across Power and ARM based SoCs with superior I/O capabilities KVM/QEMU LXC libvirt Linux External Use 21

23 Device Passthrough in KVM Device Passthrough-- assigns a physical I/O device to a virtual machine Freescale did substantial proof of concept work around device passthrough in In a new framework called vfio was proposed by Red Hat for doing device passthrough vfio-pci was accepted into upstream kernel in 3.6 Freescale is currently working on a vfio solution for doing this for platform/memorymapped devices USB QEMU currently supports passthrough of USB devices to VMs Note: currently all interrupts are mediated by the kernel External Use 23

24 Comparison of Processor Virtualization Capabilities ARM, Power, x68 architectures all support similar mechanisms to support virtualization. Capabilities ARM Power x86 3 rd privilege level Yes Yes Yes Extended Address space Yes Yes Yes Hardware guest physical address translation (2-stage) Yes Yes (LRAT) Yes (EPT/NPT) Direct guest interrupt management Yes Yes Yes (x2apic) IOMMU Yes (SMMU) Yes (PAMU) Yes (VT-d) External Use 24

25 Open Source Development External Use 25

26 Freescale 64 bit ARM migration No migration needed. Freescale QorIQ SDK based on platform independent opensource ecosystem. Software based on QorIQ SDK will implicitly support PowerPC 32/64 bit and ARM AArch32/64 bit platforms with a minimum of changes. Freescale is a Linaro member Freescale is a Yocto Project member Linaro is the place where engineers from the world's leading technology companies define the future of Linux on ARM. The company is a not-for-profit engineering organization with over 200 engineers working on consolidating and optimizing open source software for the ARM architecture, including the GCC toolchain, the Linux kernel, ARM power management, graphics and multimedia interfaces. Linaro is making toolchains and software images for AArch64 (the 64-bit execution state of ARMv8) available to interested developers. The Yocto Project is an open source collaboration project that provides templates, tools and methods to help you create custom Linux-based systems for embedded products regardless of the hardware architecture. It was founded in 2010 as a collaboration among many hardware manufacturers, open-source operating systems vendors, and electronics companies to bring some order to the chaos of embedded Linux development. Linaro and the Yocto Project are working closely to create full Linux distributions based on ARMv8. External Use 26

27 Freescale 64 bit ARM migration Migration is greatly simplified by leveraging all our ecosystem partners. Continually upstreaming and targeting SDK to latest upstream releases. Always capturing latest Linux features/support Yocto targets for ppc32, ppc64, ARMv7, ARMv8 Freescale PPC toolchains, Linaro ARM toolchains U-boot bootloader for powerpc and ARM. Freescale added ARMv8 support to U- boot. ARM 32 and 64 bit toolchains, ARMv8 Linux support, ARM technology support including SMMU, ARM- A53, ARM-A57, Device Trees, Timers, KVM (IOMMU, PMU, VFIO, Migration, GICv3), Kexec, PCIe, klib, kgdb, hugetblfs, endianness. Single release of multiple platform support for ARM and PPC targets, with FSL, Linux, Linaro, and Yocto content. PPC32 and 64 bit toolchains created by FSL, e6500, e5500, e500 32/64 bit SoCs, Soc device support and KVM all developed by FSL External Use 27

28 SDK Upstreaming Model Feature Content As content is upstreamed Feature Content Configuration Settings Repository / Branch / Patches Configurati on Settings QorIQ Features and NPIs Upstream Kernel IP Content (ex. ASF) IP Content (ex. DPAA) IP Content (ex. Private Optimizations) NPI Content (ex. LS2100 BSP) Additional Features QorIQ Kernel Feature Merge Feature Integration Performance Engineering External Use 28

29 SDK Development Flow Continually Upstreaming IP Develo pment NSSG Simulation and Virtual Machines Unit and Regression Testing IP Patches Upstream Repository IP Repository Feature Delivery (GERRIT) As content upstreamed, removed from IP repository backport uprev Yocto Layers and Recipes Systems Engineering Integration Test 5500 system tests 100 boards System Test External Repository Performance and Systems Integration External Use 29

30 Freescale Linux Software Development Kit Freescale Linux SDK is a complete Linux development environment (Linux distribution) Based on industry standard Yocto/Poky. Embedded-style (cross-compilation but native tools also provided) Source code provided Linux SDK main contents: GNU tools Package system Build System Kernel source Bootloader source Package sources Hypervisor package sources Freescale Network SW packages Generates Everything needed to boot and run Linux Bootloader image Kernel image Customizable file system Hypervisor images (optional) Freescale optimized package images (optional) External Use 30

31 Freescale Semiconductor, Inc. External Use