QLOGIC SRIOV Fuel Plugin Documentation

Transcription

1 QLOGIC SRIOV Fuel Plugin Documentation Release QLOGIC Jul 19, 2016

2 CONTENTS 1 Overview of the QLogic SRIOV Fuel Plugin Software Prerequisites Hardware Prerequisites Limitations Install QLogic SRIOV Fuel Plugin 3 3 Configure QLOGIC SRIOV Fuel Plugin To configure MOS enviornment: To configure qlogic sriov fuel plugin: User Guide 8 5 Troubleshooting notes 9 6 Verification 10 i

3 CHAPTER ONE OVERVIEW OF THE QLOGIC SRIOV FUEL PLUGIN The fuel qlogic sriov plugin provides functionality to configure SRIOV on QLOGIC 3400/8400 series NICs with Scripts and Metadata. The SRIOV specification details how a single PCI Express (PCIe) device can be shared between various guest operating systems the VMs. Devices with SRIOV support multiple virtual functions (VFs) on top of the physical function. VFs are enabled in hardware as a lightweight PCIe function that can be directly assigned to a VM without hypervisor mediation. These VFs operate in the context of a VM, and must be associated with a physical function (PF); that is, full-featured PCIe function that operates in the context of the hypervisor or parent partition. SRIOV provides direct VM connectivity and isolation across VMs. It allows the data to bypass the software virtual switch (vswitch) and provides near-native performance. The benefits to deploying hardware-based SRIOV- enabled NICs include reduction of CPU and memory usage compared to vswitches. Moving the network virtualization into hardware (SRIOV adapters) relieves the performance problems associated with vswitches. By directing VM I/O directly to VFs and bypassing the hypervisor, the vswitches are no longer part of the data path. In addition, it significantly increases the number of virtual networking functions for a single physical server. To configure QLOGIC SRIOV : Host Server should be enable with VT-d/SRIOV enable in BIOS Settings for compute nodes. QLogic 3400/8400 series NIC Adapter should support SRIOV, To enable SRIOV on the adapter, use the pre-boot configuration interface (CTRL+S), the QCS CLI, or the QCS GUI. Fuel-qlogic-sriov-plugin will create No. VF on the compute nodes as per user inputs for SRIOV enabled NIC. 1.1 Software Prerequisites To use the qlogic sriov fuel plugin, verify that your environment meets the following prerequisites: Prerequisites Version/Comment Fuel 7.0 or Hardware Prerequisites Install QLogic 3400/8400 series 10Gbps NIC Adapter in server system. Make sure Host Server and QLogic NIC 3400/8400 series adapter are enabled with SRIOV support. If not, For Host Server to enable with SRIOV, Refer troubleshooting section, for adapter press CTRL+S during QLogic NIC BIOS banner and configure with SRIOV enabled. Link up adapter with 10Gbps supported switch and make sure Adapter link shows up. 1

4 QLOGIC SRIOV Fuel Plugin Documentation, Release Limitations The fuel qlogic sriov plugin has some known issues/limitations : The Fuel plugin is only compatible with OpenStack environments deployed with Neutron using OVS + VLAN. It will configure SRIOV on single interface ( should not be Storage and Management Network) whichever is discovered first with Link Up. QLogic NIC 3400/8400 series adapter are not able to set the quality of service (QoS) bandwidth limit on SRIOV VFs. The SRIOV IP network interface does not receive the DHCP IP address while creating the VM. Therefore, you must assign the IP address for the SRIOV interface manually. When an MOS maintenance update is applied, you must run the update_controller.sh script manually to make sure ml2_sriov_agent.ini file is added a part of the neutron_server.conf file, and then restart the neutron-server service can be run from Fuel master node for controller nodes. # fuel node node xx,yy tasks fuel-plugin-qlogic-update-neutron-startup-sh 1.3. Limitations 2

5 CHAPTER TWO INSTALL QLOGIC SRIOV FUEL PLUGIN Before you install qlogic sriov fuel plugin, verify that your environment meets the software/hardware prerequisite criteria as mention in Overview. You must have the Fuel Master node installed and configured before you can install the plugin. Typically, you install a Fuel plugin before you deploy an OpenStack environment. To install qlogic sriov fuel plugin: 1. Download fuel-plugin-qlogic-sriov noarch.rpm from the Fuel Plugins Catalog. 2. Copy the plugin fuel-plugin-qlogic-sriov noarch.rpm package to the Fuel Master node: # scp fuel-plugin-qlogic-sriov noarch.rpm root@fuel-master:/tmp 3. Log into Fuel Master node CLI as root. 4. Install the plugin by typing: # fuel plugins --install fuel-plugin-qlogic-sriov noarch.rpm 5. Verify that the plugin is installed correctly: # fuel plugins id name version package_version fuel-plugin-qlogic-sriov

6 CHAPTER THREE CONFIGURE QLOGIC SRIOV FUEL PLUGIN Configuring the qlogic sriov fuel plugin involves following steps. The qlogic sriov fuel plugin must be installed correctly at Fuel master nodes. 3.1 To configure MOS enviornment: Create an OpenStack environment as described in the Fuel User Guide: Number of Minimum nodes require: 1 Controller/1 Compute Hypervisor: KVM Networking Segmentation type: Neutron VLAN To Configure MOS: 1. Select Name and Release. Specify the OpenStack Name and release (Liberty on Ubuntu 14.04), and then click Next. 2. Select Compute Select QEMU-KMU to use QEMU as the hypervisor with capability of KVM acceleration, and then click Next. 4

7 QLOGIC SRIOV Fuel Plugin Documentation, Release Select Networking Setup. Select ML2 Plugin with Neutron and Neutron with VLAN segmentation, and then click Next. 4. Select Storage Backends. Under Block Storage, select LVM, and then click Next To configure MOS enviornment: 5

8 QLOGIC SRIOV Fuel Plugin Documentation, Release Once environment get deployed, go to Networks tab and configure Public, Storage, Management, Neutron L2, Neutron L3 configuration. 6. For MOS 8.0, go to Settings Tab, and the click Compute. Under Hypervisor Type, select KVM and check Resume guests state on host boot. 7. Go to Nodes tab, and assign Controller and Compute nodes as per requirement and do interface configuration for each node. 3.2 To configure qlogic sriov fuel plugin: 1. For MOS 7.0, go to settings tab -> Qlogic openstack Fuel plugin for SRIOV Configuration for plugin configuration 3.2. To configure qlogic sriov fuel plugin: 6

9 QLOGIC SRIOV Fuel Plugin Documentation, Release For MOS 8.0, go to settings tab -> Other, under Qlogic openstack Fuel plugin for SRIOV Configuration 3. Enable SRIOV for Qlogic NX2 10G Ethernet. 4. Specify the number of VFs. 5. Enable VLAN for SRIOV VF with Start and End Range. (Make sure this VLAN range is supported at switch level connected ports). 6. The system will create SRIOV VFs on QLogic 3400/8400 adapter single interface, whichever is discovered first. 7. Perform a network verification check and confirm that it passes To configure qlogic sriov fuel plugin: 7

10 CHAPTER FOUR USER GUIDE Use the CLI to create an instance with SRIOV ports. 1. Go to the Controller Node. 2. Create an SRIOV network with flat or vlan configuration as per settings in the Fuel plugin # neutron net-create --provider:physical_network=qphysnet --provider:network_ type=flat sriov or # neutron net-create --provider:physical_network=qphysnet --provider:network_ type=vlan sriov 3. Create an SRIOV subnet network. # neutron subnet-create sriov /24 --name sriov-subnet --dns-nameserver gateway Create an SRIOV port with binding as vnic_type:direct. # neutron port-create <sriov nw net id> --name P1 --binding:vnic_type direct 5. Create a VM with an SRIOV port. # nova boot --flavor m1.medium --image <image_id> --nic port-id=<p1 id> VM1 8

11 CHAPTER FIVE TROUBLESHOOTING NOTES Please verify network configuration before deploying environment. Please verify network verification test should pass. To confirm that SRIOV is enabled on the compute server hardware BIOS configuration (Advance option). Open the system BIOS and inspect the Processor Settings and the Integrated Devices. Under Processor Settings, ensure that virtualization Technology is enabled. Under Integrated Devices, ensure that SR-IOV GLOBAL ENABLE is enabled. To make sure SRIOV VFs have been created on compute nodes correctly, use the ip link show command as shown: After creating a VM, if you cannot ping between the SR-IOV VFs, examine the related neutron and nova logs. For further information you can check the relevant logs: /var/log/docker-logs/astute/astute.log (fuel-master) /var/log/messages (target nodes) /var/log/neutron/openvswitch-agent.log (target nodes) /var/log/neutron/neutron-*.log for dhcp,l3,metadata,sriov agents. (target nodes) /var/log/nova/nova-*.log (target nodes) 9

12 CHAPTER SIX VERIFICATION Create two VMs (VM1 and VM2) with different ports using the procedure as described in USER GUIDE. Log into VM1 and assign static IP Address to the SR-IOV port using ifconfig command. # ifconfig <ethx> Log into VM2 and assign static IP Address to the SR-IOV port using ifconfig command. # ifconfig <ethx> Run Traffic between VM1 and VM2 and it should work fine. 10