Introduction to PCI Express Positioning Information

Similar documents
BladeCenter HS21 XM Memory Configurations Positioning Information (withdrawn product)

Comparing the IBM eserver xseries 440 with the xseries 445 Positioning Information

Lenovo RAID Introduction Reference Information

2/4 Port Ethernet Expansion Card (CFFh) for IBM BladeCenter Product Guide

Cisco Systems 4 Gb 20-port and 10-port Fibre Channel Switch Modules for BladeCenter

Brocade 10Gb CNA for IBM System x (Withdrawn) Product Guide

IBM UPS5000 HV Uninterruptible Power Supply for IBM System x Product Guide

Broadcom 10Gb 2-Port and 4-Port Ethernet Expansion Cards (CFFh) for IBM BladeCenter (Withdrawn) Product Guide

IBM High IOPS Modular Adapters (Withdrawn) Product Guide

N2225 and N2226 SAS/SATA HBAs for System x Lenovo Press Product Guide

Intel Xeon Scalable Family Balanced Memory Configurations

IBM 1735 Rack-Based Local Console Switches (Withdrawn) Product Guide

Flex System EN port 10Gb Ethernet Adapter Product Guide

IBM High IOPS MLC Adapters Product Guide

ServeRAID C100 and C105 Product Guide

Flex System EN port 1Gb Ethernet Adapter Product Guide

Brocade 20-port 8Gb SAN Switch Modules for BladeCenter

Maximizing System x and ThinkServer Performance with a Balanced Memory Configuration

Lenovo LTO Generation 6 (LTO6) Internal SAS Tape Drive Product Guide

Broadcom NetXtreme Gigabit Ethernet Adapters Product Guide

Flex System FC port 8Gb FC Adapter Lenovo Press Product Guide

OSIG Change History Article

SAS 2.5-inch Hybrid Hard Drives for System x Product Guide

ServeRAID H1110 SAS/SATA Controller Product Guide

ServeRAID M5015 and M5014 SAS/SATA Controllers Product Guide

Lenovo 42U 1200mm Deep Racks Product Guide

1 UPDATING GCM16, GCM32 (1754D1X, 1754D2X) FIRMWARE

IBM BladeCenter Layer 2-7 Gigabit Ethernet Switch Module (Withdrawn) Product Guide

Lenovo exflash DDR3 Storage DIMMs Product Guide

Flex System FC5024D 4-port 16Gb FC Adapter Lenovo Press Product Guide

IBM RDX Removable Disk Backup Solution (Withdrawn) Product Guide

Lenovo Flex System EN Gb Ethernet Pass-thru Product Guide

Lenovo PM963 NVMe Enterprise Value PCIe SSDs Product Guide

Flex System FC port 16Gb FC Adapter Lenovo Press Product Guide

SATA 1.8-inch and 2.5-inch MLC Enterprise SSDs for System x Product Guide

Lenovo RDX USB 3.0 Disk Backup Solution Product Guide

Introduction to Windows Server 2016 Hyper-V Discrete Device Assignment

ServeRAID M5000 Series Performance Accelerator Key for System x Product Guide

Flex System IB port FDR InfiniBand Adapter Lenovo Press Product Guide

Intel I350 Gigabit Ethernet Adapters Product Guide

Implementing Disk Encryption on System x Servers with IBM Security Key Lifecycle Manager Solution Guide

Hardware Replacement Guide Lenovo 3000 J Series. Types 8453, 8454, 8455, 8458, 8459, 8460

Using Read Intensive SSDs with Lenovo Storage V Series and IBM Storwize for Lenovo

Understanding the Performance Benefits of MegaRAID FastPath with Lenovo Servers

Hardware Replacement Guide

Flex System FC port and FC port 16Gb FC Adapters Lenovo Press Product Guide

Lenovo PM1635a Enterprise Mainstream 12Gb SAS SSDs Product Guide

S3500 SATA MLC Enterprise Value SSDs for System x Product Guide

M910q. User Guide and Hardware Maintenance Manual. Overview. Computer locks. Specifications. Replacing FRUs. Replacing CRUs.

Lenovo Enterprise Capacity Solid State Drives Product Guide

SATA MLC Enterprise Value SSDs (Withdrawn) Product Guide

IBM 1U 17-inch and 19-inch Flat Panel Console Kits (Withdrawn) Product Guide

Lenovo XClarity Provisioning Manager User Guide

IBM Flex System FC port 16Gb FC Adapter Lenovo Product Guide

An Introduction to NIC Teaming with Lenovo Networking Switches

Hardware Replacement Guide Types 8099, 8116, 8155, 8156 Types 8157, 8158, 8159, 8160 Types 8215, 9210, 9211

Brocade Converged 10GbE Switch Module for BladeCenter Product Guide

Best practices. Starting and stopping IBM Platform Symphony Developer Edition on a two-host Microsoft Windows cluster. IBM Platform Symphony

ServeRAID-MR10i SAS/SATA Controller IBM System x at-a-glance guide

DS8880 High Performance Flash Enclosure Gen2

Flex System Storage Expansion Node Product Guide

ServeRAID-BR10il SAS/SATA Controller v2 for IBM System x IBM System x at-a-glance guide

2-Port 40 Gb InfiniBand Expansion Card (CFFh) for IBM BladeCenter IBM BladeCenter at-a-glance guide

Hub 500 User Guide and Hardware Maintenance Manual

Lenovo XClarity Essentials UpdateXpress User Guide

Lenovo PM863 Enterprise Entry SATA SSDs Product Guide

120 GB, 240 GB, 480 GB, and 800 GB SATA MLC Enterprise Value SSDs Product Guide

IBM FlashSystem V MTM 9846-AC3, 9848-AC3, 9846-AE2, 9848-AE2, F, F. Quick Start Guide IBM GI

ServeRAID F GB and 800GB SAS/SATA Controllers for IBM System x Product Guide

iscsi Configuration Manager Version 2.0

Best practices. Linux system tuning for heavilyloaded. IBM Platform Symphony

SAS Connectivity Card (CIOv) for IBM BladeCenter IBM Redbooks Product Guide

Best practices. Reducing concurrent SIM connection requests to SSM for Windows IBM Platform Symphony

Emulex 8Gb Fibre Channel Single-port and Dual-port HBAs for IBM System x IBM System x at-a-glance guide

IBM Flex System FC port 8Gb FC Adapter IBM Redbooks Product Guide

IBM 6 Gb Performance Optimized HBA IBM Redbooks Product Guide

Lenovo ThinkSystem RAID 930 Series Internal RAID Adapters Product Guide

IBM FlashSystem V Quick Start Guide IBM GI

QLogic 8200 Virtual Fabric Adapter Family Product Guide

ThinkCentre Hardware Installation and Replacement Guide. Machine Types 6062, 6065, 6071, 6076, 6089, 7103, 9011, 9014, 9071, 9089, 9162, 9182, 9303

CONFIGURING SSO FOR FILENET P8 DOCUMENTS

Broadcom NetXtreme 10 GbE SFP+ Network Adapter Family for System x Product Guide

DS8880 High-Performance Flash Enclosure Gen2

Flex System PCIe Expansion Node Product Guide

V520S. User Guide and Hardware Maintenance Manual. Specifications. Overview. Computer locks. Replacing CRUs. Replacing FRUs.

Installing Watson Content Analytics 3.5 Fix Pack 1 on WebSphere Application Server Network Deployment 8.5.5

M920q User Guide and Hardware Maintenance Manual

ServeRAID M1115 SAS/SATA Controller Product Guide

IBM LoadLeveler Version 5 Release 1. Documentation Update: IBM LoadLeveler Version 5 Release 1 IBM

IBM High IOPS SSD PCIe Adapters IBM System x at-a-glance guide

SAS MLC Enterprise SSDs for System x Product Guide

ServeRAID M1215 SAS/SATA Controller Product Guide

Lenovo ThinkSystem RAID 530 Series Internal RAID Adapters Product Guide

Broadcom NetXtreme Gigabit Ethernet Adapters IBM Redbooks Product Guide

N2225 and N2226 SAS/SATA HBAs for IBM System x IBM Redbooks Product Guide

Introduction to Spine-Leaf Networking Designs

M910s. User Guide and Hardware Maintenance Manual. Overview. Specifications. Computer locks. Replaceable parts. Replacing CRUs.

Solution Guide: Flex System Solution for Oracle RAC

M710s. User Guide and Hardware Maintenance Manual. Overview. Specifications. Locking the computer. Replacing hardware. Replacing CRUs.

Lenovo Flex System FC3171 8Gb SAN Switch and Passthru

Transcription:

Introduction to PCI Express Positioning Information Main PCI Express is the latest development in PCI to support adapters and devices. The technology is aimed at multiple market segments, meaning that it can be used to provide for connectivity for chip-to-chips, boardto-boards, and adapters. PCI Express uses a serial interface and allows for point-to-point interconnections between devices using directly wired interfaces between these connection points. This differs from previous PCI bus architectures that used a shared, parallel bus architecture. A single PCI Express serial link is a dual-simplex connection using two pairs of wires, one pair for transmit and one pair for receive, and can only transmit one bit per cycle. Although this sounds limiting, it can transmit at the extremely high speed of 2.5 Gbps, which equates to a burst mode of 320 MBps on a single connection. These two pairs of wires is called a lane. A PCI Express link may be comprised of multiple lanes. In such configurations, the connection is labeled as x1, x2, x4, x12, x16 or x32, where the number is effectively the number of lanes. So where PCI Express x1 would require 4 wires to connect, a x16 implementation would require 16 times that amount or 64 wires. This also results in differently sized slots. Tip: When you refer to the lane nomenclature, you use the word "by", as in "by eight" for x8. The figure below shows the slots for 32-bit PCI 2.0, PCI Express x1 and PCI Express x16. It is clear that the PCI Express x16 adapter will not physically fit in the PCI x1 slot. Figure: PCI 2.0 and PCI Express Edge Connectors Introduction to PCI Express 1

You can install PCI Express slots in larger slots but not smaller ones. For example, you can install a PCI Express x1 adapter into an x16 slot (but will still operate at the x1 speed), but you cannot insert an x16 adapter into an x1 slot. This compatibility is shown in the table below. Table: PCI Express slot compatibility x1 slot x4 slot x8 slot x16 slot x1 card Supported Supported Supported Supported x4 card No Supported Supported Supported x8 card No No Supported Supported x16 card No No No Supported While the underlying hardware technology is different between PCI-X and PCI Express, they remain compatible at the software layer. So it will support existing operating systems, drivers and BIOS without any changes. As they are compatible at the device driver model and software stacks PCI Express devices look just like PCI devices to software. One of the major benefits of PCI Express is that it is not limited to use as a connector for adapters. Due to its high speed and scalable bus widths, it can be used as a high speed interface to connect many different devices. PCI Express may be used to connect multiple onboard devices and provide a fabric that is capable of supporting USB 2, Infiniband, Gigabit Ethernet, and others. Performance PCI Express currently runs at 2.5 Gbps, or 200 MBps per lane in each direction, providing a total bandwidth of 80 Gbps in a 32-lane configuration, and up to 160 Gbps in a full duplex x32 configuration. Future frequency increases will scale up total bandwidth to the limits of copper (which is 12.5 Gbps per wire) and significantly beyond that via other media without impacting any layers above the physical layer in the protocol stack. The table below shows the throughput of PCI Express at different lane widths. Table: PCI Express maximum transfer rate Lane width Clock speed Throughput (duplex, bits) Throughput (duplex, bytes) Initial expected uses x1 2.5 GHz 5 Gbps 400 MBps Slots, Gigabit Ethernet x2 2.5 GHz 10 Gbps 800 MBps x4 2.5 GHz 20 Gbps 1.6 GBps Slots, 10 Gigabit Ethernet, SCSI, SAS x8 2.5 GHz 40 Gbps 3.2 GBps x16 2.5 GHz 80 Gbps 6.4 GBps Graphics adapters Introduction to PCI Express 2

PCI Express uses an embedded clocking technique using 8b/10b encoding. The clock information is encoded directly into the data stream, rather than having the clock as a separate signal. The 8b/10b encoding essentially requires 10 bits per character, or about 20% channel overhead. This encoding explains differences in the published spec speeds of 250 MBps (with the embedded clock overhead) and 200 MBps (data only, without the overhead). For ease of comparison, Table 5-3 shows throughput in both bps and Bps. When compared to the current version of a PCI-X 2.0 adapter running at 133 MHz QDR, the potential sustained throughput of PCI Express x16 is over double the throughput as shown in the figure below. Figure: PCI Express and PCI-X comparison (in Gbps) Related product families Product families related to this document are the following: Processors Introduction to PCI Express 3

Notices Lenovo may not offer the products, services, or features discussed in this document in all countries. Consult your local Lenovo representative for information on the products and services currently available in your area. Any reference to a Lenovo product, program, or service is not intended to state or imply that only that Lenovo product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any Lenovo intellectual property right may be used instead. However, it is the user's responsibility to evaluate and verify the operation of any other product, program, or service. Lenovo may have patents or pending patent applications covering subject matter described in this document. The furnishing of this document does not give you any license to these patents. You can send license inquiries, in writing, to: Lenovo (United States), Inc. 1009 Think Place - Building One Morrisville, NC 27560 U.S.A. Attention: Lenovo Director of Licensing LENOVO PROVIDES THIS PUBLICATION AS IS WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some jurisdictions do not allow disclaimer of express or implied warranties in certain transactions, therefore, this statement may not apply to you. This information could include technical inaccuracies or typographical errors. Changes are periodically made to the information herein; these changes will be incorporated in new editions of the publication. Lenovo may make improvements and/or changes in the product(s) and/or the program(s) described in this publication at any time without notice. The products described in this document are not intended for use in implantation or other life support applications where malfunction may result in injury or death to persons. The information contained in this document does not affect or change Lenovo product specifications or warranties. Nothing in this document shall operate as an express or implied license or indemnity under the intellectual property rights of Lenovo or third parties. All information contained in this document was obtained in specific environments and is presented as an illustration. The result obtained in other operating environments may vary. Lenovo may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you. Any references in this publication to non-lenovo Web sites are provided for convenience only and do not in any manner serve as an endorsement of those Web sites. The materials at those Web sites are not part of the materials for this Lenovo product, and use of those Web sites is at your own risk. Any performance data contained herein was determined in a controlled environment. Therefore, the result obtained in other operating environments may vary significantly. Some measurements may have been made on development-level systems and there is no guarantee that these measurements will be the same on generally available systems. Furthermore, some measurements may have been estimated through extrapolation. Actual results may vary. Users of this document should verify the applicable data for their specific environment. Copyright Lenovo 2017. All rights reserved. This document, TIPS0456, was created or updated on October 16, 2005. Send us your comments in one of the following ways: Use the online Contact us review form found at: http://lenovopress.com/tips0456 Send your comments in an e-mail to: comments@lenovopress.com This document is available online at http://lenovopress.com/tips0456. Introduction to PCI Express 4

Trademarks Lenovo, the Lenovo logo, and For Those Who Do are trademarks or registered trademarks of Lenovo in the United States, other countries, or both. A current list of Lenovo trademarks is available on the Web at http://www3.lenovo.com/us/en/legal/copytrade/. The following terms are trademarks of Lenovo in the United States, other countries, or both: Lenovo NetVista xseries Other company, product, or service names may be trademarks or service marks of others. Introduction to PCI Express 5