OSA-Express Support for TPF

Transcription

1 6XEFRPPLWWHH OSA-Express Support for TPF Mark Gambino Any references to future plans are for planning purposes only. IBM reserves the right to change those plans at its discretion. Any reliance on such a disclosure is solely at your own risk. IBM makes no commitment to provide additional information in the future.

2 TCP/IP Native Stack Support on PUT 11 &RPPXQLFDWLRQV APAR PJ26683 Implemented the following layers: Full socket layer More socket options supported New DFWLYDWHBRQBDFFHSW API Protocol layers TCP, UDP, RAW sockets IP layer (for a host) IP over CDLC link layer Connects to IBM 374x IP routers Can use same 374x for SNA and IP traffic

3 PUT 11 TCP/IP Native Stack Support &RPPXQLFDWLRQV TPF IP over CDLC Link Layer,26XEV\VWHP APPLICATION Socket API SOCKET LAYER TCP UDP IP LAYER 374x 374x 374x Network Cloud CEC

4 What Is OSA? Open Systems Adapter (OSA) Card that resides in the IBM mainframe Enables the S/390 host to directly connect to various networks without the need for front-end router boxes OSA/2 Uses standard channel programs for data transfer between the host and OSA card Requires OSA/SF component to configure the OSA card

5 OSA/2 on OS/390 $SSOLFDWLRQ 7&3,36WDFN 03&/LQN/D\HU,26XEV\VWHP Network Cloud 26 26$6) 26$ CEC 3&ZLWK 26$6) VRIWZDUH

6 What is OSA-Express? OSA-Express is the third generation OSA Requires IBM G5 processor or above Connects to high-bandwidth networks Initially gigabit Ethernet (GbE) Uses Queued Direct I/O (QDIO) to transfer data between the host and OSA card Does QRW use channel programs to transfer data Host and OSA-Express card share memory Huge performance improvement over OSA/2 Can be self-configured by the host Does not require OSA/SF anymore

7 TCP/IP Native Stack Support with OSA-Express &RPPXQLFDWLRQV TPF IP over CDLC Link Layer APPLICATION Socket API SOCKET LAYER TCP UDP IP LAYER,26XEV\VWHP 26$([SUHVV 374x 374x 374x Network Cloud 4',2/LQN/D\HU *E(6ZLWFK CEC

8 OSA-Express Support... Adds a new link layer to TPF for TCP/IP connectivity Uses the upper layers that were provided by TCP/IP native stack support on PUT 11 Socket layer, protocol layers, IP layer Coexists with IP over CDLC support and offload support Uses the same IP trace facility that was provided with TCP/IP native stack support on PUT 11

9 TPF Support Statement TPF plans to support OSA-Express TPF does QRW plan to support previous generations of OSA cards such as OSA/2: Would require the OSA/SF function in TPF Would require a new and very complicated link layer implemented in TPF Older OSA cards do not connect to high-bandwidth networks such as GbE Older cards use standard channel programs for data transfer, which limit throughput

10 Subchannels for OSA-Express The host activates the connection to the OSA-Express card using a mixture of legacy (OSA/2) flows and new flows These do use standard channel programs Need at least three SDAs for each connection between the host and OSA-Express card Need exactly three SDAs if TPF is the host Subchannels (SDAs) are used only for activating the connection Not used for data (IP packet) transfer

11 OSA-Express Configurations Each OSA-Express card has one GbE port Connects to one GbE network An OSA-Express card can be shared by any combination of LPARs in the CEC Includes TPF and other operating systems TPF can connect to multiple OSA-Express cards at the same time TPF running under VM (as a VM guest) requires VM/ESA 2.4 or later release to connect to OSA-Express

12 Sample CEC with Four LPARs 73)$ 73)% 26$([SUHVV 26$([SUHVV 26$([SUHVV GbE Switch 26 73) XVHU; GbE Switch 73) XVHU< 90 73) XVHU=

13 OSA Names and Port Names OSA name The name for a connection to an OSA-Express card as defined by the host Two hosts cannot define the same OSA name for connections to same OSA-Express card Port name The name of the port on the OSA-Express card as defined by the host All connections to the same OSA-Express card must use the same port name You must coordinate the OSA names and port names across all LPARs in a CEC sharing OSA-Express

14 Registering IP Addresses OSA-Express is an extension of the host: It is not a router It does not have its own IP addresses It does not maintain IP routing tables Hosts in the CEC register their IP addresses with OSA-Express IP addresses must be unique OSA-Express uses this information to route packets from the network to the correct host TPF has one real IP address for each OSA-Express connection

15 Two Hosts Share an &RPPXQLFDWLRQV OSA-Express Card 73)$ 1$0( 73)$26$ $3257,3 26$([SUHVV,3$''5( )$26$ 73)%26$ 26$3257 1HWZRUN[ 73)% 1$0( 73)%26$ $3257,3 1$0( 73)%26$ $3257,3 26$([SUHVV,3$''5( )%26$ 26$3257 1HWZRUN[

16 Ethernet Interface OSA-Express processes all ARP/RARP requests OSA-Express builds Ethernet header for output packets OSA-Express processes Ethernet header for input packets The host only sees IP packets and is not involved with the physical network layer Allows for future network layers to be added to the OSA-Express card with no or minimal changes required in the host

17 Virtual IP Address (VIPA) Support VIPA is an IP address that is not permanently tied to one physical network interface Can be moved to a different network using Routing Information Protocol (RIP) TPF will support a subset of RIP v2 Eliminates single points of failure so that sockets can survive the failure of: A GbE switch The GbE itself An OSA-Express card

18 Eliminating Single Points &RPPXQLFDWLRQV of Failure Sockets should use VIPAs, not the real IP address of TPF across OSA-Express Need at least two OSA-Express cards Need at least two GbE switches Need at least two IP routers

19 Suggested Configuration 26$([SUHVV *E(6ZLWFK 73),3&ORXG 26$([SUHVV *E(6ZLWFK... IP Router IP Router IP Router

20 TPF Lab s OSA-Express Test Configuration &RPPXQLFDWLRQV IBM G5 processor Four OSA-Express cards, shared by: Many users on a TPF test system running under VM Four native TPF LPARs OS/390 system Cisco GbE switches (Model 2926) Cisco routers (Model 4500) Connected to IBM production network

21 VIPA Association with OSA-Express &RPPXQLFDWLRQV TPF allows you to define OSA-Express connections in pairs (primary and alternate) A VIPA is defined to a pair of OSA-Express connections The VIPA is active on only one of these OSA-Express connections at a time If an OSA-Express connection fails and the VIPAs were active on that connection: Those VIPAs automatically swing to the other OSA-Express connection (if it is active) No sockets are lost TPF operator can manually swing VIPAs as well

22 VIPA Example OSA1PRIM is the name of the primary connection is real IP address of TPF across OSA1PRIM OSA1ALT is the name of the alternate OSA-Express connection associated with OSA1PRIM is the real address of TPF across OSA1ALT and are VIPAs defined to this pair of OSA-Express connections The VIPAs are currently active on OSA1PRIM When the OSA-Express connections are activated: TPF registers IP addresses with OSA-Express cards The real IP address and VIPAs defined to this card TPF broadcasts RIP messages to the IP routers indicating that the VIPAs can be reached via the real IP address of OSA1PRIM ( )

23 VIPA Example 9,3$ 9,3$ 26$35,0,3$''5( $35,0 26$35,0 26$35,0 1HWZRUN[ 73),3$''5(661(; $$/7,3$''5( $$/7 26$$/7 26$$/7 1HWZRUN[,35RXWHUV

24 Routing Packets to TPF Using VIPAs &RPPXQLFDWLRQV Assume an IP router receives a packet that has a destination IP address of The routing table indicates to send the packet to as the next hop The IP router is connected to the network where resides; therefore, the IP router sends the packet on x network destined for The OSA-Express card receives the packet because it is managing IP address The OSA-Express card looks up the final destination of the packet ( ) in its table and routes the packet to the appropriate host (to TPF across the OSA1PRIM connection)

25 Swinging VIPAs Assume network x fails TPF will detect the failure and broadcast RIP messages to the IP routers that the VIPAs can now be reached via the real IP address for OSA1ALT ( ) IP routers update their routing tables and sockets using the VIPAs remain active

26 Swinging VIPAs 26$35,0,3$''5( $35,0 26$35,0 26$35,0 1HWZRUN[ 73),3$''5(661(;7+23 9,3$ 9,3$ 26$$/7,3$''5( $$/7 26$$/7 26$$/7 1HWZRUN[,35RXWHUV

27 Defining OSA-Express Information to TPF &RPPXQLFDWLRQV OSA-Express connections and VIPAs are defined and modified using the new ZOSAE functional messages Changes take effect immediately Even in NORM state! New VIPAs and gateways can be defined while the connection is active

28 First-Hop Routing for Output Messages &RPPXQLFDWLRQV TPF must tell OSA-Express the first-hop IP address for each output packet You can define up to two default gateways to TPF for each OSA-Express connection If the destination (remote IP address) is also on the GbE, this is a one-hop connection and, therefore, the destination and first hop are the same For all other sockets, TPF uses one of the default gateways unless directed otherwise ICMP redirect message is sent to TPF if a better path (gateway) exists

29 Output Message Routing Example 9,3$ 73)% 26$ *DWHZD\ 'HIDXOW GbE Switch *DWHZD\ 'HIDXOW,31HWZRUN 1RGH; 9,3$ 73)& 26$ *DWHZD\ 1RGH= *DWHZD\,31HWZRUN 1RGH<

30 Socket Considerations A given socket uses offload support or native stack support One TPF server application can be bound to all native stack network interfaces Includes all CDLC IP routers and all OSA-Express connections For connected sockets using native stack support, the local (TPF) IP address of the socket determines whether CDLC or OSA-Express is used for that socket

31 Summary OSA-Express support: Enables TPF to directly connect to higher-bandwidth TCP/IP networks To keep up with the increased TCP/IP traffic load on TPF systems Implements VIPA support to provide fault-tolerant network capability Reduces the load on the IOP Questions?