Configuring and Installing Fibre Channel (FC) Storage on OpenVMS. Fibre Channel (FC) Storage on OpenVMS

Transcription

1 Configuring and Installing Vortrag 3C02 Compaq Computer München Topics of Discussion Websites of interest, Documentation FC and Multipath Support Description FC Storage System Components: Fibre Channel Adapter Fibre Channel Switch HSG80 RAID Controller FC Drivers, Loading, Driver Configuration File 2 1

2 Topics of Discussion (cont.) Fibre Channel Storage Naming Booting from a Fibre Channel Device FC and MP Device OS Commands 3 Websites of Interest (cont.) Pointers to: Fibre Channel support on Multipath support on Supported systems Configurations 4 2

3 FC Documentation Fibre Channel support is documented in two chapters of Guidelines for Cluster Configurations Chapter 6 - Configuring multiple paths to SCSI and Fibre Channel storage Chapter 7 - Configuring Fibre Channel as an Cluster Storage Interconnect Recently updated Multiple formats: HTML, PDF, Postscript 5 FC Support FC is a shared cluster storage interconnect HSG80 disks support booting, dumping, serving, quorum disk, and shadowing Another interconnect is required for SCS traffic FC storage can be served to all cluster members including VAX systems back to V6.2 and Alpha systems back to V

4 FC Support (cont.) Fibre Channel is supported on Version and later as a storage interconnect for single systems and for Multihost Cluster systems Maximum distance between hosts 100KM (including-drm) Far greater using ATM gateways 7 FC Support (cont.) To date, Fibre Channel has been qualified on the following systems: AlphaServer 800, 1000A, 1200, 4000, 4100, 8200, 8400, GS60, GS140 AlphaServer GS80, GS160, GS320 AlphaServer DS10, DS20, DS20E, ES40, ES45 No boot support from 1000A 8 4

5 FC Support (cont.) Compaq recommends all Fibre Channel sites run version or later Current version is 7.3 Includes: Fast path Fibre Channel tapes - V7.2-2 Hardware distributed interrupts (Fast Path) Latent support for LP9002 (2Gb) (2002) 9 FC Support (cont.) Install the latest remedial kits: dec-axpvms-vms721_update-v0300 dec-axpvms-vms721h1_update-v0500 dec-axpvms-vms722_fibre_scsi-v0100 dec-axpvms-vms73_update-v0100 Located at:

6 Fibre Channel Support (cont) Component Version 7.2 Version 7.2 w/ TIMA kit Version Version version 7.3 SCSI Devices FC Devices No Shadowing of MP SCSI and MP FC No No Fail-over to MSCP path No No No No No FC Tapes No No No 11 FC Fabric Redundancy Host-to-Host cluster communication Alpha Alpha HSG HSG HSG HSG 12 6

7 Four Large Fabrics Host-to-Host cluster communication FC host FC host HSG HSG HSG HSG 13 AMulti Multi-site FC Cluster Host-to-Host cluster communication FC host FC host FC host FC host HSG HSG HSG HSG HSG HSG HSG HSG 14 7

8 Multipath Support Provides failover from one path to a device to another path to the same device Can use SCSI or Fibre Channel interconnects Two or more paths to a single device are called a Multipath Set Parallel SCSI Transparent Failover Supported since V6.2 FC Multibus Failover Supported since V7.2-1 Multipath supports shadowing in V MP Support (cont.) Multiple paths provide: Higher availability Recovery from failures in host-to-storage path Higher performance through load balancing System selects one path as Current Path All IO Directed over this path until a Switch Automatic or Manual Path Switch 16 8

9 MP Support (cont.) Transparent Failover Multiple Ports are on the same Host Bus Each LUN on one Port of Dual Controllers Different LUNS assigned to different ports LUN Moves to corresponding port on surviving controller upon controller failure No Host Software or Intervention Supported by FC for heterogeneous SAN connectivity for other OS types 17 MP Support (cont.) Multibus Failover Multiple Ports are on different Host Buses LUN visible on all ports Host selects alternate path upon path failure Removes host interconnect as SPOF Host Software Intervention 18 9

10 MP Support (cont.) In multibus mode, each logical unit is: Visible to the OS on all four ports Online to one controller at a time The unit can do I/O through both ports of that controller D44 answers Inquiry on these ports D44 does I/O on these ports HSG80 HSG80 Unit D44 19 MP Support (cont.) Each host sees four paths to D44 Two are online and two are standby Each host picks one online path for I/O Better performance if the hosts use different ports Path selection for load balancing is done manually Alpha Alpha HSG80 HSG80 Unit D

11 MP Support (cont.) Multipath support must be Enabled SYSGEN> SHO MPDEV* Parameter Name Current Default Min. Max. Unit Dynamic MPDEV_ENABLE Boolean D MPDEV_REMOTE Boolean D MPDEV_POLLER Boolean D MPDEV_LCRETRIES Pure-num D MPDEV_D D 21 FC Adapter LP KGPSA-BC FW - SS3.03A1 LP DS-KGPSA-CA FW - DS3.81A4 Optical GLM only Adapter FW available on Alpha FW CD Adapter FW is displayed during boot Adapter FW displayed using SDA command SDA> fc sho dev fg KGPSA must be connected to a No Direct Attach (Point to Point) 22 11

12 Default settings from factory Zoning Controls which FC nodes can see each other Supported but not required by Optical GBICs Short Range: meters Medium Range: 200 meters 10Km Long Range: 10Km 100 Km 23 (cont) Casacading Switches Maximum of 20 switches per Fabric Maximum of 7 inter-switch hops Refer to the SAN Design Guide Switch Managed via RS232 or SNMP connection Single-mode inter-switch link up to 100KM 24 12

13 HSG80 RAID Controller 1 or 2 HSG80 Controller Modules per Subsystem Each HSG80 Module has 2 FC Host Ports 6 Wide Ultra SCSI Device Ports Console terminal connection 25 HSG80 RAID Controller Config Use PVA Module to set SCSI ID (usually 0) Need ACS FW Version 8.5-x or 8.6-x Establish Local Connection to Controller SCSI_VERSION SCSI3 Controller ID should be non-zero (CCL) Failover method: Multibus Mode Transparent mode Host Connections 26 13

14 HSG80 RAID Ctlr Config (cont.) Selective Storage Presentation (SSP) HSG80 controls which hosts can access a Storage Unit Limits visibility of specific units from certain hosts Defaults to ALL access paths enabled 27 FC Storage Naming There is an name for each: Fibre Channel storage adapter Path from the storage adapter to the storage subsystem Storage device 28 14

15 FC Storage Adapter Naming Fibre Channel storage adapter names are automatically assigned by and take the form FGx0: FG represents Fibre Channel. x represents the unit letter, from A to Z. 0 is a constant. The naming design places a limit of 26 adapters per system 29 FC Storage Adapter Naming (cont.) Fibre Channel adapters can run multiple protocols, such as SCSI and LAN. Each protocol is a pseudo device associated with the adapter. For the initial implementation, just the SCSI protocol is supported. The SCSI pseudo device name is PGx0, where x represents the same unit letter as the associated FGx0 adapter. 0 is a constant

16 FC Storage Path naming With the introduction of multipath SCSI support, it is necessary to identify specific paths from the host to the storage subsystem. This is done by concatenating the SCSI pseudo device name, a decimal point (.), and the WWID of the storage subsystem port that is being accessed 31 FC Path Names An FC path is identified by the pseudo device name of the host adapter and the remote FC port WWID For example, "PGB FE " Edgar PGA0 PGB0 Poe PGA0 PGB0 Port WWID = FE Port WWID = FE HSG HSG Port WWID = FE Port WWID = FE

17 FC Storage Device Naming Four identifiers are associated with each FC storage device 1.) Logical Unit Number: Used by the system as the address of a specific device within the storage subsystem Set and displayed from the HSG80 console by the System Manager CanalsobedisplayedbytheSDAutility. 33 FC Storage Device Naming (cont.) 2.) Fibre Channel WWID Each Fibre Channel storage device has a WWID to provide permanent, unique identification of the device. The HSG80 device WWID is 128 bits. Half of this identifier is the WWID of the HSG80 that created the logical storage device, and the other half is specific to the logical device. The device WWID is displayed by the HSG80 console and the AlphaServer console. Fibre Channel device WWIDs are uniquely assigned to the device, and they are path independent, They could be used for device naming, if they were not so long. For example, a Fibre Channel storage unit WWID might be: FE D

18 FC Storage Device Naming (cont.) 3.) Device ID To simplify the use of WWIDs in device names, enables the use of a shorter identifier, called an device ID. For the device with the WWID shown previously, a system manager might choose an device ID of 567. An device ID for a Fibre Channel WWID has the following attributes: User assigned at the HSG80 console. User must ensure it is cluster unique. Moves with the device. Can be any decimal number from 1 to FC Storage Device Naming (cont.) 4.) Device Name Formed by the operating system by concatenating: Constant $1$DGA ADeviceID,nnnnn. The Device ID is variable Assigned at the HSG80 console. In the previous example, the storage device would be known to the host as $1$DGA

19 FC Storage Device Naming (cont.) device name = $1$DGA567 Host PGA0 PGB0 HSG80 HSG80 Logical Unit D44 Device ID = Booting from a Fibre Channel Device The initial setup for FC is a bit more complex then setting up a SCSI bus device Make sure the Alpha System Firmware is at V5.6 (minimum) Use the HSG80 CLI to SET UNIT IDENTIFIER = xxx Use wwidmgr to locate unit on FC network and create alias Use SET BOOTDEF_DEV to set all paths to FC device Init and boot the system 38 19

20 Booting From a FC Device (cont.) Use the HSG80 CLI to SET UNIT IDENTIFIER = xxx HSG> SHOW D10 LUN Uses Used by D10 SYS LUN ID: FE EE NOIDENTIFIER Switches: RUN NOWRITE_PROTECT READ_CACHE READAHEAD_CACHE WRITEBACK_CACHE MAXIMUM_CACHED_TRANSFER_SIZE = 32 Access: ALL State: ONLINE to this controller Not reserved NOPREFERRED_PATH Size: blocks Geometry (C/H/S): ( 5258 / 20 / 169 ) 39 Booting From a FC Device (cont.) Use the HSG80 CLI to SET UNIT IDENTIFIER = xxx HSG> SET D10 IDENTIFIER = 10 HSG> SHOW D10 LUN Uses Used by D10 SYS LUN ID: FE EE IDENTIFIER = 10 Switches: RUN NOWRITE_PROTECT READ_CACHE READAHEAD_CACHE WRITEBACK_CACHE MAXIMUM_CACHED_TRANSFER_SIZE = 32 Access: ALL State: ONLINE to this controller Not reserved NOPREFERRED_PATH Size: blocks Geometry (C/H/S): ( 5258 / 20 / 169 ) 40 20

21 Booting From a FC Device (cont.) Use wwidmgr to locate unit on FC network P00>>> SET MODE DIAG { Only needed on older versions of Alpha I.e } Console is in diagnostic mode P00>>> wwidmgr -clear all P00>>> wwidmgr -show wwid polling kgpsa0 (KGPSA-C) slot 2, bus 0 PCI, hose 1 kgpsaa Nvram read failed. kgpsaa PGA0 WWN c921-bcdc polling kgpsa1 (KGPSA-B) slot 4, bus 0 PCI, hose 0 kgpsab Nvram read failed. kgpsab PGB0 WWN c920-a5a1 polling kgpsa2 (KGPSA-C) slot 5, bus 0 PCI, hose 0 kgpsac Nvram read failed. kgpsac PGC0 WWN c [0] UDID:10 WWID: :6000-1fe ee (ev:none) [1] UDID:-1 WWID: :6000-1fe aa (ev:none) [2] UDID:-1 WWID: :6000-1fe ab (ev:none) [3] UDID:-1 WWID: :6000-1fe ba (ev:none) 41 Booting From a FC Device (cont.) Use wwidmgr to create alias P00>>> wwidmgr -quickset -item 0 -unit 10 Disk assignment and reachability after next initialization: fe ee via adapter: via fc nport: connected: dgb kgpsab fe No dgb kgpsab fe dgb kgpsab fe No dgb kgpsab fe dgc kgpsac fe No dgc kgpsac fe dgc kgpsac fe No dgc kgpsac fe dga kgpsaa fe No dga kgpsaa fe dga kgpsaa fe No dga kgpsaa fe

22 Booting From a FC Device (cont.) Use SET BOOTDEF_DEV to set all paths to FC device P00>>> set bootdef_dev dgc ,dgc ,dgb , dgb ,dga ,dga P00>>> show auto_action BOOT boot_dev dgb dgb dgc dgc dga dga boot_file boot_osflags 0,0 boot_reset OFF bootdef_dev dgc dgc dgb dgb dga dga Booting From a FC Device (cont.) Initialize and boot the system P00>>> boot CPU 0 booting Initializing... SROM V1.1 on cpu0 (boot dgc flags 0,0) SR... block 0 of dgc is a valid boot block reading 18 blocks from dgc probing IOD1 hose 1 bootstrap code read in bus 0 slot 1 - NCR 53C810 Building FRU table bus 0 slot 2 - KGPSA-C base = , image_start = 0, image_bytes = 2400 probing IOD0 hose 0 initializing HWRPB at 2000 b... initializing page table at 1f2000 initializing machine state bus 0 slot 4 - KGPSA-B setting affinity to the primary CPU bus 0 slot 5 - KGPSA-C jumping to bootstrap code configuring I/O adapters... ncr0, hose 1, bus 0, slot 1 V kgpsa0, hose 1, bus 0, slot 2 kgpsa1, hose 0, bus 0, slot 4 kgpsa2, hose 0, bus 0, slot 5 AlphaServer 4100 Console V5.6-4, 29-NOV :39:

23 FC Device OS Commands $SHOWDEVICEFG Device Device Error Name Status Count FGA0: Online 0 FGB0: Online 0 $SHOWDEVICEPG Device Device Error Name Status Count PGA0: Online 0 PGB0: Online 0 45 FC Device OS Commands (cont.) $SHOWDEVICEGG Device Device Error Name Status Count $1$GGA1234: Online 0 $SHOWDEVICEDG Device Device Error Volume Free Trans Mnt Name Status Count Label Blocks Count Cnt $1$DGA300: (VORDME) Online 0 $1$DGA400: (VORDME) Online 0 $1$DGA500: (VORDME) Online 0 $1$DGA600: (VORDME) Online

24 MP Device OS Commands To Show Current Path for Multipath Devices $ SHOW DEVICE DG/MULTIPATH Device Device Error Paths Current Name Status Count Avl/Tot path $1$DGA300: (VORDME) Online 0 8/ 8 PGA FE F4 $1$DGA400: (VORDME) Online 0 8/ 8 PGA FE F4 $1$DGA500: (VORDME) Online 0 8/ 8 PGA FE F4 $1$DGA600: (VORDME) Online 0 8/ 8 PGA FE F4 47 MP Device OS Commands (cont.) To Show All Paths for Multipath Devices $ SHOW DEVICE $1$DGA300/FULL I/O paths to device 4 Path PGA FE F1 (VORDME), primary path, current path. Error count 0 Operations completed 0 Path PGA FE F4 (VORDME). Error count 0 Operations completed 0 Path PGB FE F2 (VORDME). Error count 0 Operations completed 0 Path PGB FE F3 (VORDME). Error count 0 Operations completed

25 MP Device OS Commands (cont.) To Add a Switch Path Destination: $ SET DEVICE $1$DGA300:/PATH=PGB AB-CDEF/ENABLE In this example, a request is made to enable path "PGB AB- CDEF as a switch path destination. No error is indicated if the path was in the enabled state prior to the request. Had the /NOENABLE option been used, the path would have been removed from switch path consideration 49 MP Device OS Commands (cont.) To enable a path for polling of its continued availability as a path switch destination $ SET DEVICE $1$DGA300:/PATH=PGB AB-CDEF/POLL In this example, a request is made to enable path "PGB AB-CDEF" for polling of its continued availability as a path switch destination. Had the /NOPOLL option been used, the path would have been removed from path availability polling consideration

26 MP Device OS Commands (cont.) To cause a switch to a different path SET DEVICE $1$DGA300:/PATH=PGB AB-CDEF/SWITCH In this example, a request is made to switch from the current path to path "PGB AB-CDEF". Should the path fail, the switch algorithm of the unspecified path is used. 51 Summary has robust support for Fibre Channel cluster storage today Long-distance support using DRM or HBVS Support for snapshots and clones Support for SANs and larger configurations Fibre Channel is the key strategic storage interconnect for 52 26

27 27