Server Support Matrix ETERNUS Disk storage systems Server Connection Guide (Fibre Channel) for Oracle Solaris

Transcription

1

2

3 Preface This document briefly explains the operations that need to be performed by the user in order to connect an ETERNUS2000 model 100 or 200, ETERNUS4000 model 300, 400, 500, or 600, or ETERNUS8000 model 700, 800, 900, 1100, 1200, 2100, or 2200 Disk storage system to a server running Solaris OS and using Sun Fibre Channel cards via a Fibre Channel interface. This document should be used in conjunction with any other applicable user manuals, such as those for the ETERNUS2000 model 100 or 200, ETERNUS4000 model 300, 400, 500, or 600, or ETERNUS8000 model 700, 800, 900, 1100, 1200, 2100, or 2200 Disk storage system, server, OS used, Fibre Channel cards, drivers, etc. Note that this manual refers the following documents. Server Support Matrix ETERNUS Disk storage systems Server Connection Guide (Fibre Channel) for Oracle Solaris Also, note that in this document the ETERNUS2000 models 100 and 200, ETERNUS4000 models 300, 400, 500, and 600, and ETERNUS8000 models 700, 800, 900, 1100, 1200, 2100, and 2200 Disk storage systems are collectively referred to as ETERNUS Disk storage systems. Fifth Edition December 2010 The Contents and Structure of this Manual This document is composed of the following five chapters and an appendix. Chapter 1 Workflow This describes the workflow required to establish a connection between a server with Sun Fibre Channel cards and an ETERNUS Disk storage system. Chapter 2 Installing the Fibre Channel Card Driver This describes how to install the Fibre Channel card driver. Chapter 3 Setting Up the Server This describes how to set up the server for different connection topologies. Chapter 4 Logical Unit Recognition This describes how to make the server recognize the ETERNUS Disk storage system LUNs (logical units). Chapter 5 Required Driver Parameters This describes how to set up the Sun Fibre Channel card driver for use with Emulex OEM Fibre Channel cards. 3

4 Preface An appendix contains the various management tables that are used in "Chapter 3 Setting Up the Server". Safe Use of this Product Using this manual This manual contains important information to ensure the safe use of this product. Be sure to thoroughly read and understand its contents before using the product. After reading, store this manual in a safe place for future reference. FUJITSU has made every effort to ensure the safety of the users and other personnel, and to prevent property damage. When using this product, carefully follow the instructions described in this manual. Acknowledgments Oracle and Java are registered trademarks of Oracle and/or its affiliates. All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International, Inc. in the United States and other countries. Emulex is a trademark of Emulex Corp. QLogic is a trademark of QLogic Corp. The company names, product names and service names mentioned in this document are registered trademarks or trademarks of their respective companies. Naming Conventions Product names Oracle Solaris might be described as Solaris, Solaris Operating System, or Solaris OS. Other names "Channel Adapter" (CA) refers to the Fibre Channel interface module used in the ETERNUS Disk storage systems to connect to the server. "Fibre Channel card" refers to the Fibre Channel interface module normally used by the server. A "Host Bus Adapter" (HBA) or "Channel Adapter" (CA) may be used instead, depending on the server. Italics are used to show variables such as values and characters that appear in command parameters and output examples. 4

5 Contents Chapter 1 Workflow...6 Chapter 2 Installing the Fibre Channel Card Driver...8 Chapter 3 Setting Up the Server Sun Driver For QLogic OEM Fibre Channel Cards Creating a WWN Instance Management Table for the Server Setting the Configuration File (/etc/system) Sun Driver For Emulex OEM Fibre Channel Cards Creating a WWN Instance Management Table for the Server Setting the Configuration File (/kernel/drv/emlxs.conf) Setting the Configuration File (/etc/system) Chapter 4 Logical Unit Recognition For FC-AL Connection For Fabric Connection Chapter 5 Required Driver Parameters Emulex OEM Fibre Channel Card Setup /kernel/drv/emlxs.conf Parameter List /kernel/drv/emlxs.conf Example Appendix A Management Table Template...29 A.1 WWN Instance Management Table for the Server

6 Chapter 1 Workflow This manual is used when performing the setup procedure described in "Installing the Driver and Setting Up the Server" and "Logical Unit Recognition" of the "ETERNUS Disk storage systems Server Connection Guide (Fibre Channel) for Oracle Solaris". Workflow Fiber Channel Card Driver Installation Refer Install the driver. Download the proper driver from the Oracle web-site as required. - "Chapter 2 Installing the Fibre Channel Card Driver" (page 8) - Used for driver installation Driver (downloaded from the Oracle web-site) Various Management Table Creation Refer Enter necessary information in "WWN Instance Management Table for the Server". - "Chapter 3 Setting Up the Server" (page 9) - "Appendix A Management Table Template" (page 29) Fiber Channel Card Driver Setup Refer Set the driver parameters by editing the configuration file. - "Chapter 3 Setting Up the Server" (page 9) - "Chapter 5 Required Driver Parameters" (page 23) - Check the Sun driver notes "ETERNUS Disk storage systems Server Connection Guide (Fibre Channel) for Oracle Solaris" 6

7 Chapter 1 Workflow > Logical Unit (LUN) Recognition Make the server recognize the ETERNUS Disk storage system logical units using the ssd driver. Refer - "Chapter 4 Logical Unit Recognition" (page 20) After completing all the required procedures in this manual, proceed to "Setting the Multipaths" in "ETERNUS Disk storage systems Server Connection Guide (Fibre Channel) for Oracle Solaris". 7

8 Chapter 2 Installing the Fibre Channel Card Driver Install the Fibre Channel card driver. Required procedure varies depending on the Solaris OS version. Refer to the following Oracle web-site for installation procedures. Solaris 10 OS Driver installation is not necessary because the OS-bundled driver is used. Solaris 9 OS or Solaris 8 OS Download and install the appropriate driver from the Oracle web-site. 8

9 Chapter 3 Setting Up the Server The server setup will vary according to how the ETERNUS Disk storage systems and server are to be connected. There are two possible connection topologies: FC-AL connection and Fabric connection. Edit the server's configuration file to match the chosen topology. Configuration files may also differ depending on which Fibre Channel cards are to be used. Check the Fibre Channel card product ID in the following table and follow the procedure detailed in the indicated section ("3.1 Sun Driver For QLogic OEM Fibre Channel Cards" (page 10) or "3.2 Sun Driver For Emulex OEM Fibre Channel Cards" (page 15)). Procedure Supplier Fibre Channel card product ID "3.1 Sun Driver For QLogic OEM Fibre Channel Cards" (page 10) Fujitsu Sun SE0X7F22X SE0X7F21X XSPFC212A XSPFC211A XSPFC202A XSPFC201A X6799A X6768A X6767A X6727A SG-XPCIE2FC-QF8-Z SG-XPCIE1FC-QF8-Z SG-XPCIE2FC-QF4 SG-XPCIE1FC-QF4 SG-XPCI2FC-QF4 SG-XPCI1FC-QF4 SG-XPCI2FC-QF2-Z SG-XPCI2FC-QF2 SG-XPCI1FC-QF2 SG-XPCI1FC-QL2 9

10 Chapter 3 Setting Up the Server > 3.1 Sun Driver For QLogic OEM Fibre Channel Cards Procedure Supplier Fibre Channel card product ID "3.2 Sun Driver For Emulex OEM Fibre Channel Cards" (page 15) Fujitsu Sun XSEFC402AF XSEFC401AF XSEFC402A XSEFC401A SG-XPCIE2FC-EM8-Z SG-XPCIE1FC-EM8-Z SG-XPCI2FC-EM4-Z SG-XPCI1FC-EM4-Z SG-XPCE2FC-EM4 SG-XPCE1FC-EM4 SG-XPCI2FC-EM2 SG-XPCI1FC-EM2 3.1 Sun Driver For QLogic OEM Fibre Channel Cards When connecting using QLogic OEM Fibre Channel cards with a Sun Fibre Channel card driver, the configuration file will need to be edited as follows. The "command queue depth" setting must be adjusted for both FC-AL connection and Fabric connection. The "command queue depth" setting is specified in the configuration file (/etc/system). For FC-AL connection Instance name data of the Fibre Channel card is necessary. Refer to the following to set. "3.1.1 Creating a WWN Instance Management Table for the Server" (page 11) "3.1.2 Setting the Configuration File (/etc/system)" (page 13) For Fabric connection The Fibre Channel card Instance name, target WWN, and target ID information are necessary. Check each item and enter them in the list. Edit the configuration file according to those information and make settings. Refer to the following to set. "3.1.1 Creating a WWN Instance Management Table for the Server" (page 11) "3.1.2 Setting the Configuration File (/etc/system)" (page 13) 10

11 Chapter 3 Setting Up the Server > 3.1 Sun Driver For QLogic OEM Fibre Channel Cards Creating a WWN Instance Management Table for the Server Create a "WWN instance management table for the server" with information regarding the Fibre Channel card installed in the server. For each Fibre Channel cards installed in the server, check the physical slot names, WWN, instance names, physical path names, and controller number of the target connected to the Fibre Channel card and enter them in the "WWN instance management table for the server" (provided in "Appendix A Management Table Template" (page 29)). WWN Instance Management Table for the Server Physical slot name WWN Controller number Instance name Physical path name Procedure 1 Check the instance name. "qlc + instance number" is the format used to represent Fibre Channel card instance names. The instance No. that corresponds to the physical path in which the Fibre Channel card is installed is stored in the "/etc/path_to_inst" file at Fibre Channel card driver installation. Extract necessary parts using the "grep" command. grep "qlc" /etc/path_to_inst Example grep "qlc" /etc/path_to_inst "/pci@9,600000/sunw,qlc@1" 0 "qlc" "/pci@9,600000/sunw,qlc@2" 1 "qlc" Physical path name Instance number 2 Enter the results in "Instance name" and "Physical path name" columns of the "WWN instance management table for the server". Example Physical slot name WWN Controller number Instance name Physical path name qlc0 /pci@9,600000/sunw,qlc@1 qlc1 /pci@9,600000/sunw,qlc@2 11

12 Chapter 3 Setting Up the Server > 3.1 Sun Driver For QLogic OEM Fibre Channel Cards 3 Enter the slot number of the Fibre Channel card installed in the server in the "Physical slot number" field of the "WWN instance management table for the server". Use the "/usr/platform/`uname -i`/sbin/prtdiag -v" command to check the installed Fibre Channel card slot number. Example: Excerpt from "/usr/platform/sunw,sparc-enterprise-t5220/sbin/prtdiag -v" output /usr/platform/sunw,sparc-enterprise-t5220/sbin/prtdiag -v ========================= IO Configuration ================================================= Location Type Slot Path Name Model MB/PCIE1 PCIE 1 /pci@9,600000/sunw,qlc@2 SUNW,qlc-pciex1077,2432 QLE2460 MB/PCIE0 PCIE 0 /pci@9,600000/sunw,qlc@1 SUNW,qlc-pciex1077,2432 QLE2460 Physical slot WWN Controller number Instance name Physical path name PCIE 0 qlc0 /pci@9,600000/sunw,qlc@1 PCIE 1 qlc1 /pci@9,600000/sunw,qlc@2 4 Check the WWN for the Fibre Channel card. 4-1 Use the following command to check the display order of the Fibre Channel card physical path names. prtpicl -v -c scsi-fcp grep devfs-path Example prtpicl -v -c scsi-fcp grep devfs-path :devfs-path /pci@9,600000/sunw,qlc@1 :devfs-path /pci@9,600000/sunw,qlc@2 4-2 Use the following command to check the WWN of the Fibre Channel card that corresponds to the physical path name. The result is displayed in the same order as shown in Step 4-1. prtpicl -v -c scsi-fcp grep port-wwn Example prtpicl -v -c scsi-fcp grep port-wwn :port-wwn e0 8b 12 6d 70 :port-wwn e0 8b 16 cf fd 5 Add the results in the "WWN instance management table for the server". Example Physical slot name WWN Controller number Instance name Physical path name PCIE e08b126d70 qlc0 /pci@9,600000/sunw,qlc@1 PCIE e08b16cffd qlc1 /pci@9,600000/sunw,qlc@2 12

13 Chapter 3 Setting Up the Server > 3.1 Sun Driver For QLogic OEM Fibre Channel Cards 6 Check the controller number of the target connected to the Fibre Channel card. Use the following command to check the controller number of the target connected to the Fibre Channel card. The controller number can be checked by searching for the physical path that was confirmed in Step 4-1. cfgadm -v Example cfgadm -v Ap_Id Receptacle Occupant Condition Information When Type Busy Phys_Id c4 connected unconfigured unknown unavailable fc-fabric n /devices/pci@9,600000/sunw,qlc@1/fp@0,0:fc c5 connected unconfigured unknown unavailable fc-fabric n /devices/pci@9,600000/sunw,qlc@2/fp@0,0:fc 7 Add the results in the "WWN instance management table for the server". Physical slot name WWN Controller number Instance name Physical path name PCIE e08b126d70 c4 qlc0 /pci@9,600000/sunw,qlc@1 PCIE e08b16cffd c5 qlc1 /pci@9,600000/sunw,qlc@2 End of procedure This completes the "WWN instance management table for the server" Setting the Configuration File (/etc/system) Procedure 1 Edit the configuration file. Edit the configuration file (/etc/system) and specify the command queue depth. The appropriate command queue depth is determined by the ETERNUS Disk storage system model, as follows: ETERNUS Disk storage system Command queue depth setting ETERNUS ETERNUS ETERNUS The parameter to be specified is determined by the CPU which is installed in the server to be connected. 13

14 Chapter 3 Setting Up the Server > 3.1 Sun Driver For QLogic OEM Fibre Channel Cards For SPARC Specify the command queue depth for the "ssd_max_throttle" parameter. Add this parameter if it does not exist. Example: set ssd:ssd_max_throttle = 20 For x86 Specify the command queue depth for the "sd_max_throttle" parameter. Add this parameter if it does not exist. Example: set sd:sd_max_throttle = 20 2 After editing the configuration file, save it. 3 After the setting is complete, check the configuration file for incorrect settings. 4 Reboot the server. /usr/sbin/shutdown -y -g0 -i6 End of procedure 14

15 Chapter 3 Setting Up the Server > 3.2 Sun Driver For Emulex OEM Fibre Channel Cards 3.2 Sun Driver For Emulex OEM Fibre Channel Cards When connecting using an Emulex OEM Fibre Channel card and Sun Fibre Channel card driver, the configuration file will need to be edited as follows. For FC-AL connection and Fabric connection, the "command queue depth" setting must be adjusted. The "command queue depth" setting is specified in the configuration file (/etc/system). For FC-AL connection Instance name data of the Fibre Channel card is necessary. Refer to the following to set. "3.2.1 Creating a WWN Instance Management Table for the Server" (page 15) "3.2.2 Setting the Configuration File (/kernel/drv/emlxs.conf)" (page 18) "3.2.3 Setting the Configuration File (/etc/system)" (page 18) For Fabric connection The Fibre Channel card Instance name, target WWN, and target ID information are necessary. Check each item and enter them in the list. Edit the configuration file according to those information and make settings. Refer to the following to set. "3.2.1 Creating a WWN Instance Management Table for the Server" (page 15) "3.2.2 Setting the Configuration File (/kernel/drv/emlxs.conf)" (page 18) "3.2.3 Setting the Configuration File (/etc/system)" (page 18) Creating a WWN Instance Management Table for the Server Create a "WWN instance management table for the server" with information regarding the Fibre Channel card installed in the server. For each Fibre Channel cards installed in the server, check the physical slot names, WWN, instance names, physical path names, and controller number of the target connected to the Fibre Channel card and enter them in the "WWN instance management table for the server" (provided in "Appendix A Management Table Template" (page 29)). WWN Instance Management Table for the Server Physical slot name WWN Controller number Instance name Physical path name 15

16 Chapter 3 Setting Up the Server > 3.2 Sun Driver For Emulex OEM Fibre Channel Cards Procedure 1 Check the instance name. "emlxs + instance number" is the format used to represent Fibre Channel card instance names. The instance No. that corresponds to the physical path in which the Fibre Channel card is installed is stored in the "/etc/path_to_inst" file at Fibre Channel card driver installation. Extract necessary parts using the "grep" command. grep "emlxs" /etc/path_to_inst "/pci@9,600000/sunw,emlxs@1" 0 "emlxs" "/pci@9,600000/sunw,emlxs@1,1" 1 "emlxs" Physical path name Instance number 2 Enter the results in "Instance name" and "Physical path name" columns of the "WWN instance management table for the server". Physical slot name WWN Controller number Instance name Physical path name emlxs0 /pci@9,600000/sunw,emlxs@1 emlxs1 /pci@9,600000/sunw,emlxs@1,1 3 Enter the slot number of the Fibre Channel card installed in the server in the "Physical slot number" field of the "WWN instance management table for the server". Use the "/usr/platform/`uname -i`/sbin/prtdiag" command to check the installed Fibre Channel card slot number. Example: Excerpt from "/usr/platform/sunw,sparc-enterprise-t5220/sbin/prtdiag" output /usr/platform/sunw,sparc-enterprise-t5220/sbin/prtdiag ========================= IO Configuration ================================================= Location Type Slot Path Name Model MB/PCIE1 PCIE 1 /pci@9,600000/sunw,emlxs@1,1 SUNW,emlxs-pci10df,fd+LP11002-M4 MB/PCIE0 PCIE 0 /pci@9,600000/sunw,emlxs@1 SUNW,emlxs-pci10df,fd+LP11002-M4 Physical slot name WWN Controller number Instance name Physical path name PCIE 0 emlxs0 /pci@9,600000/sunw,emlxs@1 PCIE 1 emlxs1 /pci@9,600000/sunw,emlxs@1,1 16

17 Chapter 3 Setting Up the Server > 3.2 Sun Driver For Emulex OEM Fibre Channel Cards 4 Check the WWN for the Fibre Channel card. 4-1 Use the following command to check the WWN that corresponds to the Fibre Channel card instance name. prtpicl -v -c scsi-fcp grep devfs-path Example prtpicl -v -c scsi-fcp grep devfs-path :devfs-path /pci@9,600000/sunw,emlxs@1 :devfs-path /pci@9,600000/sunw,emlxs@1,1 :devfs-path /pci@9,600000/sunw,emlxs@2 :devfs-path /pci@9,600000/sunw,emlxs@2,1 4-2 Use the following command to check the WWN of the Fibre Channel card that corresponds to the physical path name. cat /var/adm/messages grep emlxs0 Example cat /var/adm/messages grep emlxs0 Sep 12 09:46:50 sfv890b emlxs: [ID kern.info] [B.125B]emlxs0: NOTICE: 100: Driver attach. (WWPN: C94CDC42 WWNN: C94CDC42) cat /var/adm/messages grep emlxs1 Sep 12 09:47:15 sfv890b emlxs: [ID kern.info] [B.125B]emlxs1: NOTICE: 100: Driver attach. (WWPN: C94CDC43 WWNN: C94CDC43) 5 Add the results in the "WWN instance management table for the server". Physical slot name WWN Controller number Instance name Physical path name C94CDC42 emlxs0 /pci@9,600000/sunw,emlxs@ C94CDC43 emlxs1 /pci@9,600000/ SUNW,emlxs@1,1 6 Check the controller number of the target connected to the Fibre Channel card. Use the following command to check the controller number of the target connected to the Fibre Channel card. cfgadm -v Example cfgadm -v Ap_Id Receptacle Occupant Condition Information When Type Busy Phys_Id c4 connected unconfigured unknown unavailable fc-fabric n /devices/pci@9,600000/sunw,emlxs@1/fp@0,0:fc c5 connected unconfigured unknown unavailable fc-fabric n /devices/pci@9,600000/sunw,emlxs@1,1/fp@0,0:fc 17

18 Chapter 3 Setting Up the Server > 3.2 Sun Driver For Emulex OEM Fibre Channel Cards 7 Add the results in the "WWN instance management table for the server". Physical slot name WWN Controller number Instance name Physical path name C94CDC42 C4 emlxs0 /pci@9,600000/sunw,emlxs@ C94CDC43 C5 emlxs1 /pci@9,600000/ SUNW,emlxs@1,1 End of procedure This completes the "WWN instance management table for the server" Setting the Configuration File (/kernel/drv/emlxs.conf) Set the "topology" and "link speed" by editing the configuration file "/kernel/drv/ emlxs.conf". For setting procedure and parameters, refer to "Chapter 5 Required Driver Parameters" (page 23) Setting the Configuration File (/etc/system) Procedure 1 Edit the configuration file. Edit the configuration file (/etc/system) and specify the command queue depth. The appropriate command queue depth is determined by the ETERNUS Disk storage system model, as follows: ETERNUS Disk storage system Command queue depth setting ETERNUS ETERNUS ETERNUS The parameter to be specified is determined by the CPU which is installed in the server to be connected. For SPARC Specify the command queue depth for the "ssd_max_throttle" parameter. Add this parameter if it does not exist. Example: set ssd:ssd_max_throttle = 20 18

19 Chapter 3 Setting Up the Server > 3.2 Sun Driver For Emulex OEM Fibre Channel Cards For x86 Specify the command queue depth for the "sd_max_throttle" parameter. Add this parameter if it does not exist. Example: set sd:sd_max_throttle = 20 2 Save the configuration file. 3 After the setting is complete, check the configuration file for incorrect settings. 4 Reboot the server. /usr/sbin/shutdown -y -g0 -i6 End of procedure 19

20 Chapter 4 Logical Unit Recognition The ssd driver needs to be set to allow the server to recognize the ETERNUS Disk storage systems' logical units. If Sun Fibre Channel cards are used, the logical unit recognition method will depend on the ETERNUS Disk storage systems to server connection topology. There are two possible connection topologies: FC-AL connection and Fabric connection. 4.1 For FC-AL Connection Confirm that the logical units have been correctly recognized by servers. Procedure 1 Use the following command to confirm that the storage system has been correctly recognized. cfgadm -al cfgadm -al Ap_Id Type Receptacle Occupant Condition c4 fc-private connected configured unknown c4::21ff00e000a8ffaf disk connected configured unknown c5 fc-private connected configured unknown c5::25ff00e000a8ffaf disk connected configured unknown ETERNUS Disk storage system CA (WWN:25ff00e000a8ffaf) has been connected to the Fibre Channel card port with controller number "c5". 2 Use the following command to confirm that the storage system and all the logical units have been correctly recognized. format 20

21 Chapter 4 Logical Unit Recognition > 4.2 For Fabric Connection ETERNUS8000 target ID=16, lun=0 and 1 are connected to physical path /pci@9,600000/sunw,qlc@1 format and c4t16d0 and c4t16d1 are assigned to each of these LUNs. Searching for disks...done c4t16d0: configured with capacity of 7.98GB c4t16d1: configured with capacity of 7.98GB c5t16d0: configured with capacity of 7.98GB c5t16d1: configured with capacity of 7.98GB AVAILABLE DISK SELECTIONS: 0. c1t0d0 <SUN36G cyl alt 2 hd 27 sec 107> /pci@8,600000/sunw,qlc@2/fp@0,0/ssd@w cf6851ce,0 1. c4t16d0 <FUJITSU-E cyl 1022 alt 2 hd 64 sec 256> /pci@9,600000/sunw,qlc@1/fp@0,0/ssd@w21ff00e000a8ffaf,0 2. c4t16d1 <FUJITSU-E cyl 1022 alt 2 hd 64 sec 256> /pci@9,600000/sunw,qlc@1/fp@0,0/ssd@w21ff00e000a8ffaf,1 3. c5t16d0 <FUJITSU-E cyl 1022 alt 2 hd 64 sec 256> /pci@9,600000/sunw,qlc@2/fp@0,0/ssd@w25ff00e000a8ffaf,0 4. c5t16d1 <FUJITSU-E cyl 1022 alt 2 hd 64 sec 256> /pci@9,600000/sunw,qlc@2/fp@0,0/ssd@w25ff00e000a8ffaf,1 Specify disk (enter its number): End of procedure 4.2 For Fabric Connection Use the following commands to enable the server to access the logical units. Procedure 1 Use the following command to identify the paths to the ETERNUS Disk storage system that is being connected. cfgadm -al Example cfgadm -al Ap_Id Type Receptacle Occupant Condition c4 fc-fabric connected unconfigured unknown c4::21ff00e000a8ffaf disk connected unconfigured unknown c5 fc-fabric connected unconfigured unknown c5::25ff00e000a8ffaf disk connected unconfigured unknown 2 Use the following command for each path obtained in Step 1. Repeat this step for all paths to be used. cfgadm -c configure path_obtained_in_step1 21

22 Chapter 4 Logical Unit Recognition > 4.2 For Fabric Connection Example cfgadm -c configure c4::21ff00e000a8ffaf cfgadm -c configure c5::25ff00e000a8ffaf 3 Use the following command to confirm that the paths to the ETERNUS Disk storage system are now usable. "Occupant" status changes from "unconfigured" to "configured". cfgadm -al cfgadm -al Ap_Id Type Receptacle Occupant Condition c4 fc-fabric connected configured unknown c4::21ff00e000a8ffaf disk connected configured unknown c5 fc-fabric connected configured unknown c5::25ff00e000a8ffaf disk connected configured unknown ETERNUS Disk storage system CA (WWN:25ff00e000a8ffaf) has been connected to the Fibre Channel card port with controller number "c5". 4 Use the following command to confirm that the storage system and all the logical units have been correctly recognized. format Target ID=250000E000A8FFAF, lun=0 and 1 are connected and c5t250000e000a8ffafd0 and c5t250000e000a8ffafd1 are format assigned to each of these LUNs. Searching for disks...done c4t16d0: configured with capacity of 7.98GB c4t16d1: configured with capacity of 7.98GB c5t16d0: configured with capacity of 7.98GB c5t16d1: configured with capacity of 7.98GB AVAILABLE DISK SELECTIONS: 0. c1t0d0 <SUN36G cyl alt 2 hd 27 sec 107> /pci@8,600000/sunw,qlc@2/fp@0,0/ssd@w cf6851ce,0 1. c4t210000e000a8ffafd0 <FUJITSU-E cyl 1022 alt 2 hd 64 sec 256> /pci@9,600000/sunw,qlc@1/fp@0,0/ssd@w210000e000a8ffaf,0 2. c4t210000e000a8ffafd1 <FUJITSU-E cyl 1022 alt 2 hd 64 sec 256> /pci@9,600000/sunw,qlc@1/fp@0,0/ssd@w210000e000a8ffaf,1 3. c5t250000e000a8ffafd0 <FUJITSU-E cyl 1022 alt 2 hd 64 sec 256> /pci@9,600000/sunw,qlc@2/fp@0,0/ssd@w250000e000a8ffaf,0 4. c5t250000e000a8ffafd1 <FUJITSU-E cyl 1022 alt 2 hd 64 sec 256> /pci@9,600000/sunw,qlc@2/fp@0,0/ssd@w250000e000a8ffaf,1 Specify disk (enter its number): End of procedure 22

23 Chapter 5 Required Driver Parameters 5.1 Emulex OEM Fibre Channel Card Setup If a Sun driver for a Sun Fibre Channel card (Emulex OEM) is used, the parameters of the "/kernel/drv/emlxs.conf" configuration file need to be edited using the "vi" command. Edit the file in accordance with the "5.1.1 /kernel/drv/emlxs.conf Parameter List" (page 24). The old configuration file should always be backed up before editing: Example cp /kernel/drv/emlxs.conf./emlxs.conf.backup Instance names are specified for some item names, but not for others. Confirm the X part of "emlxsx" with the /var/adm/messages file or the /etc/path_to_inst file. The following examples show the two confirmation methods: Example 1 Check with the "/var/adm/messages" file. "emlxs0" shows an instance name and instance number. Aug155:59:27 sfv890a genunix: [ID kern.info] "emlxs0" is /pci@9,600000/fibre-channel@1 Aug 15 15:59:27 sfv890a emlxs: [ID kern.info] [B.03F0]emlxs0: NOTICE: 720: Link up (2Gb,fabric *) Example 2 Check with the "/etc/path_to_inst". "/pci@9,600000" 3 "pcisch" "/pci@9,600000/fibre-channel@1" 0 "emlxs" "/pci@9,600000/fibre-channel@1/fp@0,0" 0 "fp" Instance number Instance name 23

24 Chapter 5 Required Driver Parameters > 5.1 Emulex OEM Fibre Channel Card Setup /kernel/drv/emlxs.conf Parameter List Parameter Value (for FC-AL connection) *1: "emlxsx-link-speed" setting value Value (for Fabric connection) Initial value emlxsx instance name Remarks num-iocbs ub-bufs network-on emlxsx-topology Yes An instance name is specified for each instance. emlxsx-linkspeed 2, 4, or 8 2, 4, or 8 0 Yes An instance name is specified for each instance. (*1) ack cr-delay cr-count assign-alpa 0x00 0x00 0x00 adisc-support pm-support num-nodes Fibre Channel card transfer speed Fabric connection Fibre Channel switch transfer speed FC-AL connection CA transfer speed 8Gbps 4Gbps 2Gbps 8Gbps 4Gbps 8Gbps Gbps Gbps

25 Chapter 5 Required Driver Parameters > 5.1 Emulex OEM Fibre Channel Card Setup /kernel/drv/emlxs.conf Example The following is a Fabric connection example. COPYRIGHT Emulex. All rights reserved. Solaris LightPulse emlxs driver: global initialized data. console-notices: Sets the verbose level for driver notices to the console. console-warnings: Sets the verbose level for driver warnings to the console. console-errors: Sets the verbose level for driver errors to the console. log-notices: Sets the verbose level for driver notices to the system log file*. log-warnings: Sets the verbose level for driver warnings to the system log file*. log-errors: Sets the verbose level for driver errors to the system log file*. *NOTE: The system log file is normally found at /var/adm/messages. Each parameter is a bit mask that enables/disables specific types of messages. If the bit is set, then the messages of that type are enabled. The available message types are listed below: LOG_MISC 0x /* Misc events */ LOG_DRIVER 0x /* Driver attach and detach events */ LOG_INIT 0x /* HBA initialization events */ LOG_MEM 0x /* Memory management events */ LOG_SLI 0x /* Service Level Interface (SLI) events */ LOG_MBOX 0x /* Mailbox events */ LOG_NODE 0x /* Node events */ LOG_LINK 0x /* Link events */ LOG_ELS 0x /* ELS events */ LOG_PKT 0x /* General I/O packet events */ LOG_FCP 0x /* FCP traffic events */ LOG_TGTM 0x /* FCP target mode events */ LOG_IP 0x /* IP traffic events */ LOG_SFS 0x /* SFS events */ LOG_IOCTL 0x /* IOCtl events */ LOG_FIRMWARE 0x /* Firmware download events */ LOG_CT 0x /* CT events */ LOG_FCSP 0x /* FCSP events */ LOG_RESERVED 0xfffc0000 /* Reserved for future use */ Range: Min:0 Max:0xffffffff console-notices = 0; (Default) console-warnings = 0; (Default) console-errors = 0; (Default) log-notices = 0xffffffff; (Default) log-warnings = 0xffffffff; (Default) log-errors = 0xffffffff; (Default) 25

26 Chapter 5 Required Driver Parameters > 5.1 Emulex OEM Fibre Channel Card Setup console-notices=0; console-warnings=0; console-errors=0; log-notices=0xffffffff; log-warnings=0xffffffff; log-errors=0xffffffff; num-iocbs: Sets the number of iocb buffers to allocate. Range: Min:128 Max:10240 Default:1024 num-iocbs=1024; ub-bufs: Sets the number of unsolicited buffers to be allocated. Range: Min:40 Max:16320 Default:1000 ub-bufs=1000; +++ Variables relating to IP networking support. +++ network-on: Enable/Disable IP networking support in the driver. 0 = Disables IP networking support in the driver. 1 = Enables IP networking support in the driver. Range: Min:0 Max:1 Default:1 network-on=1; +++ Fibre Channel specific parameters +++ topology: link topology for initializing the Fibre Channel connection. 0 = attempt loop mode, if it fails attempt point-to-point mode 2 = attempt point-to-point mode only 4 = attempt loop mode only 6 = attempt point-to-point mode, if it fails attempt loop mode Set point-to-point mode if you want to run as an N_Port. Set loop mode if you want to run as an NL_Port. Range: Min:0 Max:6 Default:0 For FC-AL connection,emlxs0-topology=4; topology=0; emlxs0-topology=2; emlxs1-topology=2; link-speed: Sets the link speed setting for initializing the Fibre Channel connection. 0 = auto select 1 = 1 Gigabaud 2 = 2 Gigabaud 4 = 4 Gigabaud 8 = 8 Gigabaud Range: Min:0 Max:8 Default:0 For both FC-AL and Fabric connections, add these settings. link-speed=0; emlxs0-link-speed=8; emlxs1-link-speed=8; ack0: Determines if ACK0 is used instead of ACK1 for class 2 acknowledgement. 0 = The driver will use ACK1 for class 2 acknowledgement. 1 = The driver will use ACK0 for class 2 acknowledgement. 26

27 Chapter 5 Required Driver Parameters > 5.1 Emulex OEM Fibre Channel Card Setup Range: Min:0 Max:1 Default:0 ack0=0; cr-delay: Sets the coalesce response delay in the adapter. This value specifies a count of milliseconds after which an interrupt response is generated if cr-count has not been satisfied. This value is set to 0 to disable the Coalesce Response feature as default. Range: Min:0 Max:63 Default:0 cr-delay=0; cr-count: Sets the coalesce response count in the adapter. This value specifies a count of I/O completions after which an interrupt response is generated. This feature is disabled if cr-delay is set to 0. Range: Min:1 Max:255 Default:1 cr-count=1; assign-alpa: Sets a preferred ALPA for the adapter. This is only valid if topology is loop. A zero setting means no preference. If multiple adapter instances on the same host are on the same loop, you will want to set this value differently for each adapter. For example: emlxs0-assign-alpa=0x01; assigns ALPA 0x01 to adapter 0 emlxs1-assign-alpa=0x02; assigns ALPA 0x02 to adapter 1 emlxs2-assign-alpa=0x04; assigns ALPA 0x04 to adapter 2 Range: Min:0x00 Max:0xef Default:0x00 (valid ALPA s only) assign-alpa=0x00; adisc-support: Sets the ADISC login support level. This sets the level of driver support for the Fibre Channel ADISC login I/O recovery method. 0 = No support. Flush active I/O s for all FCP target devices at link down. 1 = Partial support. Flush I/O s for non-fcp2 target devices at link down. 2 = Full support. Hold active I/O s for all devices at link down. Range: Min:0 Max:2 Default:1 adisc-support=1; pm-support: Enable/Disable power management support in the driver. 0 = Disables power management support in the driver. 1 = Enables power management support in the driver. Range: Min:0 Max:1 Default:0 pm-support=0; num-nodes: Number of fibre channel nodes (NPorts) the driver will support. 0 = Indicates auto detect limit of adapter. Range: Min:0 Max:4096 Default:0 num-nodes=0; pci-max-read: Sets the PCI-X max memory read byte count on the adapter. This value controls the adapter s max PCI-X memory read count. On Sunfire x4100/4200 systems this parameter must be changed to 1024 bytes. Currently, this parameter should only be modified on Sunfire x4100/4200 systems due to the unique nature of the PCI-X bus on these systems, otherwise it should be left as default. Options: 512, 1024, 2048, 4096 Range: Min:512 Max:4096 Default:

28 Chapter 5 Required Driver Parameters > 5.1 Emulex OEM Fibre Channel Card Setup *Uncomment this parameter for Sunfire x4100/4200 systems only pci-max-read=1024; linkup-delay: Sets the linkup delay period (seconds) after initialization. This value controls how long the driver waits for the Fibre Channel link to come up after an adapter reset before continuing normal operation. Range: Min:0 Max:60 Default:10 linkup-delay=10; enable-npiv: Enables NPIV support in the driver. Requires SLI3 mode support in the adapter firmware. Range: Min:0 Max:1 Default:0 enable-npiv=0; vport-restrict-login: Restricts login to virtual ports to conserve resources. Requires SLI3 mode support in the adapter firmware. Requires enable-npiv parameter to be set to 1. Range: Min:0 Max:1 Default:1 vport-restrict-login=1; vport: Virtual port registration table. The enable-npiv must be set to 1. The vport table may have any number of comma delimited entries. Each entry must be of the form: "PHYS_WWPN:VPORT_WWNN:VPORT_WWPN:VPORT_ID" PHYS_WWPN = World Wide Port Name of adapter's physical port VPORT_WWNN = Desired World Wide Node Name of virtual port VPORT_WWPN = Desired World Wide Port Name of virtual port VPORT_ID = Desired virtual port id (1 to max vports) The port ids must start at 1 and increment by 1 with no gaps in the count. Example: vport=" c : c : c :1", " c : c : c :2", " c : c : c :1", " c : c : c :2", " c : c : c :3"; enable-auth: Enables DHCHAP support in the driver. Range: Min:0 Max:1 Default:0 enable-auth=0; max-xfer-size: Sets the maximum SCSI transfer size in bytes per IO This parameter is only used by the driver on i386 platforms. The driver does not limit transfer size on SPARC platforms. This parameter determines the scatter gather list buffer size. A pool of buffers is reallocated by the driver during boot. A larger transfer size requires a larger memory allocation. Memory_model max-xfer-size Small Medium Large Range: Min: Max: Default: max-xfer-size=339968; 28

29 Appendix A Management Table Template The following management table is required in "Chapter 3 Setting Up the Server" (page 9). Use it as required. A.1 WWN Instance Management Table for the Server WWN instance management table for the server Physical slot WWN Controller number Instance name name Physical path name 29

30 ETERNUS Disk storage systems Server Connection Guide (Fibre Channel) for Oracle Solaris Driver Settings for Sun Fibre Channel Cards Date of issuance: December 2010 Issuance responsibility: FUJITSU LIMITED The contents of this manual are liable to being updated without notice. While the contents of this manual are the product of all due care and diligence, no responsibility can be accepted for operational problems arising from any errors or missing information, or other use of the information contained in this manual. Fujitsu assumes no liability for damages to third party copyrights or other rights arising from the use of any information in this manual. Contents of this manual are not to be reproduced without permission from Fujitsu.

31