ST P/60M. User Manual

Transcription

1 ST P/60M User Manual Version 2.1 June Copyright 2017 Wiwynn. All rights reserved.

2 Copyright Copyright 2017 by Wiwynn Corporation. All rights reserved. No part of this publication may be reproduced, transmitted, transcribed, stored in a retrieval system, or translated into any language or computer language, in any form or by any means, electronic, mechanical, magnetic, optical, chemical, manual or otherwise, without the prior written permission of Wiwynn Corporation. Disclaimer The information in this guide is subject to change without notice. Wiwynn Corporation makes no representations or warranties, either expressed or implied, with respect to the contents hereof and specifically disclaims any warranties of merchantability or fitness for any particular purpose. Any Wiwynn Corporation software described in this manual is sold or licensed "as is". Should the programs prove defective following their purchase, the buyer (and not Wiwynn Corporation, its distributor, or its dealer) assumes the entire cost of all necessary servicing, repair, and any incidental or consequential damages resulting from any defect in the software. 2 Wiwynn ST P/60M User Manual

3 Revision History Date Version Changes 2016/12/ First release 2017/03/ Added chapters regarding: 1. Pre OS Installation 2. Connecting Wiwynn ST P/60M to the servers. Re-organized contents 2017/05/ Added items in section Moved original Chapters 4 and 5 to Chapters 6 and Added Chapter 4 Client Remote Environment Setup. 4. Added Chapter 5 Applicable System utilities. 2017/06/ Added section 5.5 BMC Connection via Retimer Card. 2. Combined and revised sections 6.7 and 6.8 as 6.7 Replacing U.2 SSD Cartridge and Module. 3. Added section 6.8 Replacing M.2 SSD Cartridge and Module. Wiwynn ST P/60M User Manual 3

4 Contents Contents... 4 Preface... 7 Introduction... 7 About this Manual... 7 Conventions System Tour System Specification Front Panel Rear Panel PCIe Expander Board PCIe Expander Board LED Indicator Status Drive Plane Board Fan Controller Board Installing and Removing the System from the Rack Installing Removing the System from the Rack Connecting ST P/60M to SV7221G Client Remote Environment Setup BMC IP Setting Client Remote Environment Setup (Windows) Client Remote Environment Setup (Linux) Applicable System Utilities lspci fdisk lsblk nvme BMC Connection via Retimer Card Wiwynn ST P/60M User Manual

5 6 System Upgrades Safety instructions Recommended Tools Replacing the Side Ear Brackets Removing the Side Ear Brackets Installing the Side Ear Brackets Opening the System Removing the Top Cover Installing the Top Cover Replacing the System Fans Removing the Fan Module Installing the Fan Module Replacing the PCIe Expander Boards Removing the PCIe Expander Board Installing the PCIe Expander Board Replacing the U.2 SSD Cartridge and Module (for ST P) Removing the U.2 SSD Cartridge Installing the U.2 SSD Cartridge Removing the U.2 SSD Module Installing the U.2 SSD Module Replacing the M.2 SSD Cartridge and Module (for ST M) Removing the M.2 SSD Cartridge Installing the M.2 SSD Cartridge Removing the M.2 SSD Module Installing the M.2 SSD Module Replacing the Power Cable Removing the Power Cable Wiwynn ST P/60M User Manual 5

6 6.9.2 Installing the Power Cable Replacing the SSD Tray Removing the SSD Tray Installing the SSD Tray Replacing the Bus Bar Cable Module Removing the Bus Bar Cable Module Installing the Bus Bar Cable Module Replacing the Fan Controller Board Removing the Fan Controller Board Installing the Fan Controller Board Replacing the Power Transition Board Removing the Power Transition Board Installing the Power Transition Board Replacing the Drive Plane Board Removing the Drive Plane Board Installing the Drive Plane Board Checking Errors Using the Debug Card Installing the Debug Card Error Code Definition Wiwynn ST P/60M User Manual

7 Preface Wiwynn ST P/60M is the leading All-Flash NVMe Storage in the industry, featuring up to 60/30 NVMe SSDs. Introduction With an impressive storage capacity of 60 NVMe SSDs in a 2U chassis, Wiwynn ST P/60M stands out from other JBOF storage systems as having the densest storage capacity in the industry. About this Manual The contents in this manual include: Chapter 1 describes the system specification, front and rear components, and the different boards Chapter 2 shows how to install or remove the system to or from the rack Chapter 3 shows how to connect the cables from the system to the SV7221G2 Chapter 4 shows how to set up the remote environment on the client Chapter 5 lists the applicable system utilities Chapter 6 shows how to replace the system and system components Chapter 7 shows how to install the debug card and using it to check errors Wiwynn ST P/60M User Manual 7

8 Conventions WARNING CAUTION Indicates the presence of a hazard that may result in serious personal injury if the WARNING is ignored. Indicates the presence of a hazard that may cause minor personal injury or property damage if the CAUTION is ignored. 8 Wiwynn ST P/60M User Manual

9 1 System Tour Wiwynn ST P/60M must be connected to SV7221G2-S or SV7221G2-V servers through the exclusive PCIe retimer card designed by Wiwynn. Additional server support may be available in the future. 1.1 System Specification Storage and IO Expander Storage Expansion Ports Remote Management PCIe 3.0 Switch Thirty hot-plug drive bays (fifteen per tray): 60 M.2 NVMe SSDs: or U.2 NVMe SSDs 15mm or 7mm Up to 4 PCIe 3.0 (x16) ports BMC (Pass Through from Retimer Card) Power Supply, Physical and Packaging Specifications Power Supply Form Factor Dimensions Weight Centralized 12V DC bus bar 2 OU (Open Rack) 93.5(H) x 536 (W) x 795 (D) 38 kg ~ 55 kg Wiwynn ST P/60M User Manual 9

10 System Requirements Compatible Server(s) Expansion Card(s) Cable(s) Wiwynn SV7221G2-S Wiwynn SV7221G2-V Retimer card Mini-SAS HD Cable (for retimer card) Host to PEB cables are custom mini-sas HD cables. Cables are available in 1.5M and 2M lengths. Operating System OS (CentOS 6.7 and above) supported by the client servers Applicable System Utilities lspci - lists all PCI devices fdisk partition table manipulator for Linux lsblk lists block devices nvme lists all recognized NVMe devices Note: For details regarding the command format and parameters of these utilities, please refer to Chapter 5 System Utilities. 10 Wiwynn ST P/60M User Manual

11 1.2 Front Panel The illustration below shows the system front panel. Tray 1 Tray 2 Item Component Item Component 1 SSD Tray 1 7 SSD Tray 2 2 USB Port 8 USB Port 3 Mini-SAS HD Port 1 9 Mini-SAS HD Port 1 4 Debug Port 10 Debug Port 5 Mini-SAS HD Port 2 11 Mini-SAS HD Port 2 6 PCIe Expander Board in Tray 1 12 PCIe Expander Board in Tray 2 Important: Mini-SAS HD Port 1 must be populated first before Port 2 in Tray 1. The same goes for Tray 2. See Chapter 3 for details on how to connect the mini-sas HD cable from ST P/60M to SV7221G2. Wiwynn ST P/60M User Manual 11

12 1.3 Rear Panel Item Component 1 Fan 1 2 Fan 2 3 Fan 3 4 Bus Bar Connector 5 Fan 4 6 Fan 5 7 Fan 6 8 Top Cover Thumbscrews 12 Wiwynn ST P/60M User Manual

13 1.4 PCIe Expander Board Item Component Item Component 1 BMC AST Mini-SAS HD Port 1 2 Battery Holder 7 Debug Port 3 BMC 8 RST slide switch 4 RJ45 Header (Not Populated) 9 Mini-SAS HD Port 2 5 USB Port 10 EJTAG header Wiwynn ST P/60M User Manual 13

14 1.4.1 PCIe Expander Board LED Indicator Status LED LED4 LED5 LED14 LED8, LED9, LED10, LED11, LED12, LED13, LED15, LED16 LED18~23 SLED28 SLED29 Description Enclosure Fault Status Power and System Identify UART : BMC or PM8536 indicated LED UPLINK indicator Virtual SW Zoning indicator BMC Heart Beat LED PMC Heart Beat LED 14 Wiwynn ST P/60M User Manual

15 LED Indicator LED Color LED State LED4 Red Off Normal system operation LED5 Power and System Identify LED14 UART : BMC or PM8536 indicated LED LED8, LED9, LED10, LED11 LED12, LED13, LED15, LED16 Uplink Status Uplink Status On Blinking Status Any fault in whole enclosure Reserved for future use Blue Consistently on Power on, System Identify off On 0.9sec, off 0.1sec, and loop Power on, System Identify on Yellow On PMC Path Off Green LED8 LED9 LED10 LED11 On Off Off Off Green LED8 LED9 LED10 LED11 On On Off Off Green LED8 LED9 LED10 LED11 On On On On Green LED12 LED13 LED15 On Off Off Off Green LED12 LED13 LED15 On On Off Off Green LED12 LED13 LED15 On On On On LED16 LED16 LED16 BMC Path X16 X8 Reserved X16 X8 Reserved Wiwynn ST P/60M User Manual 15

16 LED Indicator LED18, LED19, LED20, LED21, LED22, LED23 SLED28 SLED29 Mini-SAS Port Link Status BMC Heart Beat PMC Heart Beat LED Color LED State Green LED18 LED19 LED20 LED21 LED22 LED23 On Off Off Off Off Off Green LED18 LED19 LED20 LED21 LED22 LED23 Off On Off Off Off Off Green LED18 LED19 LED20 LED21 LED22 LED23 Off Off On Off Off Off Green LED18 LED19 LED20 LED21 LED22 LED23 Off Off Off On Off Off Green LED18 LED19 LED20 LED21 LED22 LED23 Off Off Off Off On Off Green LED18 LED19 LED20 LED21 LED22 LED23 Off Off Off Off Off On Status 1X16 2X8 Reserved 2x16 4x8 Reserved Yellow Blinking BMC FW working On/Off BMC FW not working Yellow Blinking PMC FW working On/Off PMC FW not working 16 Wiwynn ST P/60M User Manual

17 1.5 Drive Plane Board Item Component Item Component 1 Straddle Connector 11 SSD9 Connector 2 SSD0 Connector 12 SSD10 Connector 3 SSD1 Connector 13 SSD11 Connector 4 SSD2 Connector 14 SSD12 Connector 5 SSD3 Connector 15 SSD13 Connector 6 SSD4 Connector 16 SSD14 Connector 7 SSD5 Connector 17 PCIe Gen3 Connector 1 (Power and Signals) 8 SSD6 Connector 18 PCIe Gen3 Connector 2 (Signals) 9 SSD7 Connector 19 PCIe Gen3 Connector 3 (Signals) 10 SSD8 Connector Wiwynn ST P/60M User Manual 17

18 1.6 Fan Controller Board Item Component 1 Fan 1 Connector 2 Fan 2 Connector 3 Fan 3 Connector 4 Fan 4 Connector 5 Fan 5 Connector 6 Fan 6 Connector 7 Power Cable Connector 1 8 Power Cable Connector 2 18 Wiwynn ST P/60M User Manual

19 2 Installing and Removing the System from the Rack Caution: The system is very heavy. Use a server lift or at least two people to lift the system into or from the rack. If this is your first time to install the server to the rack, please pay attention to the procedures below regarding safety concerns. To avoid personal injury or damage to the system, you must adequately support the system rack during installation and removal. WARNING CAUTION Only a certified service technician can do certain repairs. You should only perform troubleshooting and simple repairs, or as directed by the online or telephone service and support team. Damage due to servicing that is not authorized by Wiwynn is not covered by your warranty. Wiwynn ST P/60M User Manual 19

20 2.1 Installing the System into the Rack 1 Insert the system into the chassis (1) then lift the tabs to release the latch handles (2). 2 Push the system into the chassis. 20 Wiwynn ST P/60M User Manual

21 3 When the latch handles clear the rack posts, return the latch handles to the lock position (1) and push the system (2) until it is securely fitted into the rack. Wiwynn ST P/60M User Manual 21

22 2.2 Removing the System from the Rack 1 Lift the tabs to release the latch handles that secure the SSD tray to the chassis. 2 Slide the system slowly out of the rack using two hands. 22 Wiwynn ST P/60M User Manual

23 3 When the latch handles clear the rack posts, return the latch handles to the lock position (1), then slide the system out of the rack (2). Wiwynn ST P/60M User Manual 23

24 3 Connecting ST P/60M to SV7221G2 Before connecting the cables from ST P/60M to SV7221G2, check that: At least one PCIe expander board is installed in ST P/60M At least a set of external mini-sas HD cable is present Retimer card is installed in SV7221G2 (refer to the SV7221G2 User Manual for details on how to install a PCIe card) 24 Wiwynn ST P/60M User Manual

25 Follow these steps to connect ST P/60M to SV7221G2: 1 Locate the mini-sas HD ports on ST P/60M. Important: Mini-SAS HD Port 1 must be populated first before Port 2 in Tray 1. The same goes for Tray 2. 2 Connect one end of the mini-sas HD cable to connectors AB on mini-sas HD port 1 on ST P/60M. Wiwynn ST P/60M User Manual 25

26 3 Get a second external mini-sas HD cable. Connect one end of the external mini-sas HD cable to connectors CD on mini-sas HD port 1 on ST P/60M. Caution: The mini-sas HD cable connected to AB connectors on ST P/60M must be connected to the corresponding AB connectors on SV7221G2, likewise for the CD connectors. 26 Wiwynn ST P/60M User Manual

27 4 The retimer card is powered through the USB port. Connect one end of the USB cable to the USB port (1) on the retimer card and the other end to the internal USB port (2) on the SV7221G2. Wiwynn ST P/60M User Manual 27

28 5 Connect the external mini-sas HD cable from connectors AB on ST P/60M to AB (1) on the retimer card installed in SV7221G2. Connect CD on ST P/60M to CD (2) on the retimer card installed in SV7221G2. 6 Proceed to the next chapter to perform the pre OS installation procedure for the SV7221G2 node you just connected. Important: You must complete the pre OS installation procedure for one node before connecting the next node. 7 Repeat the steps above to connect another SV7221G2 node. 28 Wiwynn ST P/60M User Manual

29 4 Client Remote Environment Setup After connecting Wiwynn ST P/60M to the SV7221G2 servers, you can now set up the client remote environment on the SV7221G2 servers as shown in the following sections. 4.1 BMC IP Setting 1 Upon power on, enter the server BIOS setup by pressing the Del, Esc or F1 key (please refer to the server BIOS User Manual for details on how to enter the BIOS Setup). Note that the following BIOS screens are just sample screens. The actual BIOS screens on your server may look different. Wiwynn ST P/60M User Manual 29

30 2 The screen displays the BIOS Setup Utility. 3 Select Server Mgmt and then select BMC network configuration. 30 Wiwynn ST P/60M User Manual

31 4 Select the Configuration Address Source. Options are Unspecified, Static and DHCP. Unspecified will not change any BMC network parameters during the BIOS phase. 5 If Static is selected, the LAN channel parameters (such as Station IP address, Subnet mask and Router IP address) must be keyed in manually. Wiwynn ST P/60M User Manual 31

32 6 Key in the Station IP address, Subnet mask and Router IP address. 32 Wiwynn ST P/60M User Manual

33 7 If DHPC is selected, the LAN channel parameters will be configured automatically. 8 Select Save & Exit to save the changes and exit the BIOS Setup Utility. Wiwynn ST P/60M User Manual 33

34 4.2 Client Remote Environment Setup (Windows) 1 Click on the Windows Start button on the far left of the Taskbar and key in Java and select Configure Java. 34 Wiwynn ST P/60M User Manual

35 2 The screen displays the Java Control Panel as follows: \ 3 Click on the Security Tab. Wiwynn ST P/60M User Manual 35

36 4 Click on Edit Site List to display the Exception Site List. 5 Click on Add to display a blank row. Key in the server BMC IP (obtained in section 4.1 BMC IP Setting) in the blank row and click on OK. 36 Wiwynn ST P/60M User Manual

37 6 Open your browser and key in the server BMC IP (obtained in section 4.1 BMC IP Setting) to go to the BMC login screen. Note that the following BMC screens are just sample screens. The actual BMC screens on your server may look different. 7 Enter your username and password (refer to the server BMC user manual). 8 Click on the Login button to view the GUI. Wiwynn ST P/60M User Manual 37

38 9 Select Remote Control > Console Redirection. 10 Click on the Java Console button. 38 Wiwynn ST P/60M User Manual

39 11 Download and launch the JViewer.jnlp file. 12 The screen displays the Security Warning. 13 Select Accept and click on Run. Wiwynn ST P/60M User Manual 39

40 14 You will see the JViewer screen. Click on the CDROM icon. Note that the icon is encircled in red because there is no image file. CDROM icon 15 Select the media containing the image file and click the corresponding Connect key. Click on Close if you did not select any media. 40 Wiwynn ST P/60M User Manual

41 16 Retrieve an image file. For example, select CD Image under CD/DVD Media, and then click on the Connect CD/DVD button. 17 Click on OK. Wiwynn ST P/60M User Manual 41

42 18 The CDROM icon is now encircled in green to indicate that you have mounted the image successfully. Click on the power button on the upper right and click on Yes to turn on power. CDROM icon Power button 42 Wiwynn ST P/60M User Manual

43 19 Upon power on, enter the server BIOS setup by pressing the Del, Esc or F1 key (please refer to the server BIOS User Manual for details on how to enter the BIOS Setup). Note that the following BIOS screens are just sample screens. The actual BIOS screens on your server may look different. Wiwynn ST P/60M User Manual 43

44 20 The screen displays the BIOS Setup Utility. 21 Click on Save & Exit. Select the media and image file and press Enter. 44 Wiwynn ST P/60M User Manual

45 4.3 Client Remote Environment Setup (Linux) 1 Click on the Firefox Web Browser icon. 2 Enter the BMC IP address (specific IP address provided by the supplier (static) or IP assigned by the DHCP server) into your web browser and you will see the BMC login page. Wiwynn ST P/60M User Manual 45

46 3 Click on Preference and select Allow pop-ups. 4 You will see a green check icon at the end of 1. Allow pop-ups from this site option in the BMC login menu. 5 Key in the username and password. 46 Wiwynn ST P/60M User Manual

47 6 After logging in successfully, the BMC Web GUI appears as shown below: 7 Select Remote Control and then Console Redirection. Wiwynn ST P/60M User Manual 47

48 8 Under the Console Redirection screen, click on the Java Console button. 9 Open jviewer. 48 Wiwynn ST P/60M User Manual

49 10 Run jviewer. 11 The screen displays the jviewer window. Wiwynn ST P/60M User Manual 49

50 12 You will see the JViewer screen. Click on the CDROM icon. Note that the icon is encircled in red because there is no image file. CDROM icon 13 Select the media containing the image file and click the corresponding Connect key. Click on Close if you did not select any media. 50 Wiwynn ST P/60M User Manual

51 14 Retrieve an image file. For example, select CD Image under CD/DVD Media, and then click on the Connect CD/DVD button. 15 Click on OK. Wiwynn ST P/60M User Manual 51

52 16 The CDROM icon is now encircled in green to indicate that you have mounted the image successfully. Click on the power button on the upper right and click on Yes to turn on power. CDROM icon Power button 52 Wiwynn ST P/60M User Manual

53 17 Upon power on, enter the server BIOS setup by pressing the Del, Esc or F1 key (please refer to the server BIOS User Manual for details on how to enter the BIOS Setup). Note that the following BIOS screens are just sample screens. The actual BIOS screens on your server may look different. Wiwynn ST P/60M User Manual 53

54 18 The screen displays the BIOS Setup Utility. 19 Click on Save & Exit. Select the media and image file and press Enter. 54 Wiwynn ST P/60M User Manual

55 5 Applicable System Utilities This chapter lists the system utilities and their parameters that are applicable to the ST P/60M system. 5.1 lspci Use lspci to list all PCI devices. Command format: lspci vt -v Verbose display of detailed information about all devices. -t Shows a tree-like diagram containing all buses, bridges, devices and connections between them. The following is a sample screen showing the PCI devices listed using the lspci command: Wiwynn ST P/60M User Manual 55

56 5.2 fdisk fdisk is the partition table manipulator for Linux. Command format: fdisk -l -l Lists the partition tables for the specified devices and then exit. The following is a sample screen showing the partition tables listed using the fdisk command: 56 Wiwynn ST P/60M User Manual

57 5.3 lsblk lsblk lists information about all or specified block devices. The lsblk command reads the sysfs filesystem to gather information. Command format: lsblk The following is a sample screen showing the block device information listed using the lsblk command: Wiwynn ST P/60M User Manual 57

58 5.4 nvme nvme lists all recognized NVMe devices. Command format: nvme list list Scans the sysfs tree for NVM Express devices and returns the /dev node for those devices as well as some pertinent information about them. The following is a sample screen showing the list of NVMe devices using the nvme command: 58 Wiwynn ST P/60M User Manual

59 5.5 BMC Connection via Retimer Card 1 Connect ST P/60M to SV7221G2 (see Connecting ST P/60M to SV7221G2 on page 24) and then type ip a to check the device of the retimer card. 2 Note that the state is Down. After bringing up the interface, connect to BMC using the ssh command with root/0penbmc. Wiwynn ST P/60M User Manual 59

60 3 Login to the BMC on Lightning to get the device information using the following utilities. a. fruid-util- reads the FRUID information of the side plane boards: fruid-util [peb pdpb fcb all] ped = PCie expander board pdpb = PCIe Drive Plane Board fcb = Fan Controller Board b. fan-util - gets fan speed status: fan-util --get c. enclosure-util - gets drive information and check drive health status: enclosure-util --drive-status <slot number [0~14], --all> enclosure-util --drive-health d. sensor-util - provides sensor information for side plane boards: sensor-util [peb pdpb fcb all] ped = PCie expander board pdpb = PCIe Drive Plane Board fcb = Fan Controller Board 60 Wiwynn ST P/60M User Manual

61 6 System Upgrades NOTE: The components shown in this chapter are for your reference in replacement only. Actual component may vary and may not reflect the appearance of the component. 6.1 Safety instructions Read these instructions carefully. Keep this document for future reference. Follow all warnings and instructions for your safety and to avoid damaging the system. 1 Use both hands on the tray handles at all times and keep the SDD trays in the horizontal position when pulling out or pushing in to avoid damaging the SSDs and PCIe expander boards. 2 To avoid any injury, do not hold and use the latches or other parts of the SSD tray to pull out or push in. 3 For safety reason, after pulling out the SSD tray, keep holding the tray to prevent it from dropping. 4 SSD cartridges on the SSD tray may pop out if systems are inappropriately handled during transport, for example, if it is dropped upside down. This will prevent you from pulling out the upper or lower SSD tray alone. To fix this, you need to pull out the two SSD trays together, find the SSD cartridges that popped out and press them back into place. If you still cannot pull out the SSD tray, DO NOT FORCE IT and contact Customer Service for assistance. Wiwynn ST P/60M User Manual 61

62 5 When pulling the system out of the rack for doing system upgrade, maintenance, and debug, make sure to always place the system on a flat rigid surface. Caution: DO NOT place the system on a foam pad or other non-rigid surface; doing so may cause the chassis to warp, damaging the PCIe expander boards and damaging the drive plane board connectors while pulling out the SSD tray. 6 Before you pull out one SSD tray, make sure the other SSD tray is latched and secured by the latch handles. 7 Caution: The power in your system have energy hazards, which can cause bodily harm. Unless you are instructed otherwise, only trained service technicians are authorized to remove the covers and access any of the components inside the system. Remove the power before execute below item: - Replacing the Power cable; or - Replacing the Bus Bar Cables; or - Replacing the Fan Controller Board 62 Wiwynn ST P/60M User Manual

63 6.2 Recommended Tools In performing the disassembly and assembly process, you will need the following tools: Philips screwdriver Flat screwdriver Torque screwdriver Wiwynn ST P/60M User Manual 63

64 6.3 Replacing the Side Ear Brackets The system is shipped with two side ear brackets installed as a safety precaution during transport. Remove the brackets before installing the system in its rack Removing the Side Ear Brackets 1 Remove the four screws securing the left and right side ear brackets to the chassis. 2 Detach the two side ear brackets from the chassis. 64 Wiwynn ST P/60M User Manual

65 6.3.2 Installing the Side Ear Brackets 1 Align the left and right side ear brackets to both sides of the chassis. 2 Secure the side ear brackets to the chassis by using four screws. Tighten screws using 1.0 kgf-cm torque. Do not over-tighten the screws to avoid damaging to the SSD trays. Wiwynn ST P/60M User Manual 65

66 6.4 Opening the System Removing the Top Cover 1 Remove the system from the rack (see Removing the System from the Rack on page 22). 2 Loosen the two thumbscrews securing the top cover to the chassis. 3 Slide the top cover towards the rear and lift it off the chassis. 66 Wiwynn ST P/60M User Manual

67 6.4.2 Installing the Top Cover 1 Lower the top cover onto the chassis and slide it towards the front until the thumbscrews are aligned with the screw holes. 2 Secure the top cover to the chassis by tightening the two thumbscrews. 3 Install the system into the rack (see Installing the System into the Rack on page 20). Wiwynn ST P/60M User Manual 67

68 6.5 Replacing the System Fans Removing the Fan Module 1 Remove the system from the rack (see Removing the System from the Rack on page 22). 2 Loosen the thumbscrew securing the fan module to the chassis. 3 Pull out the fan module and lift it off the chassis. 68 Wiwynn ST P/60M User Manual

69 6.5.2 Installing the Fan Module 1 Insert the fan module into the chassis. 2 Secure the fan module to the chassis by tightening the thumbscrew. 3 Install the system into the rack (see Installing the System into the Rack on page 20). Wiwynn ST P/60M User Manual 69

70 6.6 Replacing the PCIe Expander Boards Removing the PCIe Expander Board 1 Loosen the thumbscrews securing the PCIe expander board to the SSD tray. 2 Pull out the PCIe expander board from the SSD tray. 70 Wiwynn ST P/60M User Manual

71 6.6.2 Installing the PCIe Expander Board 1 Insert the PCIe expander board into the SSD tray. 2 Secure the PCIe expander board to the SSD tray by tightening the thumbscrews. Wiwynn ST P/60M User Manual 71

72 6.7 Replacing the U.2 SSD Cartridge and Module (for ST P) Removing the U.2 SSD Cartridge 1 Lift the tabs to release the latch handles that secure the SSD tray to the chassis. 2 Pull out the SSD tray from the chassis using both hands. 72 Wiwynn ST P/60M User Manual

73 3 Press the latch (1) and slide the lock counterclockwise (2) to unlock the cartridge. 4 Slide the lock counterclockwise until it is completely in the unlock positiom. Wiwynn ST P/60M User Manual 73

74 5 Slide the U.2 cartridge (1) to disengage it from its connector and remove the cartridge (2) from the tray. 6 Repeat steps 3 to 5 to remove other U.2 cartridges. 74 Wiwynn ST P/60M User Manual

75 6.7.2 Installing the U.2 SSD Cartridge 1 Lower the U.2 cartridge (1) into the tray and slide the cartridge (2) toward the connector until it latches into place.. 2 Slide the lock clockwise to lock the cartridge. 9 Wiwynn ST P/60M User Manual 75

76 3 Slide the lock clockwise until it is completely in the lock positiom. 4 Repeat steps 1 to 3 to install other U.2 cartridges. 5 Push the SSD tray into the chassis using both hands. 76 Wiwynn ST P/60M User Manual

77 6 When the latch handles clear the rack posts, return the latch handles to the lock position (1). Push the system (2) until it is securely fitted into the rack. Wiwynn ST P/60M User Manual 77

78 6.7.3 Removing the U.2 SSD Module 1 Remove the U.2 SSD cartridge (see Removing the U.2 SSD Cartridge on page 72) from the SSD tray. 2 Turn over the cartdige so that the bottom side is facing up. 3 Remove the U.2 SSD module from its cartridge. 78 Wiwynn ST P/60M User Manual

79 6.7.4 Installing the U.2 SSD Module 1 Turn over the cartdige so that the bottom side is facing up. Insert the U.2 SSD module into the its cartridge. 2 Install the U.2 SSD cartridge (see Installing the U.2 SSD Cartridge on page 75) into the SSD tray. Wiwynn ST P/60M User Manual 79

80 6.8 Replacing the M.2 SSD Cartridge and Module (for ST M) Removing the M.2 SSD Cartridge 1 Lift the tabs to release the latch handles that secure the M.2 tray to the chassis. 2 Pull out the M.2 tray from the chassis using both hands. 80 Wiwynn ST P/60M User Manual

81 3 Press the latch (1) and slide the lock counterclockwise (2) to unlock the cartridge cover. 4 Slide the lock counterclockwise until it is completely in the unlock positiom. Wiwynn ST P/60M User Manual 81

82 5 Slide the M.2 cartridge (1) to disengage it from its connector and remove the cartridge (2) from the tray. 82 Wiwynn ST P/60M User Manual

83 6.8.2 Installing the M.2 SSD Cartridge 1 Lower the M.2 cartridge (1) into the tray and slide the cartridge (2) toward the connector until it latches into place.. 2 Slide the lock clockwise to lock the cartridge cover. Wiwynn ST P/60M User Manual 83

84 3 Slide the lock clockwise until it is completely in the lock positiom. 4 Push the M.2 tray into the chassis using both hands 84 Wiwynn ST P/60M User Manual

85 5 When the latch handles clear the rack posts, return the latch handles to the lock position (1). Push the system (2) until it is securely fitted into the rack. Wiwynn ST P/60M User Manual 85

86 6.8.3 Removing the M.2 SSD Module NOTE: It is not necessary to remove the M.2 cartridge from the tray if you are replacing the M.2 SSD module. 1 Lift the tabs to release the latch handles that secure the M.2 tray to the chassis. 2 Pull out the M.2 tray from the chassis using both hands. 86 Wiwynn ST P/60M User Manual

87 3 Pry up the latch on the M.2 cartridge cover. 4 Remove the M.2 cartridge cover. Wiwynn ST P/60M User Manual 87

88 5 Press the latch on the M.2 heat sink. 6 Lift and remove the M.2 heat sink. 88 Wiwynn ST P/60M User Manual

89 7 Remove the M.2 module from its cartrdige. 8 Repeat stpes 4 to 7 to remove the other M.2 module in the cartrdige. Wiwynn ST P/60M User Manual 89

90 6.8.4 Installing the M.2 SSD Module 1 Insert (1) and press (2) the M.2 module into its cartrdige. 2 Insert (1) and close (2) the M.2 heat sink. 90 Wiwynn ST P/60M User Manual

91 3 Press the heat sink until its latch clicks into the cartrdige. 4 Lower and insert the cartridge cover until the cover latch clicks into the tray. Wiwynn ST P/60M User Manual 91

92 5 Push the M.2 tray into the chassis using both hands 6 When the latch handles clear the rack posts, return the latch handles to the lock position (1). Push the system (2) until it is securely fitted into the rack. 92 Wiwynn ST P/60M User Manual

93 6.9 Replacing the Power Cable Removing the Power Cable 1 Remove the system from the rack (see Removing the System from the Rack on page 22). 2 Remove the top cover (see Removing the Top Cover on page 66). 3 Disconnect the power cable from the drive plane board. Wiwynn ST P/60M User Manual 93

94 4 Remove the cable clips that secure the power cable to the guide rail. 5 Disconnect the power cable from the fan controller board. 94 Wiwynn ST P/60M User Manual

95 6.9.2 Installing the Power Cable 1 Connect the power cable to the fan controller board. 2 Secure the power cable to the guide rail using cable clips. Wiwynn ST P/60M User Manual 95

96 3 Connect the power cable to the drive plane board. 4 Install the top cover (see Installing the Top Cover on page 67). 5 Install the system into the rack (see Installing the System into the Rack on page 20). 96 Wiwynn ST P/60M User Manual

97 6.10 Replacing the SSD Tray Removing the SSD Tray 1 Lift the tabs to release the latch handles that secure the SSD tray to the chassis. 2 Pull out the SSD tray from the chassis using both hands. Wiwynn ST P/60M User Manual 97

98 3 Disconnect the power cable from the drive plane board. 4 Loosen the thumbscrew securing the SSD tray to the guide rail. 98 Wiwynn ST P/60M User Manual

99 5 Disengage the two safety latches that secure the SSD tray to the chassis (1), then pull out the SSD tray from the chassis (2). NOTE: Make sure that the latches are pushed completely downwards and if the SSD tray cannot be pulled out, push it back into the chassis approximately 1/8 (3mm) and try again. Wiwynn ST P/60M User Manual 99

100 Installing the SSD Tray 1 Insert the SSD tray into the chassis, making sure the sliders are properly aligned with the rails in the chassis. 2 Secure the SSD tray to the guide rail by tightening the thumbscrew. 100 Wiwynn ST P/60M User Manual

101 3 Connect the power cable to the drive plane board. 4 When the latch handles clear the rack posts, return the latch handles to the lock position (1). Push the system (2) until it is securely fitted into the rack. Wiwynn ST P/60M User Manual 101

102 6.11 Replacing the Bus Bar Cable Module Removing the Bus Bar Cable Module 1 Remove the system from the rack (see Removing the System from the Rack on page 22). 2 Remove the top cover (see Removing the Top Cover on page 66). 3 Remove the fan modules (see Removing the Fan Module on page 68). 4 Remove the power cables (see Removing the Power Cable on page 93). 5 Remove the SSD trays (see Removing the SSD Tray on page 97). 6 Remove the five screws securing the bus bar cable module to the fan controller board. 102 Wiwynn ST P/60M User Manual

103 7 Using a torx screw driver, remove the four torx screws securing the bus bar cable module to the chassis. 8 Remove the bus bar cable module from the chassis. Wiwynn ST P/60M User Manual 103

104 Installing the Bus Bar Cable Module 1 Insert the bus bar cable module into the chassis. 2 Using a torx screw driver, secure the bus bar cable module to the chassis with four torx screws. 104 Wiwynn ST P/60M User Manual

105 3 Secure the bus bar cable module to the fan controller board using five screws. 4 Install the SSD trays (see Installing the SSD Tray on page 100). 5 Install the power cables (see Installing the Power Cable on page 95). 6 Install the fan modules (see Installing the Fan Module on page 69). 7 Install the top cover (see Installing the Top Cover on page 67). 8 Install the system into the rack (see Installing the System into the Rack on page 20). Wiwynn ST P/60M User Manual 105

106 6.12 Replacing the Fan Controller Board Removing the Fan Controller Board 1 Remove the system from the rack (see Removing the System from the Rack on page 22). 2 Remove the top cover (see Removing the Top Cover on page 66). 3 Remove the fan modules (see Removing the Fan Module on page 68). 4 Remove the power cables (see Removing the Power Cable on page 95). 5 Remove the SSD trays (see Removing the SSD Tray on page 97). 6 Remove the bus bar cable module (see Removing the Bus Bar Cable Module on page 102). 7 Remove the eight screws securing the fan controller board to the chassis. 8 Remove the fan controller board from the chassis. 106 Wiwynn ST P/60M User Manual

107 Installing the Fan Controller Board 1 Insert the fan controller board into the chassis. 2 Secure the fan controller board to the chassis using eight screws. 3 Install the bus bar cable module (see Installing the Bus Bar Cable Module on page 104). 4 Install the SSD trays (see Installing the SSD Tray on page 100). 5 Install the power cables (see Installing the Power Cable on page 95). 6 Install the fan modules (see Installing the Fan Module on page 69). 7 Install the top cover (see Installing the Top Cover on page 67). 8 Install the system into the rack (see Installing the System into the Rack on page 20). Wiwynn ST P/60M User Manual 107

108 6.13 Replacing the Power Transition Board Removing the Power Transition Board 1 Remove the PCIe expander boards (see Removing the PCIe Expander Board on page 70). 2 Remove the SSD cartridges (see Removing the SSD Cartridge on page 72). 3 Remove the SSD trays (see Removing the SSD Tray on page 97). 4 Turn the SSD tray over to access its back side. 5 Remove the four screws securing the power transition board to the tray. 108 Wiwynn ST P/60M User Manual

109 6 Detach the plastic ramp (1) from the power transition board. Slide the power transition board to disengage it from the drive plane board, then lift it off the tray (2). Wiwynn ST P/60M User Manual 109

110 Installing the Power Transition Board 1 Lower the power transition board onto the back side of the tray and slide it toward the drive plane board (1) until it latches into place. Place the plastic ramp (2) on the power transition board. 110 Wiwynn ST P/60M User Manual

111 2 Secure the power transition board to the back side of the tray using four screws. 3 Turn the SSD tray over to its up side. 4 Install the SSD trays (see Installing the SSD Tray on page 100). 5 Install the SSD cartridges (see Installing the SSD Cartridge on page 75). 6 Install the PCIe expander boards (see Installing the PCIe Expander Board on page 71). Wiwynn ST P/60M User Manual 111

112 6.14 Replacing the Drive Plane Board Removing the Drive Plane Board 1 Remove the PCIe expander boards (see Removing the PCIe Expander Board on page 70). 2 Remove the SSD cartridges (see Removing the SSD Cartridge on page 72). 3 Remove the SDD tray (see Removing the SSD Tray on page 97). 4 Remove the power transition board (see Removing the Power Transition Board on page 108). 5 Remove the thirteen screws securing the drive plane board to the back side of the SSD tray. 112 Wiwynn ST P/60M User Manual

113 6 Remove the drive plane board from the SSD tray. Wiwynn ST P/60M User Manual 113

114 Installing the Drive Plane Board 1 Lower the drive plane board onto the back side of the SSD tray. 2 Secure the drive plane board to the SSD tray using thirteen screws. 114 Wiwynn ST P/60M User Manual

115 3 Install the power transition board (see Installing the Power Transition Board on page 110). 4 Install the SSD trays (see Installing the SSD Tray on page 100). 5 Install the SSD cartridges (see Installing the SSD Cartridge on page 79). 6 Install the PCIe expander boards (see Installing the PCIe Expander Board on page 71). Wiwynn ST P/60M User Manual 115

116 7 Checking Errors Using the Debug Card 7.1 Installing the Debug Card 1 Locate the debug port(s) for installing the debug card. 2 Install the debug card. 3 Connect the the serial cable from the debug card to any USB port on your computer. 116 Wiwynn ST P/60M User Manual

117 7.2 Error Code Definition The following list is the full definition of the ST P/60M Error Code that will be displayed on the Debug Card as well as stored in the system event log. Error Code Description 00 No error 01 PCIe internal switch fault 02 I2C bus 1 crash 03 I2C bus 2 crash 04 I2C bus 3 crash 05 I2C bus 4 crash 06 I2C bus 5 crash 07 I2C bus 6 crash 08 I2C bus 7 crash 09 I2C bus 8 crash 10 I2C bus 9 crash 11 I2C bus 10 crash 12 I2C bus 11 crash 13 I2C bus 12 crash 14 I2C bus 13 crash 15 I2C bus 14 crash 16 Reserved 17 Reserved 18 Reserved 19 Fan 1 front fault 20 Fan 1 rear fault 21 Fan 2 front fault 22 Fan 2 rear fault 23 Fan 3 front fault 24 Fan 3 rear fault Wiwynn ST P/60M User Manual 117

118 Error Code Description 25 Fan 4 front fault 26 Fan 4 rear fault 27 Fan 5 front fault 28 Fan 5 rear fault 29 Fan 6 front fault 30 Fan 6 rear fault 31 Drive board Temp Sensor 1 (left front) critical 32 Drive board Temp Sensor 1 (left rear) critical 33 Drive board Temp Sensor 3 (right front) critical 34 Drive board Temp Sensor 3 (right rear) critical 35 PEB HSC Temp Sensor critical 36 BMC Temp Sensor critical 37 Left ambient temp sensor critical 38 Right ambient temp sensor critical 39 PCIe switch front temp tensor critical 40 PCIe switch temp sensor critical 41 Reserved 42 Reserved 43 Reserved 44 Any PEB voltage sensor critical 45 PEB current sensor critical 46 Any Drive plane board voltage sensor critical 47 Any Fan Control Board voltage sensor critical 48 Fan Control Board current sensor critical 49 Reserved 50 SSDC0 SMART Temp critical 51 SSDC1 SMART Temp critical 52 SSDC2 SMART Temp critical 53 SSDC3 SMART Temp critical 54 SSDC4 SMART Temp critical 55 SSDC5 SMART Temp critical 118 Wiwynn ST P/60M User Manual

119 Error Code Description 56 SSDC6 SMART Temp critical 57 SSDC7 SMART Temp critical 58 SSDC8 SMART Temp critical 59 SSDC9 SMART Temp critical 60 SSDC10 SMART Temp critical 61 SSDC11 SMART Temp critical 62 SSDC12 SMART Temp critical 63 SSDC13 SMART Temp critical 64 SSDC14 SMART Temp critical 65 Reserved 66 Reserved 67 Reserved 68 Reserved 69 Reserved 70 SSDC0 fault 71 SSDC1 fault 72 SSDC2 fault 73 SSDC3 fault 74 SSDC4 fault 75 SSDC5 fault 76 SSDC6 fault 77 SSDC7 fault 78 SSDC8 fault 79 SSDC9 fault 80 SSDC10 fault 81 SSDC11 fault 82 SSDC12 fault 83 SSDC13 fault 84 SSDC14 fault 85 Reserved 86 Reserved Wiwynn ST P/60M User Manual 119

120 Error Code Description 87 Reserved 88 Reserved 89 Reserved 90 PCIe Uplink Error (left side) 91 PCIe Uplink Error (right side) 92 Reserved 93 Self Tray Pulled-out 94 Peer Tray Pulled-out 95 Reserved 96 BMC Error 97 Reserved 98 Reserved 99 Firmware and hardware mismatch NOTE: Error code may be caused by cable issues (physical damage, incorrect installation or disconnected cables) 120 Wiwynn ST P/60M User Manual