Purchasing Services SVC East Fowler Avenue Tampa, Florida (813)

Transcription

1 Purchasing Services SVC East Fowler Avenue Tampa, Florida (813) Web Address: April 25, 2018 Invitation to Negotiate No. Entitled: MH High Performance Computer Equipment 2018 Opening Date: May 09, 2018 at 3:00 p.m. Addendum No. 1 Review the following changes/additions/clarifications to Invitation to Negotiate (ITN) No MH High Performance Computer Equipment 2018 to be addressed in submitted proposals: Below are the USF responses (in red) to the vendor questions we received for this solicitation. Questions from Advanced Clustering Technologies, received on 4/17/18 at 4:51pm 1. There are different size, power & performance details between various consumer GPU's that can have a bearing on what server platform is best to base the nodes on; what consumer GPU model would you prefer? We don t have a preference on a particular model, but the NVidia GTX 1080 would be roughly the minimum performance that we are looking to acquire. Vendors may propose more than one GPU that we could choose from base on price/performance ratio. 2. Is there a preference for more than one GPU per node? No. 3. Is on node storage required or preferred and if so which type (SSD or hard drive) and what capacity? Storage on the individual nodes is used for operating system only.

2 4. Are the ICX 7250 switches already in place or do they need to be included with the proposal? They need to be included and 4 optics per switch. 5. You mention that you will need to acquire a ICX 7750, does that need to be included with the proposal and if so which model? Yes, the switch needs to be included in the proposal and we need two 40Gb optics. 6. What level of warranty, service & support is required for the ICX switches? We require at least 3 year warranty on all equipment with cross shipment. 7. Lot 2 - What is the correct through date? 06/30/19 Questions from Aspen Systems, Inc. received on 4/17/18 at 6:26pm 8. Do you want AMD or Intel processors? At this point we are interested in Intel If Intel, Broadwell or Skylake? We are looking for the best price/performance ratio, but often use not the premium chips. In this case lower model Skylake would be appropriate, but we would consider Broadwell. Do you have a specific processor model or core count and clock speed you are looking at? As per the announcement we are looking for at least cores per socket. We are not looking for specific model or clock speeds. 9. Redundant power supplies for the 1U nodes? No. 10. What applications do you plan on running on the GPUs? We run a variety of codes from material sciences to machine learning that have all used GPUs. 11. Consumer GPU cards are not recommended in the server environment. Would you consider K80, P4, P40, P100, or V100s? That would be dependent on price, but we are looking for more resources rather than higher performance. 12. What model and/or dimensions are the racks USF currently has? Slim body APC AR What phase PDUs does USF currently have? (Single, 3 phase, etc.) We are not requesting PDU s through this purchase. The racks and pdus will be provided. Questions received from The Divine Sage Studios, LLC on 4/17/18 at 5:19pm 14. What is the use of the computers you are looking to purchase? High Performance Computing in a Linux cluster environment.

3 15. What other equipment are you looking to use with the systems? Nothing outside of the equipment mentioned in the ITN call. Questions received from FL Government and Education, on 4/18/15 at 12:20pm 16. Section III, II Background and Planning it states: Vendors will be asked to provide benchmarks for the systems that they propose as outlined below. Can the University provide guidance on the benchmarks that will need to be run? HPL performance will be accepted. 17. Section III, IV. ITN Specifications, # 3, Gb Ethernet under Computational Resources: Is the intent for the vendor to provide pricing on the Brocade ICX 7750 or does USF have their own source? If the vendor is to provide this Brocade switch does the vendor also need to provide the cabling? Yes, the switch needs to be included in the proposal and we need two 40Gb optics. USF will provide cabling. 18. Are vendors to provide the IB or Omnipath switches and cabling as well? Yes, both should be provided. 19. Section III, IV. ITN Specifications, # 4 Racks and PDUs under Computational Resources: is there a max power/heat load (e.g. kw) requirement per rack? Racks and PDU s will be provided, and we will keep power under 24 Amps per rack. 20. Is the vendor expected to install and configure the cluster into USF s racks? Or will USF install and configure the cluster? USF will install and configure. 21. Can you provide details on the racks and PDUs that USF will be providing? The racks are slim body APC AR3300 and the PDUs are AP Is there a requirement for a drive on each node? Yes, we use the onboard drive for OS only. 23. Is a management or login node required? No. 24. Are vendors required to provide the RedHat licenses for this cluster? If so is the requirement for the vendor to load the software on the nodes? The vendor should not provide RedHat licenses. 25. Are vendors required to provide SLURM? If so is the vendor required to load the software on the nodes? No.

4 26. Can you describe the requirements for inter-rack cabling? E.g. does cable routing need to be via overhead trays or under the floor? Please provide dimensions so the vendor can provide the proper cable lengths. USF will provide inter-rack cabling separately. 27. Is there a specific GPU card USF wants? We don t have a preference on a particular model, but the NVidia GTX 1080 would be roughly the minimum performance that we are looking to acquire. Vendors may propose more than one GPU that we could choose from based on price/performance ratio. 28. Will the workloads be centred on machine learning or deep learning request? The workload will be general purpose research with codes from material science through data science. 29. On hardware support issues are you looking for a single support contact maintained through one vendor? Yes. 30. Are your application workloads single precision or double precision? Mixed. Your current infrastructure is stated as: We use a 2 level fat tree configuration with a 2:1 blocking factor for our Infiniband or Omnipath network. As part of this purchase we will acquire a new IB infrastructure for this acquisition which will be a separate network from the rest of the cluster. 31. Will you require the same 2 level fat tree configuration with a 2:1 blocking factor? Yes. 32. Will you require additional storage for the new HPC system? Other than the small disk per node for the OS there is no other need for storage. 33. Are there any Storage requirements? See answer to You state a minimum core count of 10 with dual processors. Is there a minimum speed associated with the processors? 2.1, 2.4, 2.6, 3.0GHz? We are not looking for specific model or clock speeds. Questions received from Dell, on 4/18/18 at 12:41pm 35. Infiniband/OmmiPath infrastructure Section IV, Item 2 (page 18) - As part of this purchase we will acquire a new IB infrastructure for this acquisition which will be a separate network from the rest of the cluster. Do you have a preference for OPA, EDR, FDR or HDR Infiniband host adapters and switches? Looking for best price/performance ratio. This purchase represents a separate computational resource in a larger cluster for the purposes of IB or OPA networking.

5 36. LOT 2 stated discount date Section IV, LOT 2 DESRCIPTION/SCOPE OF WORK (page 18) requests a stated discount that will apply to any such purchases by USF through 6/30/2015. Since this date has passed, is there an updated date/timeframe that you will require a stated discount to be applied? 06/30/ LOT 1 DESCRIPTION/SCOPE OF WORK 1.C Do you have a preference for Broadwell or Skylake processors? We are looking for the best price/performance ratio, and therefore we have traditionally not purchased the highest performance chips. In this case lower model Skylake would be appropriate, but we would consider Broadwell. 38. LOT 1 DESCRIPTION/SCOPE OF WORK 1.D Memory should be at least 128 GB per node or higher. If you prefer Skylake, is a balanced memory configuration required? Yes. 39. LOT 1 DESCRIPTION/SCOPE OF WORK 1.E iii - Please clarify the term compatible. Does compatible mean the card will work and be supported? The card must work with the proposed node, not invalidate the warranty on the node. USF reserves the right to test the proposed GPU to verify that they are compatible with our node software configuration. Questions Received from PCPC Direct, LTD 40. Do you want internal drive(s) in the nodes? If so, please specify. Other than the small disk per node for the OS 41. Are any Ethernet ports other than the 1GbE management port needed? If so, please specify. No. 42. What is the quantity and vendor/type/model of the racks that will house the proposed hardware? The racks are slim body APC AR3300 and the PDUs are AP Are there any power restrictions per rack? If so, please specify. 24Amps per rack. 44. What is the distance from the top of the rack to the cable trays? Inter-rack cabling will be provide by USF 45. How many rack units in each rack will be available for the new hardware? We are installing into empty racks. 46. What is the vendor/type/model of PDU? The PDUs are AP How many PDUs are installed in each rack? Two.

6 48. Are all of the plugs available in the PDU, if not, how many are available for use by the proposed hardware? Yes. 49. In the ITN document on page 17, Section 3 Bid Specifications, 2. Background and Planning says Vendors will be asked to provide benchmarks for the systems that they propose as outlined below. However, there are no benchmarks mentioned throughout the document. Will the University accept the expected HPL performance to meet this requirement? Yes, HPL performance will be accepted. Note: Please note receipt of this addendum by signing and returning with your proposal response Authorized Signature & Date Print Name Company Name