DATA CENTER LIQUID COOLING

Transcription

1 DATA CENTER LIQUID COOLING EFFICIENT, EFFECTIVE, SUSTAINABLE What is Liquid Cooling? Key Trends & Potential Inhibitors Why are Many Owner/Operators Making the Move? Types of Liquid Cooling Solutions Liquid Cooling Implementation & Best Practices Facility Pipingi Designs & Best Practices Liquid Cooling Performance <insert your logo here>

2 WHAT IS LIQUID COOLING? DEFINITIONS Air Cooling: Liquids are used within separate cooling loops that do not interact thermally; air is used as a heat transfer medium between the cooling loops (ex. Perimeter CRAC/CRAH) Cooling Unit: A product used to cool servers, storage, networking gear and other mission-critical equipment located within a Datacom Facility Datacom Facility: A Data Center, Telecommunications or Communications Services room Liquid Cooling: Liquid (water, refrigerant, vapor) is supplied to a Cooling Unit through a liquid to liquid heat exchanger for the purpose of rejecting heat directly outside of the Datacom Facility

3 KEY TRENDS ESCALATING COSTS OF POWER & COOLING IDC Whitepaper January, 2007: Solutions for the Datacenter's Thermal Challenges Power and Cooling costs increasing exponentially

4 KEY TRENDS SERVER OPEX EXCEEDS CAPEX Annual Amortized Costs for a 1U Server in a Data Center 3 year server life 10 year infrastructure life Source: Belady, C., In the Data Center, Power and Cooling Costs More than IT Equipment it Supports, Electronics Cooling Magazine (Feb 2007) OPEX over lifetime of a server growing to 4X original purchase cost

5 KEY TRENDS INCREASING CARBON FOOTPRINT CO2 Pr roduction (As % of world total) 1.40% 1.20% 1.00% 0.80% 0.60% 0.40% 0.20% 0.00% Data Centers Airlines Shipyards Source: McKinsey & Company Steel plants Pressure to Develop Sustainable IT Systems Today s average Data Center consumes the energy equivalent of 25,000 homes 90% of large Data Centers will require more power and cooling in the next 3 years Without changes, Data Center greenhouse emissions are predicted to quadruple by 2020 Data Centers carbon footprint almost as high as steel plants

6 KEY TRENDS DENSITY SURVEY Approx 150 responses 52% indicated future facilities with 10kW - 20kW per rack, per 2009 Survey Average above 8kw approx. 23% Source: Emerson Network Power Survey Shows Data Center Energy Efficiency Initiatives are Gaining Ground Despite Challenges, Press Release 9/20/07

7 PERCEPTION OR REALITY? 1. Water is 3,500 times more efficient than air as a heat transfer medium. That is why liquid cooling solutions are so much more efficient than traditional Computer Room Air- Conditioning. True or False? Neither. Although water is 3,500 times more efficient than air as a heat transfer medium, the improved efficiency of liquid cooling systems has much to do with the localization li of the cooling unit(s), the reduction or elimination i of fan power and the use of 100% sensible cooling designs. 2. Water cooling solutions are prone to leaks. True or False Depends on the Product & Manufacturer. There are products on the market today with an install based of thousands of units that have a 0% rate of failure.

8 PERCEPTION OR REALITY? 3. Even if #2 is False, my Data Center will have potential exposure to thousands of gallons of water. True or False? False. This is not the case when a well designed Secondary Cooling Loop and/or valving design is implemented. 4. While liquid cooling solutions may be more efficient, they are typically 2-3X more expensive than air-cooling solutions. True or False? False. Some liquid cooling solutions become economically attractive beginning at loads of 5-10 kw per rack. However, air-cooling remains very cost competitive below 5kW per rack.

9 s i t y o f I T E q u i p m e n t ( k W / r a Virtualization Increasing Data Center Demands I m Over- Provisioned c k ) HPC Pressure to Reduce CAPEX & OPEX Increasing Energy, Power & Space Constraints Cloud Computing I m Consolidating PRESSURE POINTS CONVERGE Several proven liquid cooling products, available now, offer effective, efficient solutions to these challenges Inefficient or Inadequate Cooling Traditional air cooling solutions do not efficiently solve the migration toward mid-high density computing

10 TYPES OF LIQUID COOLING SOLUTIONS In Row Overhead Side Car Active Rear Door Passive Rear Door Component Liquid System Water/Air

11 PARTIAL LIQUID COOLING DEPLOYMENT EXAMPLE CFD Hot Air Recirculation Hot Air Recirculation 150 kw CDU Liquid Cooled Rear Door Heat Exchangers

12 FULL LIQUID COOLING DEPLOYMENT COLD AISLE COLD AISLE 150 kw CDUs P=5kW Hot Air Recirculation Liquid Cooled Rear Door Heat Exchangers P=20kW

13 ECONOMICS OF LIQUID COOLING CAPEX per MW Cooling (STREET PRICE) 3 kw per Rack 5kW 7.5kW 10kW 3.4kW RDHx Qty Qy333 RDHx Qty Qy200 RDHx Qty Qy133 RDHx Qty Qy Ton CW-106D Qty Qy19 $1,804,500 $1,082,700 $721,800 $541,350 $564,526 Straight-line CAPEX Break-Even per MW, in Months, OPEX Savings 3 kw per Rack 5kW 75kW 7.5kW 10kW 34kW 3.4kW RDHx Qty 333 RDHx Qty 200 RDHx Qty 133 RDHx Qty Ton CW-106D Qty Immediate N/A 2-Year TCO per MW 3 kw per Rack 5kW 7.5kW 10kW 3.4kW RDHx Qty 333 RDHx Qty 200 RDHx Qty 133 RDHx Qty Ton CW-106D Qty 19 $1,891,167 $1,134,700 $756,467 $567,350 $1,026,081 At 7.5kW per Rack Liquid id Cooling becomes attractive ti cooling architecture t

14 LIQUID COOLING IMPLEMENTATION TYPICAL PRIMARY - SECONDARY LOOP SYSTEM ~8 o C ~13 o C

15 LIQUID COOLING BEST PRACTICES PRIMARY LOOP Chilled Water Supply from 4 o C/16 o C Nominal (40 o F 60 o F) Higher set points provide added efficiency + additional days for free cooling Chilled Water Supply temperature at inlet to CDU or Cooling Unit should not exceed 3 o C rate of change per 5-minute cycle Without t a CDU, Primary Loop must include a 2-way modulating water flow valve Fouling factors affect required flow rates: i.e. Muddy, silty or hard water requires ~3 times the flow rate of city or cooling tower water Isolation valves must be installed upstream of any interface that occurs to Secondary Loop equipment (CDUs, Cooling Units) Strainers should be installed after the isolation valves for filtration Balancing valve should be installed after the isolation valve for flow control Pressure, temperature and flow instrumentation is required for proper operation

16 LIQUID COOLING BEST PRACTICES SECONDARY LOOP Connects to flex tails or internal manifolds on CDU secondary side ISO B or Sweated Connections

17 LIQUID COOLING BEST PRACTICES SECONDARY LOOP Use flexible Supply and Return hoses, whenever possible Stainless quick-connect drip-free couplings on one end or both ends Couplings should be leak-tested using helium Assembled hose kits should be pressure tested to at least 250 psi (normal operation is ~20 to 50 psi) Standard lengths from 3ft. to 50ft. If hard-piping, i brazed joints only (vs. solder) preferable to avoid open torch in Data Center

18 LIQUID COOLING BEST PRACTICES SECONDARY LOOP Maximum Secondary Loop pressure of 100 psi Flow rates 4 to 25 GPM is typical Velocity 5 to 7 (fps) typical; flexible piping not to exceed 5 fps Otherwise water hammering, erosion, or vibration is possible Drain dead piping legs to mitigate chance for bacterial contamination on reconnection Use cleaning fluid (chemical detergent) for start-up of any new piping legs or restart of dead legs Avoid the use of following materials in Secondary Loop: Chlorine, Bromine, Chlorine Dioxide Aluminum Brass with >15% Zinc Irons (non Stainless Steel)

19 FACILITY PIPING DESIGNS COMMON RETURN COMMON SUPPLY COMMON RETURN COMMON SUPPLY Add Isolation Valves Between Each Branch

20 FACILITY PIPING DESIGNS 2 Supply & Return Branches to Plant Dedicated Cross Branches Add Isolation Valves

21 BEST PRACTICES WATER TREATMENT TREATMENT OF COOLING WATER Potential effects of non-treatment Loss of heat transfer Reduced system efficiency Reduced equipment life Equipment failures or leaks De-ionized water without inhibitors is corrosive! MICROBIO CORROSION

22 LIQUID COOLING PERFORMANCE 9kW Heat Removal Achieved! 73 F Rack Inlet Air Temperature, 74 F Treated Supply Water (using Cooling Tower Water), 11kW Load, 1500cfm Source: Lawrence Berkeley National Laboratory

23 LIQUID COOLING PERFORMANCE CHILL OFF

24 LIQUID COOLING PERFORMANCE SVLG CHILL OFF RESULTS

25 THANK YOU Joe Capes General Manager Datacom Facilities Division Vette Corp VETTE