High Density Cooling Solutions that work from Knurr Kris Holla

High Density Cooling Solutions that work from Knurr Kris Holla The Heat Goes On Ó by

Knürr A An International Company Ranked #3 in the world Founded 1931 Strong international setting in over 32 countries Engineering & Manufacturing in Europe, Americas, Asia ~ 1.200 employees worldwide Focus on Telecom, LAN/Networking, Server/Storage, Data Centers, Traffic/Automotive, Medical Equipment, Security Portfolio of leading global customers Ó by

Knurr- Third largest Enclosure company in the world Our Products and Sevices... Rack and enclosure systems + technical furniture Customized solutions & standard products - platform based Level 3 system integration: Mechanics cabling thermal power active components Innovation quality/reliability flexibility speed attractive price Ó by

Leader in Networking & Data Center Products Serverracks Cooling Power Supply DI-Strip UPS Cable Management Administration TFT Displays KVM Switches Security RMS @-lock Ó by

Today we focus on High Density cooling Solutions Contents Capabilities of Liquid Cooling («LC») Water the Domesticated «Beast» - Rack Liquid Cooling GridKa: The World First Completely Watercooled Cluster- A case Study TCO Study Total Cost of Ownership Ó by

Can You Pack This into a Serverrack? This is our dilemma today... 37 Pizzas: å 12 kw 5 7U Blade Boxes: å 18 kw Ó by

Yes You can...... there is enough space in a 42 U Rack! Ó by

But: Can You Cool It? May be if there is enough cold air around it! Ó by

Can You Put It Into This Environment? You can but you cannot cool it! Ó by

The Limits of Air Cooling - High end datacenters today accommodate only. [HP] Maximum heat load : ~ 1.100 1.500 W/m² (100-140 W/sqft) = 3-4 kw / rack Ó by

Is This the Solution? 3,6 kw / rack 4 kw / rack Leave your racks empty? Build new datacenters? Ó by

Today The Room is also the Limit [Siemens Business Services] You cannot unleash a hurricane in a room But you can box it in a rack! Ó by

It's All About bringing the Cold closer to the Heat - Bring cooling to Enclosure level.not room Rack Liquid Cooling Ó by CPU Liquid Cooling

High Density Cooling Solutions that Work-Cooltherm Rack Liquid Cooling Miracel CoolTherm CoolTherm Ó by

CoolTherm: Basic Function cooling water connection Ó by

The need to Shift to a new approach-water Comes Back...Capabilities of Liquid Cooling (1,000 Watt, DT = 10 C / 18 F) x 3.500! Heat transport ða small water tube can carry more heat than an entire room of air! In other words the amount of heat that can be removed by water is roughly 3,500 times which can be removed by the same volume of air. Security Water has been a standard and safe medium for heat transport in buildings and mainframes for decades. Flexibility Fluid cooling systems can be flexibly adapted to new cooling needs in the datacenter. Ó by

CoolTherm - Performance Data 10 22 kw cooling capacity height up to 54 U / 2600 mm / 102" width 700 or 800 mm / 28 or 32" depth 1.200 or 1.300 mm / 48 or 52" 6 or 9U air/water heat exchanger cooling water temp. 12 / 18 C (54/65 F) 0.4 0.9 l/s (6-14 USgal/min) water flow ~ 0.3 bar (4 PSI) pressure drop system pressure ~ 2 3 bar (30-45 PSI) closed air loop 2000 5500 m³/h (1,200-3,250 cfm) air flow cooling air temp. 20 25 C (68-77 F) Þ ASHRAE Class 1 recommended envelope Ó by

CoolTherm - Main Advantages. ~ 0 heat disspation to the room uniform cooling air temperature over height, enhanced component lifetime for any 19" components water strictly under server compartment 2 or 3 fans / n+1 redundancy cooling control by fan speed monitoring of temperatures, water flow, fan speed, fire detection by RMS low noise emission enhanced protection against smoke, water vapor, high temperature in case of fire Ó by

Ultimate Cooling: CoolTherm 22 kw-25kw Ó by

Miracel Cooltherm- Closed loop Cooling Benefits... Improved Cooling More Data Processing Dense Packing Sealed System Smoke Sensing Lower Noise levels Improved work areas Fully Monitored In a Nutshell--They are Reliable, Very Economical with Highest performance and Secured.. Ó by

The Case Study Project Ó by

GridKa: Computing Power for High Energy Physics Pictures/Data: Forschungszentrum Karlsruhe Ó by

GridKa: Data Challenge and Hardware Deployment Pictures/Data: Forschungszentrum Karlsruhe Ó by

Rack Liquid Cooling for Cluster Computing 4 kw/rack 12-15 kw/rack Pictures/Data: Forschungszentrum Karlsruhe Ó by

GridKa Milestones 2001: Forschungszentrum Karlsruhe starts deployment of a new grid data center «GridKa» Oct 2002: Prototype of world first completely watercooled PC cluster goes into operation Mar 2003: - multiple watercooled server- / storage-racks operating - 780 CPUs, 160 TB RAID, 250 TB tape - several hundreds kw cooling capacity (watercooled) Oct 2003 - more then 60 racks installed - Extension to > 80 racks / ~ 1 MW scheduled for Q1/05 Pictures/Data: Forschungszentrum Karlsruhe - on only 250 m² (2,700 sqft) room size Ó by

Rack Liquid Cooling: System Installation Pictures/Data: Forschungszentrum Karlsruhe 1 MW ó Æ 125 mm / 5 Ó by

Full Density: Liquid Cooled 12kW Racks / 1 MW (ultimate configuration) on 250m² / 2,700 sqft The worlds first completely watercooled operating cluster - since 2002 Result: Reduction of 240 Racks to 60 Pictures/Data: Racks Forschungszentrum Karlsruhe and Reduction of Floor Space from 10000 Sqft to 2500 Sqft. Ó by

Economy Ó by

TCO Study by DS-Plan Virtual Model Data Center: - 2000 1U servers ("pizzabox") - 500 W heat dissipation each - 1 MW in total Removal of heat load by: Option1: Conventional Airconditioning Option 2: Rack Liquid Cooling (Knürr CoolTherm) Ó by

Main Impact on Investment: 80% Floor Space Reduction Option1: Conventional Airconditioning - 4 kw / rack - 8 servers / rack - 250 racks - 750 m² floor space - 4,5 m room height Option 2: Rack Liquid Cooling (Knürr CoolTherm) - 20 kw / rack - 40 servers / rack - 50 racks - 150 m² floor space - 3,5 m room height Ó by

TCO Study: Investment Cost Investment Costs for Data Center Example ] Investment costs [1.000 2500 2000-40 % Electric equipment Ventilation 1500 Refrigeration Racks 1000 Required space 500 0 Conventional Airconditioning Rack Liquid Cooling (CoolTherm) Ó by Please Pleasenote note green bar green barisis removed. removed.

TCO Study: Energy Cost Electricity Costs for Data Center Example (without Servers) 90-15 % /a] Electricity cost [1.000 100 80 70 Recooling plant Compression chillers Racks Recirculated air DC 60 50 40 30 20 10 0 Conventional Airconditioning Rack Liquid Cooling (CoolTherm) Ó by

TCO Study: Profitability Calculation Observation Period 15 Years, Service Life of Racks 6 / 12 / 15 Years 500'000 Savings: 110.000 /a 450'000 Costs [ /a] 400'000 Savings: 130.000 /a Savings: 140.000 /a 350'000 300'000 250'000 200'000 150'000 100'000 50'000 0 Option 1 Option 2 / 6 years Capital-related payments Requirement-related payments Electricity costs Option 2 / 12 years Option 2 / 15 years Operation-related payments Maintenance, inspection and operation Requirement-related payments Waste heat recovery potential Ó by

Conclusions Ó by

Knurr High Density Cooling Solutions that Work! We offer scalable solutions from 4kw to 25 kw. CPU Liquid Cooling > 100W/CPU Combined Rack + CPU Liquid Cooling Rack Liquid Cooling Forced Air Free Air 1 3 5 8 10 15 20 25 30... kw / Rack CoolTherm CoolBoost Miracel Ó by

Conclusions Limits of air cooling reached at w 3-4 kw / rack (full density deployment) Liquid cooling overcomes the «heat barrier» and allows high density applications. Technology and products are already available: Complete data center solutions for rack and CPU cooling Liquid cooling provides considerable reduction of - Floor space - Energy consumption - TCO proves that the products work. Knurr has more installations than any body in the world that are Reliable and proven to work.! Ó by

Thank You Ó by

Knurr High Density Cooling Solutions that Work! CPU Liquid Cooling > 100W/CPU Combined Rack + CPU Liquid Cooling Forced Air Thank You! Rack Liquid Cooling Free Air 1 3 5 8 10 15 20 25 30... kw / Rack CoolTherm Miracel CoolBoost Ó by