Data Center Trends and Challenges, IBM Fellow Chief Engineer - Data Center Energy Efficiency
Customers challenges are driven by the following Increasing IT demand Continued cost pressure Responsive to change 6x 69x 85% Growth in server and storage shipments this decade. Of distributed computing capacity sits idle. 18% 75% Increase in data center energy costs in next year. Of CIO s anticipate a strongly centralized infrastructure in 5 years. 20x 71% 5-60% Technology density increase in servers this decade. Of data centers > 7 years old. Of IT workloads may be cloud-enabled.
Everyone Has A Computer Room Branch Office Enterprise Data Center
Data centers use electricity How much? More video was uploaded to YouTube in the past 2 months than if ABC, CBS and NBC had been airing content 24/365 since 1948 Nov, 2012
Typical Data Center Energy End Use 100 Units 35 Units Power Conversions Data Center Energy& Breakdown Distribution Power 16.7% 30 Units Cooling Equipment Cooling 33.3% Server Load /Computing Operations X86 average utilization 5 12% IT Equipment 50.0% 33 Units Delivered Power Usage Effectiveness(PUE) = (Infrastructure Power + IT Power)/IT Power = 2
Data Center Energy Use Trends
Total Electricity Usage by State (MkWhr/year) World Data Centers US Data Centers
Information Technology is becoming more energy efficient at a furious pace The computer in your cell phone today is a million times cheaper, and a thousand times more powerful and about a hundred thousand time smaller than the one computer installed at MIT in 1965 Nov, 2012
Incredible performance improvements Incredible performance improvements Energy per Transistor goes DOWN Number of transistors 70 80 90 00 10 ~ 1 Million Factor Reduction In Energy/Transistor Over 30+ Years
Moore s Law: Delivering DC Performance power5 575 power6 575 power7 775 2004 79 TFlops 118 racks 10,000 ft 2 3.5 MW 2008 79 TFlops 9 racks 300 ft 2 0.5 MW 2012 79+ TFlops 1 racks 30 ft 2 0.15 MW
Overview of ASHRAE s Thermal Guidelines Book third edition Chapter 1 Introduction Chapter 2 Air Cooled Equipment Environmental Specifications Chapter 3 Liquid Cooled Equipment Environmental Specifications Chapter 4 Facility Temperature & Humidity Measurement Chapter 5 Equipment Placement & Airflow Patterns Chapter 6 Equipment Manufacturers Heat & Airflow Reporting Appendices A - J Can obtain book @ http://tc99.ashraetcs.org/
IT Equipment Environment Measurement at Inlet Four Key Environmental Requirements 1. Inlet Air Temperature 2. Inlet Humidity 3. Inlet Particulate Contamination 4. Inlet Gaseous Contamination AIR INLET to datacom equipment IS the important specification to meet. OUTLET temperature is NOT important to datacom equipment.
Thermal Guidelines Third Edition (2011) Drivers for Updated Thermal Guidelines Improve Energy Efficiency Expand use of the allowable range - Reduce chiller hours Expand the limits of the allowable range - Enable greater economizer usage ASHRAE TC 9.9 Response Create Opportunity for Innovation Defined two new classes with wider environmental envelopes Created guidance to evaluate operation outside existing recommended range - Educate users on reliability, IT equipment power consumption and other factors
IT Equipment Environmentals ASHRAE Psychrometric Chart 2011 New Classes A1 and A2 are EXACTLY the SAME as previous Classes 1 & 2 Classes A1 and A2 apply to new and legacy equipment New Classes A3 and A4 do NOT include legacy equipment These are the IT Equipment inlet requirements!!
Overview of ASHRAE s Power Trends & Cooling Book Chapter 1 Introduction Chapter 2 Background Chapter 3 Component Power Trends Chapter 4 --- Load Trends and Their Application Chapter 5 Air Cooling of Computer Equipment Chapter 6 Liquid Cooling of Computer Equipment Chapter 7 Practical Application of Trends to Data Center Design Appendices A C ASHRAE TC 9.9 Website www.tc99.ashraetcs.org
Volume Server Power Trends to 2020 Market Requirements force IT manufacturers to maximize performance/volume creating high heat load/rack These rack heat loads will result in increased focus on improving data center ventilation solutions and localized liquid cooling solutions
Leibniz Rechenzentrum, Garching, Germany SuperMUC: Warm-Water Cooled 3 PFLOPS System 1Q12 2Q12: ~10000 IBM System x idataplex Water Cooled dx360 M4
dx360 M4 - Water Cooling design Hot Water Cooled Node with 90% heat recovery. Power advantage over air cooled node by 5-7%. {Due to lower CPU temps and absence of fans} Water inlet 18 C to 450C @ 0.5 liters/min per Node {37 liters/min Rack} idataplex Rack w/ water cooled nodes
2nd Day of Power Failures Cripples Wide Swath of India The world s largest blackout ever crippled much of northern India for a second consecutive day on Tuesday(July 31, 2012), spreading across 22 of 28 states, an area of 670 million people(10% of the planet). An estimated 32 gigawatts was taken off line.
Sandy's mammoth wake: millions without power, transit A half dozen nuclear power plants were shut down or otherwise affected, while the nation's oldest facility declared a rare "alert" after the record storm surge pushed flood waters high enough to endanger a key cooling system. More than 6.6 million homes and businesses were without electricity, about two-thirds of them in New York and New Jersey.
Energy Savings from Tri/Co-Generation 100 Units INPUT 100% USEFUL ENERGY 74.2% 35 Units ELECTRICAL OUTPUT 29.7% LOSSES 25.8% OTHER LOSSES 4.8% 30 Units Delivered EXHAUST LOSSES 21% THERMAL OUTPUT 44.5% Offset building thermal loads by recycling the waste heat energy available at site Reduces costs and increases reliability Increases efficiency and reduces fossil fuel combustion
Syracuse University Green Data Center Green Data Center Facility Micro-Turbines Water cooled raised floor Absorption Chillers
Big Issues IT demand continues to grow rapidly IT energy efficiency continues to dramatically improve Low IT equipment utilization Low infrastructure efficiency improvements remain Energy cost will continue to be #1 business concern
Thank you for your attention Nov, 2012