Achieving Energy Efficiency in Data Centers

Transcription

1 Achieving Energy Efficiency in Data Centers This document was specifically prepared to aid utility account managers who are working with C&I customers. Any other use of this material (in whole or in part) is not allowed without the express written consent of Questline, 2025 Riverside Drive, Columbus, OH

2 2 Meet Your Panelist: Mike Carter

3 3 NEEA Northwest Industrial Training Provided by: Northwest Regional Industrial Training Center: (888) Co-sponsored by your utility and: Washington State University Extension Energy Program Bonneville Power Administration Northwest Food Processors Association Utility incentives and programs: Contact your local utility representative

4 4 Upcoming In-Class Trainings Go to the NEEA calendar at for other trainings and events scheduled around the Northwest region. To register for a training, look for it by date and title. Once you find the training you want to register for, click on the title and you will find a description and registration. Data Centers: Data Centers Data Center Energy Efficiency November 7: Boise, ID Energy Management: Energy Management: Introduction to Best Practices October 23: Moses Lake, WA Fans : Fan System Assessment Tool (FSAT) September 20: Spokane, WA

5 5 Upcoming In-Class Trainings continued Motor Systems: Adjustable Speed Drive Applications and Energy Efficiency October 4: Roseburg, OR November 15: Yakima, WA Refrigeration: Industrial Refrigeration Energy Management October 23: Hermiston, OR October 24: Caldwell:, ID

6 6 Upcoming Webinars To register for a webinar, go to the NEEA calendar and look for it by date and title. Once you the webinar you want to register for, click on the title and you will find a description and registration. Adjustable Speed Drives: October 4, :00am until 11:00am (PST) Energy Auditing and Troubleshooting: November 6, :00pm until 2:00pm (PST) Energy Management Opportunities for Industrial Customers: September 25, :00am until 9:00am (PST) To register for multiple webinars at once, use this landing page.

7 7 Table of Contents Introduction Measure Power Conversion Server Load Cooling Equipment Case Studies Resources Source: LBL

8 8 Introduction Over 6,700 data centers in 2006 More than 1,220 colocation data centers (for rent) in the US Source: Data Center Map

9 9 Introduction Ideal site selection criteria* o Protection from hazards o Easy accessibility o Features that accommodate future growth and change Zoning and ordinances Known hazards o Natural disasters o EMI Multiple access routes Source: SEC *Douglas Alger, Cisco

10 10 Introduction Pre-Existing Infrastructure Power Analysis Cooling Capabilities o Geographic enthalpy maps o Economizers Structured Cabling Amenities and Obstacles Clearances Freight Issues Loading Dock Freight Elevators Source: LBL

11 11 Introduction 2009 Avetec Study o 41 data center managers responsible for 223 data centers o Industry (63%), academia (22%), government (10%) 59% of the sites track and report direct power and cooling costs. Only 34% use specific metrics and/or statistics (e.g., PUE) to measure and report energy efficiency. o o More than two-thirds of the data centers do no in-house testing to validate the energy efficiency of computer hardware. Rely on vendors' performance specifications. Only 29% of the surveyed organizations said they have a formal roadmap for moving their data center(s) to greater power and cooling efficiency.

12 12 Measure, Measure, Measure Benchmarking Source: LBL

13 13 Measure, Measure, Measure Energy intensity o 35X higher than office building o 100 to 400w/sqft o 15,000 sqft o 25 kw+ racks Typically 8 kw kwh/sqft 16.4 kwh/sqft

14 14 Measure, Measure, Measure Benchmarking o Power Utilization Effectiveness (PUE) Total Data Center Power PUE (0) = IT Power o <1.3 PUE Excellent o 1.3 to 1.7 PUE Good o >1.7 PUE Fair Can be 3.0+ Avg.=1.83 Source: LBL

15 15 Measure, Measure, Measure Benchmarking o PUE (0) at part loading o Affects peak demand Source: William Kosik, HP Technology Services

16 16 Measure, Measure, Measure Benchmarking o Improving PUE from 2.0 to 1.6 for a data center with a 2.5 MW IT load A 20% energy savings or over $800,000 annual savings at $0.08/kilowatt hour. Real-time PUE Display Source: FEMP

17 17 Measure, Measure, Measure PUE Categories IT energy measurement location Definition of IT energy Definition of total energy Cat. 0 Cat. 1 Cat. 2 Cat. 3 UPS Output UPS Output PDU Output Server Input Peak IT electric demand Peak Total electric meter demand* IT annual electric energy Total annual energy (electric, gas) IT annual electric energy Total annual energy (electric, gas) IT annual electric energy Total annual energy (electric, gas) *All-electric

18 18 Measure, Measure, Measure Benchmarking o kwh over time for IT loads o Watts per CFM for cooling loads (<1.2 w/cfm) o Watts per square foot by rack, work cell and usable floor space o Total energy cost per square foot o IT energy cost, by rack, by zone, by floor Source: FEMP

19 19 Measure, Measure, Measure Benchmarking o Lighting power density Goal is <1 watt/sqft Occupancy sensors Bi-level lighting Task lighting Source: LBL

20 20 Measure, Measure, Measure Benchmarking o Cooling plant efficiency Goal is <1 kw/ton Source: LBL

21 21 Solutions Three major opportunities for energy savings.

22 22 Power Conversion Electrical infrastructure o Four components represent the majority of losses Efficiencies: 99.0% % 84.0% % 98.5% 90% - 95% o Redundancy decreases efficiency Source: Ken Kutsmeda, KlingStubbins N losses 0.5% 6% 1.5% 5% 13% 2N losses 0.5% 12% 1.5% 6% 20%

23 23 Power Conversion Redundancy affect on UPS efficiency o Efficiency falls as loading decreases o Average loading of 20% to 30% is not uncommon. o Goals >50% UPS Load Factor >85% system efficiency Source: FEMP

24 24 Power Conversion Redundancy affect on UPS efficiency o Shutdown UPS modules when Redundancy Level exceeds N+1 or 2N o Install a scalable/modular UPS o Install a smaller UPS size to fit present load capacity o Transfer loads between UPS modules to maximize load factor % per active UPS Source: LBNL

25 25 Power Conversion Eliminate inefficient equipment Source: Ken Kutsmeda, KlingStubbins

26 26 Power Conversion Facility-Level DC Distribution o Demonstration project at Sun Microsystems o 10% to 20% efficiency improvement o Lower cooling load o Fewer points of failure Source: FEMP

27 27 Power Conversion Rack-Level DC Distribution 480 VAC Bulk Power Supply AC/DC DC/AC UPS PDU 12 V AC/DC DC/DC VRM PSU 380 VDC VRM VRM 12 V 5 V 3.3 V Loads using Legacy Voltages o Smaller savings o Thermal benefits o Smaller power supply in server Rack VRM VRM VRM 1.2 V 1.8 V 0.8 V Server Loads using Silicon Voltages Source: FEMP

28 28 Server Load Multiplier affect o Reduce IT load reduce infrastructure load Retire unused IT servers ENERGY STAR servers o 30% more efficient o Minimum 10% load 80% for power supplies 0.80 power factor o 55 to 150 watt idle power

29 29 Server Load Enable power management features Consolidation and virtualization o High utilization is goal (60% to 80%) o 10% to 40% savings Data management o Put less accessed data on lowest efficiency servers o Massive array of idle disks (MAID) o Deduplicate data Source: ENERGY STAR

30 30 Server Load Power/space monitoring Source: FEMP

31 31 Cooling Equipment Traditional data center cooling infrastructure Source: Dr. Madhu Iyengar, IBM

32 32 Cooling Equipment Better air management o Higher temperature limits ASHRAE Thermal Guidelines for Data Processing Environments o o o Server fan speeds/energy will increase with higher temperatures Requires containment and possible conductor derating Enables chillerless facilities Class 1, 2 Recommended Class 1 Allowable Class 2 Allowable Low Temperature 64.4F 59F DB 50F DB High Temperature 80.6F 89.6F DB 95F DB High Moisture 60% RH, 59F DP (50% RH, 80.6F DB) 80% RH, 62.6F DP (40% RH, 89.6F DB) 80% RH, 69.8F DP (45% RH, 95F DB)

33 33 Cooling Equipment Air mixing is inefficient Source: EPA

34 34 Cooling Equipment Containment o Reduces fan energy (8% to 10%) o Improves AC efficiency o Increases cooling capacity (20%) COLD-Aisle Containment (existing) HOT-Aisle Containment (new) HOT air in room Cold Aisle COLD air in room Hot Aisle Source: Schneider Electric, Joe Capes

35 35 Cooling Equipment Containment o Enclose return air Barriers Air curtains Source: FEMP

36 36 Cooling Equipment Containment o Use blanking panels ( 20F) o Do not overuse permeable floor tiles Reduces under-floor pressure Source: FEMP

37 37 Cooling Equipment Free cooling o Outside-air economizers 40F to 80F DB OA Dust and humidity are a concern Savings example o 4,000 hours of economizer run time Source: LBNL o o o o 300 tons for 1 MW load 0.5 kw/ton chiller efficiency $0.08/kWh electric rate $48,000 savings Source

38 38 Cooling Equipment Free cooling o Water-side economizers 40F to 64F WB OA Half the hours of air-side Compatible with warm inlet temperatures No air contamination concern Source: LBNL Source

39 39 Cooling Equipment InRow Cooling o Close-coupled Cooling IT Rack IT Rack Chilled water/ refrigerant Source: Schneider Electric

40 40 Cooling Equipment InRow Cooling o Capable of cooling high densities > 30 kw per rack o Dynamic fan control matches heat removal to heat generation o Elimination of mixing enables a predictable cooling pattern o Reduced deployment cycle through use of modular components o 10% to 20% more efficient than central or computer room air handlers (sensible cooling operation) Source: Joe Capes, Schneider Electric

41 41 Cooling Equipment Liquid cooling o Liquid has greater heat removal capacity (3500X air) o Pumps are more efficient than fans (10% of fan HP) o Water damage is a concern o 15% to 25% savings Source: LBNL Source: Dr. Madhu Iyengar, IBM

42 42 Cooling Equipment Air Energy Recovery o Baseline: 10,000 sqft, 2 MW, 78F supply, 96F return, Denver (CO) OA Economizer Technique Annual Savings Investment Delta Simple Payback Direct mixing $400 $1, yrs Indirect tempering $1,300 $5, yrs Enthalpy wheel $4,350 $20, yrs Dual duct $6,530 $43, yrs Source: John Peterson, HP 2012 ASHRAE Winter Conf.

43 43 Case Studies Lucasfilm Ltd. (CA) o 13,500 sqft o 4,300 AMD processors

44 44 Case Studies Sybase, Inc. (CA) o 16,000 sqft o 440 racks o 100 cabinets o 2,500kVA 13kV/480V o Two redundant 500kVA UPS

45 45 Case Studies The Hanover Insurance Group (MA) o 13,000 ft² data center overcooled o Solutions Implemented Demand Based Cooling (DBC) airflow and thermal management system Installed cut-out covers into floor openings Blanking panels into key rack openings Adjusted some CRAC set points o Results Five out of 13 CRAC units were placed into hot-standby Energy usage for cooling reduced by 27% Increased cooling redundancy Increased IT load capacity by 70kW Cost of project: $144,000 Annual energy savings Energy cost savings 600,000 kwh $96,000/yr Utility incentive $21,500 Company payback 16 months

46 46 Resources DOE Data Center Profiler (DC Pro) Software Tool Suite o A web-based application accessible from any computer o DC Pro Profiling Tool o Air-Management Tool Raised floor w/hot/cold aisles o Electrical Systems Tool

47 47 Resources DOE ASHRAE Awareness training events o Sept. 11, Golden, CO EPA/DOE Labs for the 21st Century ASHRAE Green Tips for Data Centers Data Center Energy Practitioner Program o Level I & Level II certification o Specialists tracks 80 PLUS Certified Power Supplies and Manufacturers ENERGY STAR Portfolio Manager data center model

48 48 Upcoming In-Class Trainings Go to the NEEA calendar at for other trainings and events scheduled around the Northwest region. To register for a training, look for it by date and title. Once you find the training you want to register for, click on the title and you will find a description and registration. Data Centers: Data Centers Data Center Energy Efficiency November 7: Boise, ID Energy Management: Energy Management: Introduction to Best Practices October 23: Moses Lake, WA Fans : Fan System Assessment Tool (FSAT) September 20: Spokane, WA

49 49 Upcoming In-Class Trainings continued Motor Systems: Adjustable Speed Drive Applications and Energy Efficiency October 4: Roseburg, OR November 15: Yakima, WA Refrigeration: Industrial Refrigeration Energy Management October 23: Hermiston, OR October 24: Caldwell:, ID

50 50 Upcoming Webinars To register for a webinar, go to the NEEA calendar and look for it by date and title. Once you the webinar you want to register for, click on the title and you will find a description and registration. Adjustable Speed Drives: October 4, :00am until 11:00am (PST) Energy Auditing and Troubleshooting: November 6, :00pm until 2:00pm (PST) Energy Management Opportunities for Industrial Customers: September 25, :00am until 9:00am (PST) To register for multiple webinars at once, use this landing page.

51 51 Thank You Please take our online survey