Powering Compute Platforms in High Efficiency Data Centers. Annabelle Pratt, Pavan Kumar, Kevin Bross, Tomm Aldridge

Size: px

Start display at page:

Download "Powering Compute Platforms in High Efficiency Data Centers. Annabelle Pratt, Pavan Kumar, Kevin Bross, Tomm Aldridge"

Walter McLaughlin
5 years ago
Views:

1 Powering Compute Platforms in High Efficiency Data Centers Annabelle Pratt, Pavan Kumar, Kevin Bross, Tomm Aldridge

2 Agenda Defining a power-efficient efficient data center Improving power delivery efficiency Power delivery architecture comparison DC data center demonstration Slide 2

3 Defining a powerpower-efficient data center Scope Die Board Slide 3 Server Rk Data Center

4 Defining a power-efficient efficient data center Powering a Data Center BLDG PWR DC/AC DC/DC 12V Loads PSU UPS PDU Rk Server Fans Cool Air to Data Center Room Cooling System Heat Rejected To Outdoors Slide 4

5 Defining a power-efficient efficient data center Power Delivery Challenge Power delivery efficiency for data center is only ~ 50% Total 285W 405W Load 100W Server fans 13W Room cooling 80W 200W UPS&PDU 22W PSU 48W 22W Get the whole picture : Consider powerefficiency at data center level Slide 5

6 Agenda Defining a power-efficient efficient data center Improving power delivery efficiency Power delivery architecture comparison DC data center demonstration Slide 6

7 Improving power delivery efficiency Conventional AC architecture 480V 3φ AC DC/AC 208V 1φ AC DC/DC 12V Loads PSU UPS PDU Rk Server Fans 88% x 93% x 79% x 75% = 48% Prevalent architecture Multiple conversion stages all impt efficiency Slide 7

8 Improving power delivery efficiency Note on efficiencies Use heavy load efficiencies for comparison Efficiency [%] Baseline efficiency Improved efficiency Input power savings Input power savings [%] Load [%] Slide 8

9 Improving power delivery efficiency Power Train: UPS 480V 3φ AC DC/AC 208V 1φ AC DC/DC 12V Loads PSU UPS PDU Rk Server Fans 88% x 93% x 79% x 75% = 48% Double Conversion UPS Most commonly used in data centers today Typical 88% efficient As high as 94% Slide 9

10 Improving power delivery efficiency Power Train: PDU 480V 3φ AC DC/AC 208V 1φ AC DC/DC 12V Loads PSU UPS PDU Rk Server Fans 88% x 93% x 79% x 75% = 48% Power Distribution Unit Transformer steps down 480V AC to 208V AC Provides branch protection Typically 97-99% efficient Include cable losses here Slide 10

11 Improving power delivery efficiency Power Train: PSU DC/AC DC/DC 12V Loads PSU UPS PDU Rk Server Fans PSU 88% x 93% x 79% x 75% = 48% Typical PSU efficiency 75% EPA Energy Star *, 80PLUS, SSI promote 80% Technology exists for ~90% Initial cost remains a challenge Slide 11 * Draft

12 Improving power delivery efficiency Power Train: DC/AC DC/DC 12V Loads PSU UPS PDU Rk Server Fans 88% x 93% x 79% x 75% = 48% Typical efficiency 75% (system aggregate) Continually increasing, approhing 80% * Draft Slide 12

13 Improving power delivery efficiency Conventional AC architecture 480V 3φ AC DC/AC 208V 1φ AC DC/DC 12V Loads PSU UPS PDU Rk Server Fans 88% x 93% x 79% x 75% = 48% 94% x 94% x 89% x 86% = 68% High efficiency components can reduce input power by 30% Use high efficiency components to reduce energy consumption Slide 13

14 Agenda Defining a power-efficient efficient data center Improving power delivery efficiency Power delivery architecture comparison DC data center demonstration Slide 14

15 Power delivery architecture comparison Best-in in-class AC Architecture Line-intertive 208V 1φ AC DC/DC 12V Loads DC/AC PSU UPS PDU Rk Server Fans 98% x 94% x 89% x 86% = 71% Avoid double conversion in UPS Use line-intertive intertive or Delta Conversion UPS Highly efficient ~98% ~ Not in wide-spread use today Slide 15

16 Power delivery architecture comparison Best-in in-class AC Architecture 480V 3φ AC Delta Conversion 208V 1φ AC DC/DC 12V Loads DC/AC UPS PDU Rk Server PSU Fans 98% x 94% x 89% x 86% = 71% Avoid double conversion in UPS Use line-intertive intertive or Delta Conversion UPS Highly efficient ~98% ~ Not in wide-spread use today Slide 16

17 Power delivery architecture comparison 400V AC Architecture 480V 3φ AC DC/AC 400V 3φ AC 230V 1φ AC DC/DC 12V Loads PSU UPS PDU Rk Server Fans 94% x 97% x 89% x 86% = 70% If UPS output 400V, do not need transformer in PDU Slide 17

18 Power delivery architecture comparison Rk Level -48V DC Architecture 480V 3φ AC DC/AC 208V -48V DC/DC 12V Loads PSU UPS PDU Rk Server Fans 94% x 94% x 92% x 93% x 86% = 65% Reduce heat load in individual server Reduce PSU volume Rk level redundancy Slide 18

19 Power delivery architecture comparison -48V DC Architecture 480V 3φ AC AC / DC -48V DC -48V DC/DC 12V Loads UPS PDU Rk PSU Server Fans 93% x 97% x 93% x 86% = 72% Remove conversion stages Used in telecommunications industry ~ 100 x copper UPS to PDU ~ 20 x copper PDU to rk Addressed with distributed UPS Slide 19

20 Power delivery architecture comparison Rk Level DC Architecture 480V 3φ AC DC/AC 208V AC DC DC/DC 12V Loads PSU PDU Rk Server Fans 94% x 94% x 96% x 93% x 86% = 68% Similar to -48V rk level DC architecture Use DC link Available in some high end servers Slide 20

21 Power delivery architecture comparison DC Architecture 480V 3φ AC DC DC/DC 12V Loads PSU PDU Rk Server Fans 97% x 97% x 93% x 86% = 76% Eliminate intermediate conversion stages No harmonics or phasing requirements Fewer components higher reliability Slide 21

22 Power delivery architecture comparison Comparing Efficiencies DC 48V DC +5.5% Best-in-class AC 400V AC Rk level DC High efficiency AC Rk level 48V DC Baseline AC Power delivery efficiency [%] Slide 22

23 Power delivery architecture comparison Comparing input power DC 48V DC Best-in-class AC $370,000 savings per year at 0.1$/kWh 400V AC Rk level DC High efficiency AC Rk level 48V DC Baseline AC Total building input power [MW] For 10,000 servers with 300 W load power eh and cooling COP = 2.6 Slide 23

24 Power delivery architecture comparison # servers / 10MW power budget DC 48V DC Best-in-class AC 7.5% increase in number of servers (~1,300) 400V AC Rk level DC High efficiency AC Rk level 48V DC Baseline AC Number of servers for 10MW power budget Servers with 300 W load power eh and cooling COP = 2.6 Slide 24

25 Power delivery architecture comparison Architecture observations High efficiency architecture and components Significant power savings Increased server density AC and -48V DC distribution used today Fility level DC delivers highest efficiency Not used in industry today Need to demonstrate feasibility Power delivery architecture choice can reduce energy consumption & TCO, increase density Slide 25

26 Agenda Defining a power-efficient efficient data center Improving power delivery efficiency Power delivery architecture comparison DC data center demonstration Slide 26

27 DC data center demonstration DC Data Center Demonstration Summer 2006 : Intel collaboration with Lawrence Berkeley National Lab (LBNL) and multiple industry partners DC Lights DC Compares AC architecture to DC Demonstrated operational servers with DC AC Dist. 48V Slide 27

28 DC data center demonstration Results from DC Demo AC System DC System Load Input Load Input kw kw kw kw * Input power savings of ~ 7% Confirms theoretical evaluation *Ratio of DC Load power to AC load power = Reduced due to elimination of stage in server PSU Slide 28

29 DC data center demonstration DC Data Centers DC data center Equipment development DC Circuit Breakers Certified power supplies Building codes may need to be expanded Infrastructure development, maintenance General ceptance by customers to drive cost, volume Demonstration of DC data center confirmed its viability and efficiency benefits Slide 29

30 Summary Get the whole picture : Consider power-efficiency efficiency at data center level Use high efficiency components to reduce energy consumption Power delivery architecture choice can reduce energy consumption & TCO, increase density Demonstration of DC data center confirmed its viability and efficiency benefits Slide 30

31 References For energy efficiency specifications, see and For information on the DC demo, see Marquet, D., et al., New flexible powering architecture for integrated service operators, IEEE Intelec Conference, 2005 This paper provides many other good references Jill Jones, Empires of Light: Edison, Tesla, Westinghouse, and the Re to Electrify the World, Random House, 2003 Slide 31

33 Bk-up Slide 33

34 What about light load? A P P in = η η η load 1 2 3η 4 B Pload P in = η 1 η 4 P in A P in B η 1 η 2 η 3 η 4 η 1 η 4 P load P load P P B in A in Pload η1η 2η 3η 4 = η η P P A in 1 4 P A P in B in load B = η η Pin = 1 = 1 η2η A 3 P in 2 3 Power savings [%] (η 2 = η 3 ) Efficiency [%] For the same load power,, lower efficiencies (η)) result in higher power savings Case for power savings stronger for conversion stages with lower efficiencies Slide 34

35 Copper comparison AC vs DC R R R N I V V/ 3 Output power dc Po = 3V I P o = VdcIdc Cable losses 2 2 P 3I R P = 2I R loss Cu = loss dc dc Copper 3 Cu R dc 2 R dc R R N Idc Vdc Vdc/2 P For the same output power : P o = I 3V dc = I 3V V dc = P dc o I = V And for the same cable losses : loss R = 3I dc = R I I 2 2 dc = R P dc loss = 3 2 = 2I V 2 dc dc 3V dc R I dc dc 2 R Slide 35 Cu Cu dc = 2 R dc R 3 2 3V V dc 4 V Cu = Cu 3 V dc For Vdc =, compared to: V = 480V, need 2.1 x more copper V = 208V, need 2.5 x less copper = dc 2

Why Not Operate Data Centers & Telecom Central Offices at 400 VDC???

Why Not Operate Data Centers & Telecom Central Offices at 400 VDC??? Dennis P. Symanski Senior Project Manager 2009 IBM Power and Cooling Technology Symposium 20-21OCT2009 Rochester, MN Data Center Energy