Are All Servers Created Equal? Comparing Server Energy Use and Efficiency

Transcription

1 Are All Servers Created Equal? Comparing Server Energy Use and Efficiency Henry Coles Lawrence Berkeley National Laboratory Nov. 5, 2014 SVLG Data Center Efficiency Summit Santa Clara University contact: 1

2 Presentation Acknowledgments Goals Equipment/Setup Methods/Results Conclusions SVLG Santa Clara University 2

3 Acknowledgements California Energy Commission *LBNL High Performance Computing Services Gary Jung, Manager *Susan James *Karen Fernsler *Bernard Li Mike Magstadt (Computer Facility) Partners: Intel, Dell, Supermicro, Server Technology Other Authors: Yong Qin, Phillip N. Price SVLG Santa Clara University 3

4 Goals Explore and Document Server Power Use and Efficiency Differences (3 brands) Assist Purchasers with Selecting Efficient Severs by Developing and Documenting Methods Used SVLG Santa Clara University 4

5 Equipment Intel Server Technology Common Attributes: 2U size 4 nodes per server 2 Intel E slots per node 2 power supplies per server Supermicro Dell SVLG Santa Clara University 5

6 Setup Dell Supermicro Intel Blanking Panels Removed for Clarity SVLG Santa Clara University 6

7 Software Used / BIOS Settings LINPACK (LINear equations software PACKage) Used to test/compare HPC systems HPL (High Performance LINPACK) BIOS Settings: Turbo Boost Disabled Hyper Threading - Disabled Cyclic Process Distribution SVLG Santa Clara University 7

8 Test: As-Received Observation: Idle Power and 100% Load Power High for Intel Sandy Bridge Processor (Supermicro) others used Ivy Bridge SVLG Santa Clara University 8

9 Test: As-Received 358 GFLOPS per node 301 GFLOPS per node Conclusion: Sandy Bridge and Ivy Bridge have different efficiencies. Dell (Ivy Bridge): less power, more GFLOPS, Supermicro (Sandy Bridge): more power, less GFLOPS SVLG Santa Clara University 9

10 Test: Swap A All Intel Servers As-Received 985 -> 985 W > 982 W > 989 W Results: Range is 7 watts or <1% of the mean (985 W) of all three Conclusion: The Intel power supplies have low efficiency variability. SVLG Santa Clara University 10

11 Test: Swap B Frankenstein 985 W 1030 W 1019 W Conclusion: For the Intel server Key components cause most of variability compared to other components. ( A + B ) / E = 985 ( A + B ) / E = 1030 ( B - B ) / E = 45 ( B + A ) / E = 1019 ( A - A ) / E = power supply = 95% efficiency B -B = 42 A -A = -10 SVLG Santa Clara University 11

12 Test: Swap C Gold Set in All Brands Key Set Processor and Memory Components from Intel Chassis #1 Tested also in Dell and Supermicro Servers 986 W 899 W 933 W Swap C (power range caused by motherboard, fans, etc.) Swap B (power range caused by proc. and memory) 87 W 42 W Conclusion: Other components (mother board, power supplies, etc.) provide an opportunity for reducing power use. SVLG Santa Clara University 12

13 Test: Swap C Gold Set in All Brands SM Idle Still High Performance per node: Intel GFLOPS Dell GFLOPS Supermicro GFLOPS SVLG Santa Clara University 13

14 Test: Swap C Gold Set in All Brands Conclusion: Efficiency by brand not determinate at high compute load. SVLG Santa Clara University 14

15 Other Findings: Cold Redundancy ~5% Lower Idle Power compared to Dell SVLG Santa Clara University 15

16 More Findings: Power vs. Inlet Air Temp. ~6C increase = 1.2% more power good fan speed control SVLG Santa Clara University 16

17 Conclusions Can not conclude efficiency is different across brands (at high compute loads) with the same processors and memory. Variability from Key components is significant. (processors and memory) Brand Variability of other components also significant. (power supplies, motherboards/etc.) Idle power can vary significantly among server brands. Simple methods can be used to test power use at idle. A repeatable software test is needed to test computation efficiency. Power supply controls e.g. cold redundancy show promise for energy savings. Recommend purchasers test different servers and compare idle power and loaded efficiency to select models with optimum overall efficiency. SVLG Santa Clara University 17

18 Questions? LBNL Report # 6831E Backup Slides SVLG Santa Clara University 18

19 Simulation Results Backup Slide SVLG Santa Clara University 19

20 Simulation Inputs Backup Slide SVLG Santa Clara University 20

21 Backup Slide SVLG Santa Clara University 21