Reliable Power and Thermal Management in The Data Center

Transcription

1 Reliable Power and Thermal Management in The Data Center Deva Bodas Corporation April 19,

2 Agenda 2 Data center manageability challenges & trends Current state of power & thermal management New approaches Integrated management architecture Summary

3 3 Data Center Overview Exponential data growth Server Growth Higher performance driving increased power Load Balance, Firewall, proxy, Back End business open client requests, responses Front End Shrinking form factors driving transaction increased power density Mid complexity Increasing Tier Increasing TCO Flat IT Spending The Enterprise

4 Complexity & Mission Criticality Drive TCO 4 ~$0.01 NSC $1 HW/SW Consumer $1.5 NSC $1 HW/SW Enterprise Single User $5.5 NSC Integration & Deployment $2.5 Operation $2.5 Utilities $.5 HW/SW Enterprise Multi-user user driving new architectures $1 Growth, complexity, focus to to reduce TCO TCO driving new architectures Non-systems cost (NSC) Complexity & Mission Criticality Source:, Gartner studies (

5 Data Center Trends 5 Virtualization Dynamic partitioning Logical compute, I/O & storage Dynamic resource allocation SOFTWARE Manages Complexity HARDWARE Delivers Flexibility And Value Automation Self- configuring Self-optimizing Self-healing Auto Power & Thermal mgt Performance optimization Auto recovery Independent scaling Open standards & protocols Modularity App logic, server, & network Focus of this presentation

6 Agenda 6 Data center manageability challenges & trends Current state of power & thermal management New approaches Integrated management architecture Summary

7 Rack Space Not Fully Used 7 42 U Rack Empty Space Why do you want new room, you are not using all the space you already have? 350W 350W 350W 550W 550W Power & cooling limits number of of systems in in a rack

8 Power & Cooling Infrastructure 8 2KW 42 U Rack Empty Space 300 Watts/Sq Ft? You are not fully using the 100 Watt/Sq Ft we already have. 0 KW 1KW 2KW 350W 350W 350W 550W 550W Using nameplate, provisioning for for the the worst case Power Meter

9 Rate of Power Consumption 9 2KW 42 U Rack Empty Space Rack is consuming same power even if utilization varies between 0% & 100%! 0 KW 1KW 2KW 350W 350W 350W Power Meter 550W 550W

10 Fractured Power & Thermal Management 10 Fractured monitoring Separate monitoring systems for various elements Near zero integration Lack of knowledge on power consumption Who is consuming power, when & how much? No system power monitoring Limited controls for management Systems shut down at time of crisis Lack of of integrated power & thermal manageability

11 How Do We Address These Problems? 11 Improve energy efficiency in existing racks DBS & EPTM Introduce smarter scheme for allocating power & cooling ACPC & EPTM Establish integrated architecture EPTM

12 Today s Approach? 12 Method to allocate power & cooling Nameplate De-rating Sample measurement Near future: heat load guidance ASHRAE TC9.9 Components at the same power/performance level irrespective of workload No No scientific approach for for power budget & usage

13 Agenda 13 Data center manageability challenges & trends Current state of power & thermal management New approaches Integrated management architecture Summary

14 Wasted Energy 14 % Processor Utilization % 100% System Power 80% 60% 40% 20% 0% System power continues to be high during low processor utilization. Time CPU 0 CPU 1 AC Power Dual Processor.NET Web Server a workload to test directory services Power consumption is is high while application needs are are low! Wasted Energy Wasted Energy

15 Demand Based Switching 15 Principle Optimize processor speed based upon utilization Ingredients Support for P states Power-performance policy OS directed changes Example with hypothetical numbers High 3 GHz 1.15V 50W 2.8 GHz 1.05V 38W Halt Idle Utilization 2.6 GHz.975V 31W Low 2.4 GHz 0.9 V 25W Change performance to to match utilization, Power will will follow

16 Benefit of Demand Based Switching 16 % processor utilization Time CPU 0 CPU 1 P with DBS P w/o DBS Estimated power profile for the hypothetical example 120% 100% System Power 80% 60% 40% 20% 0% Server system power without DBS Server system power with DBS Assumptions: All components except processor consume fixed amount of power System energy consumption drops up up to to 30%

17 Wasted Space & Infrastructure 17 2KW 42 U Rack Empty Space Problem statements: How to put more systems in a rack, reliably? How to take advantage of reduced power with DBS? 0 KW 1KW 2KW 350W 350W 350W Power Meter 550W 550W

18 Automatic Control of Power Consumption 18 Principle Set power threshold System level power manager to ensure power consumption will not exceed a set threshold Ingredients DBS Power supply monitoring ACPC policy Yes P states restricted? Yes Remove restrictions on P states Power within threshold? No Restrict available P states No Adjustable threshold provides multiple operating power states to to systems

19 ACPC: Benefits 19 Better space & infrastructure efficiency Removes nameplate dependency Takes advantage of reduced power consumption with DBS Don t have to shut down system while in crisis Opportunity for smaller power supply Lower system cost Better power efficiency Without ACPC: 500 watts system running at % efficiency With ACPC: (a) use 250 watts power supply (save ~$55), (b) % efficiency ACPC increases rack space utilization 2 to to 3x 3x

20 Automation & Integration 20 Automate setting of threshold Dynamic setting of threshold Power & thermal capacity Policy based setting upon integrated power & thermal monitored events

21 Enterprise Power & Thermal Manager 21 Rack power & cooling capability (Hotspots) Thermocouples Systems with ACPC Administrative Policy EPTM Enterprise Power and Thermal Manager Status of Backup Power Status of Cooling systems Status of Utility Power Enterprise level integrated power and and thermal management

22 EPTM: Principle of Operation 22 Available Power Cooling capacity Hot spots System utilization Policy based dynamic allocation of power & cooling Set thresholds for systems at time t Controls for power & cooling systems Workload Predictor Cluster Manager Load Balancer Policy based management maximizes use use of of space, power & cooling

23 Agenda 23 Data center manageability challenges & trends Current state of power & thermal management New approaches Integrated management architecture Summary

24 Integrated Management Architecture 24 Enterprise Mgt Console SW Policy Mgr Management Server SW Scripting Engine Object Manager Interface PT Schema SNMP provider IPMI provider PT EPTM provider SW Storage provider Common Interfaces PTMI PTMI PTMI PTMI PTMI Compute Network Storage Power Supply Architecture that that provide integration and and promotes automation Cooling

25 Agenda 25 Data center manageability challenges & trends Current state of power & thermal management New approaches Integrated management architecture Summary

26 What Can You Do Now? 26 Look for future announcement on server support for DBS & ACPC Don t use nameplate to allocate power & cooling Use ASHRAE TC9.9 guidelines for defining heat/power loads ( Use dynamic, policy based allocation in future Join industry efforts Common industry interfaces Integration of manageability solutions

27 Summary 27 Power & thermal manageability essential to reduce TCO & improve reliability DBS, ACPC & EPTM provide automated & scientific approaches for allocating of power & cooling Coordinated industry efforts needed to realize integrated management architecture

28 Backup 28

29 ACPC Operation 29 watts 2. ACPC Programs Thresholds P HIGH = 400 P LOW = 350 P LIMIT = 500 P TARGET ACPC Manager User selects a power level 4. ACPC manager forces change of P state Power Input Power Supply With Power Monitoring 3. Power Monitor generates interrupt when power consumption exceeds a threshold Processor Processor Processor 5. Lowering power states reduces system power consumption

30 ACPC: Components 30 OS User Interface ACPC Policy ACPC (Software) Interface SM Bus Power Monitoring Controller +12V System Power Supply +5V +3.3V -12V

31 Top IT Problems 31 Asset Management Interoperable management model & interfaces Remote in-band & Out of Band (OOB) management Security Power & thermal management Simplify data center management Solution scalability Asset ID, active location info, sys profile info persistent across installation of new OS images Consistent management info model, Common API, & command line interface across all server states: Pre-boot, OS functional, OS not-functional, etc. Power on/off, BIOS install, OS boot/reboot, Set diagnostic levels, Run diagnostics CPU, Chipset, memory, IO, storage Access control, error/virus detection, isolation, & inoculation Policy-based power allocation/de-allocation, usage monitoring,, integrated power & thermal management standards and tools, More intelligent and integrated tool, scripts that scale, & work across multiple platforms Increased automated management (server provisioning, auto fault detection, prediction, & correction)