An Optimized Infrastructure In a Virtualised World Bassel Al Halabi Regional Manager Middle East & Pakistan Panduit International Corporation
Overview IT is rapidly transforming how businesses, consumers and technology are creating a dynamic environment. Some of the challenges we face today are they truly understood? The effect change is having on the facility how can we prepare? How do we protect our investment lifecycle management.
Practical comparisons of IT Data Traffic A popular expression claims that "all words ever spoken by human beings" could be stored in approximately 5 exabytes of data!! The world's technological capacity to store information grew from 2.6 exabytes in 1986 to 15.8 in 1993, over 54.5 in 2000, and to 295 exabytes in 2007. The world s technological capacity to receive information through one way broadcast networks was 432 exabytes of information in 1986, 715 exabytes in 1993, 1,200 exabytes in 2000, and 1,900 in 2007. Name (Symbol) Value kilobyte (KB) 10 3 megabyte (MB) 10 6 gigabyte (GB) 10 9 terabyte (TB) 10 12 petabyte (PB) 10 15 exabyte (EB) 10 18 zettabyte (ZB) 10 21 yottabyte (YB) 10 24
Practical comparisons of IT Data Traffic In 2004, the global monthly Internet traffic passed 1 exabyte for the first time. As of March 2010 it is estimated at 21 exabytes per month. According to the February 2013 update of Cisco VNI Forecast for 2012 2017, Annual global IP traffic will pass the zettabyte threshold by the end of 2016. In 2016, global IP traffic will reach 1.3 zettabytes per year or 110.3 exabytes per month. By 2017, global mobile data traffic will reach 11.2 exabytes per month (134 exabytes annually); growing 13 fold from 2012 to 2017.
Growth in Networked Devices Will Drive Data Center Traffic to New Heights Source: Cisco VNI, 2010
Growth in Networked Devices Will Drive Data Center Traffic to New Heights Source: Cisco VNI, 2010
Data Center Evolution Discrete Data Center Manageability Virtualized Data Center Manageability Console Cloud Data Center Manageability Console Console Console Console Console Compute Storage Networking Resource Pools Discrete Networks Multi-port I/O 1Gb Ethernet Unified Network I/O Virtualization 10Gb Ethernet Network Virtualization Software Defined Networks 10Gb/40GbE Low Latency 1. Information Week Data Center Convergence Survey December 2011 2. IDC CIA Agenda Survey: November December 2011 Increasing Bandwidth Needs
Transitioning from 1GbE to 10GbE Helps Remove Bottlenecks and Balance the Network I/O 1Gb Network Connections Unified 10Gb Network Connections VM VM VM VM VM VM Hypervisor Hypervisor 2X 10GbE Intel Ethernet CNA X540 10X 1GbE Up to 80% Up to 15% Up to 2x Reduction in Cables & Switch ports Reduction in Infrastructure Costs Improved Bandwidth per Server
Customer Initiatives Importance of IT Initiatives Next 12 Months Critical Very important Somewhat important Not important Server virtualization 33% 42% 17% 8% Server consolidation 26% 40% 25% 8% Retrofitting/expanding bandwidth 24% 39% 25% 12% Move to higher speed networks 24% 39% 24% 12% Energy efficient data center 22% 32% 33% 13% Private cloud computing 21% 34% 28% 17% Desktop virtualization (VDI) 17% 22% 37% 24% Public cloud computing 15% 22% 31% 31% *IDG Survey Results
Data Center Transformation Consolidate Virtualize Automate Reduced complexity, less to manage Lower OPEX Regain control of IT resources Higher resource utilization Lower CAPEX Decouples logical from physical resources Dynamically allocate resources Simplified policy based provisioning Increase IT agility and productivity The Network is the Platform
Virtualization & Consolidation Advantages Driving Transformation Less Complex Fewer Machines up to 50:1 Smaller Footprint Machines sizing reduced Physical size reduced by a factor of 3x to 8x Cost Savings Cap Ex and Op Ex Power and cooling load reduced by 66% to 88% Efficiency Improvements High Utilization of assets From 5% to 10% utilization for legacy machines to 80%+ Smaller Footprint Higher Utilization Fewer Physical Machines Lower Overall Power Use
Virtualization & Consolidation Challenges High Density/Utalization From 3 to 4 connections per legacy machine to 6 to 10+ per virtualized machine Power Density Demands from under 2kW per cabinet to over 9kW Air Flow/Cooling Issues more CFM of air flow needed Compute Capacity of the Facility As technology becomes more complex, all other interdependencies (overall compute capacity) within the datacenter, need to be considered! Cooling Concerns air flow reachability
Getting Started on the Journey Standards and Best Practices TIA, IEEE ITIL Energy Star Rating for Data Centers Utilize Reference Designs Regulations, Directives and Guidance Basel II Sarbanes Oxley European Code of Conduct on Data Centers Assess Your Environment Applications Assets Concept Design Thermal Modeling Power Grounding and bonding Infrastructure Analyze the Results Identify points of failure Locate inefficiencies Conduct what if scenarios Update Thermal Model Design Align the logical design to the physical design Think scalable and modular Account for operational issues Implement Faster speed to deploy Allow for day one and beyond flexibility Practical solutions with low CapEx and OpEx
Ways to Prepare the DC for Transformation Optimized Space Thermal Architecture. Implement Rack Level Power & Thermal Management. Upgrade Cabling for High Speed Data Transport. Modularized Pod Design. Automate the Physical Layer.
Rack Level Consideration is Key... Server/Switch/Storage Manufacturer No Man s Land Facilities Management
Optimized Thermal Architecture Today's technology requires a well thought out cooling design. Baseline existing facilities and optimise in order to realise more compute capacity. Solutions to address thermal issues include: CFD modeling to match heat load of equipment. Space planning: evenly distributing equipment across multiple racks reduces thermal hot spots. Prescribing the correct cooling architecture to suit the client, not the manufacturer.
Cisco Nexus 7000 Thermal Considerations Item Nexus 7K 4 Slot Nexus 7K 9 Slot Nexus 7K 10 Slot Nexus 7K 18 Slot Airflow Direction Side to Rear Side to Side Bottom front of chassis to Top Back Side to Side Heat Dissipation Airflow Ducts Required Operating Temperature Maximum 3500W per Chassis Maximum 7500W per Chassis 1 2 Maximum 12,000W per Chassis 0 (Not required) Maximum 18,000W per Chassis (actual dissipation could be lower, depending on the chassis configuration) 32 to 104 F (0 to 40 C) 32 to 104 F (0 to 40 C) 32 to 104 F (0 to 40 C) 2 32 to 104 F (0 to 40 C)
Optimized Thermal Architecture Hot Spots/Heat are Symptoms Not the Root Cause! Airflow is Key
Modularized Physical Infrastructure Design PODs are repeatable configurations that combine design and CFD modeling that are optimized for: Power consumption Cooling efficiency Space utilization Transport speed Network performance Switch port utilization PODs reduce install and commissioning time by 70% Pre Configured Solutions.
Automate the Physical Layer You can t manage what you can t measure, so automating the physical layer reduces MTTR and increases MTBF. Traditional methods like Excel spreadsheets are prone to error and don t provide an holistic view. Physical layer automation software enables: Management of Moves, Adds and Changes. Tracking of physical assets and virtual machines. Monitoring power and thermal capacity. RU capacity and switch port utilization. Integration with upper level management systems.
6 Zone Power/Energy Management & Automation Zone 1 Water Power In Oil Gas Zone 2 Main MV / LV Distribution Board (A or B) Zone 3 UPS Lighting Boilers Fire Security Chillers CRAC Back up Generator Zone 4 Power Monitoring Data Hall Environmental Environmental Monitoring Data Rack or Free Standing Equipment Zone 5 Sub PDU Zone 6 Individual Payloads
Take the Journey Consultative Led Approach Migration to next generation solutions, mitigating risks in consolidation and virtualization, and achieving greater energy and realestate efficiency. Look at the business needs/strategy not just at a specific vendors product (e.g Cooling Architectures)
Take the Journey Physical Infrastructure Foundation Ensuring reliability, agility, and security to drive business advantages and overall success.
Take the Journey High Speed Data Transport (HSDT) Copper and Fiber Cabling Systems Ease of deployment and proven performance to ensure availability, reliability and scalability of mission critical systems. Cat8, OM5!!
Take the Journey Infrastructure Automation & Management Approach Complete data center infrastructure management (DCIM) through monitoring of and management of critical physical layer resources, energy efficiency and power utilization.
Case Study: VBlock On Site Readiness Assessment Jewelry Manufacturer Global Background Customer Requirement: 2,500 sq. ft. Data Center Facility To identify any potential issues that Located within Office Building could result in costly deployment delays Customer Challenge Required fluid transition, with no downtime, from a virtualized infrastructure to a private cloud converged, VBlock solution. Need to ensure that cable infrastructure/connectivity, power, space and floor loading were all to up to specification, in order to accommodate the new VBlock configuration (10 rack Pod) Solution / ROI Undertook a Panduit VBlock On Site Readiness Assessment, on behalf of the client, in order to inspect seven critical physical areas, to ensure that the new facility will support this high end converged technology.. Areas include: Power, Space, Floor Loading, Connectivity, Telecommunication Grounding & Bonding and Pathways Detailed report presented to the client, detailing the critical issues that required addressing, prior to VBlock deployment. Without this assessment, the Vblock deployment would have been aborted, due to inadequate fiber/copper connectivity and power issues.
Case Study: Design / CFD Analysis Insurance Company Benelux Background Design a Physical Layer Infrastructure for a new Tier 3 Data Center and Co location facility. Customer Requirement: Design a scalable modular and green DC that support today s requirements and future growth Customer Challenge They recognised they had an issue, but didn t know how to rectify it. Space was limited, whilst significant growth was required. Adopted a legacy cooling architecture, with limited cooling capacity. Solution/ROI Capacity, planning workshop with the partner and client to clearly identify the key requirements and top of mind issues Provide the optimum layout, offering scalability and resilience at the physical layer, whilst maximizing the space. Provided a predictive CFD model to show the thermal performance of the DC based around the legacy cooling architecture.. The final design gave the client 25% extra compute capacity over the proposed layout. Energy savings calculated to be approximately 20%.
Case Study: CFD Analysis Telecoms Provider UK Background Customer Requirement: Multiple Data Halls to be refreshed across various sites To optimize the existing facility across the UK new technology strategy so as to realize more compute capacity, in order to prolong Customer Challenge building new facilities. Plenty of floor space and power for additional equipment but cooling system is close to it s maximum capacity. Upgrading the cooling system would cost in excess of 1m. No budget for new build. Concerned that a standard CFD study will only fix current issues and then back to guesswork. Require a solution for on going management. Looking to deploy Cold Aisle Containment. Solution/ROI Carried out a detailed Thermal/CFD of the data hall. Realized approximately 30% additional compute capacity with energy savings of 20% Uploaded VF to 6 Sigma FM for on going management allowing both FM and IT to simulate before any further changes are made.
Case Study: Design/CFD Analysis Government Organization Middle East Background 150msq Tier 3 Greenfield HQ Facility. Relocation Project. Customer Requirement: A scalable, modular and optimized datacenter, that will not only support today s requirements, but Customer Challenge will ensure the future growth plans Aggressive timelines and relocation plan. of the client. Data Center needs to be designed to accommodate the expansion plans, as dictated by the business Heavily Virtualised Environment/High Performance Core Switching Ensure that the cooling architecture and capacity can be scaled to support the expansion plans. Top of mind issues: Uptime, Performance, Security, Capacity, Reliability, Budget & an aggressive go live date. Solution/ROI Worked with the partner and undertook a number of capacity planning workshops with the key stakeholders (Client/IT/Power/HVAC) resulting in a number of different design scenarios, in order to meet the client expectations. these designs were optimized using predictive Thermal/CFD modeling. Final design gave an extra 28% compute capacity. PUE improvement of approximately 20% on the original design.
building a smarter, unified foundation