Contents 1. Document Purpose... 2 2. Facility Overview... 2 2.1 Technical Space... 2 2.2 Load Density... 2 2.3 Resilience... 2 2.4 Engineering Plant Maintenance & Service Restoration... 3 3. Engineering Systems Overview... 4 3.1 Power Supply... 4 3.2 Cooling... 4 3.3 Ventilation... 4 4. Safety and Security Systems... 5 4.1 Fire Suppression Systems... 5 4.2 Fire Alarm System... 5 4.3 Security Systems... 5 4.3.1 Security Controls... 5 4.3.2 Access Control System... 6 4.3.3 CCTV System... 6 5 Connectivity... 6 1
1. Document Purpose This document gives an overview of the IXcellerate Moscow One DataCentre infrastructure and core services at the completion of the Phase 2 of the project. 2. Facility Overview IXcellerate Moscow One DataCentre is located in a warehouse building with the total area of about 6,000 m² in the industrial estate in the North of Moscow. The location is not in an active seismic area and has no hazards in the immediate locality. The site has an area of about 2 hectares and it is fully fenced. The building was constructed from steel and prefabricated panels and commissioned in 2007. The building is a single store warehouse with the height of 12 meters. It has two 2-floor annexes on the North and West side of the building with loading bays and technical plant room on the ground floor and office spaces on the first floor. 2.1 Technical Space 2.2 Load Density In phases 1 and 2 the total area of the white space is 1,420 m²: Phase 1 data hall 440 m²; constructed in 2012 Phase 2 data hall 980 m², constructed in 2015 Each data hall comprise a dedicated room with the wall and ceiling fire rating EI90. The floor has a load bearing capacity of 8000kg/ m². A 1,000mm high raised floor with the load bearing capacity of 1800 kg/ m² is installed in the data halls. The clear height in the data hall between the raised floor top level and the data hall roof structure is 4,000mm. Additional two more phases are planned to be added to the facility increasing the capacity up to a total of 6000 m². The facility is designed to provide 4kW per m² of power using room cooling and 12kW per m² using room and in-row cooling. The UPS and cooling systems installed are sized to deliver both the maximum average load density in kw and high-density power to racks where required. 2.3 Resilience The facility is built to offer a high degree of reliability and availability in respect of the critical building services offered to customers. The facility is designed and constructed to operate continuously delivering critical services to the required level of service 24 hours a day, 7 days a week, 52 weeks a year. This is achieved by using a combination of redundant and standby systems. The mechanical and electrical systems are arranged so that no single point of failure within the controls or plant could materially affect the output of that system. Fault tolerance has also been built into the systems so that predictable failure modes do not interrupt service to customers. 2
There are two fully separate dark fiber routes into the building and two separate meet-me and carrier rooms. The following table illustrates the resilience strategy for each of the critical systems: Distribution routes Electrical Mechanical Power streams Four independent streams CHW Pipework Two circuits with the ability to interconnect (at Phase 3) Plant Transformers Single TX per UPS string Chillers N+1 in circuit Generators Single unit per UPS string CRAC units N+1 UPS N+N strings Pumps N+1 in circuit Physical Separation UPS and switchgear Separate room AHUs Via use of fire dampers Transformers Separate rooms Chillers External Generators Separate external containers CHW pumps One set per compartment Concurrently maintainability Fault Tolerance (single event) All equipment Yes All equipment Yes UPS module on string Yes Pipework Yes Generator unit Yes Ductwork Yes HV/LV switchgear Yes Chiller unit Yes CRAC unit Yes The Tier classification is Tier 3+. The facility has been certified by IBM as Level 3, the certificate is given for the data centre project, construction and operation in the accordance with globally recognised IBM Reliability Rating System. The additional fault tolerance makes the site closer to Tier 4 than Tier 3. 2.4 Engineering Plant Maintenance & Service Restoration The engineering plant vendors used in IXcellerate Moscow One DataCentre not only provide high quality equipment, but also high levels of service. The equipment maintenance program is built from two key sources; firstly the equipment provider s specification, ensuring the equipment will deliver the specified level of availability. Secondly, a failure mode analysis of the systems is performed to ascertain what resources, training and spare parts are needed to be able to restore service within the SLAs provided to customers. The service level delivered by the combination of design, maintenance and service restoration capability, deliver a level of availability higher that the 99.999% availability promised to customers by the SLA. 3
3. Engineering Systems Overview 3.1 Power Supply Power supply is provided from four independent power streams with minimal points of failure. Power supply to the facility is from two independent transformer substations with the total electrical load of 5,000kVA: 2x1,000kVA transformers; and 2x1,600kVA transformers Each UPS string is fed by a dedicated transformer. UPS power supply is provided by four UPS strings as follows: 2 strings with 2x400kVA UPS in each string. Each UPS string will be fed by a dedicated 1,000kVA transformer; 2 strings with 2x300kVA UPS in each string. Each UPS string will be fed by a dedicated 1,600kVA transformer Total UPS power available after completion of Phase 2 will be 1,180kW following N+N redundancy (up to 1,760kW following distributed redundancy). Standby power is provided by a low voltage diesel-generator which will deliver power at low voltage (0.4kV) to each LV Switchboard (UPS string). Diesel generators are installed in containers on the site. Generator fuel is stored on site in containers and will be sufficient for 72 hours of operation. Additional fuel storage can be added if needed. Three suppliers provide refueling within eight hours of the request. 3.2 Cooling 3.3 Ventilation Cooling in the data hall is provided by a combination of: 4x100kW Emerson DX down flow CRAC units installed at Phase 1. Total cooling capacity of the DX units is 200kW (N+N redundancy); 2x400kW and 2x600kW air cooled Emerson chillers with free cooling (N+1 redundancy) N+1 capacity CRAH units in the data hall, > N+1 CRAH unit redundancy The system is designed to operate at +36 C (+45 C maximum) in accordance with ASHRAE. Total cooling capacity will be 1,400kW with the ability to upgrade capacity if needed to 2MW. A chilled mains loop is installed in Phase 2 hall with RAC connection branches and the ability to add in-row cooling for high-density racks. Humidity control is provided by steam humidifiers as part of CRAC units. All environmental conditions are monitored by an integrated building management system. Both data halls are equipped with mechanical air supply and extract ventilation system. Fresh air supply system is designed to provide 0.5 AC/hr. in the data hall. Positive air pressure is maintained in both data halls. 4
4. Safety and Security Systems 4.1 Fire Suppression Systems The data centre features a multi-level fire safety system combining prevention, early detection and focused response: Level 1: Keeping the data centre tidy and free of fire hazards. Level 2: Regular inspection of the data centre by maintenance staff. Level 3: VESDA smoke detection system monitoring the air in the server rooms and providing early warning. It detects fire hazard very early, before the emergence of smoke or fire. Level 4: An automatic fire notification system and fire alarm system. Level 5: Response by data centre staff using handheld fire extinguishers and water mist fire hoses. Level 6: Automatic fire suppression with HI-FOG water mist fire suppression. The Level 3 fire detection through VESDA is enhanced by positioning probes in the flow of the hot air return from the rows of racks so that a location of a possible fire is quickly identified. A Marioff HI-FOG fire suppression system protects the data halls and UPS rooms. HI-FOG sprinklers are installed both at high and low (floor void) levels. The HI-FOG system utilizes water mist as a fire agent. The HI-FOG system pipework installed in the data halls and UPS rooms are dry and pressurized so in normal conditions there is no water in the pipes. The operation of the HI-FOG system is triggers by a combination of: Disruption of the sprinkler thermal bulb by high temperature and an air pressure drop in the pipework; AND Fire alarm from the fire control system The dual action approach limits accidental discharge. 4.2 Fire Alarm System A dedicated analogue addressable fire alarm system is installed for protection of all IXcellerate Moscow One DataCentre premises. Optical analogue addressable smoke detectors are installed at high and low (floor void) levels in the data halls and UPS rooms. The fire alarm system is integrated with the data centre building management system which controls the following systems: Marioff HI-FOG fire suppression system; Access control system; Ventilation system The cooling system in the data hall remains in operation in case of a fire alarm. 4.3 Security Systems 4.3.1 Security Controls Integrated procedures, systems and teams provide security. Two teams work closely together to deter, detect, deny, delay and defend all security threats as appropriate. The majority of the activity of the team is to ensure the existing defenses are in good repair to deter threats; detect threats through monitoring via multiple mechanisms such as visual inspection and cameras; access to all areas is denied to any person who does not have pre-authorisation to access the area; delaying threats is done through multiple layers of security as indicated below and defense is supported by a rapid armed response from local law enforcement. 5
4.3.2 Access Control System IXcellerate Moscow One DataCentre has the following levels of security: 4.3.3 CCTV System Clear perimeter with wall and barbed wire fence, regularly patrolled Secured entrance gate to the site; Secured entrance to the building s entrance lobby with the use of intercom system; Secured entrance lobby with the turnstile controlled by the security guard, card reader and a biometric reader; Secured access to the data halls, UPS room and auxiliary with the use of card readers. Access doors to Phase 1 and 2 data halls are also equipped with biometric readers. Additional security can be provided for customers such as cages with biometric access control. All information from the access control system transmits to the data centre building management system. All premises of IXcellerate Moscow One Data Centre are equipped with the CCTV system. All entrance doors, corridors and premises are under CCTV system control. Data stored over 90 days. Additional CCTV cameras may be installed by the specific customer s demand. 5. Connectivity A structured cabling system is used by all customers and provides the ability for customers to connect to each other or telecoms carriers in the two meet-me rooms. Each cross-connect is installed and tested by our factory certified technicians. This structured approach enables changes, troubleshooting and repairs to be fast and efficient. Dual meet-me rooms and two separate cable entrances enable full redundancy of communication connections. A third meet-me room and cable entrance will be added in future phases. Private and public peering is available from Eurasia:peering and MSK-IX (Moscow Internet Exchange). More than thirty local and international carriers are present in the facility. 6