Our Bethel, Connecticut facility is on-line and functioning normally. We experienced no infrastructure damage due to the storm.

Similar documents
Testimony of Donald D. Kittell Executive Vice President Securities Industry Association

Dealing With a Disaster and Its Effect on the Utility Operation

Security and Disaster Preparedness: New York s Experience. Presented by: New York Department of Public Service. December 7, James T.

1301 FANNIN HOUSTON, TEXAS 77002

Disaster Strikes How MPIC and Agility are Ready to Help

Technology & GIS During Sandy Recovery. Outline

Dude Solutions Business Continuity Overview

Telecommunications Network Reliability

2010 HURRICANE SEASON PREPARATION BRIEFING

Data Center Operations Guide

MultiPlan Selects CyrusOne for Exceptional Colocation and Flexible Solutions

Hurricane Florence Response and Recovery. October 18, 2018 Miles Lackey, Vice Chancellor of Business Affairs & CFO

WHITE PAPER BCDR: 4 CRITICAL QUESTIONS FOR YOUR COMMUNICATIONS PROVIDER

DATA MSP RD AVE S MINNEAPOLIS, MN MINNEAPOLIS, MINNESOTA

Hurricane and Storm Commercial Damage Assessment

Health Facilities and Utility Providers

Assessing the Need: The Business Impact of a Fiber Management System

Appendix M. Lifeline Sector Coordination

Business Continuity Plan Executive Overview

AKF Partners Case Study Engagement Type: Long Term Interim CTO Role Industry: Online Marketing Analytics

FLORIDA STATE UNIVERSITY MASTER PLAN 10 Utilities

iseries Failover 5/28/2010 Revised 6/10/2010

Global Crisis Management at Target

PLANNING FOR THE WORST: Collections Management Approaches to Disaster Planning

THE TELEPORT. Merrill Lynch Data Center. TELEHOUSE Center. Teleport I Teleport II AT&T / Globecast. Ariel view of the Teleport

Emergency Preparedness:

University Information Systems. Administrative Computing Services. Contingency Plan. Overview

A Strong Response Before, During and After. Hurricane Sandy. West Penn Power, Penelec and Met-Ed

Daily briefing. October 16, Columbia Gas ColumbiaGas.com

Piton Investment Management. Business Continuity Plan

Emergency Support Function (ESF) #14b: UTILITIES: Potable Water. ESF Activation Contact: Cornell Facilities Customer Service (607)

INFORMATION SECURITY- DISASTER RECOVERY

A SAFE, DEPENDABLE AND TRUSTWORTHY ENVIRONMENT YOU CAN CALL HOME FOR ALL YOUR BUSINESS NEEDS.

Global Crisis Management at Target

PROACTIVE COMMUNICATIONS: HELPING CUSTOMERS WEATHER THE STORM

City of Dallas Emergency Operation Center Response to May 2015 Flood Events

CenturyLink Data Center Services Herndon, Virginia

Florida Power & Light Company Hurricane Response Update. Eric Silagy President and CEO Florida Power & Light Company

How Agility Enhances Your Business Continuity Plan

UTILITY MARKING DEVICES. Naples City Council Workshop November 17, 2014 Presented by: Andrew Holland, P.E., Engineering Manager

DISASTER RECOVERY PRIMER

GMLC Grid Analysis and Design for Energy and Infrastructure Resilience in New Orleans, LA

MUNICIPALITY OF NORRISTOWN. Responses to Proposal Questions

BUSINESS CONTINUITY TOOLKIT

CenturyLink Data Center Services Omaha, Nebraska

Disclaimer This webinar may be recorded. This webinar presents a sampling of best practices and overviews, generalities, and some state laws.

Creating A More Robust Facility Risk Assessment

Newbury Street Water Main Replacement Project

STAUNING Credit Application Internet Sales Process with /Voic Templates to Non-Responsive Prospects 2018 Edition

Hope in Solutions of Special Projects

PLANNING FOR DISASTER

Introduction. Service and Support

Public and Private Interdependencies Filling a Gap in Most Continuity Plans

Henderson Mill Road 48 Water Line Issue. Thursday, July 23, 2015 Monday, July 27, 2015

GENERATOR ADDENDUM TO MAGNOLIA GARDENS ASSISTED LIVING COMPREHENSIVE EMERGENCY MANAGEMENT PLAN

Space rental size and cost: Each space measures 10 feet wide by approximately 8 feet deep. The fees are:

PEARL MANHATTAN, NY

IEEE 2014 T&D Conference Paper 14TD Storm & Flood Hardening of Electrical Substations

FLOOD VULNERABILITY ASSESSMENT FOR CRITICAL FACILITIES

South East Region THIRA

Use of Innovative Technology to Identify Flood Vulnerabilities and Mobilize Response for NYC Transit

City Reso-A Requests FY 2018 (City Council and Borough Presidents)

Business Continuity Disaster Recovery & Emergency Response

INFORMATION TECHNOLOGY Annual Report

KEEPING YOU OUT IN FRONT

Natural Disaster Preparation Checklist

Resilient By Design Post-Sandy Design Guidelines and Practice at PANYNJ

ASCENT DATA CENTER. 30 MW Data Center Enterprise Grade Facility LEED Gold ATLANTA, GA ABOUT ASCENT CO LO CAT I O N SUI T E S AVAI LAB LE NO W!

Information. Technology. Annual Report

STORAGE. UOVO's storage is designed to meet or exceed the standards set by the world's leading museums. Storage Options

DELAWARE RIVER AREA LOCAL DOWNTIME POLICY

CANVAS DISASTER RECOVERY PLAN AND PROCEDURES

Groton Data Center Migration Project

TVA Response to the Fukushima Event and Lessons Learned from Recent Natural Disasters

Did every one that had outages on verizon get service back

WHITE PAPER. Distribution Substation Outage Investigations. Overview. Introduction. By Ahmad Shahsiah, Ph.D., P.E. March 2018

PECO 2013 Summer Readiness Overview June 28, 2013

Midwest Cyber Incident Coordination Scenario

Resilient Networks in Japan

Looking Ahead. A Context for the Next Twenty Year Needs Assessment. July 2013

Florida State University

October 13, From: Larry Snyder, Associate Director for Administrative Services. Subject: Solutions Center Facilities Emergency Response Plan

IBM and Sirius help food service distributor Nicholas and Company deliver a world-class data center

Audubon Aquarium of the Americas. Emergency Life Support Scheme & Hurricane Preparation

Continuity of Business

Resilient By Design Post-Sandy Design Guidelines and Practice at PANYNJ. Josh DeFlorio, Chief, Resilience & Sustainability November 2017

FiberWatch Remote Fiber Testing for Full Service, Emerging and Next Generation Networks

Panel II: Are We Prepared?

Good Morning. ELAN Technologies Profile

An introductory guide to Disaster Recovery and how it can ultimately keep your company alive. A Publication of

Verizon fios equipment return locations ny

Daily briefing. October 18, Columbia Gas ColumbiaGas.com

Daily briefing. October 17, Columbia Gas ColumbiaGas.com

Acknowledgements. Exercise Overview

CONSIDERATIONS BEFORE MOVING TO THE CLOUD

CLOUDALLY EBOOK. Best Practices for Business Continuity

Resilient By Design Post-Sandy Design Guidelines and Practice at PANYNJ. Josh DeFlorio, Chief, Resilience & Sustainability August 2017

CASE STUDY: NAP del Caribe- A successful IXP initiative in the Dominican Republic and The Caribbean.

Business Continuity. Policies. Promotion Framework

Michael I. Lenchner (212) Third Avenue New York, NY ThirdAve.com

Transcription:

Page 1 of 6 Due to widespread outages from Verizon, ATT & Paetec (Windstream) our phones are not currently working, but our email is working fine and we are standing by. You can email us at support@datagram.com. Our Bethel, Connecticut facility is on-line and functioning normally Official Statement As of 5pm on October 29, 2012, Datagram had thoroughly tested its emergency systems at 33 Whitehall, NYC fully staffed and awaiting the storm to hit Manhattan's shores. Once ConEd lost power to Lower Manhattan, Datagram's emergency systems kicked on maintaining power to Datagram's datacenter. Unfortunately, within a couple hours of the storm hitting Manhattan's shores, the building's entire basement, which houses the building's fuel tank pumps and sump pumps, was completely filled with water and a few feet into the lobby. Due to electrical systems being underwater the building was forced to shut down to avoid fire and permanent damage. We experienced no infrastructure damage due to the storm. We have been working closely with the city, coned and building engineers to clear the water from the basement so that we may restore our emergency power systems. We are providing regular updates through our website at http://www.datagram.com Notices: 11/1 16:52: Driver is still experiencing tremendous traffic approaching NY still expected to be here this evening. 11/1 14:59: Driver is experiencing tremendous traffic approaching NY looks like we might be missing 5PM but hopefully just a couple of hours or less. Electricians will be waiting as are we. No damage has been found as of yet in the basement. We hope this is just a small delay. We will attempt to contact the driver for updates as often as possible. 11/1 14:11: Last drops of water, inspections are on-going. Nothing bad has been reported so far. We continue to prepare and ready ourselves for the generator delivery. We will be fully staffed this evening in anticipation of customers requiring access or remote-hands. We expect all services to be operating normally, however, we will not know the availability of telephone service in the area until we restore. We are unable to terminate voice calls at 60 Hudson or 111 8th Avenue due to outages in both facilities. 11/1 13:20: Preparing for delivery of street generator. On or ahead of expected delivery time. Inspections are on-going. No bad reports as of now. 11/1 9:30: There is only a small amount of water in the basement. Electricians

Page 2 of 6 have been testing equipment, there is another company doing damage assessments of the basement as well. There were some plumbing issues that were resolved during the night. We are as eager as everyone else to get some updated information. 11/1 9:00: Generator is still on schedule, it will be on-site before 5PM 10/31 23:15: Lot of questions regarding the generator: It is our generator for at least one week or longer if needed. 2MW is at least twice the power we need. Fuel tank will last two days. We have nightly fuel deliveries scheduled. We will keep generator on-site until we have ConEd utility power fully restored. We have offered to power the building elevators and emergency systems as well for everyones general safety. We do not know how long it will take to park and connect but we will be providing live updates and pictures as soon as it arrives. Our electricians are excellent, they have done this many times before and they are eager to get us back on line. 5PM is the latest it is supposed to arrive, it will hopefully arrive sooner. We hope to answer all of your questions, some remain unanswered and as soon as we have the information we will post it. 10/31 22:05: 2MW Mobile diesel generator is confirmed to arrive tomorrow before 5PM. We still feel there is a chance that power will be restored before 5PM. Our electricians will be on site all day and are prepared to fuse the generator to our main feed. We have new switch gear and cable to make the connection. Nightly fuel deliveries have also been arranged. 10/31 21:30: Fiber connectivity is confirmed out of BFC we are seeing light from our other locations. We will be on-line as soon as we have power. 10/31 20:40: Verizon is now helping us pump the last two feet. Sooner the better - thank you Verizon! Water St. and Broad St. Battery Park Underpass

Page 3 of 6 4 NY Plaza Bridge St. and Broad St. Previous 10/31 20:01: Less than 2 feet of water left to be removed. We are almost at the bottom. 10/31 18:55: ConEd still standing by for OK to energize Pearl Street. 10/31 18:25: Many water pumps are sending water back into manholes and basements. Sewer is overflowing, we seem to be on high enough ground that this is not affecting us. Broad Street and Water Street are getting the worst of it by far. 10/31 18:05: Wall street from South Street to Pearl still under significant amount of water. This is where the ConEd substation is supposed to be. 10/31 17:55: PLEASE NOTE - ZONE A IS STILL A MANDATORY EVACUATION ZONE. MTA WILL REMAIN CLOSED FROM 34TH TO BROOKLYN UNTIL FURTHER NOTICE. TRAFFIC LIGHTS ARE NOT WORKING. PLEASE USE CAUTION TRAVELING DOWNTOWN. 10/31 17:49: Witnessed a work truck knock down a traffic light on Beaver Street pictures to come. 10/31 17:35: Nearly all water has been pumped, electricians are standing by to get started with repairs in the early morning. ConEd reports that the transformer on Pearl has been cleared and standing by to energize (although they have been standing by all day).

Page 4 of 6 10/31 16:23: Destruction downtown is massive, NY Plaza still under 50 feet of water and FDR underpass is completely full of water as well. 10/31 15:45: We have been running our network operations out of contingency facilities for almost 48 hours now while techs on site remain in the dark ready to assist customers. Support teams are working remotely with customers to help migrate data or servers to our other locations. Food is in good supply and spirits are up. 10/31 15:33: Electricians have sourced replacement pumps and switch gear on hand to replace if necessary. 10/31 15:32: Mobile backup generator is on route, we expect it on site tomorrow afternoon/evening. 10/31 15:29: Bloomberg done speaking. No new information, we need to be patient while ConEd and workers finish. 10/31 15:25: 17 Million gallons of water remaining to remove at Bellevue hospital. 10/31 15:10: Bloomberg offers no new information. Phone service not working, working hard to restore power. 10/31 14:50: Mayor Bloomberg & ConEd addresses city. 10/31 14:30: Mobile rolling backup generator is on it's way. We will provide an ETA as soon as possible. We know that everyone needs to know when this will be resolved. We will report as soon as we have reliable answers. 10/31 13:55: Mayor Bloomberg & ConEd to report (delayed) 10/31 13:40: Verizon Pearl St. Central Office still under water. Pumping in the area will extend into the night. 10/31 13:14: Water pumping has slowed but continues. No update from ConEd. 10/31 12:52: Voice services downtown worsening. MUX Batteries are running out all over. 10/31 12:39: Disruption to downtown NYC area as devastating or more than 9/11 10/31 10:51: Still no word from ConEd on status of electrical switch systems. We hope to have an update soon. No one in the area is allowed to energize without ConEd sign off. There are countless ConEd personnel in the area, trucks on the sidewalks, and double parked in the street. ConEd and all of the contract workers downtown are the true heroes of Hurricane Sandy. 10/31 09:30: NYSE Begins trading with low volume running on generator. Utility power will not be restored until the entire area is cleared by ConEd. 10/31 09:21: Still many providers down and some additional outages today as batteries run down. Paetec and Verizon continue to have massive outages all over the City. We have several diverse connections which are all down. We are seeing evidence of fiberoptic line cuts along the east as clean up begins, fiber optic cables are being cut. 10/31 08:02: The building's engineers are pumping out the last of the water while electricians and ConEd are inspecting all of the basements in the area for damage. Power can not be restored until all basements are clear. Roll up generators are not allowed in the area until all the water is removed and ConEd gives the all-clear. 10/31 03:20: We have been providing backup servers to customer out of our CT facility which is fully functioning and on-line. Some NY customers already had backup and Disaster Recovery services with us in CT who have failed over and have been up during the storm. Many NYC customers have already engaged their DR plans and are operating under backup systems. We also have facilities in CA which are also unaffected and operating normally. 10/30 23:02: The building's engineers will be pumping water through the night

Page 5 of 6 and they hope to have the water in the basement fully pumped by morning. In case services cannot be restored, we have proactively rented a street generator, which will be allowed in the area as soon as work crews have finished. 10/30 16:42: ConEd and city workers are still working to restore services at 33 Whitehall, and water is still being pumped from the basement. 10/30 14:42: ConEd and city workers are currently outside of 33 Whitehall doing an amazing job working to restore services. There are currently at least five pumps pumping water from the basement into the street. 10/30 12:37: Water continues to be pumped from the basement. Many other buildings are beginning to do the same. 10/30 11:53: The building has slowly begun to pump water out of the basement. They are unable to provide an ETA however. 10/30 11:20: We are still flooded, as soon as the basement is cleared we will be allowed to operate the generator and restore power. 10/30 09:07: Downtown NY is still underwater. Mayor Bloomberg is giving an address at 9:45am. 10/30 08:49: We are currently waiting for the Army Corps of Engineers to assist in pumping out water. 10/30 05:34: We are continuing to battle flooding and fiber outages in downtown New York and Connecticut. Verizon and other carriers in the area are down as well. Generators are unable pump fuel due to the flooding in the basements. Downed trees are causing fiber outages all across the northeast. We will provide updates as soon as possible. Thank you for your patience. Bridge St.

Page 6 of 6 Water St. and Moore St. Battery Park Underpass