Nortel Confidential InformationNortel Government Solutions CONFIDENTIAL
Global Wireless Emergency RecoveryDisaster PreparednessTony Anastasio
954-336-7445
Nortel Confidential InformationNORTEL GOVERNMENT SOLUTIONS CONFIDENTIAL2
Typical Types of Disasters
> Hurricanes, Typhoons
> Tsunamis
> Tornadoes
> Flash Floods or Flooding
> Fire – Brush, Forest, Building
> Earthquakes
> Terrorist Attacks
Tornado
Flood
Earthquake
Fire
Flood
Nortel Confidential InformationNORTEL GOVERNMENT SOLUTIONS CONFIDENTIAL3
Disaster PreparednessThings to Consider (1/2)
> Network installed base information• Off site storage of detailed engineering information, equipment lists• Off site storage of current nodal backups/images• Off site storage of critical database information (subscriber info)• Current network interconnect diagrams
> Prepare for network overload• Prioritize service for the 1st responders, 911
> Ensure backup power systems are ready to go• Generators, battery plants, UPS systems• Generator refueling?• Portable generators ready and tested?
> Adequate spare equipment on hand?• Circuit packs• Antennas and lines• BTS’s• COW’s
> Contingency Plans• MSC loss (backhaul to another switch)• BTS loss (replacement)• Backhaul Loss (24x7 contact info and access to backhaul provider(s))• Infrastructure failure (PSTN interconnect, power)
Nortel Confidential InformationNORTEL GOVERNMENT SOLUTIONS CONFIDENTIAL4
Disaster PreparednessThings to Consider (2/2)
> Establish liaison with local/regional/state EOC’s
> Establish liaison with local/regional/state Law Enforcement• Required for ingress / egress to disaster zone
> Establish liaison at the Federal level (as required) with FEMA, National Guard• Determine who is the Lead Federal Agency and establish liaison
> Arrange for on demand security support• Site security• Personnel security
> Personnel Safety• Lodging, Food, Water• Safety gear e.g. Hard Hats, Chainsaws, Steel toe boots, heavy gloves, flashlights, etc• Clothing appropriate for the location and disaster• Immunizations (Tetanus)• Communications• First Aid training & kits• Nearest functioning hospital emergency room• Minimum of 2 personnel per recovery team• Know location of Shelters (Fallout Shelters, Red Cross, Salvation Army, etc)
> Plan for Public Relations point of contact for Media inquiries
Nortel Confidential InformationNORTEL GOVERNMENT SOLUTIONS CONFIDENTIAL5
Disaster PreparednessThings to Expect> Plan for Limited or No Access into disaster zone
• May be restricted or impossible for days/weeks• Inability to refuel generators
> Plan for Loss of Security• Lack of law enforcement in disaster area may lead to looting, riots, robberies, muggings
or worse• Expect to secure your own security teams for sites and technical personnel
> Plan for Loss of Commercial power• Recent experiences highlight long delays in power restoration, in some cases 6-8 weeks• Even if access is possible to the disaster zone, fuel may not be available to refuel
generators due to lack of power at gas stations, fuel depots
> Plan to augment/replace local resources with others from outside disaster zone
> Plan for lack of lodging for recovery personnel in disaster zone
> Plan for lack of food, water for recovery personnel in disaster zone
> Plan for appropriate transportation, e.g. 4wd vehicles, boats, RV’s, etc.
> Plan for secure staging area
Nortel Confidential InformationNORTEL GOVERNMENT SOLUTIONS CONFIDENTIAL6
Disaster PreparednessNortel Support
> Securing replacement hardware• Typically not an issue
> Securing resources for installation and/or recovery• Typically not an issue
> Switch on Wheels (SOW)• Can be created and made available in 3-7 days• Provides limited capacity• Requires infrastructure availability
• PSTN Interconnect• BTS Interconnect
> ER will open a Disaster Response bridge for progress updates
Nortel Confidential InformationNORTEL GOVERNMENT SOLUTIONS CONFIDENTIAL7
Disaster Recovery Steps> If you are involved in a disaster
• Account for and verify safety of all your personnel in disaster zone• Contact Nortel Emergency Recovery to report the disaster, if we have not already
contacted you first• Work with Nortel ER to assess damage and your requirements for recovery• ER will activate the Nortel Disaster Response Team (DRT) involving:
• Engineering• Logistics• Installation• Supply Chain• Customer Operations• Account Team• Technical Support• Network Integration
• The DRT will secure replacement equipment on a priority basis• The DRT will secure resources to install, commission and integrate the equipment• The DRT will engage other DRT members as required for each customer and/or event• The DRT operates 24x7 until stand down from the disaster is declared• Where multiple customers are impacted simultaneously, Nortel will prioritize disaster
response actions in accordance with the severity, the highest severity items will be managed first.
• You should provide a single point of contact (SPOC) for the DRT, acting as your Damage Assessment Prime
Nortel Confidential InformationNORTEL GOVERNMENT SOLUTIONS CONFIDENTIAL8
Disaster Management & Recovery
Early Prep (ER)• Send email notification to all teams of potential disaster
(Kick-off preparedness planning)• Consolidate Potentially affected sites & existing
equipment (feed to supply chain)• Validate logistics (War Rooms, Communications, etc.)• Communicate Prep status to executive team• Gather resource help (GNPS, GNTS/TAS)• Validate Disaster Preparedness documentation
AdvancedWarning
DisasterPreparednessdocumentation
ER War Room
Execute “prep”
steps in parallel.
YES
Early Prep (COL)• Collect Potentially affected
sites & existing equipment• Assess potential damage
sites• Send Disaster Preparedness
documentation to potentially affected customers.
Early Prep (Supply Chain)• Review Factory inventory and manufacturing
capabilities against potentially impacted sites.
DisasterHit
Disaster Recovery (ER)• Initiate Disaster Recovery Action Plan (War Room, Recovery,
Communications, etc.)• Coordinate all incoming calls for assistance (Customer & COL)• Send executive status reports
Disaster Recovery (COL)• Assign Disaster Assessment Prime• Collect Site impact & Communicate to ER Prime• Provide Periodic Status (as defined by communication plan) to
ER coordination prime.
Disaster Recovery (Supply Chain)• Pre-stage equipment• Communicate status to ER coordination Prime
YES
Stand DownNO
NO
DisasterHit
StandDown NO YES
Hot Line
Disaster Recovery (I&C)• Resource Management• Communicate status to ER coordination prime
Early Prep (Government relations)• Engage government agencies & communicate
plans to ER teams.
Tornado
Fire
Flood
Earthquake
Hurricane
Terrorism
Nortel Confidential InformationNORTEL GOVERNMENT SOLUTIONS CONFIDENTIAL9
Nortel Confidential InformationNORTEL GOVERNMENT SOLUTIONS CONFIDENTIAL10
Buras Water Tower Collapsed on top of District 8 Council Building - Buras
Nortel Confidential InformationNORTEL GOVERNMENT SOLUTIONS CONFIDENTIAL11
Nortel Confidential InformationNORTEL GOVERNMENT SOLUTIONS CONFIDENTIAL12
Nortel Confidential InformationNORTEL GOVERNMENT SOLUTIONS CONFIDENTIAL13
Nortel Confidential InformationNORTEL GOVERNMENT SOLUTIONS CONFIDENTIAL14
> Equipment Delivery & InstallationChallenges (large scale disasters)
• Access (Road Closures)• Security (Social unrest)• Logistics (Lodging, Food, Gas)• Health Concerns (Contamination/Disease)
> Evacuee Telecommunications Requirements• Cellular Roaming• Evacuee Centers
> “Non-Traditional” Customers• FEMA (1-800 Help Line)• Government Agency Interaction• 1st Responders Support
Dynamics of Disaster Recovery
Re-Home – Containerize – Replace
Access
Security
Health
Logistics
Nortel Confidential InformationNORTEL GOVERNMENT SOLUTIONS CONFIDENTIAL15
Alternative SolutionsChoosing the Best Path
Containerized Systems• Network Facilities
must be in place at the point of replacement
• Containerized Solutions are NOT a like-for-like replacement (usually smaller)
• Environmental conditions must support bringing in containers and Human Resources to set-up and run the temporary facility.
OfficeRe-Homing• While Geographic Survivability is
not typically part of standard network designs, Tandem office re-homing can usually be accomplished with minimal effort.
• Only partial Network Facilities required
• Environmental conditions at point of loss not an issue
• End Office re-homing (lines) is more difficult, but depending on the nature of the disaster, line “users” are also displaced and land-line facilities are also destroyed. This allows time for more conventional office replacement.
Office Replacement• If time,
physical facilities, and environmental conditions permit, replacing the equipment in the current facility is always the best alternative
Nortel Confidential InformationNORTEL GOVERNMENT SOLUTIONS CONFIDENTIAL16
CDMA MTX SOW
Nortel Confidential InformationNORTEL GOVERNMENT SOLUTIONS CONFIDENTIAL17
CDMA BSC SOW
Nortel Confidential InformationNORTEL GOVERNMENT SOLUTIONS CONFIDENTIAL18
Optera 11p FP
SPM
114 BTS T1smicrowave
CDMA MTX
CDMA BSC
PSTN
320 SBS T1sMuxed to OC-3
ESEL SBS
frames
416 PSTN T1s or DS3 or OC3
CBRS
CDMA HUB site
MW RadioGear
Optera
48 CMI BTS sites
Optera
Nortel Confidential InformationNORTEL GOVERNMENT SOLUTIONS CONFIDENTIAL19
Commercially Available COW’s(Cell Site on Wheels)
Pictures courtesy of Ft. Worth Tower, Inc. and Aluma Tower Co. Inc.
Top Related