February 2011 Cold Snap Event RecommendationsEvent ... DL/Cold_Snap_Event...impacted by the cold...
Transcript of February 2011 Cold Snap Event RecommendationsEvent ... DL/Cold_Snap_Event...impacted by the cold...
![Page 1: February 2011 Cold Snap Event RecommendationsEvent ... DL/Cold_Snap_Event...impacted by the cold snap event. • The lessons learned were reviewed by NERC, categorized and consolidated](https://reader033.fdocuments.us/reader033/viewer/2022051902/5ff0ffacbbe4117f9a58b279/html5/thumbnails/1.jpg)
February 2011 Cold Snap Event RecommendationsEvent RecommendationsJanuary 23, 2011y ,Earl Shockley, Director of Reliability Risk Management
![Page 2: February 2011 Cold Snap Event RecommendationsEvent ... DL/Cold_Snap_Event...impacted by the cold snap event. • The lessons learned were reviewed by NERC, categorized and consolidated](https://reader033.fdocuments.us/reader033/viewer/2022051902/5ff0ffacbbe4117f9a58b279/html5/thumbnails/2.jpg)
Recommendations - Electric
• February 1‐5, 2011 event occurred
• August 15 2011 joint report released• August 15, 2011 – joint report released
• There were a total of 26 electric recommendations issued:issued: Planning and reserves (5);
Coordination with generator owners/operators (5);Coordination with generator owners/operators (5);
Winterization (10);
Communications (4); and
Load Shedding (2)
• There were also six gas recommendations
2 RELIABILITY | ACCOUNTABILITY
![Page 3: February 2011 Cold Snap Event RecommendationsEvent ... DL/Cold_Snap_Event...impacted by the cold snap event. • The lessons learned were reviewed by NERC, categorized and consolidated](https://reader033.fdocuments.us/reader033/viewer/2022051902/5ff0ffacbbe4117f9a58b279/html5/thumbnails/3.jpg)
Theme -Three “P’s”
• August 2003 Blackout delivered three distinct themes ll d th th “T’ ”called the three “T’s”. Trees
Tools Tools
Training
• The February 2011 Cold Snap event delivered threeThe February 2011 Cold Snap event delivered three distinct themes Predict
Planning
Preparation
3 RELIABILITY | ACCOUNTABILITY
![Page 4: February 2011 Cold Snap Event RecommendationsEvent ... DL/Cold_Snap_Event...impacted by the cold snap event. • The lessons learned were reviewed by NERC, categorized and consolidated](https://reader033.fdocuments.us/reader033/viewer/2022051902/5ff0ffacbbe4117f9a58b279/html5/thumbnails/4.jpg)
Predict
First P – “Predict”
• The storm was not without precedent There were priorThe storm was not without precedent. There were prior severe cold weather events in the Southwest in 1983, 1989, 2003, 2006, 2008, and 2010. , , , , Good analyses were conducted
Good reports were written
Good recommendations were developed
No institutionalization of the recommendations and lessons
Can we now predict the same circumstances?
4 RELIABILITY | ACCOUNTABILITY
![Page 5: February 2011 Cold Snap Event RecommendationsEvent ... DL/Cold_Snap_Event...impacted by the cold snap event. • The lessons learned were reviewed by NERC, categorized and consolidated](https://reader033.fdocuments.us/reader033/viewer/2022051902/5ff0ffacbbe4117f9a58b279/html5/thumbnails/5.jpg)
Planning
Second P – “Planning”
• On site visits with GO/GOPs revealed:On site visits with GO/GOPs revealed: Some plants had inadequate plans and safeguards in place
to address severe weather.o Lack of formal plans, procedures to address severe weather
o Lack of adequate knowledge of plant temperature design limits and the equipment most effected by freezingq p y g
o Failure to adequately apply and institutionalize knowledge and recommendations from previous severe winter weather events
Some plants had rigorous plans and safeguards in place Some plants had rigorous plans and safeguards in place, some required validation.
Can you predict which plants were most successful during the event?
5 RELIABILITY | ACCOUNTABILITY
Can you predict which plants were most successful during the event?
![Page 6: February 2011 Cold Snap Event RecommendationsEvent ... DL/Cold_Snap_Event...impacted by the cold snap event. • The lessons learned were reviewed by NERC, categorized and consolidated](https://reader033.fdocuments.us/reader033/viewer/2022051902/5ff0ffacbbe4117f9a58b279/html5/thumbnails/6.jpg)
Preparation
Third P – “Preparation”
• Generators were generally reactive as opposed toGenerators were generally reactive as opposed to being proactive in their approach to winterization and preparedness. Many generators failed to adequately p p y g q yprepare for winter, including the following: Failed or inadequate heat traces,
Missing or inadequate wind breaks
Inadequate or lack of insulation
l h h l d h Failure to have or to maintain heating elements and heat lamps in instrument cabinets
Failure to have necessary resources and supplies
6 RELIABILITY | ACCOUNTABILITY
Failure to have necessary resources and supplies
![Page 7: February 2011 Cold Snap Event RecommendationsEvent ... DL/Cold_Snap_Event...impacted by the cold snap event. • The lessons learned were reviewed by NERC, categorized and consolidated](https://reader033.fdocuments.us/reader033/viewer/2022051902/5ff0ffacbbe4117f9a58b279/html5/thumbnails/7.jpg)
BY FAILING TO BY FAILING TO PREPARE, YOU ARE PREPARING TO FAIL.
BENJAMIN FRANKLIN
7 RELIABILITY | ACCOUNTABILITY
![Page 8: February 2011 Cold Snap Event RecommendationsEvent ... DL/Cold_Snap_Event...impacted by the cold snap event. • The lessons learned were reviewed by NERC, categorized and consolidated](https://reader033.fdocuments.us/reader033/viewer/2022051902/5ff0ffacbbe4117f9a58b279/html5/thumbnails/8.jpg)
Frozen Sensor
Aerator Sensor
3/8 inch tubing ‐exposed
R 14 GO/GOP E th t d t i t d i ti f f
8 RELIABILITY | ACCOUNTABILITY
R 14 ‐ GO/GOPs – Ensure that adequate maintenance and inspection of freeze protection elements is conducted on a timely and repetitive basis.
![Page 9: February 2011 Cold Snap Event RecommendationsEvent ... DL/Cold_Snap_Event...impacted by the cold snap event. • The lessons learned were reviewed by NERC, categorized and consolidated](https://reader033.fdocuments.us/reader033/viewer/2022051902/5ff0ffacbbe4117f9a58b279/html5/thumbnails/9.jpg)
Inadequate Insulation
R‐16 GO/GOPs – inspect andinspect and maintain thermal
i l tiinsulation on all units.
9 RELIABILITY | ACCOUNTABILITY
![Page 10: February 2011 Cold Snap Event RecommendationsEvent ... DL/Cold_Snap_Event...impacted by the cold snap event. • The lessons learned were reviewed by NERC, categorized and consolidated](https://reader033.fdocuments.us/reader033/viewer/2022051902/5ff0ffacbbe4117f9a58b279/html5/thumbnails/10.jpg)
Lack of Insulation
Notice burn marks (from torch) on bare tube
R – 18 GO/GOPs – Develop and annually conduct winter‐specific and plant‐specific operator awareness
Outside exposure
10 RELIABILITY | ACCOUNTABILITY
specific operator awareness and maintenance training.
![Page 11: February 2011 Cold Snap Event RecommendationsEvent ... DL/Cold_Snap_Event...impacted by the cold snap event. • The lessons learned were reviewed by NERC, categorized and consolidated](https://reader033.fdocuments.us/reader033/viewer/2022051902/5ff0ffacbbe4117f9a58b279/html5/thumbnails/11.jpg)
Wind Break Design
Wind break was too
Feedwater Sensor Froze
Wind break was too Short
Wind BreakR – 17 GO/GOPs – Plan to erect
adequate wind breaks and enclosures,
11 RELIABILITY | ACCOUNTABILITY
adequate wind breaks and enclosures, where needed.
![Page 12: February 2011 Cold Snap Event RecommendationsEvent ... DL/Cold_Snap_Event...impacted by the cold snap event. • The lessons learned were reviewed by NERC, categorized and consolidated](https://reader033.fdocuments.us/reader033/viewer/2022051902/5ff0ffacbbe4117f9a58b279/html5/thumbnails/12.jpg)
Corroded FreezeProtection Panel
R – 15 GO/GOPs – Inspect and maintain heat tracing equipment on all
12 RELIABILITY | ACCOUNTABILITY
R 15 GO/GOPs Inspect and maintain heat tracing equipment on all generating units.
![Page 13: February 2011 Cold Snap Event RecommendationsEvent ... DL/Cold_Snap_Event...impacted by the cold snap event. • The lessons learned were reviewed by NERC, categorized and consolidated](https://reader033.fdocuments.us/reader033/viewer/2022051902/5ff0ffacbbe4117f9a58b279/html5/thumbnails/13.jpg)
Oil Burning Wands
R – 6 TOs, BAs, and GO/GOPs –if h i h h f lVerify that units that have fuel switching capabilities can
periodically demonstrate those p ycapabilities
13 RELIABILITY | ACCOUNTABILITY
![Page 14: February 2011 Cold Snap Event RecommendationsEvent ... DL/Cold_Snap_Event...impacted by the cold snap event. • The lessons learned were reviewed by NERC, categorized and consolidated](https://reader033.fdocuments.us/reader033/viewer/2022051902/5ff0ffacbbe4117f9a58b279/html5/thumbnails/14.jpg)
Fuel Transfer Valves
Valve Froze
14 RELIABILITY | ACCOUNTABILITY
![Page 15: February 2011 Cold Snap Event RecommendationsEvent ... DL/Cold_Snap_Event...impacted by the cold snap event. • The lessons learned were reviewed by NERC, categorized and consolidated](https://reader033.fdocuments.us/reader033/viewer/2022051902/5ff0ffacbbe4117f9a58b279/html5/thumbnails/15.jpg)
Lessons Learned
• NERC received a total of 55 lessons learned from entities impacted by the cold snap event.p y p
• The lessons learned were reviewed by NERC, categorized and consolidated into 22 individual lessons that align with the
d ti tli d i th j i t FERC/NERC trecommendations outlined in the joint FERC/NERC report “Outages and Curtailments during the Southwest Cold Weather Event” published on August 15, 2011.
• On September 30, 2011 the first two cold snap lessons learned were posted to correspond with the fall maintenance program for winter weather preparationwinter weather preparation.
• Two additional lessons learned have been posted.
15 RELIABILITY | ACCOUNTABILITY
![Page 16: February 2011 Cold Snap Event RecommendationsEvent ... DL/Cold_Snap_Event...impacted by the cold snap event. • The lessons learned were reviewed by NERC, categorized and consolidated](https://reader033.fdocuments.us/reader033/viewer/2022051902/5ff0ffacbbe4117f9a58b279/html5/thumbnails/16.jpg)
Events Happen
Lab Tests Confirm Salmonella Source
16 RELIABILITY | ACCOUNTABILITYRELIABILITY | ACCOUNTABILITY
![Page 17: February 2011 Cold Snap Event RecommendationsEvent ... DL/Cold_Snap_Event...impacted by the cold snap event. • The lessons learned were reviewed by NERC, categorized and consolidated](https://reader033.fdocuments.us/reader033/viewer/2022051902/5ff0ffacbbe4117f9a58b279/html5/thumbnails/17.jpg)
Reliability Risk ManagementConcepts
Severity
Avoid
InverseLearn and Reduce
Cost‐Benefit
Reporting Threshold
17 RELIABILITY | ACCOUNTABILITY
Trend lower tiered events – identify emerging reliability risk trends.
![Page 18: February 2011 Cold Snap Event RecommendationsEvent ... DL/Cold_Snap_Event...impacted by the cold snap event. • The lessons learned were reviewed by NERC, categorized and consolidated](https://reader033.fdocuments.us/reader033/viewer/2022051902/5ff0ffacbbe4117f9a58b279/html5/thumbnails/18.jpg)
Drifting to Failure Concept*
Hi
Expectations: Desired approach to work (as imagined)Normal Practices: Work as actually performed
Hi
Drift
Managements Stated Expectations
“Normal”
liability
f NormalPractice
Real Margin for Error
Error
Latent Errors
Re
Latent Errorsunnoticed at the time made; often deeply or embedded within system.
RISK CLUSTERS ‐ Programmatic deficiencies, deficiencies in barriers and defenses, Latent organizational weaknesses and conditionsErrors in human performance and contextual factorsEquipment design and/or maintenance issues
18 RELIABILITY | ACCOUNTABILITY
Lo Time * Adapted from Muschara Error Management Consulting, LLC
![Page 19: February 2011 Cold Snap Event RecommendationsEvent ... DL/Cold_Snap_Event...impacted by the cold snap event. • The lessons learned were reviewed by NERC, categorized and consolidated](https://reader033.fdocuments.us/reader033/viewer/2022051902/5ff0ffacbbe4117f9a58b279/html5/thumbnails/19.jpg)
Cold Snap EventDrifting to Failure*
Hi
Expectations: Desired approach to work (as imagined)Normal Practices: Work as actually performed
Hi
Drift
Stated Expectations
“Normal”
liability Normal
PracticeReal Margin for Error Error
Latent Error
Re
Latent Errorunnoticed at the time made; often deeply or embedded within system.
Linked Causal factors = examples above
19 RELIABILITY | ACCOUNTABILITY
Lo Time * Adapted from Muschara Error Management Consulting, LLC
![Page 20: February 2011 Cold Snap Event RecommendationsEvent ... DL/Cold_Snap_Event...impacted by the cold snap event. • The lessons learned were reviewed by NERC, categorized and consolidated](https://reader033.fdocuments.us/reader033/viewer/2022051902/5ff0ffacbbe4117f9a58b279/html5/thumbnails/20.jpg)
Defense in Depth Concept*
When the wrong set of circumstances line up, major events occur…
Defense 1Defense 2Defense 3
Freezing weather, high winds
fDefense 4
Event
20 RELIABILITY | ACCOUNTABILITY
* Adapted from Dr. James Reason, Human Error 1990
![Page 21: February 2011 Cold Snap Event RecommendationsEvent ... DL/Cold_Snap_Event...impacted by the cold snap event. • The lessons learned were reviewed by NERC, categorized and consolidated](https://reader033.fdocuments.us/reader033/viewer/2022051902/5ff0ffacbbe4117f9a58b279/html5/thumbnails/21.jpg)
Summary
• We do not want to lose our perspective of what happened during the winter of 2011happened during the winter of 2011
• Consider the three “P’s”
E i f d• Examine your safeguards
• We should consider the cost benefit as well as the risk to reliability and reputation:reliability and reputation: Institutionalize recommendation and learning's
Show that we not only can identify problems but also put the Show that we not only can identify problems but also put the necessary fixes in place.
• Have a passionate focus on reliability
21 RELIABILITY | ACCOUNTABILITY
p y
![Page 22: February 2011 Cold Snap Event RecommendationsEvent ... DL/Cold_Snap_Event...impacted by the cold snap event. • The lessons learned were reviewed by NERC, categorized and consolidated](https://reader033.fdocuments.us/reader033/viewer/2022051902/5ff0ffacbbe4117f9a58b279/html5/thumbnails/22.jpg)
Questions ?Questions ?
22 RELIABILITY | ACCOUNTABILITY