CAST Analysis of the Internaonal Space Staon EVA 23 Suit...

28
CAST Analysis of the Interna3onal Space Sta3on EVA 23 Suit Water Intrusion Mishap STAMP Workshop 2018 Akshay Kothakonda MassachuseDs Ins3tute of Technology March 28, 2018

Transcript of CAST Analysis of the Internaonal Space Staon EVA 23 Suit...

Page 1: CAST Analysis of the Internaonal Space Staon EVA 23 Suit ...psas.scripts.mit.edu/home/wp-content/uploads/2018/... · Events During EVA 23 • Roughly 38 minutes into the EVA 23 (July

CASTAnalysisoftheInterna3onalSpaceSta3onEVA23SuitWaterIntrusionMishap

STAMPWorkshop2018

AkshayKothakondaMassachuseDsIns3tuteofTechnology March28,2018

Page 2: CAST Analysis of the Internaonal Space Staon EVA 23 Suit ...psas.scripts.mit.edu/home/wp-content/uploads/2018/... · Events During EVA 23 • Roughly 38 minutes into the EVA 23 (July

Background and Events Leading up to EVA 23 EV1(ChrisCassidy)hadcompletedfiveEVA’s,totalingalmost30hoursandEV2(LucaParmitano)hadcompletedoneEVA,las3ng6hours

EVA23Crew

DuringEVA21onMay12,2013,thesuitthatleakedwasusedwithoutanyissuesEVA21

•  EVA22onJuly9,2013hadthesamecrewandsuitsasonEVA23•  ½to1literofwaterwasfoundinEV2’shelmetpostEVA•  EV1reportednotseeinganywaterinEV2’shelmetduringairlockrepressandEV2waslookingdownandleaningforwardduringthis3me

•  Basedonthis,thecrewincorrectlyconcludedthewaterenteredthehelmetduringrepressasEV2pressedthedrinkbagwithhischestandpinchedbitevalveopenwithhischin

•  Thegroundteamacceptedthistheoryandtherewasnofurtherinves<ga<on•  TherewasnodiscussionofwaterleakageduringEVA23pre-briefs

EVA22

Page 3: CAST Analysis of the Internaonal Space Staon EVA 23 Suit ...psas.scripts.mit.edu/home/wp-content/uploads/2018/... · Events During EVA 23 • Roughly 38 minutes into the EVA 23 (July

Events During EVA 23

•  Roughly38minutesintotheEVA23(July16,2013),Parmitanohada“CO2SensorBad”alarm•  Another6minuteslater,hereportedfeelingwateronthebackofheadandneck•  Thewaterwasreportedtoincreaseoverthenext10minutes•  Cassidyvisuallyconfirmedthepoolingofwater•  Thesourceofthewaterwasnotiden<fiedbytheEVAcreworthegroundandtheEVAcrewcon3nuedtowork

•  ThegroundeventuallycalledforanEVATermina<on23minutesaEerParmitanofirstreportedwater

•  Duringtransla3onbacktoairlock,watermigratedtofrontoftheface,coveringhiseyes,nose,andears;andsoakinghiscommunica3onscap

•  Thiscausedseverevisibility,breathing,andcommunica<onissues•  AZerrepress,thesuitwasdoffedexpedi3ouslyand1to1.5litersofwaterwasfound

EVA23

Page 4: CAST Analysis of the Internaonal Space Staon EVA 23 Suit ...psas.scripts.mit.edu/home/wp-content/uploads/2018/... · Events During EVA 23 • Roughly 38 minutes into the EVA 23 (July

NASA Investigation •  Ini3altroubleshoo3ngwasperformedbytheflightcrew•  TheISSProgramconvenedaMishapInves3ga3onBoard(MIB)toinves3gatethisHighVisibilityCloseCall(HVCC)

•  EventandCausalFactorTree(ECFT)wasdevelopedwhichiden3fiedproximate,intermediate,androotcauses,andcontribu3ngfactors

•  Severalobserva<onsweremadethroughcourseofinves3ga3onthatcouldimproveISSopera3ons

•  Recommenda<onsweredrawnfromthesetasks•  HumanfactorsanalysisperformedusingDoDHumanFactorsAnalysisandClassifica3onSystem(HFACS)

•  MishapwasfoundtobeduetoinorganicmaterialsblockingthedrumholesintheEMUwaterseparator,resul3nginwaterspillingintotheventloop

•  Sourceofinorganicmaterialshasnotbeenfound•  MIBreportandthisstudyfocusonwhywaterintrusionaEerEVA22wasnotinves<gatedandwhyEVA23wasnotimmediatelyterminated

Page 5: CAST Analysis of the Internaonal Space Staon EVA 23 Suit ...psas.scripts.mit.edu/home/wp-content/uploads/2018/... · Events During EVA 23 • Roughly 38 minutes into the EVA 23 (July

Why do a CAST Analysis?

•  EnablesonetobePerdissectthecomplexinterconnectedorganiza<onalandreal<meflightopera<onsstructureoftheISSProgram

•  Thisgivesamorerealis<candtransparentpictureofwhythisincidentoccurred•  Itallowsforgenera3onofamorecomprehensivelistofrecommenda<ons•  Overall,itoffersaclearerunderstandingofthemishap•  Providesanopportunitytocomparetheresultsofaneventbasedapproachwithasystemstheorybasedone

Page 6: CAST Analysis of the Internaonal Space Staon EVA 23 Suit ...psas.scripts.mit.edu/home/wp-content/uploads/2018/... · Events During EVA 23 • Roughly 38 minutes into the EVA 23 (July

Extravehicular Mobility Unit

Page 7: CAST Analysis of the Internaonal Space Staon EVA 23 Suit ...psas.scripts.mit.edu/home/wp-content/uploads/2018/... · Events During EVA 23 • Roughly 38 minutes into the EVA 23 (July

Safety Control Structure

Page 8: CAST Analysis of the Internaonal Space Staon EVA 23 Suit ...psas.scripts.mit.edu/home/wp-content/uploads/2018/... · Events During EVA 23 • Roughly 38 minutes into the EVA 23 (July

PhysicalSafetyControls

•  Filterimpuri3esinEMU•  Keepwaterfromgebngintoventloop

ConstraintsViolated

•  CO2Sensor•  EMUHelmetPurgeValveSafetyEquipment

•  Inadequatefiltra3onofimpuri3es•  Fan-Pump-Separatorfailureduetoimpuri3es

Failure/InadequateControls

•  EMUini3allycer3fiedforsingleShuDlemission,isnowcer3fiedforsixyearsonboardISS

•  ErroneousCO2sensorreadingnormalizedover3me

PhysicalContextualFactors

Page 9: CAST Analysis of the Internaonal Space Staon EVA 23 Suit ...psas.scripts.mit.edu/home/wp-content/uploads/2018/... · Events During EVA 23 • Roughly 38 minutes into the EVA 23 (July

EVACrewmembers

•  DiagnoseEMUproblems•  Makejudgementcalltoabort/terminate

SafetyResponsibili3es

•  Trainingdidnotcoverwaterinhelmet• WaterintrusionaZerEVA22notinves3gatedContext

•  Didnotcommunicatewatertemperature•  Didnotrequesttermina3onimmediately

UnsafeDecisions/ControlAc3ons

•  Crewinfluencedbydrinkbagleakagetheory•  Concurredwithground’srecommenda3ontocon3nuewithEVA

ProcessModelFlaws

Page 10: CAST Analysis of the Internaonal Space Staon EVA 23 Suit ...psas.scripts.mit.edu/home/wp-content/uploads/2018/... · Events During EVA 23 • Roughly 38 minutes into the EVA 23 (July

MissionControlCenter

•  DiagnoseproblemsduringEVAopera3onsandinves3gatepost-EVA

•  Constantlyrefreshtrainingandsystemknowledge

SafetyResponsibili3es

•  Underextreme3mepressurestoprepareforEVA23aZerEVA22

• Waterinhelmetnormalizedandtrainingdidnotcoverthis•  Thereweremul3plesimultaneouscommunica3onloops

Context

•  Didnotinves3gatewaterleakaZerEVA22•  DidnotterminateEVA23assoonaswaterwasreported

UnsafeDecisions/ControlAc3ons

•  Therewasanunsubstan3atedpercep3onthatdrinkbagsleak•  Therewasafeelingthatinves3ga3onintoEVA22waterleakwouldbe3meconsuming

ProcessModelFlaws

Page 11: CAST Analysis of the Internaonal Space Staon EVA 23 Suit ...psas.scripts.mit.edu/home/wp-content/uploads/2018/... · Events During EVA 23 • Roughly 38 minutes into the EVA 23 (July

MissionOpera3onsDirectorate

•  Createopera3onalprocedures•  Trainandprovidesimula3onstoFlightControl

SafetyResponsibili3es

•  Consequencesofwaterleakagewasnotunderstoodandnormalized

•  Simula3onsexpectedfindingsolu3onsinsteadoftermina3ngContext

•  Failuremodeofwaterleakagenotcoveredinflightrulesandtraining

• MODEVALessonsLearnedArchivelacksdescrip3onsoffailurespriortoSTS-88

UnsafeDecisions/ControlAc3ons

ProcessModelFlaws

Page 12: CAST Analysis of the Internaonal Space Staon EVA 23 Suit ...psas.scripts.mit.edu/home/wp-content/uploads/2018/... · Events During EVA 23 • Roughly 38 minutes into the EVA 23 (July

EVAOffice

•  Iden3fyhazardsandprovideQAinEMUandEVA•  Integratesafetyac3onswithrestofISS

SafetyResponsibili3es

•  Groundtes3ngofbehaviorofwaterinEMUwaslesssevere•  ISSProgramhadnorequirementtoreviewEMUFMEA/CIL•  ADri3oninsuitexper3se

Context

•  DidnotunderstandseverityofwaterinEMU•  UpdatestoFMEA/CILnotcomprehensive• WaterinhelmetandCO2sensorerrorsnormalized

UnsafeDecisions/ControlAc3ons

•  Basedongroundtests,waterinEMUwasdeemedtonotbeahazard

ProcessModelFlaws

Page 13: CAST Analysis of the Internaonal Space Staon EVA 23 Suit ...psas.scripts.mit.edu/home/wp-content/uploads/2018/... · Events During EVA 23 • Roughly 38 minutes into the EVA 23 (July

ISSProgram

•  EnsureallISSsystemshavecompletedSMAprocesses•  ChairingISSSafetyReviewPanel

SafetyResponsibili3es

•  BudgetcutsaffectedplannedreviewofEMUFMEA/CIL•  SMAprocessforEVAseparatefromrestofISSandismanagedbyEVAOffice

Context

•  Emphasizedmaximizingcrew3meformissionoversafetytasks•  DidnotrequireperiodicreviewofEMUFMEA/CIL•  NorequirementforEVA/EMUtrainingofMERSafetyTeam

UnsafeDecisions/ControlAc3ons

•  Upda3ngFMEA/CILwasthoughtofasmerepaperworkanddidnotreceivetheaDen3onwarranted

ProcessModelFlaws

Page 14: CAST Analysis of the Internaonal Space Staon EVA 23 Suit ...psas.scripts.mit.edu/home/wp-content/uploads/2018/... · Events During EVA 23 • Roughly 38 minutes into the EVA 23 (July

Recommendations • MODtodevelopflightrulesforwaterintrusionandtrainaccordingly.Thisincludesinves3ga3nghelmetpurgevalveopera3onandreviewinganddetailingproceduresthatrequirecrewtocontactground

• MODshouldtrainFCTandEVAcrewinpriorEMUfailuresincludingusingsimula3ons

• MODshouldtrainMERSafetyTeaminEVAsystemsandbemadearequirementbyISSProgram

•  Simula3onsshouldallowforFCTtoterminate/abortanEVA• MODshouldimplementchannelstoallowlowerlevelflightcontrolelementstohaveamoredirectaccesstoFlightControlRoomandFlightDirector

•  FlightSafetyOfficeshouldenforcebestprac3cestoaddressknownfailuremodesandnormalizeddevia3onswithinMODSMAprogram

Page 15: CAST Analysis of the Internaonal Space Staon EVA 23 Suit ...psas.scripts.mit.edu/home/wp-content/uploads/2018/... · Events During EVA 23 • Roughly 38 minutes into the EVA 23 (July

Recommendations (continued) • Possibilityofasphyxia3onshouldbeincludedinFMEA/CILbyEVAOfficeandenforcedbyISSProgram

•  ISSProgramalongwithMODandEVAOfficeshouldreviewcaseswheredevia3onsarenormalized(forinstancepresenceofsmallamountsofwaterinhelmetcausingfogging)andaddressthem.ThisshouldbedoneforwiderISSProgram.OtherexamplesincludeCO2sensorandsublimatorinefficiency.

•  ISSProgramalongwithMODandEVAOfficeshouldreviewandupdateFMEA/CILandaddressfailures.WithresourcesfromISSProgram,EVAOfficeshouldupdateandreleaseEMUlessonslearned,systemdevelopment,designandflightprocedurera3onales.Thesemaybeincludedintrainingprograms.

•  ISSProgramshouldhavebeDeroversightoverFCTinrepor3nganomalies•  ISSProgramshouldencouragecultureofpriori3zingastronautsafetyandofanyonebeingabletovoicesafetyconcernstohighermanagement

Page 16: CAST Analysis of the Internaonal Space Staon EVA 23 Suit ...psas.scripts.mit.edu/home/wp-content/uploads/2018/... · Events During EVA 23 • Roughly 38 minutes into the EVA 23 (July

Recommendation (continued) •  ISSProgramshouldreviewimplica3onsofchangingwaterqualityandchemistryonISSsystems

•  ISSProgramshouldreviewacceptabilityofEMU’ssixyearcer3fica3on•  ISSProgramshouldrequireperiodicreviewofFMEA/CILofISSsystems

Page 17: CAST Analysis of the Internaonal Space Staon EVA 23 Suit ...psas.scripts.mit.edu/home/wp-content/uploads/2018/... · Events During EVA 23 • Roughly 38 minutes into the EVA 23 (July

Conclusion

• CASTprovidedahighlysystema<canalysisprocessforaverycomplexsocio-technicalsystem

•  Thisresultedinahighlyefficientprocess• Morenumberofsignificantsafetyrecommenda<onsweregeneratedusingCASTthanthatusingevent-basedapproach

Page 18: CAST Analysis of the Internaonal Space Staon EVA 23 Suit ...psas.scripts.mit.edu/home/wp-content/uploads/2018/... · Events During EVA 23 • Roughly 38 minutes into the EVA 23 (July

References

• NASAMishapInves/ga/onReport:ISSEVASuitWaterIntrusionHighVisibilityCloseCall,IRISCaseNumber:S-2013-199-00005

• Hansen,C.,Cassidy,C.(2014)MishapInves/ga/onBoardSummaryofExtravehicularAc/vity23:LessonsLearnedFromaSpacewalkCloseCall.JournalofSpaceSafetyEngineering,Vol.1,pages32-39

• Kothakonda,A.(2015).DesignofSensorSystemtoDetectPresenceofAnomalousWaterinAirLinesintheExtravehicularMobilityUnit.JournalofSpaceSafetyEngineering,2(2),74-78.

Page 19: CAST Analysis of the Internaonal Space Staon EVA 23 Suit ...psas.scripts.mit.edu/home/wp-content/uploads/2018/... · Events During EVA 23 • Roughly 38 minutes into the EVA 23 (July

BACKUP SLIDES

Page 20: CAST Analysis of the Internaonal Space Staon EVA 23 Suit ...psas.scripts.mit.edu/home/wp-content/uploads/2018/... · Events During EVA 23 • Roughly 38 minutes into the EVA 23 (July

EVA Communication Paths

Page 21: CAST Analysis of the Internaonal Space Staon EVA 23 Suit ...psas.scripts.mit.edu/home/wp-content/uploads/2018/... · Events During EVA 23 • Roughly 38 minutes into the EVA 23 (July

Water Separator Spinning Drum and Pitot Components

Page 22: CAST Analysis of the Internaonal Space Staon EVA 23 Suit ...psas.scripts.mit.edu/home/wp-content/uploads/2018/... · Events During EVA 23 • Roughly 38 minutes into the EVA 23 (July

ECFT Proximate Causes

Page 23: CAST Analysis of the Internaonal Space Staon EVA 23 Suit ...psas.scripts.mit.edu/home/wp-content/uploads/2018/... · Events During EVA 23 • Roughly 38 minutes into the EVA 23 (July
Page 24: CAST Analysis of the Internaonal Space Staon EVA 23 Suit ...psas.scripts.mit.edu/home/wp-content/uploads/2018/... · Events During EVA 23 • Roughly 38 minutes into the EVA 23 (July
Page 25: CAST Analysis of the Internaonal Space Staon EVA 23 Suit ...psas.scripts.mit.edu/home/wp-content/uploads/2018/... · Events During EVA 23 • Roughly 38 minutes into the EVA 23 (July
Page 26: CAST Analysis of the Internaonal Space Staon EVA 23 Suit ...psas.scripts.mit.edu/home/wp-content/uploads/2018/... · Events During EVA 23 • Roughly 38 minutes into the EVA 23 (July
Page 27: CAST Analysis of the Internaonal Space Staon EVA 23 Suit ...psas.scripts.mit.edu/home/wp-content/uploads/2018/... · Events During EVA 23 • Roughly 38 minutes into the EVA 23 (July
Page 28: CAST Analysis of the Internaonal Space Staon EVA 23 Suit ...psas.scripts.mit.edu/home/wp-content/uploads/2018/... · Events During EVA 23 • Roughly 38 minutes into the EVA 23 (July