Post on 27-Aug-2018
Managing Risk through Training
The benefits of Evidence-based Training
Captain Michael Varney FRAeS President
EBT-Foundation
Comparison by aircraft generation Fatal accident rate – 4Q 2011
0
1
2
3
0 10 20 30 40
3rd generation 4th generation
2nd generation
Sources: Ascend, Airbus
Years of operation
Fatal accident per million departures 2nd generation:
2nd jet generation
3rd generation:
Glass-cockpit
Nav display
FMS
4th generation:
FBW
Flight Envelope
Protection
further improvement ?
Evidence-based Training Foundation © 2015
Competency development
Session 1
Task/condition/standard
Task/condition/standard
Task/condition/standard
Task/condition/standard
Task/condition/standard
Task/condition/standard
Task/condition/standard
Task/condition/standard
Task/condition/standard
Task/condition/standard
Task/condition/standard
S
essio
n 2
Sessio
n 3
Sessio
n 4
Sessio
n 5
Sessio
n 6
Competencies tool shop
Tasks
66 Performance
indicators
Evidence-based Training Foundation © 2015
Evidence example
TEM indicator: Average number per flight
Outstanding leadership and communication
Good leadership and poor communication
Poor leadership and communication
Threats
Mismanaged threats
Errors
Undesired aircraft states (UAS)
LOSA observer ratings for captain leadership and communication
4.9 4.3 5.0
1.4
0.7 1.1
2.3 5.6 7.0
0.4
0.3
1.8
Evidence-based Training Foundation © 2015
Ob
ject
ive
Co
nd
uct
Manoeuvres
Validation (Training)
Train manoeuvre
skills
to proficiency
e.g. “V1 cut”
All engine Go -
around (New)
EBT Training Phases
Evaluation
Assess competence
Identify
training needs
Line Orientated
Evaluation
Scenario Based
Training
Develop resilience,
learning by
exposure
Line-orientated
training
Evidence-based Training Foundation © 2015
ICAO Doc 9868 PANS-TRG Applicability 3rd May 2013
ICAO Doc 9995 Manual of EBT Applicability 3rd May 2013
IATA EBT Data Report July 2013
EBT Implementation Guide June 2013
FAA Endorse transition from AQP
EASA EBT Task Group Q1-2 2015
CAAC CCAR 121 R4
✔
✔
✔
✔
✔
EBT – Current status
Evidence-based Training Foundation © 2015
“In a breakthrough that I would not have expected for years, the International Civil Aviation Organization (ICAO) has approved provisions for evidence-based training (EBT) in ICAO Standards and Recommended Practices…”
“Credit goes to some extraordinary work done by a range of people and organizations
that came together faster and better than anyone expected…”
Bill Voss (2013) President Flight Safety Foundation
Evidence-based Training Foundation © 2015
Summary
Continually examine the
evidence
Measure performance
effectively
Learn through exposure
Learn from positive
performance
Continuous improvement
Evidence-based Training Foundation © 2015
EBT Foundation
Captain Steve Chealander – ex NTSB Board Member / American Airlines Carey Edwards – Managing Director LMQ Ltd Captain Iain Gunther – FDA specialist / Airbus Lars Fucke – Research and Development Engineer / Boeing Captain Dieter Harms – CEO Harms Consulting Captain Simon Henderson PhD (Manager Standards Virgin Australia) Barbara Mahwin PhD – Human Factors & Fatigue / Neuroscience specialist Professor Patrick Murray – Griffith University / LOSA Collaborative Jari Nisula – CEO Risk In Motion David Robinson PhD – Head of Statistics University of Minnesota Captain John Scully – Head of EBT Data Analyses Captain Michael Varney – EBT Project Leader Captain Simon Wood – Virgin Atlantic / Coventry University
Evidence-based Training Foundation © 2015
mailto:michael@ebt-foundation.com
Evidence-based Training Foundation © 2015