Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world...

70
Designing for Situation Designing for Situation Awareness Awareness - - the world behind the glass the world behind the glass - - EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max Mulder

Transcript of Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world...

Page 1: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

Designing for Situation Designing for Situation AwarenessAwareness

--the world behind the glassthe world behind the glass--

EUROCONTROL scientific seminar January 21, 2011

prof dr ir Max Mulder

Page 2: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

today

• introduce the human-machine systems group

• cognitive systems engineering & ecological interface design

• example : airborne separation assurance

Page 3: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

aerospace human-machine systems @ TU Delft

Page 4: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

aerospace human-machine systems

TU DelftTU Delft

Aerospace EngineeringAerospace Engineering

Control & SimulationControl & Simulation

Page 5: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

+ approximately 20-25 MSc graduate students each year

people in the HMS cluster

Max Mulder & René van Paassen

Mark Mulder

Clark BorstOlaf Stroosma

Xander in ‘t Veld Herman Damveld

Joost Ellerbroek

Stijn van DamMariam Rahman

Arjen de Leege

Daan Pool

Rita PaisStefan de Groot

Joost Venrooij

Bruno Gracio

Jan ComansPaul de Jong

Deniz Yilmaz

Frank Nieuwenhuizen Johan de Prins

Page 6: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

know-how

create, integrate and validate knowledge from various

domains

1) engineering sciences

systems and control theory

artificial intelligence

real-time simulation

2) cognitive sciences

(ecological) psychology

cognitive systems engineering

Page 7: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

cognitive systems engineering & ecological interface design

Page 8: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

why do we need to study humans in the aerospace domain?

>70 % of all accidents is attributed to human error

Page 9: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

response options

• Fire the pilot• Improve training• Better maintenance, improve reliability• Adapt procedures• Add automation/warning systems (TCAS, EGPWS)• Improve the interface

Page 10: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

why do we need to study humans in the aerospace domain?

enormous cost reductions through automation…

Page 11: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

why do we need to study humans in the aerospace domain?

…changing roles of humans

Page 12: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

the evolving cockpit

our approach: design systems in which cognition is a joint process

Yes, all information is presented to the pilot. But, in doing so, all cognition needs to be done by the human

High workloadHigh workload, low performance

Yes, most tasks are automated. But, in doing so, only a small part of the cognition needs to be done by the human

Low workload, low situation low situation awarenessawareness

Page 13: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

levels in interface design

• illumination, readability, colors, symbols

• integrated displays, configural displays, emergent features, principle of moving part

• ...so, what’s next?

?

Page 14: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

the flight deck is . . .

• an “OPEN” system (Vicente)• extensive + complex

interaction with the environment

• “the airborne office”

. . . a workplace for cognitive (team)work

Page 15: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

the challenge of automation

Apologies to Edwards’ SHELL

Page 16: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

. . . is there a display format that helps pilots with their (cognitive) tasks?

Page 17: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

human capabilities “direct perception” – Gibson

affording

specifying

perception-actioncoupling

Page 18: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ecological interface design

Basic idea: “make visible the invisible ”

Work Domain Analysis

Use technology to create an interface that provides meaningful information and that allows humans to directly act on the information to achieve their goal

Transfer a cognitive process into a perceptual process

Interface design

(Vicente & Rasmussen, 1992)

Control task analysisStrategies analysisSocial organization and cooperationWorker competencies analysis

+

Page 19: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

work domain analysis• Consider the path taken by

an ant on the beach. It looks irregular, the ant must be a complex organism to remember & follow this path

• If one instead studies the beach, the path seems obvious. The ant creates that path as it feels, sees and smells the beach

• We did not evolve to feel, see and smell process plants and airplanes. We should analyse “the beach” and create an appropriate representation

Page 20: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

airborne separation assurance

Page 21: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

Page 22: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

typical engineering approaches

Calculation CPA

(CPA < look-ahead time) & (CPA dist < 5 NM) = conflict

Page 23: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

interface: visualise the CPA

• Conflict location moves when maneuvering

• Affordance ‘hit’ is clear, affordance ‘avoidance’ is not

• Only heading, no speed

• Conflicts triggered by manoeuvres

Page 24: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

predictive ASAS

• Conflict location moves when maneuvering

• Affordance ‘hit’ is clear, affordance ‘avoidance’ is not

• Conflicts triggered by maneuvers

Engineer’s answer : p-ASAS (predictive ASAS)

Page 25: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

predictive ASAS (2)

• “no-go” bands for• track/heading• vertical speed

and speed

Page 26: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

p-ASAS issues

• yes, we can see how to avoid aircraft,• but we cannot see how to do it efficiently, and• the computer-aided solution can be within a no-go

heading or speed zone....• so how can we check that the computer is right??• no-go bands for multiple aircraft??

Over to EID/Cognitive Systems Engineering

Page 27: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

let’s take another look at a conflict situation

Page 28: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP: airborne trajectory planningassume we have two aircraft

own

intruder

Page 29: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP....set intruder aircraft to stand still

Page 30: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP...then we should also change the speed of own...

Page 31: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP...add the protected zone...

Page 32: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP....create Forbidden Beam Zone....in relative space

Page 33: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP....calculate relative speed....here: we’re safe

Page 34: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP....move FBZ with intruder speed....to obtain own a/c

“speed/heading space”

Page 35: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP....an owncraft-centered

presentation of own motion constraints

Page 36: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP....look at another situation

Page 37: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP....look at another situation

own velocity

Page 38: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP....look at another situation

velocity of the intruder aircraft

own velocity

Page 39: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP....look at another situation

velocity of the intruder aircraft

own velocity

relative velocity

Page 40: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP....add own a/c maximum speed

Page 41: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP....add own a/c minimum speed

Page 42: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP....add maximum heading changes for productivity

Page 43: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP....the result is the state vector envelope for 2D motion

Page 44: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

demo: conflict with one aircraft

Page 45: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

no reaction, development of conflict

Page 46: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP....heading bands??

Page 47: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP....heading bands?

Page 48: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP....heading bands!

Page 49: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP....a whole family of heading bands!

Page 50: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP....speed bands??

Page 51: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP....speed bands!

Page 52: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP....a whole family of speed bands!

Page 53: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP....multiple intruder aircraft??

Page 54: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP....multiple intruder aircraft!

Page 55: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

demonstration: multiple intruders

Page 56: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP....optimal solution??

Page 57: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP....optimal solution!

Page 58: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP

smallest state change

....optimal solution!

Page 59: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP....implicit

coordination!

Page 60: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP....implicit

coordination!

Page 61: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

safety

production

efficiency

locomotion

relativemotion

flight and control

aircraft limits

Page 62: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

. . . is there a display format that helps pilots with their (cognitive) tasks?

Page 63: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

closing statements

The goal of EID is to transform a cognitive task into a perceptual task by providing meaningful information that humans can directly perceive and act on accordingly.

“make visible the invisible”

Distribute the cognition between humans and the automated systems through the interface. Strive for a joint cognitive system.

Page 64: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

our approach to interface design

...usually starts out with a lot of engineering calculations, modelling and describing the system

...we have learned that picking the right representation (state variables) is crucial to the success of the interface design

...we are no rocket scientists, so we go through lots of iterations!!

Page 65: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

….current work

Ecological ASAS (funded by EUROCONTROL + NLR)Ecological ASAS (funded by EUROCONTROL + NLR)

Merging terrain and traffic constraintsMerging terrain and traffic constraints

Page 66: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

….current work

….creating joint cognitive systems for air traffic control through a SOLUTION SPACE DIAGRAMSOLUTION SPACE DIAGRAM approach

Page 67: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

thank you for your attention

Page 68: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

Designing for Situation Designing for Situation AwarenessAwareness

--the world behind the glassthe world behind the glass--

EUROCONTROL scientific seminar January 21, 2011

prof dr ir Max Mulder

Page 69: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP....the FBZ is a family of circles

Page 70: Designing for Situation Awareness - Eurocontrol | - … for Situation Awareness Awareness-the world behind the glass-EUROCONTROL scientific seminar January 21, 2011 prof dr ir Max

EUROCONTROL scientific seminar January 21, 2011

ATP....that represent the intruder’s 4D trajectory relative to own