interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

40
Outlook Information, Warning and Intervention strategies & future research directions Anna Schieben & Tobias Hesse - German Aerospace Center (DLR) interactIVe Final Event 20 th -21 st November 2013

Transcript of interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

Page 1: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

OutlookInformation, Warning and Intervention strategies & future research directions

Anna Schieben & Tobias Hesse - German Aerospace Center (DLR)interactIVe Final Event

20th-21st November 2013

Page 2: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

3

Introduction: Lessons learnt from InteractIVe

20th-21st November 2013 │interactIVe Final Event

Introduction Work process in SP 3

Page 3: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

4

IntroductionInformation, Warning and Intervention (IWI) strategies & Human Factors Outlook

20th-21st November 2013 │interactIVe Final Event

Page 4: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

5

IntroductionFunctions covered by demonstrator vehicles

20th-21st November 2013 │interactIVe Final Event

Ford

Fiat

BMW

Volvo truck

Volvo car

Conti

VW

SE

CO

ND

S

INC

AE

MIC

Enhanced dynamic pass predictor

Collision avoidance, continuous haptic support and automated driving

Continuous support with focus on haptic HMI solutions

Collision avoidance, continuous support and SafeCruise

Collision avoidance and run-off road prevention by braking and steering, stability considerations for heavy vehicles

Collision mitigation with focus on cost-efficient sensors and algorithm approach

Emergency steering assistance with focus on radar/vision combination

Page 5: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

6

IntroductionModes of automation covered by demonstrator vehicles

20th-21st November 2013 │interactIVe Final Event

Several modes of automation adressed: • depending on the implemented

functions• depending on the situation

Lowlyautomated

Semiautomated

Highlyautomated

Page 6: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

7

IntroductionCooperation between driver and automation

20th-21st November 2013 │interactIVe Final Event

interact

intendsintends

Page 7: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

8

IntroductionInformation, Warning and Intervention (IWI) strategies –aspects

20th-21st November 2013 │interactIVe Final Event

Adaptivity andAdapability

CommunicateSystem Status

Communication channel

Sequence ofinteraction

Arbitration

State, Modes andMode Transitions

Prioritisation andScheduling

Layer of driving tasksLevel of Assistance and

Automation

Trust, Mental workload, Situation Awareness, Driver

mental model

Page 8: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

9

IntroductionInformation, Warning and Intervention (IWI) strategies –Deliverable 3.2

20th-21st November 2013 │interactIVe Final Event

Detailed information on the IWI strategies in interactIVe „Deliverable 3.2 - IWI Strategies“

Page 9: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

10

IntroductionInformation, Warning and Intervention (IWI) strategies -categories

20th-21st November 2013 │interactIVe Final Event

Adaptivity andAdapability

CommunicateSystem Status

Communication channel

Sequence ofinteraction

Arbitration

States, Modes andMode Transitions

Prioritisation andScheduling

Layer of driving tasksLevel of Assistance and

Automation

Trust, Mental workload, Situation Awareness, Driver

mental model

Page 10: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

11

IWI strategiesCommunicate System Status

20th-21st November 2013 │interactIVe Final Event

Adaptivity andAdapability

CommunicateSystem Status

Communication channel

Sequence ofinteraction

Arbitration

States, Modes andMode Transitions

Prioritisation andScheduling

Layer of driving tasksLevel of Assistance and

Automation

Trust, Mental workload, Situation Awareness, Driver

mental model

Page 11: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

12

IWI strategies Communicate System Status

20th-21st November 2013 │interactIVe Final Event

Page 12: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

13

IWI strategies Communicate System Status

• Help the driver to build up a correct mental model about the automation

• Examples of InteractIVe IWI strategies: • Group continuous intervention / automation functions for normal

driving into modes of increasing degree of automation

20th-21st November 2013 interactIVe - eCoMove Joint FE

Page 13: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

14

IWI strategies Communicate System Status

• Help the driver to build up a correct mental model about the automation

• Examples of InteractIVe IWI strategies: • Group continuous intervention / automation functions for normal

driving into modes of increasing degree of automation• Group protection functions using shield metaphor (according to type

of support and direction)

20th-21st November 2013 │interactIVe Final Event

Page 14: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

15

IWI strategies Communicate System Status

• Help the driver to build up a correct mental model about the automation

• Examples of InteractIVe IWI strategies: • Group continuous intervention / automation functions for normal

driving into modes of increasing degree of automation• Group protection functions using shield metaphor (according to type

of support and direction).

20th-21st November 2013 │interactIVe Final Event

Page 15: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

16

Outlook Communicate System Status

20th-21st November 2013 │interactIVe Final Event

Adaptivity andAdapability

CommunicateSystem Status

Communication channel

Sequence ofinteraction

Arbitration

State, Modes andMode Transitions

Prioritisation andScheduling

Layer of driving tasksLevel of Assistance and

Automation

Trust, Mental workload, Situation Awareness, Driver

mental model

Page 16: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

17

OutlookCommunicate System Status

• Use of new technologies (e.g. Head-up-displays) to improve driver‘sunderstanding of the overall system

• Use of integrated concepts covering several assistance andautomation functions

20th-21st November 2013 │interactIVe Final Event

Source: BMW

Page 17: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

18

OutlookCommunicate System Status

• Use of new technologies (e.g. Head-up-displays) to improve driver‘sunderstanding of the overall system

• Use of integrated concepts covering several assistance andautomation functions

• Use information about the automation state e.g. uncertaintyinformation

• Use information about the driver state e.g. adaption of functions andtransitions

20th-21st November 2013 │interactIVe Final Event

© APA (dpa/gms/DVR)

Page 18: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

19

IWI strategies States, Modes and Mode Transitions

20th-21st November 2013 │interactIVe Final Event

Adaptivity andAdapability

CommunicateSystem Status

Communication channel

Sequence ofinteraction

Arbitration

State, Modes andMode Transitions

Prioritisation andScheduling

Layer of driving tasksLevel of Assistance and

Automation

Trust, Mental workload, Situation Awareness, Driver

mental model

Page 19: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

20

IWI strategies States, Modes and Mode Transitions

20th-21st November 2013 │interactIVe Final Event

Page 20: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

21

IWI strategies States, Modes and Mode Transitions

20th-21st November 2013 │interactIVe Final Event

Page 21: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

22

IWI strategies States, Modes and Mode Transitions

20th-21st November 2013 │interactIVe Final Event

Semiautomated

Driver-initiatedtransition

Driver-initiatedtransition

Driver-initiatedtransition

Driver-initiatedtransition

Driver-initiatedtransition

Driver-initiatedtransition

Automation-initiatedtransition

Automation-initiatedtransition

Driver-initiatedtransition

Automation-initiatedtransition

Page 22: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

23

IWI strategiesStates, Modes and Mode Transitions

• Help the driver and the automation to always be aware of who is in control

• Examples of InteractIVe IWI strategies: • Use interlocked transitions

20th-21st November 2013 │interactIVe Final Event

Page 23: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

24

IWI strategies States, Modes and Mode Transitions

• Help the driver and the automation to always be aware of who is in control

• Examples of InteractIVe IWI strategies: • Use interlocked transitions• Display current and available modes

20th-21st November 2013 │interactIVe Final Event

Page 24: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

25

Outlook States, Modes and Mode Transitions

20th-21st November 2013 │interactIVe Final Event

Adaptivity andAdapability

CommunicateSystem Status

Communication channel

Sequence ofinteraction

Arbitration

State, Modes andMode Transitions

Prioritisation andScheduling

Layer of driving tasksLevel of Assistance and

Automation

Trust, Mental workload, Situation Awareness, Driver

mental model

Page 25: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

27

OutlookStates, Modes and Mode Transitions

• Exploration of the drivers ability to take over after longer periods of driving in highly automated modes

• Transition design for transitions directly after automatic emergency interventions

• Exploration of behavioural adaptation for vehicles equipped with automatic intervention in critical situations

20th-21st November 2013 │interactIVe Final Event

Lowlyautomated

Semiautomated

Highlyautomated

Page 26: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

28

IWI strategiesArbitration

20th-21st November 2013 │interactIVe Final Event

Adaptivity andAdapability

CommunicateSystem Status

Communication channel

Sequence ofinteraction

Arbitration

State, Modes andMode Transitions

Prioritisation andScheduling

Layer of driving tasksLevel of Assistance and

Automation

Trust, Mental workload, Situation Awareness, Driver

mental model

Page 27: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

29

IWI strategiesArbitration

20th-21st November 2013 interactIVe - eCoMove Joint FE

Lowlyautomated

Semiautomated

Highlyautomated

Page 28: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

30

IWI strategiesArbitration

20th-21st November 2013 │interactIVe Final Event

• Arbitration helps to solve situations in which the driver and the automationhave different intentions

DriverIntention

?AutomationIntention

Page 29: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

31

IWI strategiesArbitration

20th-21st November 2013 │interactIVe Final Event

Page 30: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

32

IWI strategiesArbitration

20th-21st November 2013 │interactIVe Final Event

• Examples of InteractIVe IWI strategies: • The driver should be always

able to control the system

• Arbitration helps to solve situations in which the driver and theautomation have different intentions

Page 31: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

33

IWI strategiesArbitration

20th-21st November 2013 │interactIVe Final Event

• Examples of InteractIVe IWI strategies: • The driver should be always

able to control the system• Define degree of authority for

automation according to thecriticality and urgency of a situation

• E.g. automation can initiate an intervention without driver inputin critical emergency situations

• Arbitration helps to solve situations in which the driver and theautomation have different intentions

DriverIntention

?AutomationIntentionAutomationIntervention

Page 32: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

34

OutlookArbitration

20th-21st November 2013 │interactIVe Final Event

Adaptivity andAdapability

CommunicateSystem Status

Communication channel

Sequence ofinteraction

Arbitration

State, Modes andMode Transitions

Prioritisation andScheduling

Layer of driving tasksLevel of Assistance and

Automation

Trust, Mental workload, Situation Awareness, Driver

mental model

Page 33: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

35

OutlookArbitration

• Decide on the distribution of authority in emergency situations• Define if and when the automation should have full control• Check for controllability issues in false alarm situations

20th-21st November 2013 │interactIVe Final Event

Page 34: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

36

OutlookArbitration

• Decide on the distribution of authority in emergency situations• Define if and when the automation should have full control• Check for controllability issues in false alarm situations

• Decide on the way the driver can overrule the automatic intervention• Define situations when the driver is allowed to overrule the intervention

e.g. based on criticality, urgency or automation mode• Explore and define criteria to assess drivers‘ intention• Define criteria to decide on conscious vs. unconscious overruling of the

driver

20th-21st November 2013 │interactIVe Final Event

Page 35: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

37

Adaptivity andAdapability

CommunicateSystem Status

Communication channel

Sequence ofinteraction

Arbitration

State, Modes andMode Transitions

Prioritisation andScheduling

Layer of driving tasksLevel of Assistance and

Automation

Trust, Mental workload, Situation Awareness, Driver

mental model

IWI strategiesSummary

20th-21st November 2013 │interactIVe Final Event

Page 36: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

38

OutlookComplex cooperative systems

20th-21st November 2013 │interactIVe Final Event

Page 37: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

39

OutlookComplex, cooperative systems

• Cooperation with infrastructure, other road users and other vehicles brings new challenges for the Human Factors research

• Modes and mode transitions & communicate system status• Find solutions to integrate complex information not only from vehicle-

based assistance systems but also from other entities

• Arbitration• Enlarge arbitration concepts to negotiations including surrounding

traffic participants with different intentions• Work on concepts to decided which intentions to prioritize

20th-21st November 2013 │interactIVe Final Event

Page 38: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

40

Acknowledgements

• Volvo Group Trucks: Emma Johansson, Ida Esberg, Christian Larsson, Pontus Larsson, Per Nordqvist, Erik Karlsson, Christer Lundevall, Johan Engström

• CRF: Amon Rambaldini, Sara Silvagni, Antonella Masala, Irene Mazzi, Fabrizio Picariello, Giuseppe Varalda, Cristina Zoldan

• DLR: Tobias Hesse, Anna Schieben, Frank Flemisch, Matthias Heesen, Johann Kelsch, Stefan Griesche, Marc Dziennus, Nicola Fricke, Julian Schindler, Claas Brunken, Christian Löper, Martin Baumann, Astrid Kassner

• ATG: Martin Brockmann, Fabienne Stordiau, Angela Allgaier

20th-21st November 2013 │interactIVe Final Event

Page 39: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

41

References

• Hesse, T.; Johannson, E.; Brockmann, M.; Rambaldini, A.; Allgaier, A.; et al. (2013): Interactive Deliverable 3.2: IWI Strategies.

• Hesse, T.; Engström, E.; Johansson, E.; Varalda, G.; Brockmann, M.; et al. (2011). Towards user-centred development of integrated information, warning, and intervention strategies for multiple ADAS in the EU project interactIVe. Paper presented at the HCI Conference 2011, Orlando, US.

• Hesse, T. & Schieben, A. (2012): Highly automated driving. InteractIVe Summer School, 04.-06. June 2012, Corfu Island, Greece.

• Kelsch, J.; Temme, G.; Schindler, J. (2013): Arbitration based framework for design of holistic multimodal human-machine interaction. Paper presented at the AAET Conference 2013, 6.-7. Feb. 2013, Braunschweig, Germany.

• Kelsch, J. (2012): Arbitration between Driver and Automation: why Overriding is just the Tip of the Iceberg. InteractIVe Summer School, 04.-06. June 2012, Corfu Island, Greece.

20th-21st November 2013 │interactIVe Final Event

Page 40: interactIVe 20131018-SP3Day2 Outlook HesseSchiebenDRAFT v0 ...

42

Thank you.

Anna Schieben & Tobias HesseGerman Aerospace Center (DLR)[email protected]+49-(0)531-295-3426