16.422 Human Supervisory Control Naturalistic Decision Making Massachusetts Institute of Technology.
-
Upload
jacob-mclean -
Category
Documents
-
view
214 -
download
1
Transcript of 16.422 Human Supervisory Control Naturalistic Decision Making Massachusetts Institute of Technology.
![Page 1: 16.422 Human Supervisory Control Naturalistic Decision Making Massachusetts Institute of Technology.](https://reader036.fdocuments.us/reader036/viewer/2022082805/55150206550346935c8b646b/html5/thumbnails/1.jpg)
16.422 Human Supervisory Control
Naturalistic Decision Making
Massachusetts Institute of Technology
![Page 2: 16.422 Human Supervisory Control Naturalistic Decision Making Massachusetts Institute of Technology.](https://reader036.fdocuments.us/reader036/viewer/2022082805/55150206550346935c8b646b/html5/thumbnails/2.jpg)
Naturalistic Decision Making• How experts make decisions in the real world
– Descriptive method– Stress, time-pressure, dynamic conditions, ambiguous
information, and ill-defined goals
• Heuristics may introduce bias but can be very powerful.
• Other related research areas:– Behavioral decision theory– Judgment decision making– Organizational decision making
Group of behavioral scientists who shared common theme of “the importance of (1) time pressure, (2) uncertainty, (3) ill-defined goals, (4) high personal stakes, and (5) other complexities that characterize decision making in real-world settings.”2nd theme was to study people with expertise during the decisionmaking process3rd theme was that people appeared to size up situations with more importance than they would select between courses of action
![Page 3: 16.422 Human Supervisory Control Naturalistic Decision Making Massachusetts Institute of Technology.](https://reader036.fdocuments.us/reader036/viewer/2022082805/55150206550346935c8b646b/html5/thumbnails/3.jpg)
NDM vs. Classic Decision Theory
• People are not always “rational” decision makers– But people are proficient
• Situation-action matching decision rules– As opposed to choosing an alternate
• Context-bound informal modeling as opposed to context-free formal modeling
• Process orientation as opposed to prediction of outcomes
• Empirical-based prescriptions
![Page 4: 16.422 Human Supervisory Control Naturalistic Decision Making Massachusetts Institute of Technology.](https://reader036.fdocuments.us/reader036/viewer/2022082805/55150206550346935c8b646b/html5/thumbnails/4.jpg)
Forms of NDM
• Recognition primed decision making
• Related theories/methods
–Critical decision method
–Explanation based theory
–Image theory
![Page 5: 16.422 Human Supervisory Control Naturalistic Decision Making Massachusetts Institute of Technology.](https://reader036.fdocuments.us/reader036/viewer/2022082805/55150206550346935c8b646b/html5/thumbnails/5.jpg)
Recognition Primed Decision Making (RPD)
• Intuitive form of diagnosis and prediction– Pattern matching
• Multiple cues, highly correlated– Key observations
• Requires learning and expertise – Experts choose feasible course of action without analyzing all
or even many options
• Decision making under uncertainty, time-pressure, & stress– Military commanders & firefighters
• What biases might we see in RPD?
![Page 6: 16.422 Human Supervisory Control Naturalistic Decision Making Massachusetts Institute of Technology.](https://reader036.fdocuments.us/reader036/viewer/2022082805/55150206550346935c8b646b/html5/thumbnails/6.jpg)
RPD Process• Boundary conditions: expertise, time-pressure,
uncertainty/ill-defined goals• Recognition• Situation Understanding
– plausible goals– critical cues– Expectancies– typical actions
• Serial Evaluation• Mental Simulation
![Page 7: 16.422 Human Supervisory Control Naturalistic Decision Making Massachusetts Institute of Technology.](https://reader036.fdocuments.us/reader036/viewer/2022082805/55150206550346935c8b646b/html5/thumbnails/7.jpg)
Coping With Uncertainty• Inadequate understanding, lack of information,
conflicted alternatives• RAWFS heuristic
– Reducing uncertainty• Gathering more information
– Assumption-based reasoning• Filling in gaps
– Weighing pros and cons– Forestalling
• Anticipate undesirable consequences
– Suppressing uncertainty• Rationalization16.422
![Page 8: 16.422 Human Supervisory Control Naturalistic Decision Making Massachusetts Institute of Technology.](https://reader036.fdocuments.us/reader036/viewer/2022082805/55150206550346935c8b646b/html5/thumbnails/8.jpg)
Recognition/Meta-cognition Model
• Another model (framework?) for how decision makers cope with uncertainty
• Pattern matching critical• What happens when recognition fails?
– Decision makers revert to assumption-based reasoning and meta-cognitive processes
• Attempt to find flaws & weaknesses in evaluation
• STEP: Construct a story, test, evaluate, & plan– A prescriptive approach
![Page 9: 16.422 Human Supervisory Control Naturalistic Decision Making Massachusetts Institute of Technology.](https://reader036.fdocuments.us/reader036/viewer/2022082805/55150206550346935c8b646b/html5/thumbnails/9.jpg)
NDM and Teams• How does team decision making differ from
individual?
• Team SA and shared mental models
• Studying teams in their natural environment– Real teams performing real tasks in real
settings
– Contextual focus as opposed to more general and abstract
• Team research is not easy
![Page 10: 16.422 Human Supervisory Control Naturalistic Decision Making Massachusetts Institute of Technology.](https://reader036.fdocuments.us/reader036/viewer/2022082805/55150206550346935c8b646b/html5/thumbnails/10.jpg)
CTA Methods for NDM Research
• critical decision method in which participants are asked to describe a specific decision-making incident in detail and then to respond to probes seeking elaboration of important aspectsof the decision sequences.
• Semantic mapping (a.k.a., mind-mapping, idea mapping, word webbing, etc.) is a term which describes a variety of strategies designed to show how key words or concepts are related to one another through graphic representations.Mapping is an effectivetechnique for teaching vocabulary and textual patterns of organization; and it is also effectivefor improving note taking and creative thinking skills.
COGNITIVE TASK ANALYSIS
Exploring the Current World Exploring the Envisioned WorldUnderstanding the way people operatein their world
Goal :Understand/model expertise se, knowledge,strategies, s, and errorTechniques :Semantic MappingEthnographic / Observational investigationsCritical Incident TechniqueCritical Decision MethodStructured Interview T w Techniques
Discovering support for how peoplewill operate in their world
Gro
wth
of
Un
ders
tan
din
g
DesignBasis
CTAModel
Scratch
Practitioner(s)
Th
e D
om
ain
Understanding the way the world worksDiscovering how to support the way the worldwill work
Time Time
Fie
ld o
f P
r P
racti
ce
Adapted from Carnegie Group, Inc.
Goal :Understand/model complexities, s,demands, s, variability, y, and complicatingfactorsTechniques :Functional/Means- s-ends AnalysisEthnographic / Observational investigationsFunctional Task and Workflow ModelingStructured Interview Techniques
CTA Representation
Prototype Representation
![Page 11: 16.422 Human Supervisory Control Naturalistic Decision Making Massachusetts Institute of Technology.](https://reader036.fdocuments.us/reader036/viewer/2022082805/55150206550346935c8b646b/html5/thumbnails/11.jpg)
Evaluating NDM Studies• Laboratory vs. real-world settings
• Credibility determined by:– Quality of research questions– Data collection methods– Suitability of methods for research questions– Plausibility of answers– Reasonableness of assumptions
• Transferability
• Cognition in the wild
![Page 12: 16.422 Human Supervisory Control Naturalistic Decision Making Massachusetts Institute of Technology.](https://reader036.fdocuments.us/reader036/viewer/2022082805/55150206550346935c8b646b/html5/thumbnails/12.jpg)
Forms of NDM
• Recognition primed decision making
• Related theories/methods
–Critical decision method
–Explanation based theory
–Image theory
![Page 13: 16.422 Human Supervisory Control Naturalistic Decision Making Massachusetts Institute of Technology.](https://reader036.fdocuments.us/reader036/viewer/2022082805/55150206550346935c8b646b/html5/thumbnails/13.jpg)
Critical Decision Method• Retrospective interview technique
– Cognitive probes used to elicit knowledge and strategies used in expert decision-making
– Non-routine events
• Based on critical incident technique (1954)– What led up to the situation?– What action was effective or ineffective?– What was the outcome or result of this action?
• CDM focuses on identifying critical cues, judgments, & decisions– What-if queries
John Flanagan is the originator if the CIT method. Read more athttp://www.air.org/overview/flanagan.htm
More CIT: http://www.apa.org/psycinfo/special/cit-intro.pdfhttp://www.emmus.org/html/frames/guidelines/EmmusWP3/methods/cit.html
![Page 14: 16.422 Human Supervisory Control Naturalistic Decision Making Massachusetts Institute of Technology.](https://reader036.fdocuments.us/reader036/viewer/2022082805/55150206550346935c8b646b/html5/thumbnails/14.jpg)
Explanation Based Model• Need to generate a coherent story and match that story
against possible choices• Formulating a full story based on incomplete facts
– Filling in the gaps– Expectancies– Recall long term memory discussion
• Match hypothesized story with possible outcomes– Modifying story to achieve a desired outcome is
possible• Where might we see this in aviation accidents?
![Page 15: 16.422 Human Supervisory Control Naturalistic Decision Making Massachusetts Institute of Technology.](https://reader036.fdocuments.us/reader036/viewer/2022082805/55150206550346935c8b646b/html5/thumbnails/15.jpg)
Image Theory• Decisions are not discrete events but a more complicated process
– Progress Decisions: Are past decisions are being adequately carried out?
– Adoption Decisions: Consideration of new goals, plans, principles or actions,
• Problems
– Unclear underlying goals
– Poor planning or implementation of strategy
– Values insufficient or incorrectly defined
ValueImage
StrategicImage
TrajectoryImage
![Page 16: 16.422 Human Supervisory Control Naturalistic Decision Making Massachusetts Institute of Technology.](https://reader036.fdocuments.us/reader036/viewer/2022082805/55150206550346935c8b646b/html5/thumbnails/16.jpg)
Cognitive Continuum of Decision Making
Analytic Decisions
• Analytic strategies– Example: SEU
• Concurrent options
• Unbounded rationality
• Optimization with constraints
Intuitive Decisions
• Naturalistic Decision Making – Example: RPD
• Serial options
• Bounded rationality
• Fast & frugal heuristics
Social Judgment Theories (Lens Model)
![Page 17: 16.422 Human Supervisory Control Naturalistic Decision Making Massachusetts Institute of Technology.](https://reader036.fdocuments.us/reader036/viewer/2022082805/55150206550346935c8b646b/html5/thumbnails/17.jpg)
References• Cooksey, R. W. (1996). Judgment Analysis: Theory, Methods, a
nd Applications. San Diego, Academic Press.
• Brunswik, E. (1952). The conceptual framework of psychology. Chicago, University of Chicago Press.
• Klein, G. (1989). "Recognition-Primed Decisions." Advances in Man-Machine Research5: 47-92
• Decision Making in Action: Models and Methods. G. Klein, J. Orasanu, R. Calderwoodand C. E. Zsambok. Norwood, N.J., AblexPublishing.
• Beach, L.R., & Mitchell, T.R.(1990).Image theory:A behavioral theory of decision making in organizations. Research in Organizational Behavior, 12, 1-41.