Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van...

41
Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators & Kanbar Center for Simulation

Transcript of Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van...

Page 1: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Simulation: Why, when, what?Terminology, definitions,

frameworks and applications

Sandrijn van Schaik, MD PhD

2015

UCSF Center for Faculty Educators & Kanbar Center for Simulation

Page 2: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Simulation: Why, when, what?

1. Define and describe simulation

2. Explain the rationale for using simulation in health professional education

3. List best practices for the use of simulation as an educational strategy

4. Find your way to various simulation resources at UCSF and beyond

Objectives

SIMULATION: WHY, WHEN, WHAT?

Page 3: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Simulation: Definition

• “To do or make something which looks real but is not real”– Dictionary.com

• “An educational modality with which the learner physically interacts to mimic an aspect of clinical care for the purpose of teaching or assessment”– Adapted from Cook et al. , Med Teach. 2013

SIMULATION: WHY, WHEN, WHAT?

Page 4: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Simulation modalities for HPE

• Mannequin-based simulation

• Standardized patients

• Partial Task Trainers

• Virtual Reality

• Mixed Modalities

4

SIMULATION: WHY, WHEN, WHAT?

Page 5: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Mixed Modalities / Hybrid Simulation

5

Combination of actors, partial task trainers and/or

simulation mannequins

SIMULATION: WHY, WHEN, WHAT?

Page 6: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Why Simulation?

• Patient Safety

• Learner Benefits

• Institutional Benefits

6

Learning Assessment

SIMULATION: WHY, WHEN, WHAT?

Page 7: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Simulation for Patient Safety

• Avoid “practicing” on real patients

• Error reduction

• Optimize communication / teamwork

7

SIMULATION: WHY, WHEN, WHAT?

Page 8: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Simulation to Benefit Learners

•Deliberate practice– Practice, received feedback, reflect,

practice again

•Practice in safe environment – Early practice of clinical skills

– High stakes, low volume events

8

SIMULATION: WHY, WHEN, WHAT?

Page 9: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Simulation to Benefit Institutions

• Disaster preparedness

• Test (new) systems

• Uncover latent safety issues

• Reduced malpractice insurance

• Accreditation and other compliance issues

9

SIMULATION: WHY, WHEN, WHAT?

Page 10: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

SIMULATION: WHY, WHEN, WHAT?

Page 11: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Effective simulation: characteristics

1. Integration into curriculum

2. Feedback

3. Deliberate practice

4. Mastery learning

5. Range of difficulty levels

6. Clinical variation

7. Individualized learning

11

SIMULATION: WHY, WHEN, WHAT?

Page 12: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Effective simulation: characteristics

1. Integration into curriculum

2. Feedback

3. Deliberate practice

4. Mastery learning

5. Range of difficulty levels

6. Clinical variation

7. Individualized learning

12

SIMULATION: WHY, WHEN, WHAT?

Page 13: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Integration into Curriculum

• Simulation is one educational tool to get to the educational objectives of a curriculum

13

Kern’s 6 steps to curriculum development

1. Problem identification

2. Needs Assessment

3. Goals and Objectives

4. Education Strategies

5. Implementation

6. Evaluation and Feedback

KernThe Johns Hopkins University Press 1998

SIMULATION: WHY, WHEN, WHAT?

Page 14: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Integration into Curriculum

• Simulation is most successful if related to other educational content and/or clinical experiences

14

SIMULATION: WHY, WHEN, WHAT?

Page 15: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Simulation as educational strategy

• Is simulation the appropriate teaching modality to reach the educational objectives?

• Different types of simulation can be used for different educational objectives

15

SIMULATION: WHY, WHEN, WHAT?

History taking

Communication skillsStandardized Patients

Hyb

rid s

imul

atio

n

Clinical reasoning

Clinical exam skillsMannequins

Teamwork

Resuscitation skillsTask trainers

Procedural skills

Page 16: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Effective simulation: characteristics

1. Integration into curriculum

2. Feedback

3. Deliberate practice

4. Mastery learning

5. Range of difficulty levels

6. Clinical variation

7. Individualized learning

16

SIMULATION: WHY, WHEN, WHAT?

Page 17: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Feedback

• Often considered the most important aspect of simulation

• In scenario-based simulations, typically takes the form of “debriefing” – feedback with/among group of learners

• Effective feedback and debriefing require training and experience– Various approaches have been described

– Separate workshops dedicated to these topics

17

SIMULATION: WHY, WHEN, WHAT?

Page 18: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Effective simulation: characteristics

1. Integration into curriculum

2. Feedback

3. Deliberate practice

4. Mastery learning

5. Range of difficulty levels

6. Clinical variation

7. Individualized learning

18

SIMULATION: WHY, WHEN, WHAT?

Page 19: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Deliberate practice

• Practice followed by feedback and reflection, followed by focused repeated practice

19

EricssonAcad Med 2004S70-S81

SIMULATION: WHY, WHEN, WHAT?

Page 20: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Effective simulation: characteristics

1. Integration into curriculum

2. Feedback

3. Deliberate practice

4. Mastery learning

5. Range of difficulty levels

6. Clinical variation

7. Individualized learning

20

SIMULATION: WHY, WHEN, WHAT?

Page 21: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Mastery Learning

• Rigorous approach to competency-based education

• Different levels of mastery = different outcomes (or mastery standards) that learner needs to achieve at each level

• Requires clear bench marks with measurable outcomes

• Learner progresses through educational units of increasing level of difficulty

21

SIMULATION: WHY, WHEN, WHAT?

Page 22: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Effective simulation: characteristics

1. Integration into curriculum

2. Feedback

3. Deliberate practice

4. Mastery learning

5. Range of difficulty levels

6. Clinical variation

7. Individualized learning

22

SIMULATION: WHY, WHEN, WHAT?

Page 23: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Effective simulation: characteristics

1. Integration into curriculum

2. Feedback

3. Deliberate practice

4. Mastery learning

5. Range of difficulty levels

6. Clinical variation

7. Individualized learning

23

SIMULATION: WHY, WHEN, WHAT?

Page 24: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Individualized learning

• Learners are active participants, not passive bystanders

• Can be challenging for larger groups of learners

• Different models to engage multiple learners in simulation– Rotating or shared “active” roles

– Observation roles with specific tasks

24

SIMULATION: WHY, WHEN, WHAT?

Page 25: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Two more aspects to consider…

1. Controlled environment/psychological safety: learners can make, detect and correct errors without adverse consequences

2. Simulator validity or fidelity: the degree of realism the simulator provides

25

SIMULATION: WHY, WHEN, WHAT?

Page 26: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Fidelity of simulation

SIMULATION: WHY, WHEN, WHAT?

Page 27: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Fidelity – useful concept?

Replace term fidelity with• Physical resemblance

– Should get less emphasis (no evidence that it improves learning by itself)

• Functional task alignment– functional properties of the entire simulation context

that align with learning objectives

27

Hamstra et alAcad Med2014

SIMULATION: WHY, WHEN, WHAT?

Page 28: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Dimensions of Fidelity

• Equipment Fidelity– Highest with physiology-based mannequins (realistic

responses to interventions such as O2, medications)

• Environmental Fidelity– Highest with in-situ simulation (takes place in the

actual clinical setting)

• Psychological Fidelity– Highest if the participants forget the situation is not

real. Dependent on instructor/actor

28

BeaubienQual Saf Health Care 2004

SIMULATION: WHY, WHEN, WHAT?

Page 29: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

SIMULATION: WHY, WHEN, WHAT?

Page 30: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Simulation for Assessment

• Standardization

• Direct observation

• Video recording / multiple observers

• Feedback from standardized patients

30

Learning Assessment

SIMULATION: WHY, WHEN, WHAT?

Page 31: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Assessment and simulation

• Checklist vs global rating scales

• Bench marks / milestones

• Self assessment / peer assessment?

31

SIMULATION: WHY, WHEN, WHAT?

Page 32: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

32

SIMULATION: WHY, WHEN, WHAT?

Page 33: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Framework for Simulation as Educational Strategy

33

Simulation Activity

Script

Patient

Environment

Instructors

Learner

Equipment and Tools

Preparation

Assessment & Feedback

SIMULATION: WHY, WHEN, WHAT?

Page 34: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Example: Standardize Patient exercise

34

History & Clinical Exam Practice

Patient Script (PMH, HPI, Symptoms)

Actor/Standardized

Patient

Clinical Exam Room Faculty

observers/simulation staff (video)

Medical Student

Stethoscope and BP cuff

Instructions

ChecklistFeedback

SIMULATION: WHY, WHEN, WHAT?

Page 35: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Example: Mannequin-based activity

35

Resuscitation team training

Scenario outline

Mannequin

Operating Room Technicians

ConfederatesFacilitator

OR team members

Crash cartMedications

(pre) brief

Assessment toolDebriefing

SIMULATION: WHY, WHEN, WHAT?

Page 36: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Example: Procedure training

36

Phlebotomy Training

Steps of the procedure

Partial task trainer

Environment

Instructor

Nursing student

NeedlesSyringes

ChecklistFeedback

SIMULATION: WHY, WHEN, WHAT?

Content knowledge

Page 37: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Simulation = Preparation

There are many factors that can impact learning

• SP activity:– Need to select and train actors; create checklists and

detailed instruction materials

• Mannequin activity:– Technicians need to know how the mannequin

should respond to various learner actions; create a scenario thinking about different paths

• Procedure activity:– Instructors need to know the trainers, and best

practices for procedural training (demonstrate, break down into step, practice with feedback)

37

SIMULATION: WHY, WHEN, WHAT?

Page 38: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Teach for UCSF Simulation Certificate

• Certificate program offered to current and future faculty at UCSF and affiliated institutions

• Series of workshops, simulation is one of several certificates offered

• Details see: http://meded.ucsf.edu/radme/Teach-for-UCSF

38

SIMULATION: WHY, WHEN, WHAT?

Page 39: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Resources

• UCSF Kanbar Center for Simulation– Visit the website: http://meded.ucsf.edu/simulation

– Visit the instructor resources on the CLE: go to moodle.ucsf.edu and search for Kanbar or click the link on the kanbar website

– Email [email protected]

• Society for Simulation in HealthCare– http://www.ssih.org/

• California Simulation Alliance– https://www.californiasimulationalliance.org/

CSACollaboratives.aspx

39

SIMULATION: WHY, WHEN, WHAT?

Page 40: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

References

• Simulation in healthcare education: A best evidence practical guide. AMEE Guide No. 82. Motola Y et al; Medical Teacher 2013;35 (10):e1511-e1530

• Comparative effectiveness of instructional design features in simulation-based education: systematic review and meta-analysis. Cook DA et al; Medical Teacher 2013;35(1):e867-98.

• Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Ericsson K; Academic Medicine, 2004;79(10):S70-80

• A critical review of simulation-based mastery learning with translational outcomes. McGaghie WC; Medical Education 2014;48(4):375-85.

40

SIMULATION: WHY, WHEN, WHAT?

Page 41: Simulation: Why, when, what? Terminology, definitions, frameworks and applications Sandrijn van Schaik, MD PhD 2015 UCSF Center for Faculty Educators &

Questions?

[email protected]

41