Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills...
-
Upload
hugh-nicholson -
Category
Documents
-
view
215 -
download
0
Transcript of Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills...
![Page 1: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/1.jpg)
Evaluating the Briefing, Intraoperative Teaching,
Debriefing (BID) method for surgical skills teaching:
a pilot study
Evaluating the Briefing, Intraoperative Teaching,
Debriefing (BID) method for surgical skills teaching:
a pilot study
Daniel Hoppe MD MEdOleg Safir MD FRCS(C) MEdAdam Dubrowski PhD
![Page 2: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/2.jpg)
What is BID?What is BID?
![Page 3: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/3.jpg)
Journal of the American College of Surgeons (2009)
Step Task
Briefing Set learning objectives
Intra-operative Teaching
Teaching during the encounter
DebriefingReflection
RulesReinforceCorrect
![Page 4: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/4.jpg)
Why the BID?Why the BID?
![Page 5: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/5.jpg)
WHAT LEARNERS WANT*
Instructor “game-plan”
Involvement in the learning process
Ongoing and direct feedback
WHAT ACTUALLY HAPPENS**
“Opportunistic” teaching
Passive transfer of information
Limited feedback given
*Vikis et al. (2008), Cox and Swanson (2001), Snyder et al (2012)**Scallon et al. (1992), Irby (1995), Roberts et al. (2008), Jefree and Clarke (2010)
![Page 6: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/6.jpg)
Objective
✦ To evaluate whether the BID method is an effective framework for surgical skills teaching
✦ Learner reactions, satisfaction
![Page 7: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/7.jpg)
MethodsMethods
![Page 8: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/8.jpg)
First year orthopaedic residents (n=12)
Allocated to control group (n=6)
Allocated to BID group (n=6)
PRE-TEST (OSATS)
Learned Control Skill(Central Line)
Learned Control Skill(Central Line)
BID Method Training Session
![Page 9: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/9.jpg)
First year orthopaedic residents (n=12)
Allocated to control group (n=6)
Allocated to BID group (n=6)
PRE-TEST (OSATS)
Learned Control Skill(Central Line)
Learned Control Skill(Central Line)
BID Method Training Session
![Page 10: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/10.jpg)
✦ 60 minute session
✦ Interactive - presentation, discussion, role-play
✦ Given to both instructor and BID group separately
✦ Learners trained to create synergistic learning effect*
BID Method Training Session
*Aagaard et al. (2004), Manyon et al. (2003), Vikis et al. (2008)
![Page 11: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/11.jpg)
Learned Control Skill(Central Line)
Learned Control Skill(Central Line)
BID Method Training Session
Learned Test Skill 1(Bone Wedge)
Learned Test Skill 2(Bone Plating)
Learned Test Skill 1(Bone Wedge)
Learned Test Skill 2(Bone Plating)
POST-TEST (OSATS)
![Page 12: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/12.jpg)
Outcome Measures✦ Change in individual OSATS scores -
checklist and GRS
![Page 13: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/13.jpg)
Outcome Measures
Rizzolo (2006), National League for Nursing (2007)
✦ Focus group data
✦ Satisfaction Questionnaire, Educational Practices Questionnaire*
![Page 14: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/14.jpg)
Standardization of Instructors
✦ Used a number of measures to try and ensure approximate instructor equivalency
1. Perception of Preparedness Questionnaire - no differences
2. “Assessing Teaching Skills” assignment (adapted from Ramsden et al. 1995)
3. “Control Skill” (Central Line Insertion) - taught to each group prior to BID training
![Page 15: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/15.jpg)
ResultsResults
![Page 16: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/16.jpg)
Assessing Instructor Equivalency
✦ Perception of Preparedness Questionnaires similar between both instructors
✦ also had similar teaching ideologies/experience-no formal educational training
-no familiarity with educational theory
-preferred small-group learning to lectures
-feedback important (but neither knew framework for delivering feedback)
-use questions to confirm understanding
![Page 17: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/17.jpg)
OSATS Pre-test Data✦ no significant differences in baseline pre-test
scores between groups for checklist and GRS scores
Skill GRS Checklist
Central Line Insertion
P=0.326 P=0.102
Bone Wedge P=0.478 P=0.536
Bone Plating P=0.927 P=0.263
![Page 18: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/18.jpg)
Control Skill: Central Line Insertion
PROPORTIONAL CHANGE
84.93
55.96
0
20
40
60
80
100
Pro
po
rtio
nal
Incr
ease
Control Group BID Group
P=0.129Pre-Test
Post-Test
Control 46 96
BID 53 81
Global Rating Scale
![Page 19: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/19.jpg)
After BID trainingAfter BID training
![Page 20: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/20.jpg)
Test Skill 1: Bone Wedge Cut
PROPORTIONAL CHANGE
13.8
82.2
0
20
40
60
80
100
Pro
po
rtio
nal
Incr
ease
Control Group BID Group
P=0.049Pre-Test
Post-Test
Control 59 69
BID 66 94
Global Rating Scale
![Page 21: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/21.jpg)
Test Skill 2: Bone Plating
PROPORTIONAL CHANGE
23.7
69
0
20
40
60
80
Pro
po
rtio
nal
Incr
ease
Control Group BID Group
P=0.011Pre-Test
Post-Test
Control 42 56
BID 43 82
Global Rating Scale
![Page 22: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/22.jpg)
Checklist Scores
✦ No significant difference in improvement in checklist scores for any skills
![Page 23: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/23.jpg)
Secondary Outcome Measures
Secondary Outcome Measures
![Page 24: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/24.jpg)
Questionnaire Data✦ After first skill (both groups
untrained)Control
Group (%)BID Group
(%)Satisfaction
with Teaching Method
85 85
Objectives/Information
83 77
Active Learning/Facult
y Interaction79 83
Feedback 85 72
![Page 25: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/25.jpg)
Questionnaire Data✦ After last skill
Control Group (%)
BID Group (%)
Satisfaction with Teaching
Method77 90
Objectives/Information
74 84
Active Learning/Facult
y Interaction72 88
Feedback 69 81
![Page 26: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/26.jpg)
Focus Group Data
✦ Easy to use and remember
✦ For majority, first time setting objectives
✦ Formal time for feedback appreciated
✦ Less time wasted during sim sessions
![Page 27: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/27.jpg)
Conclusions
✦ training both the learners and instructors in the BID method produced significant improvement in GRS scores for specific surgical skills
✦ trend towards higher learner satisfaction
✦ BID provides an easy-to-implement framework for surgical simulation teaching
![Page 28: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/28.jpg)
Limitations
✦ Small sample size
✦ Choice of skills - limited
✦ Retention/transfer not tested
✦ In vivo vs. in vitro effects?
![Page 29: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/29.jpg)
Future Directions
✦ these results are promising enough to continue with a larger-scale study
✦ more residents, more skills, more instructors
✦ simulation vs. OR
✦ role in Competency-Based Education?
![Page 30: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/30.jpg)
Quotes from BID Group
“These sessions seemed a bit like a study group”
“I can see this working in the OR but it would need to have staff buy-in”
“This may not work when I’m on call and it is very busy”
“I think using this approach improved the flow of teaching”
“Having an objective to work on focused me on a specific task”
“I really liked the debriefing part, and I wish this would happen in real life!”
![Page 31: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/31.jpg)
Thank youThank you
Acknowledgments:Thanks to Lisa Satterthwaite, Dr. Ranil
Sonnandara, Carween Hui, Polina Mironova, Dr. Hesham Abdelbary, Dr. Michael Drexler,
and the staff of the Mount Sinai Surgical Skills Centre
Acknowledgments:Thanks to Lisa Satterthwaite, Dr. Ranil
Sonnandara, Carween Hui, Polina Mironova, Dr. Hesham Abdelbary, Dr. Michael Drexler,
and the staff of the Mount Sinai Surgical Skills Centre
![Page 32: Evaluating the Briefing, Intraoperative Teaching, Debriefing (BID) method for surgical skills teaching: a pilot study Daniel Hoppe MD MEd Oleg Safir MD.](https://reader036.fdocuments.us/reader036/viewer/2022081519/56649e0e5503460f94af7a2d/html5/thumbnails/32.jpg)
Step Task Script
Briefing Set learning objectives
“What would you like to focus on?”
Intra-operative Teaching
Teaching during the encounter
Focus on stated objectives
DebriefingReflection
RulesReinforceCorrect
“How did you think you did?”
“You did well at...”“Next time, do...”