‘Do we need exams?’
description
Transcript of ‘Do we need exams?’
![Page 1: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/1.jpg)
‘Do we need exams?’
Wendy Reid Medical Director HEE
Past – Vice President RCOG
![Page 2: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/2.jpg)
Assessment of doctors....
• Demanded by the public• Required by the regulator• Necessary for the definition of ‘profession’But.....• Opaque methods• No direct input from the public• Examinations are often ‘historical’ not
designed for their present purpose
![Page 3: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/3.jpg)
What is Assessment ?
• A biopsy ofknowledge and skills
“clinical competence”
![Page 4: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/4.jpg)
Critical questions in assessment
• WHY are you doing the assessment?• WHAT are you going to assess?• HOW are you going to assess it?
• HOW WELL is the assessment working?
![Page 5: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/5.jpg)
WHY are you doing the assessment?
• Is its purpose:
– Formative?
– Summative?
Graduation/ PG CertificationGraduation/ PG Certification
In course/ in training feedback In course/ in training feedback
![Page 6: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/6.jpg)
Critical questions
• WHY are you doing the assessment?• WHAT are you going to assess?• HOW are you going to assess it?
• HOW WELL is the assessment working?
![Page 7: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/7.jpg)
WHAT are we testing?
Clinical competence• Knowledge
– factual– applied: clinical reasoning
• Skills– communication– clinical
• Attitudes– professional behaviour
![Page 8: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/8.jpg)
A model of clinical competence
Miller GE. The assessment of clinical skills/competence/performance. Academic Medicine (Supplement) 1990; 65: S63-S67.
Knows
Shows how
Knows how
Does
Pro
fess
ion
al a
uth
enti
city
Cognition =knowledge
Behaviour = Skills + attitude
![Page 9: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/9.jpg)
• WHY are you doing the assessment?• WHAT are you going to assess?• HOW are you going to assess it?
• HOW WELL is the assessment working?
![Page 10: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/10.jpg)
Testing formats
Miller GE. The assessment of clinical skills/competence/performance. Academic Medicine (Supplement) 1990; 65: S63-S67.
Knows
Shows how
Knows how
Does
Pro
fess
ion
al a
uth
enti
city
Written/ Computer based assessment
Performance/hands on assessment
![Page 11: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/11.jpg)
Testing formats
Knows
Shows how
Knows how
Does
Knows Factual tests: SBA, SAQ, (EMQ)
Knows how (Clinical) Context based tests:SBA, SAQ, (EMQ)
Shows howPerformance assessment in Vitro: OSCE
DoesPerformance assessment in vivo:WBA eg mini-CEX, DOPs, TBA
![Page 12: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/12.jpg)
Critical questions• WHY are you doing the assessment?• WHAT are you going to assess?• HOW are you going to assess it?
• HOW WELL is the assessment working?
![Page 13: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/13.jpg)
How well is the assessment working?
• Is it valid? • Is it reliable? • Is it doing what it is supposed to be doing?
• To answer these questions, we have to consider the characteristics of assessment instruments
** Define the purpose of the assessment
![Page 14: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/14.jpg)
Characteristics of assessment instruments
• Validity (V)• Reliability (R)• Educational impact (E)• Acceptability (A)• Cost (C)
![Page 15: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/15.jpg)
Specialty Training & Education Programme
5 6 7
Specialist Training Curriculum
CCT
3 4
Full registration
Log Book
Subspecialty 2-3yr
1 2
Advanced Training Modules
Women's HealthModule
1*
Foundation
Annual Review of Competence (ARCP)
2
Basic
Intermediate
Part 1 MRCOG
Exam
Part 2MRCOG
Exam
![Page 16: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/16.jpg)
Curriculum• ‘Run-through’ i.e. Appointed once, progress by
assessment• Iterative 7 years – average doctor takes 9.8 years• First 2 years – basic knowledge, must pass part 1
of exam• Middle 3 years – intermediate, must pass part 2
of exam• Final 2 years – advanced, continue with core work
and learning but add specialist modules
![Page 17: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/17.jpg)
Principles of curriculum
• Competency based• Performance measured• Iterative time – ‘weigh’ points• Transition clearly defined at each stage• Flexibility in advanced training• Generic skills across core• Log book – e-portfolio• Knowledge and application of knowledge tests• Workplace based assessments
![Page 18: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/18.jpg)
Aim of curriculum
• Produce well trained Obstetricians & Gynaecologists ready for consultant posts in the NHS
• Produce doctors with flexibility of career choice, well advised throughout training
• Produce doctors who will advance the care of women
• Re-defined in ‘Tomorrow’s Specialist’ publication 2012
![Page 19: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/19.jpg)
Options during trainingDoctors are allowed to:• Work less than full time (50% or more)• Take time out of the programme to work overseas or
do research (maximum 3 years)• Can move into formal Academic training pathway• ‘Pause’ – personal reasons, Olympics, Maternity leave• Apply for sub-specialty training from end of year 5But...Every doctor does the MRCOG examination
![Page 20: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/20.jpg)
MRCOG Examination
• Any graduate can enter from anywhere in the world, need evidence of medical degree
• Part 1 – test of basic knowledge applied to clinical O&G. Written papers (EMQs, MCQs)
• Part 2- application of knowledge, 2 written elements require pass before OSCE element
• Reviewed in 2013 – new proposal to split part 2 and have oral element as part 3
![Page 21: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/21.jpg)
The MRCOG Overseas Centres
![Page 22: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/22.jpg)
Part 1 Success Rates
![Page 23: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/23.jpg)
Part 2 Success Rates
![Page 24: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/24.jpg)
Why Take the MRCOG?
“It is one of the most highly recognised and well-respected degrees in my country” [India]
“It is a window through which I can have more knowledge and find the chance of training in O&G” [Sudan]
“It would give me the best chance at getting first-world training which I could use to advance the level and quality of health care service provided in my coutry” [Trinidad]
![Page 25: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/25.jpg)
Why Take the MRCOG?
“I wish to have an international degree with expertise in evidence-based medicine, audits and protocols…to serve patients better” [India]
“Passing…means that I have achieved an appropriate level to implement RCOG standards to improve women’s health.” [Saudi Arabia]
“It is a prestigious and well-recognised qualification.” [Pakistan]
![Page 26: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/26.jpg)
Consultant Country of Qualification
© Royal College of Obstetricians and
Gynaecologists
![Page 27: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/27.jpg)
Principles of Assessment
![Page 28: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/28.jpg)
Yes, we need exams
• Public confidence• Professional recognition• RCOG standard• International credibility – for the college nad
for individuals• But they must be fit for purpose, modern,
reflect best educational practice and embrace evidence based techniques
![Page 29: ‘Do we need exams?’](https://reader035.fdocuments.us/reader035/viewer/2022062305/568157c9550346895dc5533f/html5/thumbnails/29.jpg)