As Pupilas do Senhor Reitor Júlio Dinis Capítulo I José das Dornas ...
SELF EVALUATION POORLY CORRELATED WITH RESIDENCY ADMISSION GRADES ON OSCE-BASED TEST Júlio César...
14
SELF EVALUATION POORLY SELF EVALUATION POORLY CORRELATED WITH CORRELATED WITH RESIDENCY ADMISSION RESIDENCY ADMISSION GRADES ON OSCE-BASED GRADES ON OSCE-BASED TEST TEST Júlio César de Oliveira Júlio César de Oliveira Maria Patrocínio Tenório Nunes Maria Patrocínio Tenório Nunes Leonardo Borges de Barros e Silva Leonardo Borges de Barros e Silva Cristina Helena Fonseca-Guedes Cristina Helena Fonseca-Guedes Itamar de Souza Santos Itamar de Souza Santos Joaquim Edson Vieira Joaquim Edson Vieira UNIVERSITY OF SÃO PAULO UNIVERSITY OF SÃO PAULO SCHOOL OF MEDICINE SCHOOL OF MEDICINE São Paulo São Paulo BRAZIL BRAZIL
-
Upload
melanie-butler -
Category
Documents
-
view
222 -
download
1
Transcript of SELF EVALUATION POORLY CORRELATED WITH RESIDENCY ADMISSION GRADES ON OSCE-BASED TEST Júlio César...
SELF EVALUATION POORLY SELF EVALUATION POORLY CORRELATED WITH CORRELATED WITH
RESIDENCY ADMISSION RESIDENCY ADMISSION GRADES ON OSCE-BASED GRADES ON OSCE-BASED
TESTTEST Júlio César de Oliveira Júlio César de Oliveira
Maria Patrocínio Tenório NunesMaria Patrocínio Tenório NunesLeonardo Borges de Barros e SilvaLeonardo Borges de Barros e SilvaCristina Helena Fonseca-GuedesCristina Helena Fonseca-Guedes
Itamar de Souza SantosItamar de Souza SantosJoaquim Edson VieiraJoaquim Edson Vieira
UNIVERSITY OF SÃO PAULOUNIVERSITY OF SÃO PAULO SCHOOL OF MEDICINE SCHOOL OF MEDICINE
São Paulo São Paulo BRAZILBRAZIL
UNIVERSITY OF SÃO PAULOUNIVERSITY OF SÃO PAULO SCHOOL OF MEDICINESCHOOL OF MEDICINE
São Paulo São Paulo BRAZILBRAZIL
OSCE Performance as a Residency Admission Test
-600 Graduated Doctors around the country
-264 positions as a Resident
-21 Residency Training Programs
From: 60 different Schools 21 different States
Phase 1 - Writing test 3.000 candidates
Phase 2 – OSCE Based Test 600 candidates
PHASE 2 - OSCE Selection ProcessPHASE 2 - OSCE Selection Process
Actress patient
Candidate
Observer
OBJECTIVE
• Correlation between Self Evaluation score and OSCE grade in a Residency Admission Test
CASUISTIC and METHODSCASUISTIC and METHODS
• Self-evaluation questionnaire
• 314 recently graduated physicians
• Performance on Objective Structured Clinical Examination – OSCE
• Correlation between OSCE final grade and self-evaluation of skill levels
CASUISTIC and METHODSCASUISTIC and METHODSSelf evaluation questionnaire
0 You do not know the procedure
1 You have read about or been told how the procedure is done
2 You have seen another person perform the procedure
3 You have done the procedure with guidance of another person
4 You have done the procedure correctly on your own
5 You have done the procedure correctly so many times that you feel both competent and confident about it
STATISTICAL ANALYSIS
Pearson Correlation’s test
Self evaluation scores X OSCE grade
RESULTSRESULTS
RESULTSRESULTSStation 1
R2 = 0,0336
0102030405060708090
100
0 1 2 3 4 5 6
Self evaluation
OS
CE
gra
de
Station 2
R2 = 0,0271
0102030405060708090
100
0 1 2 3 4 5 6
Self evaluation score
OS
CE
gra
de
Station 3
R2 = 0,0622
0102030405060708090
100
0 1 2 3 4 5 6
Sel- evaluation score
OS
CE
gra
de
Station 4
R2 = 0,0536
0102030405060708090
100
0 1 2 3 4 5 6
Self-evaluation score
OS
CE
gra
de
RESULTSRESULTSStation 5
R2 = 0,0568
0
20
40
60
80
100
0 1 2 3 4 5 6
Self-evaluation score
OS
CE
gra
de
Station 6
R2 = 0,0341
0
20
40
60
80
100
0 1 2 3 4 5 6
Self-evaluation score
OS
CE
gra
de
Station 7
R2 = 0,0238
0
20
40
60
80
100
0 1 2 3 4 5 6
Self-evaluation score
OS
CE
gra
de
Station 8
R2 = 0,0258
0
20
40
60
80
100
0 1 2 3 4 5 6
Self-evaluation score
OS
CE
gra
de
RESULTSRESULTSStation 9
R2 = 0,0055
0
20
40
60
80
100
0 1 2 3 4 5 6
Self-evaluation score
OS
CE
gra
de
Station 10
R2 = 0,0114
0
20
40
60
80
100
0 1 2 3 4 5 6
Self-evaluation score
OS
CE
gra
de
All 10 stations
R2 = 0,0449
0102030405060708090
100
0,0 1,0 2,0 3,0 4,0 5,0
Self-evaluation mean
OS
CE
gra
de
DISCUSSIONDISCUSSION
• The OSCE provides a nearer real clinical situation
• The self-evaluation questionnaire indicates how secure and confident was the candidate about the skill asked in each station
• It would be expected a good correlation between OSCE grade and self evaluation scores
• But no correlation was found
CONCLUSIONCONCLUSION
Young physicians could not self-evaluate OSCE grades during Residency
Admission Test.
