Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of...
Transcript of Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of...
![Page 1: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/1.jpg)
Results of the 2014 NRMP Program Director Survey
www.nrmp.org
June 2014
![Page 2: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/2.jpg)
Requests for permission to use these data as well as questions about the content of this publication or the National Resident Matching Program data and reports may be directed to
Mei Liang, Director of Research, NRMP, at [email protected].
Questions about the NRMP should be directed to Mona M. Signer, Executive Director, NRMP, at [email protected].
Suggested CitationNational Resident Matching Program, Data Release and Research Committee: Results of the
2014 NRMP Program Director Survey. National Resident Matching Program, Washington, DC. 2014.
Copyright © 2014 National Resident Matching Program.
![Page 3: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/3.jpg)
Introduction .................................................................................................................................................................. 1 All Specialties............................................................................................................................................................... 2 Charts for Individual Specialties
Anesthesiology ....................................................................................................................................................... 8 Child Neurology ................................................................................................................................................... 14 Dermatology ......................................................................................................................................................... 20 Emergency Medicine ........................................................................................................................................... 26 Family Medicine ................................................................................................................................................... 32 Internal Medicine .................................................................................................................................................. 38 Internal Medicine/Pediatrics ................................................................................................................................. 44 Neurological Surgery ............................................................................................................................................ 50 Neurology ............................................................................................................................................................. 56 Obstetrics and Gynecology .................................................................................................................................. 62 Orthopaedic Surgery ............................................................................................................................................. 68 Otolaryngology ..................................................................................................................................................... 74 Pathology .............................................................................................................................................................. 80 Pediatrics .............................................................................................................................................................. 86 Physical Medicine and Rehabilitation .................................................................................................................. 92 Plastic Surgery ...................................................................................................................................................... 98 Psychiatry ........................................................................................................................................................... 104 Radiation Oncology ............................................................................................................................................ 110 Radiology-Diagnostic ......................................................................................................................................... 116 Surgery ............................................................................................................................................................... 122 Thoracic Surgery ................................................................................................................................................ 128 Transitional Year ................................................................................................................................................ 134 Vascular Surgery ................................................................................................................................................ 140
Table of Contents
![Page 4: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/4.jpg)
Introduction
1NRMP Program Director Survey Results, 2014
In March 2014, the National Resident Matching Program (NRMP) conducted its biennial survey of the directors of all programs participating in the Main Residency Match®. The primary purpose of the survey was to shed light on the factors that program directors use to (1) select applicants to interview and (2) rank applicants for the Match.
The survey was fielded during the 18 days between the rank order list deadline and Match Week so that program match outcomes would not influence respondents' answers.
The survey solicited information on: the number of applications received, screened, and
reviewed, as well as the number of applicants interviewed and ranked
whether the program typically interviews and ranks specific applicant groups
use of test scores in considering which applicants to interview, and
the factors used for both interview selection and for ranking applicants.
The overall response rate for all specialties in this report was 52.7 percent. Transitional Year and 22 specialties with 10 or more responses are included in this report. Their response rates are listed in the table below. Response rates for those specialties ranged from a high of 65.4 percent for Emergency Medicine and Pediatrics to a low of 42.6 for Radiology.
Several changes were made to the 2014 questionnaire. In the past, program directors were asked to indicate factors they used in selecting applicants to interview and to rate the importance of each factor in ranking. In this survey, program directors were asked to indicate factors they used in selecting applicants to interview and rank respectively. They were asked to rate the importance on a scale of 1 to 5 only for the factors they used in their selection process. In addition, this survey asked program directors how they handled unfilled positions after the 2013 Match and SOAP. Because the number of responses for that question was small, the results are only reported in the "All Specialties" section.
Numbers of responses are presented in most of the graphs. Some graphs use data from multiple survey questions. In those cases, different N's are listed. Numbers of applicants ranked and positions in the Match are extracted from the NRMP database. Graphs are suppressed for questions with fewer than five responses.
This report presents results by specialty on selected items from the survey. The NRMP hopes that program directors, medical school officials, and applicants find these data useful as they prepare for and participate in the Main Residency Match._______________
The NRMP's data reporting and research activities are guided by its Data Release and Research Committee. NRMP data and reports can be found at: www.nrmp.org/match-data/.
Specialty Surveys Sent Number Responding Response Rate
Anesthesiology 127 71 55.9%
Child Neurology 72 41 56.9%
Dermatology 110 60 54.5%
Emergency Medicine 159 104 65.4%
Family Medicine 429 236 55.0%
Internal Medicine 379 197 52.0%
Internal Medicine/Pediatrics 80 35 43.8%
Neurological Surgery 102 55 53.9%
Neurology 129 60 46.5%
Obstetrics and Gynecology 230 123 53.5%
Orthopaedic Surgery 147 87 59.2%
Otolaryngology 100 46 46.0%
Pathology 134 84 62.7%
Pediatrics 185 121 65.4%
Physical Medicine and Rehabilitation 77 34 44.2%
Plastic Surgery 63 39 61.9%
Psychiatry 180 84 46.7%
Radiation Oncology 84 44 52.4%
Radiology‐Diagnostic 176 75 42.6%
Surgery 275 121 44.0%
Thoracic Surgery 25 12 48.0%
Transitional Year 91 47 51.6%
Vascular Surgery 44 22 50.0%
All others 101 46 45.5%
Total 3,499 1,844 52.7%
![Page 5: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/5.jpg)
All Specialties Combined(N=1,844)
![Page 6: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/6.jpg)
Figure 1All SpecialtiesPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=1,793)
100% 50% 0%
94%
86%
84%
80%
78%
75%
70%
70%
69%
69%
69%
65%
65%
63%
63%
61%
61%
61%
57%
57%
56%
56%
54%
48%
43%
39%
34%
28%
27%
27%
25%
25%
18%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
1 2 3 4 5
4.1
4.2
4.0
4.1
3.6
4.1
4.0
4.1
4.0
4.3
3.9
4.5
4.1
4.0
4.0
4.3
4.3
3.8
4.1
4.1
4.0
3.6
3.6
3.8
3.7
4.0
4.8
3.7
3.5
3.7
3.7
3.6
3.5
Percent Citing Factor Average Rating
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
3NRMP Program Director Survey Results, 2014
![Page 7: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/7.jpg)
100% 50% 0%
93%93%88%
82%80%
74%71%68%67%64%62%60%58%57%57%55%55%51%50%49%45%45%45%45%44%40%40%36%36%33%
26%23%22%20%20%20%19%
17%15%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
All SpecialtiesPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=1,799)
Figure 2
1 2 3 4 5
4.84.84.74.6
4.14.14.14.0
4.34.5
4.14.14.3
4.04.1
3.64.3
4.04.14.04.24.14.2
4.03.7
4.03.73.73.94.0
3.84.0
4.73.83.8
3.53.73.9
3.7
Average RatingPercent Citing Factor
4NRMP Program Director Survey Results, 2014
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
![Page 8: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/8.jpg)
0%
20%
40%
60%
80%
100%
Yes, pass only Yes, target score No
31%
50%
19%
Scores required?
All SpecialtiesPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure 3
Percentage of Programs That Use USMLE Step 1 Score
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
20%
40%
60%
80%
100%
Yes, pass only Yes, target score No
31%
68%
1%
Scores required?
0%
20%
40%
60%
80%
100%
Never Seldom Often
26%
63%
11%
Would your program consider applicants who fail theexam on the first attempt?
0%
20%
40%
60%
80%
100%
Never Seldom often
35%
58%
6%
Would your program consider applicants who fail theexam on the first attempt?
N=1,746N=1,601
N=1,672 N=1,417
N=508N=684N=989
USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
N=688
170
180
190
200
210
220
230
240
250
260
Scores Below Which Programs Generally Do Not Grant Interviews
170
180
190
200
210
220
230
240
250
260
Scores Above Which Programs Almost Always Grant Interviews
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol in the box represents the mean.
USMLE Step 2 CKUSMLE Step 1USMLE Step 2 CKUSMLE Step 1
5NRMP Program Director Survey Results, 2014
![Page 9: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/9.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
17%10%
73%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
36%41%
23%
COMLEX-USA Level 1*
N=610%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
78%
22%
USMLE Step 2 Clinical Skills (CS)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
33% 33% 34%
COMLEX-USA Level 2-CE*
N=410%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
18%
11%
71%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
50%
12%
38%
COMLEX-USA Level 2-PE*
N=1,140 N=1,102
N=1,057 N=789
* Osteopathic applicants only
Figure 4 All SpecialtiesPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
N=1,604 N=1,049
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
6NRMP Program Director Survey Results, 2014
![Page 10: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/10.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
99%
69% 71%
51%
35%
60%
48%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
All SpecialtiesProgram's Interview Activities Figure 5
0
100
200
300
400
500
600
700
800
900
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants ranked
7
856
119 96 77
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applications rejected Percentage of applicants receivingan in-depth review
51%
44%
Average Percentage of Applicants Rejected and Reviewed
N=1,733 N=1,799
N=1,772
31% of all programs consider all applicant groups
N=1,799 N=1,776 N=1,791 N=1,844*N=1,844*
7NRMP Program Director Survey Results, 2014
* Data from the NRMP database. All Responding programs included
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
We want to receive only theERAS application
We will initiate contact withreferences and/or the
medical school, but we donot wish to be contacted
We want to be contacted bythe applicant’s medical
school after we have initiatedcontact with the applicant
Other
59%
24%
15%
2%
Preferred Type of Communication About Applicants During SOAP
N=1,582
![Page 11: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/11.jpg)
Anesthesiology (N=71)
NRMP Program Director Survey Results, 2014 8
![Page 12: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/12.jpg)
Figure AN-1AnesthesiologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=67)
1 2 3 4 5
4.5
3.9
4.2
4.1
3.4
4.1
4.1
4.2
4.0
4.2
4.1
4.5
4.2
4.0
4.2
4.2
4.2
3.8
3.9
4.0
4.2
3.6
3.6
3.7
3.4
3.8
4.9
3.2
3.3
3.8
2.9
3.8
3.1
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
99%
81%
87%
82%
78%
85%
69%
75%
75%
60%
81%
70%
75%
75%
67%
48%
52%
69%
46%
51%
69%
60%
57%
52%
51%
45%
45%
27%
40%
36%
25%
13%
15%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 9
![Page 13: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/13.jpg)
AnesthesiologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=67)
Figure AN-2
1 2 3 4 5
4.84.84.74.6
4.23.8
4.24.24.24.4
4.04.1
4.34.1
4.33.3
4.14.14.14.04.03.93.93.8
3.74.0
3.63.5
3.93.7
3.23.9
4.73.4
3.83.7
3.33.7
3.4
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
96%91%
85%81%
88%65%
69%74%72%
76%69%
75%66%
75%59%60%
68%59%
43%54%
37%49%
41%56%51%
59%41%38%
43%28%
19%21%21%7%
26%29%
16%10%
13%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 10
![Page 14: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/14.jpg)
170
180
190
200
210
220
230
240
250
260
AnesthesiologyPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure AN-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
43%
57%
0%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
45%
55%
0%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
15%
85%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
23%
48%
28%
Scores required?
N=68
N=63
N=64N=53
N=30N=53 N=42 N=26
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 11
![Page 15: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/15.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
22%
53%
24%
COMLEX-USA Level 1*
N=61
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
64%
36%
USMLE Step 2 CS
AnesthesiologyPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure AN-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
26%33%
42%
COMLEX-USA Level 2-CE*
N=41
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
20%
7%
73%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
13% 13%
73%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
47%
8%
45%
COMLEX-USA Level 2-PE*
N=61 N=41
N=45 N=43
N=38 N=30
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 12
![Page 16: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/16.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%100%
85% 84%
52%
31%
55%51%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure AN-5AnesthesiologyProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
7
704
152 142102
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
47% 46%
Average Percentage of Applicants Rejected andReviewed
N=68N=66N=71* N=71*N=68N=68
N=67
30% of Anesthesiology programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=67
NRMP Program Director Survey Results, 2014 13
![Page 17: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/17.jpg)
Child Neurology (N=41)
NRMP Program Director Survey Results, 2014 14
![Page 18: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/18.jpg)
Figure CN-1Child NeurologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=40)
1 2 3 4 5
3.9
4.3
4.2
3.9
3.7
4.0
4.1
4.1
4.1
4.2
3.8
4.2
3.5
3.9
3.9
4.1
4.3
3.6
4.0
4.3
4.0
3.5
3.5
3.9
3.7
4.0
4.7
3.6
3.8
3.6
3.4
3.5
3.8
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
93%
98%
95%
80%
83%
65%
80%
57%
83%
83%
73%
63%
57%
68%
70%
78%
78%
57%
73%
57%
55%
60%
53%
45%
63%
40%
18%
60%
35%
28%
23%
28%
53%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 15
![Page 19: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/19.jpg)
Child NeurologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=40)
Figure CN-2
1 2 3 4 5
4.74.7
4.64.5
3.94.14.04.1
4.54.3
4.24.04.14.24.1
3.94.14.1
4.04.24.3
4.14.2
3.93.7
4.14.1
3.74.14.2
3.93.8
4.63.83.8
4.23.9
4.44.0
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
95%93%90%
75%83%
90%75%
83%75%
68%78%
60%57%
50%48%
70%60%57%
73%57%57%
38%55%
35%45%
33%43%
65%43%
45%50%
20%20%20%
10%25%
30%18%
45%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 16
![Page 20: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/20.jpg)
170
180
190
200
210
220
230
240
250
260
Child NeurologyPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure CN-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
22%
76%
3%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
32%
65%
3%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
38%
62%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
37%
50%
13%
Scores required?
N=39
N=37
N=38N=34
N=11N=16 N=11 N=8
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 17
![Page 21: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/21.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
38%42%
19%
COMLEX-USA Level 1*
N=37
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
89%
11%
USMLE Step 2 CS
Child NeurologyPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure CN-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
35%42%
23%
COMLEX-USA Level 2-CE*
N=31
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
39%
29% 32%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
25%
35%40%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
39% 39%
22%
COMLEX-USA Level 2-PE*
N=37 N=31
N=26 N=26
N=23 N=20
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 18
![Page 22: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/22.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%100%
73%78%
68%
45%
68%60%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure CN-5Child NeurologyProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
2
8525 18 13
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
49%
58%
Average Percentage of Applicants Rejected andReviewed
N=39N=39N=41* N=41*N=39N=39
N=40
43% of Child Neurology programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=39
NRMP Program Director Survey Results, 2014 19
![Page 23: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/23.jpg)
Dermatology (N=60)
NRMP Program Director Survey Results, 2014 20
![Page 24: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/24.jpg)
Figure D-1DermatologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=59)
1 2 3 4 5
4.3
4.5
4.0
4.1
4.0
4.2
4.2
3.6
4.3
4.5
4.3
4.6
4.5
4.4
4.3
4.5
4.4
4.0
4.1
4.2
4.3
3.8
3.7
3.8
3.9
4.1
4.9
4.1
3.9
4.2
3.9
3.1
4.0
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
92%
93%
83%
64%
85%
59%
64%
42%
76%
73%
59%
64%
75%
64%
63%
69%
58%
64%
25%
61%
68%
54%
51%
46%
53%
24%
17%
49%
39%
22%
29%
15%
10%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 21
![Page 25: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/25.jpg)
DermatologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=59)
Figure D-2
1 2 3 4 5
4.94.94.94.8
4.14.2
3.94.0
4.44.6
4.14.3
4.64.24.2
3.94.7
4.33.8
4.24.5
4.04.3
3.94.0
4.34.04.1
3.73.6
4.14.3
4.63.83.8
3.62.0
3.93.8
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
97%95%95%
80%59%
71%39%
51%64%
68%63%
54%49%
34%34%
46%47%
37%20%
49%34%
20%34%36%
39%34%
37%39%
22%22%
39%5%
14%7%
15%27%
3%20%
7%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 22
![Page 26: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/26.jpg)
170
180
190
200
210
220
230
240
250
260
DermatologyPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure D-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
57%
43%
0%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
58%
39%
3%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
18%
82%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
29%
47%
24%
Scores required?
N=57
N=51
N=51N=38
N=19N=43 N=13 N=8
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 23
![Page 27: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/27.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
18% 18%
65%
COMLEX-USA Level 1*
N=46
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
74%
26%
USMLE Step 2 CS
DermatologyPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure D-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
13%7%
80%
COMLEX-USA Level 2-CE*
N=24
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
17%13%
71%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
8%
0%
92%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
13%7%
80%
COMLEX-USA Level 2-PE*
N=46 N=24
N=17 N=15
N=15 N=12
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 24
![Page 28: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/28.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%100%
74%
35%30%
19%26% 26%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure D-5DermatologyProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
4
412
43 36 32
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
33%
58%
Average Percentage of Applicants Rejected andReviewed
N=59N=54N=60* N=60*N=59N=59
N=57
18% of Dermatology programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=59
NRMP Program Director Survey Results, 2014 25
![Page 29: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/29.jpg)
Emergency Medicine (N=104)
NRMP Program Director Survey Results, 2014 26
![Page 30: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/30.jpg)
Figure EM-1Emergency MedicinePercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=101)
1 2 3 4 5
3.9
4.8
3.9
4.0
3.0
4.0
3.8
3.8
4.0
4.1
3.7
4.4
4.3
4.4
3.9
4.6
4.6
3.7
3.9
3.9
3.8
3.5
3.6
3.4
3.1
3.9
4.6
3.5
3.0
3.3
4.3
3.2
3.4
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
97%
99%
91%
94%
67%
83%
88%
72%
82%
81%
83%
69%
68%
87%
80%
86%
90%
75%
50%
65%
52%
72%
63%
61%
43%
37%
29%
30%
22%
39%
78%
22%
18%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 27
![Page 31: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/31.jpg)
Emergency MedicinePercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=101)
Figure EM-2
1 2 3 4 5
4.84.84.74.6
3.84.7
4.03.8
4.14.5
4.04.1
4.43.8
4.13.0
4.53.83.94.0
4.43.6
4.43.9
3.73.83.8
3.43.83.9
3.64.0
4.53.63.6
2.93.4
4.33.5
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
89%93%91%88%86%87%
80%75%
66%61%62%
74%63%63%62%
43%75%
60%44%
57%71%
41%71%
50%58%
31%51%
28%41%36%
23%23%23%20%
28%16%
26%63%
11%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 28
![Page 32: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/32.jpg)
170
180
190
200
210
220
230
240
250
260
Emergency MedicinePrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure EM-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
19%
76%
5%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
52% 48%
0%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
31%
69%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
22%
54%
24%
Scores required?
N=97
N=94
N=96N=85
N=46N=62 N=41 N=34
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 29
![Page 33: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/33.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
24%
40% 37%
COMLEX-USA Level 1*
N=88
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
66%
34%
USMLE Step 2 CS
Emergency MedicinePercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure EM-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
23%29%
48%
COMLEX-USA Level 2-CE*
N=55
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
15% 13%
73%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
11% 11%
78%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
31%
10%
59%
COMLEX-USA Level 2-PE*
N=88 N=55
N=68 N=66
N=58 N=45
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 30
![Page 34: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/34.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%100%
72%77%
35%
24%
47%
22%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure EM-5Emergency MedicineProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
11
830
174138 123
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
41%
56%
Average Percentage of Applicants Rejected andReviewed
N=104N=99N=104* N=104*N=103N=104
N=101
20% of Emergency Medicine programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=101
NRMP Program Director Survey Results, 2014 31
![Page 35: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/35.jpg)
Family Medicine (N=236)
NRMP Program Director Survey Results, 2014 32
![Page 36: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/36.jpg)
Figure FM-1Family MedicinePercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=227)
1 2 3 4 5
3.8
4.0
4.0
4.1
3.9
4.1
3.9
4.3
3.7
4.5
3.5
4.6
4.2
4.0
3.9
3.9
4.1
3.4
4.2
4.2
3.8
3.7
3.8
3.6
3.3
4.3
4.8
3.2
2.9
3.5
3.2
3.7
3.4
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
91%
83%
80%
87%
87%
78%
68%
81%
52%
87%
56%
70%
69%
70%
60%
44%
51%
31%
81%
65%
54%
63%
65%
40%
10%
56%
38%
8%
20%
25%
12%
42%
24%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 33
![Page 37: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/37.jpg)
Family MedicinePercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=227)
Figure FM-2
1 2 3 4 5
4.84.84.84.8
3.93.84.04.0
4.54.6
4.24.1
4.33.7
4.03.8
4.43.9
4.23.84.0
4.24.0
3.73.83.84.0
3.13.7
4.13.5
4.44.9
3.93.8
3.43.8
3.73.7
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
93%94%91%
84%79%
67%82%
69%84%
69%67%
59%64%
53%62%
68%61%
50%77%
36%30%
61%41%
27%52%
45%53%
12%31%
43%8%
29%25%
34%21%
13%36%
8%17%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 34
![Page 38: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/38.jpg)
170
180
190
200
210
220
230
240
250
260
Family MedicinePrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure FM-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
5%
60%
35%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
13%
68%
19%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
57%
42%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
50%41%
8%
Scores required?
N=219
N=205
N=213N=194
N=65N=71 N=63 N=59
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 35
![Page 39: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/39.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
61%
36%
4%
COMLEX-USA Level 1*
N=208
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
89%
11%
USMLE Step 2 CS
Family MedicinePercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure FM-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
56%
32%
12%
COMLEX-USA Level 2-CE*
N=126
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
13%6%
80%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
16%
7%
77%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
75%
9%16%
COMLEX-USA Level 2-PE*
N=208 N=126
N=200 N=193
N=191 N=117
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 36
![Page 40: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/40.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%100%
79%
95%
63%
47%
77%
53%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure FM-5Family MedicineProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
7
1,149
106 80 64
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
68%
29%
Average Percentage of Applicants Rejected andReviewed
N=228N=215N=236* N=236*N=225N=228
N=224
36% of Family Medicine programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=223
NRMP Program Director Survey Results, 2014 37
![Page 41: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/41.jpg)
Internal Medicine (N=197)
NRMP Program Director Survey Results, 2014 38
![Page 42: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/42.jpg)
Figure IM-1Internal MedicinePercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=194)
1 2 3 4 5
4.1
3.8
4.3
4.2
3.3
4.0
4.1
4.1
4.0
3.7
4.0
4.4
3.8
3.6
3.8
4.1
4.2
3.9
4.3
3.7
4.0
3.4
3.5
3.8
3.5
3.7
4.9
3.5
3.2
4.0
3.1
3.7
3.5
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
92%
73%
90%
89%
66%
79%
70%
73%
65%
51%
74%
64%
64%
54%
53%
57%
59%
58%
75%
47%
55%
46%
38%
45%
28%
40%
44%
21%
24%
29%
9%
31%
21%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 39
![Page 43: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/43.jpg)
Internal MedicinePercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=194)
Figure IM-2
1 2 3 4 5
4.74.74.6
4.44.1
3.74.24.2
4.04.6
3.93.9
4.14.14.1
3.33.8
4.14.24.14.24.14.3
4.13.5
3.93.6
3.43.9
3.63.63.7
4.84.04.1
3.53.3
3.13.4
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
92%95%
82%73%
83%65%
86%79%
55%64%
55%55%
59%71%69%
52%47%
55%71%
51%52%
54%52%51%
36%46%
29%27%
40%21%21%
36%36%
28%25%
17%13%
7%24%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 40
![Page 44: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/44.jpg)
170
180
190
200
210
220
230
240
250
260
Internal MedicinePrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure IM-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
16%
77%
6%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
33%
65%
2%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
29%
71%
1%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
25%
65%
11%
Scores required?
N=184
N=173
N=178N=167
N=100N=112 N=81 N=72
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 41
![Page 45: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/45.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
28%
55%
17%
COMLEX-USA Level 1*
N=172
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
86%
14%
USMLE Step 2 CS
Internal MedicinePercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure IM-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
27%
50%
23%
COMLEX-USA Level 2-CE*
N=119
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
13% 12%
76%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
14% 12%
74%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
57%
15%
27%
COMLEX-USA Level 2-PE*
N=172 N=119
N=132 N=130
N=131 N=94
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 42
![Page 46: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/46.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100% 97%
74%82%
63%
44%
85%
76%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure IM-5Internal MedicineProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
18
2,864
309251
178
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
61%
30%
Average Percentage of Applicants Rejected andReviewed
N=190N=178N=197* N=197*N=189N=190
N=190
39% of Internal Medicine programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=187
NRMP Program Director Survey Results, 2014 43
![Page 47: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/47.jpg)
Internal Medicine/Pediatrics (N=35)
NRMP Program Director Survey Results, 2014 44
![Page 48: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/48.jpg)
Figure IMP-1Internal Medicine/PediatricsPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=34)
1 2 3 4 5
4.1
4.0
4.1
3.9
3.6
4.2
4.2
4.2
3.9
4.3
4.2
4.4
3.7
3.2
3.7
4.4
4.6
4.0
4.2
4.1
3.8
3.3
3.5
3.9
2.9
3.9
4.8
3.0
3.4
3.8
3.0
3.2
3.6
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
94%
65%
74%
85%
71%
74%
82%
68%
68%
59%
74%
56%
56%
38%
71%
65%
68%
71%
53%
41%
59%
47%
62%
47%
24%
29%
24%
18%
24%
68%
9%
15%
21%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 45
![Page 49: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/49.jpg)
Internal Medicine/PediatricsPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=34)
Figure IMP-2
1 2 3 4 5
4.74.74.7
4.64.1
3.64.24.14.3
4.24.3
3.93.6
4.14.3
3.43.7
4.04.4
4.24.3
3.84.2
3.73.4
3.83.8
3.34.2
3.33.8
4.34.3
2.33.9
3.32.8
3.74.5
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
94%86%
91%86%
89%71%
83%71%
77%77%
49%80%
49%83%
54%57%
34%71%
60%60%57%
60%57%
71%51%
46%66%
31%37%
26%11%
17%11%
9%40%
31%11%
9%11%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 46
![Page 50: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/50.jpg)
170
180
190
200
210
220
230
240
250
260
Internal Medicine/PediatricsPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure IMP-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
29%
71%
0%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
48% 52%
0%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
24%
76%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
30%
58%
12%
Scores required?
N=34
N=31
N=33N=27
N=18N=23 N=20 N=14
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 47
![Page 51: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/51.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
23%
64%
14%
COMLEX-USA Level 1*
N=32
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
88%
13%
USMLE Step 2 CS
Internal Medicine/PediatricsPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure IMP-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
32%
50%
18%
COMLEX-USA Level 2-CE*
N=19
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
5%
16%
79%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
7%
20%
73%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
57%
24%19%
COMLEX-USA Level 2-PE*
N=32 N=19
N=22 N=22
N=21 N=15
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 48
![Page 52: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/52.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%100%
35%
62%
35%
21%
47%
26%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure IMP-5Internal Medicine/PediatricsProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
5
245
69 53 49
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
48%42%
Average Percentage of Applicants Rejected andReviewed
N=34N=34N=35* N=35*N=35N=34
N=34
15% of Internal Medicine/Pediatrics programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=35
NRMP Program Director Survey Results, 2014 49
![Page 53: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/53.jpg)
Neurological Surgery (N=55)
NRMP Program Director Survey Results, 2014 50
![Page 54: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/54.jpg)
Figure NS-1Neurological SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=54)
1 2 3 4 5
4.4
4.7
3.8
4.0
3.7
4.3
4.3
3.9
4.2
4.6
3.9
4.5
4.3
4.2
4.3
4.3
4.3
3.8
3.9
4.3
4.0
3.6
3.5
3.8
4.1
4.0
4.6
4.1
3.4
3.4
3.9
3.7
4.5
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
93%
98%
81%
65%
78%
72%
59%
61%
69%
80%
59%
74%
63%
67%
74%
61%
44%
81%
39%
61%
61%
57%
56%
65%
80%
39%
22%
59%
41%
15%
56%
20%
4%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 51
![Page 55: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/55.jpg)
Neurological SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=54)
Figure NS-2
1 2 3 4 5
4.84.84.9
4.74.44.5
4.23.5
4.54.6
4.44.44.6
3.64.3
3.84.6
3.84.14.04.03.94.04.03.94.03.94.1
4.04.24.2
3.54.6
3.73.33.4
3.93.9
5.0
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
94%85%87%85%
70%89%
44%70%
78%74%74%
65%56%
33%46%
56%65%
43%26%
50%43%
28%39%
48%31%
37%33%
63%43%
46%52%
20%13%13%
6%19%
31%37%
2%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 52
![Page 56: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/56.jpg)
170
180
190
200
210
220
230
240
250
260
Neurological SurgeryPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure NS-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
42%
58%
0%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
61%
39%
0%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
19%
79%
2%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
32%
47%
21%
Scores required?
N=52
N=48
N=47N=33
N=19N=35 N=24 N=13
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 53
![Page 57: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/57.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
24%
12%
65%
COMLEX-USA Level 1*
N=46
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
76%
24%
USMLE Step 2 CS
Neurological SurgeryPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure NS-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
17%
6%
78%
COMLEX-USA Level 2-CE*
N=28
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
21%
4%
75%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
6%0%
94%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
18%
0%
82%
COMLEX-USA Level 2-PE*
N=46 N=28
N=17 N=18
N=17 N=16
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 54
![Page 58: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/58.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100% 96%
53%
26%
40%
23%
40% 42%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure NS-5Neurological SurgeryProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
2
202
50 38 27
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
40%
57%
Average Percentage of Applicants Rejected andReviewed
N=53N=52N=55* N=55*N=53N=53
N=53
21% of Neurological Surgery programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=53
NRMP Program Director Survey Results, 2014 55
![Page 59: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/59.jpg)
Neurology (N=60)
NRMP Program Director Survey Results, 2014 56
![Page 60: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/60.jpg)
Figure N-1NeurologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=59)
1 2 3 4 5
4.0
4.3
4.2
4.0
3.7
4.2
4.2
4.1
4.1
4.2
4.0
4.3
4.0
4.0
3.9
4.2
4.4
3.9
4.1
4.1
4.0
3.4
3.4
3.9
3.3
4.0
4.7
3.3
3.4
3.6
3.5
3.4
3.7
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
90%
92%
85%
75%
71%
71%
63%
76%
61%
71%
75%
63%
63%
59%
56%
58%
61%
56%
64%
49%
56%
44%
53%
58%
49%
39%
34%
39%
22%
31%
22%
27%
25%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 57
![Page 61: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/61.jpg)
NeurologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=59)
Figure N-2
1 2 3 4 5
4.94.8
4.74.5
3.94.2
3.84.14.34.4
4.04.14.2
4.14.1
3.64.1
4.04.04.04.24.14.24.1
3.54.0
3.33.3
4.04.0
3.63.8
4.73.73.9
3.44.03.94.0
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
97%98%
93%73%
80%81%
68%73%75%
61%56%
59%61%
68%51%
54%47%49%
53%49%47%47%46%44%41%
46%37%
44%44%
37%39%
22%22%
25%25%
20%22%20%19%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 58
![Page 62: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/62.jpg)
170
180
190
200
210
220
230
240
250
260
NeurologyPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure N-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
22%
76%
2%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
24%
73%
2%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
40%
60%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
34%
50%
16%
Scores required?
N=58
N=51
N=58N=49
N=23N=28 N=20 N=16
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 59
![Page 63: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/63.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
27%
51%
22%
COMLEX-USA Level 1*
N=57
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
77%
23%
USMLE Step 2 CS
NeurologyPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure N-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
23%
40% 38%
COMLEX-USA Level 2-CE*
N=40
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
13%20%
68%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
7%
25%
68%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
28% 25%
47%
COMLEX-USA Level 2-PE*
N=57 N=40
N=41 N=40
N=36 N=28
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 60
![Page 64: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/64.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100% 97%
71%80%
71%
53%
81% 85%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure N-5NeurologyProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
5
443
73 59 51
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
48% 50%
Average Percentage of Applicants Rejected andReviewed
N=60N=59N=60* N=60*N=59N=60
N=59
53% of Neurology programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=59
NRMP Program Director Survey Results, 2014 61
![Page 65: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/65.jpg)
Obstetrics and Gynecology (N=123)
NRMP Program Director Survey Results, 2014 62
![Page 66: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/66.jpg)
Figure OG-1Obstetrics and GynecologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=117)
1 2 3 4 5
4.2
4.1
3.9
4.1
3.5
4.2
4.1
4.2
4.2
4.2
4.0
4.4
4.1
3.9
4.0
4.4
4.4
3.7
4.0
4.0
4.0
3.6
3.7
3.6
3.6
4.2
4.8
3.5
3.2
3.6
3.7
3.5
3.7
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
97%
92%
76%
84%
81%
68%
75%
72%
72%
58%
72%
64%
69%
62%
65%
67%
62%
62%
57%
50%
57%
57%
51%
38%
43%
33%
33%
22%
21%
35%
13%
21%
14%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 63
![Page 67: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/67.jpg)
Obstetrics and GynecologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=117)
Figure OG-2
1 2 3 4 5
4.84.84.84.7
4.13.94.0
3.74.2
4.54.24.24.1
3.94.1
3.44.2
4.04.24.14.14.2
4.04.0
3.74.0
3.63.7
4.14.0
3.73.9
4.73.83.9
3.13.53.6
4.2
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
96%91%91%
86%79%
72%74%
58%67%
61%57%
60%60%
53%54%
49%53%
46%45%
48%54%
42%46%47%42%
36%34%
28%29%
35%20%
16%17%15%
25%12%
22%10%11%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 64
![Page 68: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/68.jpg)
170
180
190
200
210
220
230
240
250
260
Obstetrics and GynecologyPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure OG-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
19%
75%
6%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
41%
53%
6%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
25%
75%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
27%
54%
19%
Scores required?
N=114
N=104
N=112N=97
N=46N=71 N=50 N=34
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 65
![Page 69: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/69.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
29%
50%
21%
COMLEX-USA Level 1*
N=109
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
79%
21%
USMLE Step 2 CS
Obstetrics and GynecologyPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure OG-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
25%
35%41%
COMLEX-USA Level 2-CE*
N=60
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
23%
5%
72%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
20%
4%
76%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
44%
11%
44%
COMLEX-USA Level 2-PE*
N=109 N=60
N=72 N=69
N=63 N=45
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 66
![Page 70: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/70.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100% 97%
54%
75%
34%
18%
48%
30%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure OG-5Obstetrics and GynecologyProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
5
425
89 72 63
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
52%
44%
Average Percentage of Applicants Rejected andReviewed
N=122N=117N=123* N=123*N=122N=122
N=116
15% of Obstetrics and Gynecology programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=119
NRMP Program Director Survey Results, 2014 67
![Page 71: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/71.jpg)
Orthopaedic Surgery (N=87)
NRMP Program Director Survey Results, 2014 68
![Page 72: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/72.jpg)
Figure OS-1Orthopaedic SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=85)
1 2 3 4 5
4.4
4.2
4.0
4.0
3.3
4.5
4.2
3.8
4.3
4.1
4.2
4.5
4.4
4.6
4.1
4.5
4.4
3.9
3.6
3.9
4.2
3.6
3.6
3.9
3.7
4.0
4.8
3.8
3.8
3.4
3.7
3.9
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
95%
92%
79%
64%
82%
81%
74%
52%
87%
53%
72%
75%
67%
64%
74%
69%
58%
84%
19%
55%
66%
64%
59%
46%
69%
19%
20%
25%
40%
12%
32%
9%
0%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 69
![Page 73: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/73.jpg)
Orthopaedic SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=85)
Figure OS-2
1 2 3 4 5
4.64.64.64.6
4.24.3
4.03.94.1
4.54.04.1
4.54.0
4.43.5
4.74.0
4.34.14.14.0
4.23.9
3.74.0
3.73.94.0
3.93.94.0
4.73.0
3.83.63.7
3.54.0
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
89%88%86%82%
70%73%
48%57%
46%64%
57%57%54%50%
61%46%
62%48%
11%52%48%
33%37%
55%39%38%38%
48%30%
15%23%
10%12%
2%11%
25%12%
21%1%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 70
![Page 74: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/74.jpg)
170
180
190
200
210
220
230
240
250
260
Orthopaedic SurgeryPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure OS-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
61%
37%
3%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
65%
33%
2%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
7%
93%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
20%
52%
28%
Scores required?
N=84
N=71
N=75N=55
N=30N=65 N=27 N=15
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 71
![Page 75: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/75.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
7%
19%
74%
COMLEX-USA Level 1*
N=65
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
66%
34%
USMLE Step 2 CS
Orthopaedic SurgeryPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure OS-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
8% 8%
84%
COMLEX-USA Level 2-CE*
N=41
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
22%
5%
73%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
4% 4%
92%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
8%4%
88%
COMLEX-USA Level 2-PE*
N=65 N=41
N=27 N=25
N=26 N=26
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 72
![Page 76: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/76.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100% 99%
51%
27%20%
14%23%
16%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure OS-5Orthopaedic SurgeryProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
5
549
72 59 51
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
46%49%
Average Percentage of Applicants Rejected andReviewed
N=84N=81N=87* N=87*N=83N=84
N=83
13% of Orthopaedic Surgery programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=83
NRMP Program Director Survey Results, 2014 73
![Page 77: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/77.jpg)
Otolaryngology (N=46)
NRMP Program Director Survey Results, 2014 74
![Page 78: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/78.jpg)
Figure O-1OtolaryngologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=46)
1 2 3 4 5
4.3
4.6
3.5
4.0
3.7
4.4
4.2
3.6
4.4
4.3
4.0
4.4
4.4
4.3
4.4
4.6
4.5
4.0
4.1
4.3
4.2
3.7
3.8
3.9
4.3
4.0
4.8
4.2
3.7
3.9
3.8
2.8
4.0
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
98%
100%
74%
59%
74%
67%
74%
61%
85%
67%
59%
65%
70%
63%
76%
76%
61%
83%
20%
54%
46%
59%
72%
48%
80%
17%
24%
35%
33%
17%
39%
13%
4%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 75
![Page 79: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/79.jpg)
OtolaryngologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=46)
Figure O-2
1 2 3 4 5
4.94.84.84.7
3.74.3
3.73.7
4.54.24.34.3
4.73.9
4.53.6
4.34.14.04.24.2
3.44.1
3.73.8
3.64.14.24.14.34.2
4.04.8
2.53.4
3.05.0
3.93.0
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
96%96%96%96%
71%80%
31%38%
60%64%
53%73%
56%40%
44%42%
53%40%
4%53%51%
33%44%
49%40%
22%42%
64%20%20%
33%7%
18%7%
16%20%2%20%2%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 76
![Page 80: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/80.jpg)
170
180
190
200
210
220
230
240
250
260
OtolaryngologyPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure O-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
55%
45%
0%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
67%
33%
0%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
20%
80%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
29%
38%33%
Scores required?
N=46
N=40
N=42N=27
N=14N=32 N=15 N=8
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 77
![Page 81: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/81.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
16%11%
74%
COMLEX-USA Level 1*
N=39
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
62%
38%
USMLE Step 2 CS
OtolaryngologyPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure O-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
16%
5%
79%
COMLEX-USA Level 2-CE*
N=28
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
14%11%
75%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
6%0%
94%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
16%
5%
79%
COMLEX-USA Level 2-PE*
N=39 N=28
N=19 N=19
N=19 N=16
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 78
![Page 82: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/82.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100% 98%
70%
28% 28%24%
37%
28%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure O-5OtolaryngologyProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
3
312
46 37 35
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
31%
67%
Average Percentage of Applicants Rejected andReviewed
N=45N=45N=46* N=46*N=45N=45
N=46
24% of Otolaryngology programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=45
NRMP Program Director Survey Results, 2014 79
![Page 83: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/83.jpg)
Pathology (N=84)
NRMP Program Director Survey Results, 2014 80
![Page 84: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/84.jpg)
Figure PA-1PathologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=84)
1 2 3 4 5
4.3
4.5
4.0
4.0
3.8
4.0
3.8
4.1
3.5
4.6
3.8
4.4
4.1
3.9
3.9
4.1
4.1
3.6
4.0
4.4
4.0
3.5
3.5
4.1
3.7
3.9
4.8
4.2
3.8
3.3
3.6
4.3
3.5
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
94%
98%
83%
86%
83%
68%
60%
75%
57%
93%
57%
63%
57%
64%
54%
58%
68%
54%
71%
67%
58%
39%
40%
61%
60%
46%
45%
35%
42%
8%
42%
26%
36%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 81
![Page 85: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/85.jpg)
PathologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=84)
Figure PA-2
1 2 3 4 5
4.84.74.74.7
4.34.3
4.14.0
4.54.54.5
4.04.2
3.84.0
3.84.1
3.94.0
3.83.9
4.24.04.0
3.23.9
3.34.04.0
4.34.1
3.94.8
4.52.5
3.93.93.9
3.8
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
95%93%89%89%89%85%
79%65%
82%64%
71%42%
54%52%
60%55%54%
37%61%
35%36%
46%40%
31%25%
37%21%
45%40%40%37%
31%30%27%
2%27%
21%19%
31%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 82
![Page 86: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/86.jpg)
170
180
190
200
210
220
230
240
250
260
PathologyPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure PA-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
14%
79%
6%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
13%
82%
6%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
35%
63%
1%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
32%
52%
16%
Scores required?
N=82
N=77
N=77N=72
N=34N=42 N=33 N=27
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 83
![Page 87: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/87.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
39%
50%
11%
COMLEX-USA Level 1*
N=73
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
84%
16%
USMLE Step 2 CS
PathologyPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure PA-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
41%38%
21%
COMLEX-USA Level 2-CE*
N=61
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
30%
7%
64%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
32%
13%
55%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
55%
18%
27%
COMLEX-USA Level 2-PE*
N=73 N=61
N=62 N=56
N=55 N=47
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 84
![Page 88: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/88.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100% 99%93% 93% 91%
68%
94% 91%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Group
Figure PA-5PathologyProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
4
349
55 41 32
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
56%
42%
Average Percentage of Applicants Rejected andReviewed
N=82N=80N=84* N=84*N=82N=82
N=81
67% of Pathology programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=82
NRMP Program Director Survey Results, 2014 85
![Page 89: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/89.jpg)
Pediatrics (N=121)
NRMP Program Director Survey Results, 2014 86
![Page 90: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/90.jpg)
Figure P-1PediatricsPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=120)
1 2 3 4 5
4.0
3.8
4.1
4.1
3.4
4.0
4.1
4.0
4.0
4.0
4.0
4.4
3.8
3.9
3.9
4.0
4.1
3.9
4.2
3.7
3.8
3.6
3.7
3.7
3.4
3.9
4.8
3.6
3.4
3.7
3.5
3.4
2.7
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
98%
77%
87%
81%
70%
77%
69%
77%
63%
56%
75%
54%
60%
65%
57%
63%
66%
62%
64%
39%
63%
52%
55%
44%
23%
33%
30%
18%
24%
39%
16%
33%
16%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 87
![Page 91: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/91.jpg)
PediatricsPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=120)
Figure P-2
1 2 3 4 5
4.74.84.74.6
4.23.8
4.14.24.1
4.53.84.04.24.14.1
3.44.03.9
4.34.14.24.24.24.2
3.63.9
3.73.4
3.73.8
3.63.7
4.93.4
3.83.53.5
3.73.4
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
98%95%93%90%90%
76%88%
82%60%
67%56%
66%62%
77%68%
60%63%
69%71%
57%52%
56%56%52%
46%47%
57%30%
36%27%
21%23%23%
31%35%
21%18%
13%11%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 88
![Page 92: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/92.jpg)
170
180
190
200
210
220
230
240
250
260
PediatricsPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure P-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
5%
77%
18%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
27%
67%
6%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
43%
56%
1%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
38% 42%
20%
Scores required?
N=116
N=113
N=113N=108
N=45N=54 N=49 N=40
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 89
![Page 93: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/93.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
33%
52%
15%
COMLEX-USA Level 1*
N=111
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
82%
18%
USMLE Step 2 CS
PediatricsPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure P-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
29%
44%
27%
COMLEX-USA Level 2-CE*
N=67
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
13%6%
81%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
15%7%
79%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
60%
10%
30%
COMLEX-USA Level 2-PE*
N=111 N=67
N=100 N=97
N=91 N=61
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 90
![Page 94: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/94.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%100%
72%
86%
69%
47%
72%
60%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure P-5PediatricsProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
15
1,124
221192
161
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
58%
35%
Average Percentage of Applicants Rejected andReviewed
N=118N=114N=121* N=121*N=116N=118
N=118
42% of Pediatrics programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=116
NRMP Program Director Survey Results, 2014 91
![Page 95: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/95.jpg)
Physical Medicine and Rehabilitation (N=34)
NRMP Program Director Survey Results, 2014 92
![Page 96: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/96.jpg)
Figure PMR-1Physical Medicine and RehabilitationPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=33)
1 2 3 4 5
4.0
4.3
4.2
4.0
3.9
3.7
3.9
4.2
3.9
4.5
3.8
4.4
3.9
4.3
4.1
4.0
4.4
3.5
4.2
4.2
4.2
3.6
3.6
3.6
3.8
3.6
4.6
2.9
3.4
3.5
3.8
3.9
3.8
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
91%
91%
88%
85%
79%
64%
76%
73%
55%
76%
67%
76%
55%
67%
48%
45%
58%
42%
73%
58%
67%
55%
67%
33%
42%
33%
39%
21%
27%
6%
39%
42%
33%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 93
![Page 97: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/97.jpg)
Physical Medicine and RehabilitationPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=33)
Figure PMR-2
1 2 3 4 5
4.84.74.74.6
4.04.2
4.04.2
4.54.6
4.24.14.1
3.94.0
3.74.7
3.84.04.1
4.53.9
4.33.8
3.64.1
3.73.4
3.84.14.0
3.84.9
3.83.73.7
3.34.4
3.8
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
94%94%
85%79%
82%82%
76%76%
79%58%58%
48%52%52%
39%64%64%
58%70%
36%33%
45%45%
39%52%
61%36%
52%24%
30%15%
18%21%
27%9%
18%9%
33%27%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 94
![Page 98: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/98.jpg)
170
180
190
200
210
220
230
240
250
260
Physical Medicine and RehabilitationPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure PMR-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
13%
67%
20%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
7%
83%
10%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
48% 48%
3%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
45%
32%
23%
Scores required?
N=31
N=30
N=31N=29
N=12N=11 N=7 N=8
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 95
![Page 99: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/99.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
48%42%
10%
COMLEX-USA Level 1*
N=30
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
70%
30%
USMLE Step 2 CS
Physical Medicine and RehabilitationPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure PMR-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
45%
32%
23%
COMLEX-USA Level 2-CE*
N=23
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
17% 17%
65%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
26%
17%
57%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
55%
10%
34%
COMLEX-USA Level 2-PE*
N=30 N=23
N=31 N=31
N=29 N=23
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 96
![Page 100: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/100.jpg)
0%10%20%30%40%50%60%70%80%90%
100%100%
79%
97%
61%
42%
79%
45%
U.S. S
enior
U.S. G
radu
ate
Osteop
athic
Physic
ianCan
adian
Fifth P
athw
ay
U.S. I
MG
Non-U
.S. I
MG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure PMR-5Physical Medicine and RehabilitationProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
5
349
86 68 54
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
45%51%
Average Percentage of Applicants Rejected andReviewed
N=34N=34N=34* N=34*N=34N=34
N=33
27% of Physical Medicine and Rehabilitation programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=34
NRMP Program Director Survey Results, 2014 97
![Page 101: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/101.jpg)
Plastic Surgery (N=39)
NRMP Program Director Survey Results, 2014 98
![Page 102: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/102.jpg)
Figure PS-1Plastic SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=34)
1 2 3 4 5
4.3
4.8
3.1
4.4
3.6
4.2
3.9
3.6
4.2
4.2
3.6
4.2
4.4
4.4
4.1
4.5
4.5
4.2
4.0
3.8
4.2
3.6
3.6
3.8
4.0
3.9
4.7
4.2
3.1
3.0
3.9
3.0
4.0
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
94%
94%
62%
65%
85%
74%
50%
35%
76%
74%
59%
68%
76%
65%
71%
74%
56%
79%
26%
53%
44%
62%
65%
62%
82%
47%
29%
47%
21%
12%
24%
3%
15%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 99
![Page 103: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/103.jpg)
Plastic SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=34)
Figure PS-2
1 2 3 4 5
4.84.74.84.7
4.24.5
4.03.4
4.54.5
4.34.34.5
4.24.1
3.74.7
3.84.2
4.04.6
4.34.7
4.13.7
4.34.04.0
4.34.0
4.34.44.4
3.04.0
3.4
4.33.5
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
88%91%
85%68%
56%82%
32%32%
62%56%
35%53%53%
26%44%
29%62%
24%18%
44%47%
9%26%
47%38%
21%29%
62%24%9%
44%21%
15%3%3%
15%0%
18%12%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 100
![Page 104: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/104.jpg)
170
180
190
200
210
220
230
240
250
260
Plastic SurgeryPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure PS-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
67%
33%
0%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
65%
35%
0%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
14%
86%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
23%
57%
20%
Scores required?
N=35
N=30
N=35N=23
N=11N=21 N=14 N=8
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 101
![Page 105: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/105.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
33%
0%
67%
COMLEX-USA Level 1*
N=34
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
71%
29%
USMLE Step 2 CS
Plastic SurgeryPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure PS-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
33%
0%
67%
COMLEX-USA Level 2-CE*
N=28
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
21%29%
50%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
38%
0%
63%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
38%
0%
63%
COMLEX-USA Level 2-PE*
N=34 N=28
N=9 N=9
N=8 N=8
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 102
![Page 106: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/106.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100% 97%
39%
27%
45%
18%24% 24%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure PS-5Plastic SurgeryProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
2
192
35 30 25
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
29%
67%
Average Percentage of Applicants Rejected andReviewed
N=38N=36N=39* N=39*N=37N=38
N=33
18% of Plastic Surgery programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=37
NRMP Program Director Survey Results, 2014 103
![Page 107: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/107.jpg)
Psychiatry (N=84)
NRMP Program Director Survey Results, 2014 104
![Page 108: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/108.jpg)
Figure PSY-1PsychiatryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=83)
1 2 3 4 5
3.7
4.1
4.2
3.7
4.1
3.9
3.9
4.3
3.7
4.5
3.6
4.6
4.0
4.1
4.1
4.1
4.2
3.4
4.0
4.2
4.0
3.8
3.6
3.6
3.3
3.9
4.8
3.4
2.8
3.4
3.1
4.0
3.4
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
87%
84%
94%
84%
92%
84%
70%
89%
66%
88%
58%
71%
70%
65%
65%
67%
71%
51%
82%
60%
51%
65%
57%
58%
45%
43%
54%
30%
22%
40%
24%
51%
29%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 105
![Page 109: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/109.jpg)
PsychiatryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=83)
Figure PSY-2
1 2 3 4 5
4.95.04.94.8
3.83.93.9
4.24.4
4.84.24.14.1
3.64.1
3.74.2
3.84.1
3.83.9
4.24.0
3.73.9
4.23.8
3.63.83.83.7
4.14.9
4.23.7
3.33.63.6
3.3
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
98%99%95%
89%73%
78%73%71%
84%77%
62%61%61%
51%66%
74%59%
48%61%
44%48%
66%52%
45%54%
40%39%35%
45%39%
32%33%34%
48%29%
17%17%
11%27%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 106
![Page 110: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/110.jpg)
170
180
190
200
210
220
230
240
250
260
PsychiatryPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure PSY-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
3%
56%
41%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
6%
64%
30%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
69%
30%
1%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
60%
24%16%
Scores required?
N=83
N=71
N=83N=70
N=14N=17 N=14 N=12
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 107
![Page 111: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/111.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
67%
31%
3%
COMLEX-USA Level 1*
N=80
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
80%
20%
USMLE Step 2 CS
PsychiatryPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure PSY-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
58%
24%18%
COMLEX-USA Level 2-CE*
N=63
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
30%
11%
59%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
33%
14%
53%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
67%
10%
23%
COMLEX-USA Level 2-PE*
N=80 N=63
N=72 N=71
N=70 N=49
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 108
![Page 112: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/112.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100% 98%
86%89%
67%
46%
80%
63%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure PSY-5PsychiatryProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
7
858
100 79 61
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
61%
30%
Average Percentage of Applicants Rejected andReviewed
N=81N=77N=84* N=84*N=83N=81
N=83
40% of Psychiatry programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=81
NRMP Program Director Survey Results, 2014 109
![Page 113: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/113.jpg)
Radiation Oncology (N=44)
NRMP Program Director Survey Results, 2014 110
![Page 114: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/114.jpg)
Figure RO-1Radiation OncologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=43)
1 2 3 4 5
4.3
4.5
4.0
4.1
3.8
4.2
3.9
3.8
4.2
4.5
4.0
4.6
4.3
4.3
4.3
4.3
4.3
3.8
4.3
4.1
4.3
3.7
3.9
4.0
4.4
3.6
4.7
4.0
3.9
3.7
3.8
3.4
4.5
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
95%
100%
86%
51%
84%
65%
77%
47%
72%
67%
65%
63%
56%
72%
60%
60%
56%
60%
21%
70%
60%
58%
53%
63%
86%
21%
23%
53%
28%
14%
44%
12%
9%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 111
![Page 115: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/115.jpg)
Radiation OncologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=43)
Figure RO-2
1 2 3 4 5
4.94.94.8
4.63.8
4.44.24.2
4.44.6
4.44.24.4
4.04.04.0
4.43.7
4.03.8
4.33.4
4.04.0
3.64.2
3.74.4
3.84.5
4.24.0
5.03.3
3.54.3
4.04.0
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
84%86%
70%70%
57%77%
23%45%
57%39%
61%39%
45%39%
27%45%
39%41%
2%41%
23%11%
25%18%
32%23%20%
61%30%25%
41%2%5%7%
0%14%
7%30%
2%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 112
![Page 116: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/116.jpg)
170
180
190
200
210
220
230
240
250
260
Radiation OncologyPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure RO-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
44%
54%
3%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
43%
54%
4%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
27%
73%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
23%
40% 37%
Scores required?
N=41
N=39
N=35N=28
N=10N=24 N=11 N=6
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 113
![Page 117: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/117.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
20%
10%
70%
COMLEX-USA Level 1*
N=36
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
61%
39%
USMLE Step 2 CS
Radiation OncologyPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure RO-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
20%
10%
70%
COMLEX-USA Level 2-CE*
N=23
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
22%
4%
74%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
22%
0%
78%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
20%
10%
70%
COMLEX-USA Level 2-PE*
N=36 N=23
N=20 N=20
N=20 N=18
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 114
![Page 118: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/118.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%100%
55%
45%
19%12%
19%14%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure RO-5Radiation OncologyProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
2
169
32 25 22
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
26%
73%
Average Percentage of Applicants Rejected andReviewed
N=43N=42N=44* N=44*N=44N=43
N=42
12% of Radiation Oncology programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=44
NRMP Program Director Survey Results, 2014 115
![Page 119: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/119.jpg)
Radiology-Diagnostic (N=75)
NRMP Program Director Survey Results, 2014 116
![Page 120: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/120.jpg)
Figure RD-1Radiology-DiagnosticPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=74)
1 2 3 4 5
4.2
3.9
4.5
3.9
3.3
4.2
4.5
4.1
4.1
3.9
4.3
4.2
4.1
3.9
3.7
4.2
4.2
3.9
4.4
4.0
4.1
3.6
3.3
3.9
3.5
4.1
4.6
3.3
3.8
3.9
3.2
3.0
3.5
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
99%
77%
91%
66%
74%
82%
76%
72%
81%
62%
85%
64%
64%
59%
58%
47%
50%
77%
31%
65%
64%
61%
50%
57%
47%
42%
42%
27%
41%
22%
15%
14%
18%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 117
![Page 121: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/121.jpg)
Radiology-DiagnosticPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=74)
Figure RD-2
1 2 3 4 5
4.74.74.7
4.64.1
3.93.8
4.34.14.4
4.24.14.24.44.3
3.34.34.3
3.94.24.34.34.3
4.03.7
4.23.53.7
4.13.7
3.64.0
4.93.3
4.13.73.8
3.23.9
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
95%97%
85%82%
85%65%
53%78%
61%51%
64%57%55%
73%62%
49%50%
59%24%
50%32%
42%27%
53%50%
45%34%
39%42%38%
31%27%
22%8%19%
26%12%
8%11%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 118
![Page 122: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/122.jpg)
170
180
190
200
210
220
230
240
250
260
Radiology-DiagnosticPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure RD-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
52%45%
3%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
48% 50%
2%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
14%
86%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
20%
44%36%
Scores required?
N=71
N=62
N=66N=44
N=26N=53 N=33 N=15
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 119
![Page 123: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/123.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
24%28%
48%
COMLEX-USA Level 1*
N=62
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
60%
40%
USMLE Step 2 CS
Radiology-DiagnosticPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure RD-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
19%15%
67%
COMLEX-USA Level 2-CE*
N=39
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
23%
8%
69%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
16%8%
76%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
21%
11%
68%
COMLEX-USA Level 2-PE*
N=62 N=39
N=29 N=27
N=28 N=25
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 120
![Page 124: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/124.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100% 99%
78%
64%
45%
30%
50%
36%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure RD-5Radiology-DiagnosticProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
7
426
106 84 76
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
39%
56%
Average Percentage of Applicants Rejected andReviewed
N=74N=73N=75* N=75*N=73N=74
N=74
28% of Radiology-Diagnostic programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=71
NRMP Program Director Survey Results, 2014 121
![Page 125: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/125.jpg)
Surgery (N=121)
NRMP Program Director Survey Results, 2014 122
![Page 126: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/126.jpg)
Figure GS-1SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=115)
1 2 3 4 5
4.4
4.3
3.8
4.3
3.5
4.3
3.9
4.1
4.0
4.3
4.0
4.5
4.1
4.0
4.2
4.4
4.2
3.9
4.2
3.9
3.9
3.6
3.6
3.9
3.8
3.9
4.8
3.8
3.5
3.9
3.5
3.3
3.9
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
97%
92%
79%
87%
72%
76%
70%
69%
78%
65%
70%
58%
62%
53%
68%
73%
69%
70%
47%
55%
39%
52%
50%
43%
47%
45%
27%
33%
21%
29%
21%
10%
10%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 123
![Page 127: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/127.jpg)
SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=115)
Figure GS-2
1 2 3 4 5
4.84.74.8
4.64.4
4.24.2
3.84.34.5
4.14.24.3
4.04.3
3.44.2
4.04.24.14.24.14.24.1
3.63.9
3.53.94.04.1
3.94.14.3
3.73.9
3.64.0
3.73.9
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
91%89%86%
76%82%79%78%
58%69%
53%64%59%
53%55%
62%51%48%
41%38%
46%59%
38%44%
48%42%
33%36%34%35%36%
31%24%
14%10%
18%17%
23%12%
8%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 124
![Page 128: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/128.jpg)
170
180
190
200
210
220
230
240
250
260
SurgeryPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure GS-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
53%45%
2%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
62%
36%
2%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
9%
91%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
10%
74%
16%
Scores required?
N=112
N=104
N=107N=92
N=76N=94 N=72 N=58
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 125
![Page 129: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/129.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
11%
37%
52%
COMLEX-USA Level 1*
N=102
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
80%
20%
USMLE Step 2 CS
SurgeryPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure GS-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
13%
30%
57%
COMLEX-USA Level 2-CE*
N=62
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
10%16%
74%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
10% 10%
80%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
26%
10%
64%
COMLEX-USA Level 2-PE*
N=102 N=62
N=54 N=53
N=50 N=40
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 126
![Page 130: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/130.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%100%
66%
50%
37%
23%
48%
39%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure GS-5SurgeryProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
5
731
92 74 55
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
62%
33%
Average Percentage of Applicants Rejected andReviewed
N=118N=115N=121* N=121*N=117N=118
N=113
19% of Surgery programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=115
NRMP Program Director Survey Results, 2014 127
![Page 131: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/131.jpg)
Thoracic Surgery (N=12)
NRMP Program Director Survey Results, 2014 128
![Page 132: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/132.jpg)
Figure TS-1Thoracic SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=12)
1 2 3 4 5
4.1
4.7
4.0
4.0
3.6
4.3
4.1
4.0
4.0
4.0
3.5
4.6
3.4
3.6
4.3
4.6
4.4
4.0
3.6
4.0
3.8
4.0
4.5
4.2
4.0
5.0
5.0
3.7
3.7
3.5
5.0
3.5
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
92%
92%
83%
83%
83%
33%
83%
50%
83%
50%
33%
58%
42%
42%
50%
58%
67%
58%
42%
33%
42%
25%17%
50%
58%
42%
17%
50%
25%
0%
17%
8%
17%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 129
![Page 133: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/133.jpg)
Thoracic SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=12)
Figure TS-2
1 2 3 4 5
4.84.64.8
4.64.2
4.64.3
3.34.24.34.4
4.14.0
5.04.5
3.44.3
3.94.0
4.34.3
4.04.34.3
3.54.0
3.03.5
4.04.1
3.84.5
4.04.5
3.04.04.0
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
92%92%
83%83%
75%92%
67%58%
75%75%
42%67%
50%8%
33%67%
25%67%
33%67%67%
25%67%
50%33%
42%17%
67%58%58%
50%17%
25%17%
0%17%17%
8%0%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 130
![Page 134: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/134.jpg)
Thoracic SurgeryPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure TS-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
33%
67%
0%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
20%
80%
0%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
33%
58%
8%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
42% 42%
17%
Scores required?
N=12
N=6
N=12N=5
N=5
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 1
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
USMLE Step 2 CK not reported
because of low response rate
USMLE Step 1 not reported because of low response
rate
USMLE Step 2 CK not reported
because of low response rate
NRMP Program Director Survey Results, 2014 131
![Page 135: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/135.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
29% 29%
43%
COMLEX-USA Level 1*
N=11
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
91%
9%
USMLE Step 2 CS
Thoracic SurgeryPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure TS-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
33%
17%
50%
COMLEX-USA Level 2-CE*
N=6
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
33%
0%
67%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
40%
0%
60%
COMLEX-USA Level 3*
N=11 N=6
N=7 N=6
N=4 N=5
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
Not reported because of low response rate
NRMP Program Director Survey Results, 2014 132
![Page 136: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/136.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%100%
58% 58%50%
25%
42%
25%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure TS-5Thoracic SurgeryProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
1
108
33 28 23
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
36%
62%
Average Percentage of Applicants Rejected andReviewed
N=12N=12N=12* N=12*N=12N=12
N=12
17% of Thoracic Surgery programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=12
NRMP Program Director Survey Results, 2014 133
![Page 137: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/137.jpg)
Transitional Year (N=47)
NRMP Program Director Survey Results, 2014 134
![Page 138: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/138.jpg)
Figure TY-1Transitional YearPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=47)
1 2 3 4 5
4.2
3.9
4.2
4.1
3.9
4.4
4.4
4.4
4.3
4.1
4.3
4.7
4.3
3.9
4.2
4.1
4.2
3.8
4.2
4.4
4.0
3.9
3.8
3.6
3.8
4.3
4.6
3.9
3.9
3.5
4.0
4.4
3.3
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
98%
53%
85%
89%
70%
68%
53%
68%
70%
28%
72%
66%
68%
40%
45%
28%
23%
66%
64%
74%
53%
47%
60%
36%
28%
32%
40%
17%
26%
23%
6%
15%
9%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 135
![Page 139: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/139.jpg)
Transitional YearPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=47)
Figure TY-2
1 2 3 4 5
4.74.8
4.64.3
4.03.9
4.24.3
4.14.6
4.44.2
4.44.24.2
3.94.34.24.24.1
3.94.3
4.14.04.04.3
3.93.84.04.04.0
4.54.8
4.43.94.1
3.73.8
3.7
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
89%89%
74%83%
91%40%
79%72%
21%72%
79%53%
57%66%
60%68%
36%60%60%
64%23%
49%19%
57%45%40%
47%28%
34%45%
15%23%26%
19%15%
28%15%13%
15%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 136
![Page 140: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/140.jpg)
170
180
190
200
210
220
230
240
250
260
Transitional YearPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure TY-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
28%
65%
7%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
28%
69%
3%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
23%
74%
2%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
32%
41%
27%
Scores required?
N=47
N=43
N=44N=36
N=16N=26 N=19 N=10
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 137
![Page 141: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/141.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
33%
48%
19%
COMLEX-USA Level 1*
N=44
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
68%
32%
USMLE Step 2 CS
Transitional YearPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure TY-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
31% 31%38%
COMLEX-USA Level 2-CE*
N=19
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
16%
0%
84%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
20%
0%
80%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
52%
8%
40%
COMLEX-USA Level 2-PE*
N=44 N=19
N=27 N=26
N=25 N=15
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 138
![Page 142: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/142.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%100%
34%
74%
30%
19%
38%
23%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure TY-5Transitional YearProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
10
541
99 78 78
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
55%
34%
Average Percentage of Applicants Rejected andReviewed
N=46N=45N=47* N=47*N=45N=46
N=47
17% of Transitional Year programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=46
NRMP Program Director Survey Results, 2014 139
![Page 143: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/143.jpg)
Vascular Surgery (N=22)
NRMP Program Director Survey Results, 2014 140
![Page 144: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/144.jpg)
Figure VS-1Vascular SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=20)
1 2 3 4 5
3.8
4.7
3.9
3.6
3.9
3.9
4.0
3.5
4.1
4.8
4.0
4.5
3.3
4.0
4.0
4.2
4.2
3.8
3.6
4.5
3.7
3.9
3.7
3.8
4.0
3.7
4.6
3.9
3.5
3.0
3.7
3.3
4.3
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
95%
100%
70%
80%
80%
55%
50%
30%
70%
80%
55%
55%
60%
45%
60%
75%
65%
65%
45%
65%
50%
40%
50%
55%
75%
45%
25%
45%
10%
10%
30%
15%
15%
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
Honors in basic sciences
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 141
![Page 145: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/145.jpg)
Vascular SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=20)
Figure VS-2
1 2 3 4 5
4.94.74.7
4.23.9
4.73.93.8
4.74.54.6
3.93.93.8
4.33.6
4.04.1
3.73.7
4.03.0
4.14.1
3.64.2
2.83.93.9
3.64.2
3.55.0
2.53.4
3.04.04.0
Average RatingPercent Citing Factor
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only
100% 50% 0%
95%100%
85%60%
75%95%
70%55%
60%55%
60%40%
50%50%
35%40%
30%40%
35%50%
40%10%
45%50%
40%35%
25%60%
40%40%
45%20%5%
0%10%
25%5%
15%20%
Interactions with faculty during interview and visit
Interpersonal skills
Interactions with house staff during interview and visit
Feedback from current residents
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
USMLE Step 2 CK/COMLEX Level 2 CE score
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Perceived commitment to specialty
Evidence of professionalism and ethics
Perceived interest in program
Leadership qualities
Personal prior knowledge of the applicant
Class ranking/quartile
Graduate of U.S. allopathic medical school
Personal Statement
Audition elective/rotation within your department
Grades in required clerkships
Passing USMLE Step 2 CS/COMLEX Level 2 PE
Honors in clinical clerkships
Honors in clerkship in desired specialty
Gaps in medical education
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Other life experience
Consistency of grades
Volunteer/extracurricular experiences
Demonstrated involvement and interest in research
Graduate of highly regarded U.S. medical school
Other post‐interview contact
Interest in academic career
Visa status*
Applicant was flagged with Match violation by the NRMP
Fluency in language spoken by your patient population
Gold Society membership
Honors in basic sciences
Second interview/visit
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
NRMP Program Director Survey Results, 2014 142
![Page 146: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/146.jpg)
170
180
190
200
210
220
230
240
250
260
Vascular SurgeryPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview
Figure VS-3
Percentage of Programs That Use USMLE Step 2 (CK) Score
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom Often
32%
68%
0%
Would your program consider applicants who fail theexam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Never Seldom often
33%
67%
0%
Would your program consider applicants who failthe exam on the first attempt?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
19%
81%
0%
Scores required?
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
14%
71%
14%
Scores required?
N=21
N=19
N=21N=15
N=8N=11 N=8 N=6
Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews
Percentage of Programs That Use USMLE Step 1 Score
170
180
190
200
210
220
230
240
250
260
USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
Scores Above Which Programs Almost Always Grant Interviews
Scores Below Which Programs Generally Do Not Grant Interviews
NRMP Program Director Survey Results, 2014 143
![Page 147: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/147.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
23%
38% 38%
COMLEX-USA Level 1*
N=21
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes No
76%
24%
USMLE Step 2 CS
Vascular SurgeryPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure VS-4
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
17%
33%
50%
COMLEX-USA Level 2-CE*
N=15
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
13%
33%
53%
USMLE Step 3
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
20%
30%
50%
COMLEX-USA Level 3*
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Yes, pass only Yes, target score No
27% 27%
45%
COMLEX-USA Level 2-PE*
N=21 N=15
N=13 N=12
N=11 N=10
* Osteopathic applicants only
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
NRMP Program Director Survey Results, 2014 144
![Page 148: Results of the 2014 NRMP Program Director Survey · USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's](https://reader034.fdocuments.us/reader034/viewer/2022042202/5ea288320cee111eaa3ea7b3/html5/thumbnails/148.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100% 95%
71%
62%
48%43%
52%
43%
U.S. Senior U.S. Graduate OsteopathicPhysician
Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Percentage of Programs that Typically Interview and Rank Each Applicant Type
Figure VS-5Vascular SurgeryProgram's Interview Activities
0
100
200
300
400
500
600
700
800
900
1,000
Number ofpositions in the
Match
Number ofapplications
received
Number ofinterview
invitations sent
Number ofapplicantsinterviewed
Number ofapplicants
ranked
154
22 17 14
Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Percentage of applicationsrejected
Percentage of applicantsreceiving an in-depth review
27%
69%
Average Percentage of Applicants Rejected andReviewed
N=21N=21N=22* N=22*N=22N=21
N=21
38% of Vascular Surgery programs consider all applicant groups
* Data from the NRMP database. All Responding programs included
N=22
NRMP Program Director Survey Results, 2014 145