2014 Program Director Survey - NRMP

1 downloads 199 Views 497KB Size Report
National Resident Matching Program, Data Release and Research ..... medical school officials, and applicants find these
Results of the 2014 NRMP Program Director Survey

All rights reserved. Permission to use, copy and/or distribute any documentation and/or related images from this publication shall be expressly obtained from the NRMP.

June 2014 www.nrmp.org

Requests for permission to use these data as well as questions about the content of this publication or the National Resident Matching Program data and reports may be directed to Mei Liang, Director of Research, NRMP, at [email protected]. Questions about the NRMP should be directed to Mona M. Signer, Executive Director, NRMP, at [email protected]. Suggested Citation National Resident Matching Program, Data Release and Research Committee: Results of the 2014 NRMP Program Director Survey. National Resident Matching Program, Washington, DC. 2014. Copyright © 2014 National Resident Matching Program.

Table of Contents

Introduction .................................................................................................................................................................. 1 All Specialties............................................................................................................................................................... 2 Charts for Individual Specialties Anesthesiology ....................................................................................................................................................... 8 Child Neurology ................................................................................................................................................... 14 Dermatology ......................................................................................................................................................... 20 Emergency Medicine ........................................................................................................................................... 26 Family Medicine ................................................................................................................................................... 32 Internal Medicine.................................................................................................................................................. 38 Internal Medicine/Pediatrics ................................................................................................................................. 44 Neurological Surgery............................................................................................................................................ 50 Neurology ............................................................................................................................................................. 56 Obstetrics and Gynecology .................................................................................................................................. 62 Orthopaedic Surgery ............................................................................................................................................. 68 Otolaryngology ..................................................................................................................................................... 74 Pathology .............................................................................................................................................................. 80 Pediatrics .............................................................................................................................................................. 86 Physical Medicine and Rehabilitation .................................................................................................................. 92 Plastic Surgery ...................................................................................................................................................... 98 Psychiatry ........................................................................................................................................................... 104 Radiation Oncology ............................................................................................................................................ 110 Radiology-Diagnostic ......................................................................................................................................... 116 Surgery ............................................................................................................................................................... 122 Thoracic Surgery ................................................................................................................................................ 128 Transitional Year ................................................................................................................................................ 134 Vascular Surgery ................................................................................................................................................ 140

Introduction In March 2014, the National Resident Matching Program (NRMP) conducted its biennial survey of the directors of all programs participating in the Main Residency Match®. The primary purpose of the survey was to shed light on the factors that program directors use to (1) select applicants to interview and (2) rank applicants for the Match.

Several changes were made to the 2014 questionnaire. In the past, program directors were asked to indicate factors they used in selecting applicants to interview and to rate the importance of each factor in ranking. In this survey, program directors were asked to indicate factors they used in selecting applicants to interview and rank respectively. They were asked to rate the importance on a scale of 1 to 5 only for the factors they used in their selection process. In addition, this survey asked program directors how they handled unfilled positions after the 2013 Match and SOAP. Because the number of responses for that question was small, the results are only reported in the "All Specialties" section.

The survey was fielded during the 18 days between the rank order list deadline and Match Week so that program match outcomes would not influence respondents' answers. The survey solicited information on:  the number of applications received, screened, and reviewed, as well as the number of applicants interviewed and ranked  whether the program typically interviews and ranks specific applicant groups  use of test scores in considering which applicants to interview, and  the factors used for both interview selection and for ranking applicants.

Numbers of responses are presented in most of the graphs. Some graphs use data from multiple survey questions. In those cases, different N's are listed. Numbers of applicants ranked and positions in the Match are extracted from the NRMP database. Graphs are suppressed for questions with fewer than five responses.

The overall response rate for all specialties in this report was 52.7 percent. Transitional Year and 22 specialties with 10 or more responses are included in this report. Their response rates are listed in the table below. Response rates for those specialties ranged from a high of 65.4 percent for Emergency Medicine and Pediatrics to a low of 42.6 for Radiology.

_______________

Specialty Anesthesiology Child Neurology Dermatology Emergency Medicine Family Medicine Internal Medicine Internal Medicine/Pediatrics Neurological Surgery Neurology Obstetrics and Gynecology Orthopaedic Surgery Otolaryngology Pathology Pediatrics Physical Medicine and Rehabilitation Plastic Surgery Psychiatry Radiation Oncology Radiology‐Diagnostic Surgery Thoracic Surgery Transitional Year Vascular Surgery All others Total

NRMP Program Director Survey Results, 2014

This report presents results by specialty on selected items from the survey. The NRMP hopes that program directors, medical school officials, and applicants find these data useful as they prepare for and participate in the Main Residency Match. The NRMP's data reporting and research activities are guided by its Data Release and Research Committee. NRMP data and reports can be found at: www.nrmp.org/match-data/.

Surveys Sent Num ber Responding Response Rate 127 72 110 159 429 379 80 102 129 230 147 100 134 185 77 63 180 84 176 275 25 91 44 101 3,499

1

71 41 60 104 236 197 35 55 60 123 87 46 84 121 34 39 84 44 75 121 12 47 22 46 1,844

55.9% 56.9% 54.5% 65.4% 55.0% 52.0% 43.8% 53.9% 46.5% 53.5% 59.2% 46.0% 62.7% 65.4% 44.2% 61.9% 46.7% 52.4% 42.6% 44.0% 48.0% 51.6% 50.0% 45.5% 52.7%

All Specialties Combined (N=1,844)

Figure 1

All Specialties Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview (N=1,793) Percent Citing Factor

USMLE Step 1/COMLEX Level 1 score

Average Rating

4.1

Letters of recommendation in the specialty

94% 86%

Medical Student Performance Evaluation (MSPE/Dean's Letter)

84%

4.0

USMLE Step 2 CK/COMLEX Level 2 CE score Personal Statement Graduate of U.S. allopathic medical school

4.2

80% 78%

4.1 3.6

75%

4.1

Grades in required clerkships

70%

4.0

Gaps in medical education

70%

4.1

Honors in clinical clerkships

69%

4.0

Perceived commitment to specialty

69% 69%

Class ranking/quartile

4.3 3.9

Evidence of professionalism and ethics

65%

Personal prior knowledge of the applicant

65%

4.1

Audition elective/rotation within your department

4.0

Leadership qualities

63% 63%

Honors in clerkship in desired specialty

61%

4.3

Grades in clerkship in desired specialty

61% 61%

4.3

Alpha Omega Alpha (AOA) membership

4.5

4.0

3.8

Pass USMLE Step2 CS/COMLEX Lvl2 PE

57%

4.1

Perceived interest in program

4.1

Consistency of grades

57% 56%

Other life experience

56%

3.6

Volunteer/extracurricular experiences

54%

3.6

Graduate of highly regarded U.S. medical school Demonstrated involvement and interest in research

4.0

3.8

48% 43%

Visa status*

3.7 4.0

39% 34%

Applicant was flagged with Match violation by the NRMP

4.8 3.7

Interest in academic career

28%

Honors in basic sciences

27%

Gold Society membership

3.7

Away rotation in your specialty at another institution

27% 25%

Fluency in language spoken by your patient population

25%

3.6

USMLE/COMLEX Step 3 score 100% ¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

3

3.5 3.7

18% 50%

0% 1

2

3.5 3

4

5

Figure 2

All Specialties Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants (N=1,799) Percent Citing Factor

Interactions with faculty during interview and visit 93% Interpersonal skills 93% Interactions with house staff during interview and visit 88% Feedback from current residents 82% USMLE Step 1/COMLEX Level 1 score 80% Letters of recommendation in the specialty 74% USMLE Step 2 CK/COMLEX Level 2 CE score 71% Medical Student Performance Evaluation (MSPE/Dean's Letter) 68% Perceived commitment to specialty 67% Evidence of professionalism and ethics 64% Perceived interest in program 62% Leadership qualities 60% Personal prior knowledge of the applicant 58% Class ranking/quartile 57% Graduate of U.S. allopathic medical school 57% Personal Statement 55% Audition elective/rotation within your department 55% Grades in required clerkships 51% Passing USMLE Step 2 CS/COMLEX Level 2 PE 50% Honors in clinical clerkships 49% Honors in clerkship in desired specialty 45% Gaps in medical education 45% Grades in clerkship in desired specialty 45% Alpha Omega Alpha (AOA) membership 45% Other life experience 44% Consistency of grades 40% Volunteer/extracurricular experiences 40% Demonstrated involvement and interest in research 36% Graduate of highly regarded U.S. medical school 36% Other post‐interview contact 33% Interest in academic career 26% Visa status* 23% Applicant was flagged with Match violation by the NRMP 22% Fluency in language spoken by your patient population 20% Gold Society membership 20% Honors in basic sciences 20% Second interview/visit 19% Away rotation in your specialty at another institution 17% USMLE/COMLEX Step 3 score 15% 0% 1 100% 50%

¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

4

Average Rating

2

4.8 4.8 4.7 4.6 4.1 4.1 4.1 4.0 4.3 4.5 4.1 4.1 4.3 4.0 4.1 3.6 4.3 4.0 4.1 4.0 4.2 4.1 4.2 4.0 3.7 4.0 3.7 3.7 3.9 4.0 3.8 4.0 4.7 3.8 3.8 3.5 3.7 3.9 3.7 3 4 5

All Specialties Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure 3

Percentage of Programs That Use USMLE Step 1 Score Scores required? 100%

Would your program consider applicants who fail the exam on the first attempt?

N=1,746

N=1,601

100% 80% 80%

68%

63%

60%

40%

60% 40%

31%

26% 20%

0%

20%

1% Yes, pass only

Yes, target score

0%

No

11% Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score Scores required?

Would your program consider applicants who fail the exam on the first attempt?

100% N=1,672

N=1,417

100%

80% 80% 60%

40%

58%

60%

50%

40%

31% 19%

20%

35%

20%

6% 0%

Yes, pass only

Yes, target score

0%

No

Never

Seldom

often

USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews Scores Below Which Programs Generally Do Not Grant Interviews

Scores Above Which Programs Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

USMLE Step 1 N=989

170

USMLE Step 2 CK N=688

USMLE Step 1 N=684

USMLE Step 2 CK N=508

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol in the box represents the mean. NRMP Program Director Survey Results, 2014

5

All Specialties Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure 4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores USMLE Step 2 Clinical Skills (CS)

USMLE Step 3

N=1,604

100%

90%

90% 80%

N=1,049

100%

78%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

30%

22%

20%

20% 10%

18% 11%

10%

N=61

0%

71%

Yes

0%

No

N=41 Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores COMLEX-USA Level 1* 100%

COMLEX-USA Level 2-CE*

90%

90%

80%

80%

70%

70%

60%

60%

50% 40%

50% 41%

40%

36%

30%

23%

20%

10%

10% Yes, pass only

Yes, target score

33%

33%

34%

Yes, pass only

Yes, target score

No

30%

20%

0%

N=1,102

100%

N=1,140

0%

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores COMLEX-USA Level 2-PE*

COMLEX-USA Level 3*

N=1,057

100% 90%

90%

80%

80%

70%

70%

60% 50%

73%

60% 50%

50% 38%

40%

40%

30%

30%

20%

20%

12%

10% 0%

N=789

100%

17% 10%

10% Yes, pass only

Yes, target score

0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

6

Yes, pass only

Yes, target score

No

All Specialties Program's Interview Activities

Figure 5

Average Percentage of Applicants Rejected and Reviewed

Average Number of Positions, Applications Received, Interview Invitations Sent, and Applicants Interviewed and Ranked 900

100%

856

90%

800

80%

700

70%

600

60%

500

50%

51% 44%

40%

400

30%

300 20%

200

119

10%

96

100

77 0%

7

Percentage of applications rejected

0 Number of positions in the Match

Number of applications received

N=1,844*

N=1,799

Number of interview invitations sent

Number of applicants interviewed

N=1,776

Number of applicants ranked

N=1,791

N=1,844*

Percentage of applicants receiving an in-depth review

N=1,733

N=1,799

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Type 100%

99%

31% of all programs consider all applicant groups

90% 80%

71%

69%

70%

60%

60%

51%

50% 40%

48% 35%

30% 20% 10% 0% U.S. Senior

U.S. Graduate

Osteopathic Physician

Canadian

Fifth Pathway

U.S. IMG

Non-U.S. IMG

N=1,772

Preferred Type of Communication About Applicants During SOAP 100% 90% 80% 70% 60%

59%

50% 40% 30%

24%

20%

15%

10%

2%

0%

We want to receive only the ERAS application

We want to be contacted by the applicant’s medical school after we have initiated contact with the applicant

We will initiate contact with references and/or the medical school, but we do not wish to be contacted N=1,582

NRMP Program Director Survey Results, 2014

7

Other

Anesthesiology (N=71)

NRMP Program Director Survey Results, 2014

8

Figure AN-1

Anesthesiology Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview (N=67) Percent Citing Factor

Average Rating

USMLE Step 1/COMLEX Level 1 score 99% Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's Letter) USMLE Step 2 CK/COMLEX Level 2 CE score Personal Statement Graduate of U.S. allopathic medical school Grades in required clerkships

4.5 81%

3.9

87%

4.2

82%

4.1

78%

3.4

85%

4.1

69%

Gaps in medical education

75%

Honors in clinical clerkships

75%

Perceived commitment to specialty Class ranking/quartile Evidence of professionalism and ethics

4.2 4.0

60%

4.1

70% 75%

Audition elective/rotation within your department

75%

4.5 4.2 4.0

67%

Honors in clerkship in desired specialty Grades in clerkship in desired specialty Alpha Omega Alpha (AOA) membership

Volunteer/extracurricular experiences

4.2

69%

3.8 46%

4.0

69%

4.2

60%

3.6

57%

3.6

52%

Demonstrated involvement and interest in research

51%

3.7 3.4

Visa status*

45%

Applicant was flagged with Match violation by the NRMP

45%

Interest in academic career

3.2 3.3

36%

Away rotation in your specialty at another institution

3.8

25% 13%

Fluency in language spoken by your patient population

9

4.9

40%

Gold Society membership

NRMP Program Director Survey Results, 2014

3.8 27%

Honors in basic sciences

¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

3.9

51%

Graduate of highly regarded U.S. medical school

USMLE/COMLEX Step 3 score 100%

4.2

52%

Perceived interest in program Other life experience

4.2 48%

Pass USMLE Step2 CS/COMLEX Lvl2 PE Consistency of grades

4.2

81%

Personal prior knowledge of the applicant Leadership qualities

4.1

2.9 3.8

15% 50%

0% 1

2

3.1 3

4

5

Figure AN-2

Anesthesiology Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants (N=67) Percent Citing Factor

Interactions with faculty during interview and visit 96% Interpersonal skills 91% Interactions with house staff during interview and visit 85% Feedback from current residents 81% USMLE Step 1/COMLEX Level 1 score 88% Letters of recommendation in the specialty 65% USMLE Step 2 CK/COMLEX Level 2 CE score 69% Medical Student Performance Evaluation (MSPE/Dean's Letter) 74% Perceived commitment to specialty 72% Evidence of professionalism and ethics 76% Perceived interest in program 69% Leadership qualities 75% Personal prior knowledge of the applicant 66% Class ranking/quartile 75% Graduate of U.S. allopathic medical school 59% Personal Statement 60% Audition elective/rotation within your department 68% Grades in required clerkships 59% Passing USMLE Step 2 CS/COMLEX Level 2 PE 43% Honors in clinical clerkships 54% Honors in clerkship in desired specialty 37% Gaps in medical education 49% Grades in clerkship in desired specialty 41% Alpha Omega Alpha (AOA) membership 56% Other life experience 51% Consistency of grades 59% Volunteer/extracurricular experiences 41% Demonstrated involvement and interest in research 38% Graduate of highly regarded U.S. medical school 43% Other post‐interview contact 28% Interest in academic career 19% Visa status* 21% Applicant was flagged with Match violation by the NRMP 21% 7% Fluency in language spoken by your patient population Gold Society membership 26% Honors in basic sciences 29% Second interview/visit 16% Away rotation in your specialty at another institution 10% USMLE/COMLEX Step 3 score 13% 0% 1 100% 50% ¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

10

Average Rating

4.8 4.8 4.7 4.6 4.2 3.8 4.2 4.2 4.2 4.4 4.0 4.1 4.3 4.1 4.3 3.3 4.1 4.1 4.1 4.0 4.0 3.9 3.9 3.8 3.7 4.0 3.6 3.5 3.9 3.7 3.2 3.9 4.7 3.4 3.8 3.7 3.3 3.7 3.4 2

3

4

5

Anesthesiology Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure AN-3

Percentage of Programs That Use USMLE Step 1 Score Scores required?

Would your program consider applicants who fail the exam on the first attempt?

N=68

100% 90%

90%

80%

80%

70%

70%

60%

50%

40%

43%

40%

30%

30%

15%

20%

10% 0%

57%

60%

50%

20%

N=63

100%

85%

10%

0% Yes, pass only

Yes, target score

0%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score Would your program consider applicants who fail the exam on the first attempt?

Scores required? N=64

N=53

100%

100%

90%

90%

80%

80%

70%

70%

60%

60%

48%

50%

50%

40% 30%

55% 45%

40%

28%

23%

30%

20%

20%

10%

10%

0%

0% Yes, pass only

Yes, target score

No

0% Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews Scores Below Which Programs Generally Do Not Grant Interviews

Scores Above Which Programs Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=53

N=30

N=42

USMLE Step 2 CK N=26

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean. NRMP Program Director Survey Results, 2014

11

Anesthesiology Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure AN-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores USMLE Step 2 CS

USMLE Step 3

N=61

100% 90%

90%

80%

80%

70%

N=41

100%

73%

70%

64%

60%

60%

50%

50%

36%

40%

40%

30%

30%

20%

20%

N=61

10% 0%

20%

N=41 7%

10%

Yes

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores COMLEX-USA Level 1* 100%

COMLEX-USA Level 2-CE* 100%

N=45

90%

90%

80%

80%

70%

70%

60%

60%

53%

50%

50%

40%

40%

30%

24%

22%

30%

20%

20%

10%

10%

0%

Yes, pass only

Yes, target score

N=43

0%

No

42% 33% 26%

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores COMLEX-USA Level 2-PE* 100%

COMLEX-USA Level 3* 100%

N=38

90%

90%

80%

80%

70%

70%

47%

45%

50%

40%

40%

30%

30% 20%

20%

8%

10% 0%

73%

60%

60% 50%

N=30

Yes, pass only

Yes, target score

0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

13%

13%

Yes, pass only

Yes, target score

10%

12

No

Figure AN-5

Anesthesiology Program's Interview Activities

Average Number of Positions, Applications Received, Interview Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and Reviewed

1,000

100%

900

90%

800

80%

704

700

70%

600

60%

500 400

46%

Percentage of applications rejected

Percentage of applicants receiving an in-depth review

40%

300

30%

200

152

142

100 0

47%

50%

20%

102

10%

7 Number of positions in the Match

N=71*

Number of applications received

N=68

Number of interview invitations sent

Number of applicants interviewed

N=67

N=68

0%

Number of applicants ranked

N=71*

N=66

N=68

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type 30% of Anesthesiology programs consider all applicant groups 100% N=67

90%

85%

84%

80% 70% 60%

55%

52%

50% 40%

51%

31%

30% 20% 10% 0% U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic Physician

Canadian

13

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Child Neurology (N=41)

NRMP Program Director Survey Results, 2014

14

Figure CN-1

Child Neurology Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview (N=40) Percent Citing Factor

USMLE Step 1/COMLEX Level 1 score

Average Rating

93%

3.9

Letters of recommendation in the specialty 98% Medical Student Performance Evaluation (MSPE/Dean's Letter)

4.3

95%

USMLE Step 2 CK/COMLEX Level 2 CE score Personal Statement

4.2

80% 83%

Graduate of U.S. allopathic medical school Grades in required clerkships

3.9 3.7

65% 80%

4.1

Gaps in medical education

57%

Honors in clinical clerkships

83%

Perceived commitment to specialty

83%

Class ranking/quartile Evidence of professionalism and ethics

Leadership qualities

4.2

73%

3.9

70%

3.9

78%

Consistency of grades Other life experience Volunteer/extracurricular experiences

4.1 4.3 4.0

73%

4.3

57%

4.0

55%

3.5

60%

3.7

63%

3.6

60%

3.8

35%

3.6

28%

Away rotation in your specialty at another institution

3.4

23% 28%

Fluency in language spoken by your patient population

15

4.7

18%

Gold Society membership

NRMP Program Director Survey Results, 2014

4.0

40%

Honors in basic sciences

¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

3.9

45%

Applicant was flagged with Match violation by the NRMP

USMLE/COMLEX Step 3 score 100%

3.5

53%

Visa status* Interest in academic career

3.6

57%

Graduate of highly regarded U.S. medical school Demonstrated involvement and interest in research

3.5

68%

Grades in clerkship in desired specialty

Perceived interest in program

4.2

57%

78%

Pass USMLE Step2 CS/COMLEX Lvl2 PE

3.8

63%

Honors in clerkship in desired specialty Alpha Omega Alpha (AOA) membership

4.1 4.1

Personal prior knowledge of the applicant Audition elective/rotation within your department

4.0

3.5 3.8

53% 50%

0% 1

2

3

4

5

Figure CN-2

Child Neurology Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants (N=40) Percent Citing Factor

Interactions with faculty during interview and visit 95% Interpersonal skills 93% Interactions with house staff during interview and visit 90% Feedback from current residents 75% USMLE Step 1/COMLEX Level 1 score 83% Letters of recommendation in the specialty 90% USMLE Step 2 CK/COMLEX Level 2 CE score 75% Medical Student Performance Evaluation (MSPE/Dean's Letter) 83% Perceived commitment to specialty 75% Evidence of professionalism and ethics 68% Perceived interest in program 78% Leadership qualities 60% Personal prior knowledge of the applicant 57% Class ranking/quartile 50% Graduate of U.S. allopathic medical school 48% Personal Statement 70% Audition elective/rotation within your department 60% Grades in required clerkships 57% Passing USMLE Step 2 CS/COMLEX Level 2 PE 73% Honors in clinical clerkships 57% Honors in clerkship in desired specialty 57% Gaps in medical education 38% Grades in clerkship in desired specialty 55% Alpha Omega Alpha (AOA) membership 35% Other life experience 45% Consistency of grades 33% Volunteer/extracurricular experiences 43% Demonstrated involvement and interest in research 65% Graduate of highly regarded U.S. medical school 43% Other post‐interview contact 45% Interest in academic career 50% Visa status* 20% Applicant was flagged with Match violation by the NRMP 20% Fluency in language spoken by your patient population 20% 10% Gold Society membership Honors in basic sciences 25% Second interview/visit 30% Away rotation in your specialty at another institution 18% 45% USMLE/COMLEX Step 3 score 0% 1 100% 50% ¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

16

Average Rating

4.7 4.7 4.6 4.5 3.9 4.1 4.0 4.1 4.5 4.3 4.2 4.0 4.1 4.2 4.1 3.9 4.1 4.1 4.0 4.2 4.3 4.1 4.2 3.9 3.7 4.1 4.1 3.7 4.1 4.2 3.9 3.8 4.6 3.8 3.8 4.2 3.9 4.4 4.0 2

3

4

5

Child Neurology Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure CN-3

Percentage of Programs That Use USMLE Step 1 Score Scores required?

Would your program consider applicants who fail the exam on the first attempt?

N=39

100%

90%

80%

62%

70%

60%

60%

50%

50%

38%

40%

30%

30%

20%

20%

10% 0%

76%

80%

70%

40%

N=37

100%

90%

10%

0% Yes, pass only

Yes, target score

22% 3%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score Would your program consider applicants who fail the exam on the first attempt?

Scores required? N=38

N=34

100%

100%

90%

90%

80%

80%

70%

70%

60%

60%

50%

50% 40%

65%

50%

37%

40%

30%

32%

30%

20%

20%

13%

10%

10%

0%

0% Yes, pass only

Yes, target score

No

3% Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews Scores Below Which Programs Generally Do Not Grant Interviews

Scores Above Which Programs Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=16

N=11

N=11

USMLE Step 2 CK N=8

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean. NRMP Program Director Survey Results, 2014

17

Child Neurology Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure CN-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores USMLE Step 2 CS

USMLE Step 3

N=37

100%

89%

90%

90%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

30%

20%

0%

Yes

39% 29%

32%

20%

11%

N=37

10%

N=31

100%

N=31

10% 0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores COMLEX-USA Level 1* 100%

COMLEX-USA Level 2-CE* 100%

N=26

90%

90%

80%

80%

70%

70%

60%

60%

50% 40%

50%

42%

38%

40%

42% 35%

30%

30%

19%

20%

23%

20% 10%

10% 0%

N=26

Yes, pass only

Yes, target score

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores COMLEX-USA Level 2-PE* 100%

COMLEX-USA Level 3* 100%

N=23

90%

90%

80%

80%

70%

70%

60%

60%

50% 40%

50%

39%

39%

30%

40%

22%

30%

20%

20%

10%

10%

0%

N=20

Yes, pass only

Yes, target score

0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

18

35%

40%

25%

Yes, pass only

Yes, target score

No

Figure CN-5

Child Neurology Program's Interview Activities

Average Number of Positions, Applications Received, Interview Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and Reviewed

1,000

100%

900

90%

800

80%

700

70%

600 500

49%

50%

400

40%

300

30%

200

20%

85

100 0

58%

60%

2 Number of positions in the Match

N=41*

Number of applications received

N=39

10%

25

18

13

Number of interview invitations sent

Number of applicants interviewed

Number of applicants ranked

N=39

N=39

0%

Percentage of applications rejected

N=41*

Percentage of applicants receiving an in-depth review

N=39

N=39

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type 43% of Child Neurology programs consider all applicant groups 100% N=40

90% 80%

73%

78% 68%

70%

68% 60%

60% 50%

45%

40% 30% 20% 10% 0% U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic Physician

Canadian

19

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Dermatology (N=60)

NRMP Program Director Survey Results, 2014

20

Figure D-1

Dermatology Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview (N=59) Percent Citing Factor

USMLE Step 1/COMLEX Level 1 score

92%

Letters of recommendation in the specialty

93%

Medical Student Performance Evaluation (MSPE/Dean's Letter)

4.3 4.5

83%

USMLE Step 2 CK/COMLEX Level 2 CE score Personal Statement Graduate of U.S. allopathic medical school Grades in required clerkships

4.0 64%

4.1

85%

4.0 59%

Perceived commitment to specialty Class ranking/quartile Evidence of professionalism and ethics Personal prior knowledge of the applicant

4.2

64%

4.2

Gaps in medical education Honors in clinical clerkships

Average Rating

42%

3.6

76%

4.3

73%

4.5

59%

4.3

64%

4.6

75%

4.5

Audition elective/rotation within your department

64%

4.4

Leadership qualities

63%

4.3

Honors in clerkship in desired specialty Grades in clerkship in desired specialty Alpha Omega Alpha (AOA) membership

4.5

69%

4.4

58%

4.0

64%

Pass USMLE Step2 CS/COMLEX Lvl2 PE Perceived interest in program Consistency of grades Other life experience Volunteer/extracurricular experiences Graduate of highly regarded U.S. medical school Demonstrated involvement and interest in research

4.2

61%

4.3

68%

3.8

54%

3.9

53%

4.1

49%

3.9

39%

4.2

22%

Away rotation in your specialty at another institution

3.9

29% 15%

Fluency in language spoken by your patient population

21

4.9

17%

Gold Society membership

NRMP Program Director Survey Results, 2014

4.1

24%

Honors in basic sciences

¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

3.8

46%

Applicant was flagged with Match violation by the NRMP

USMLE/COMLEX Step 3 score 100%

3.7

51%

Visa status* Interest in academic career

4.1

25%

3.1

10% 50%

0% 1

2

4.0 3 4

5

Figure D-2

Dermatology Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants (N=59) Percent Citing Factor

Average Rating

Interactions with faculty during interview and visit 97% Interpersonal skills 95% Interactions with house staff during interview and visit 95% Feedback from current residents 80% USMLE Step 1/COMLEX Level 1 score 59% Letters of recommendation in the specialty 71% USMLE Step 2 CK/COMLEX Level 2 CE score 39% Medical Student Performance Evaluation (MSPE/Dean's Letter) 51% Perceived commitment to specialty 64% Evidence of professionalism and ethics 68% Perceived interest in program 63% Leadership qualities 54% Personal prior knowledge of the applicant 49% Class ranking/quartile 34% Graduate of U.S. allopathic medical school 34% Personal Statement 46% Audition elective/rotation within your department 47% Grades in required clerkships 37% Passing USMLE Step 2 CS/COMLEX Level 2 PE 20% Honors in clinical clerkships 49% Honors in clerkship in desired specialty 34% Gaps in medical education 20% Grades in clerkship in desired specialty 34% Alpha Omega Alpha (AOA) membership 36% Other life experience 39% Consistency of grades 34% Volunteer/extracurricular experiences 37% Demonstrated involvement and interest in research 39% Graduate of highly regarded U.S. medical school 22% Other post‐interview contact 22% Interest in academic career 39% Visa status* 5% Applicant was flagged with Match violation by the NRMP 14% 7% Fluency in language spoken by your patient population Gold Society membership 15% Honors in basic sciences 27% Second interview/visit 3% 2.0 Away rotation in your specialty at another institution 20% USMLE/COMLEX Step 3 score 7% 100% 50% 0% 1 2 ¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

22

4.9 4.9 4.9 4.8 4.1 4.2 3.9 4.0 4.4 4.6 4.1 4.3 4.6 4.2 4.2 3.9 4.7 4.3 3.8 4.2 4.5 4.0 4.3 3.9 4.0 4.3 4.0 4.1 3.7 3.6 4.1 4.3 4.6 3.8 3.8 3.6 3.9 3.8 3

4

5

Dermatology Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure D-3

Percentage of Programs That Use USMLE Step 1 Score Scores required?

Would your program consider applicants who fail the exam on the first attempt?

N=57

100%

82%

90%

80%

80%

70%

70%

60%

50%

40%

43%

40%

30%

30%

18%

20%

10% 0%

57%

60%

50%

20%

N=51

100%

90%

10%

0% Yes, pass only

Yes, target score

0%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score Would your program consider applicants who fail the exam on the first attempt?

Scores required? N=51

N=38

100%

100%

90%

90%

80%

80%

70%

70%

60%

60%

47%

50%

50%

40% 30%

39%

40%

29%

30%

24%

20%

20%

10%

10%

0%

0% Yes, pass only

58%

Yes, target score

No

3% Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews Scores Below Which Programs Generally Do Not Grant Interviews

Scores Above Which Programs Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=43

N=19

N=13

USMLE Step 2 CK N=8

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean. NRMP Program Director Survey Results, 2014

23

Dermatology Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure D-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores USMLE Step 2 CS

USMLE Step 3

N=46

100%

N=24

100% 90%

90% 80%

80%

74%

70%

70%

60%

60%

50%

50%

40%

40%

26%

30%

30%

20%

20%

N=46

10% 0%

71%

17%

N=24

10%

Yes

0%

No

Yes, pass only

13%

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores COMLEX-USA Level 1* 100%

COMLEX-USA Level 2-CE* 100%

N=17

90%

90%

80%

80%

70%

65%

80%

70%

60%

60%

50%

50%

40%

40% 30%

30% 20%

N=15

18%

18%

20%

10%

10%

0%

0%

Yes, pass only

Yes, target score

No

13% 7% Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores COMLEX-USA Level 2-PE* 100%

COMLEX-USA Level 3* 100%

N=15

90%

80%

80%

70%

60%

60%

50%

50%

40%

40%

30%

30% 20%

13% 7%

10% 0%

92%

80%

70%

20%

N=12

90%

Yes, pass only

Yes, target score

10% 0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

24

8% 0% Yes, pass only

Yes, target score

No

Figure D-5

Dermatology Program's Interview Activities

Average Number of Positions, Applications Received, Interview Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and Reviewed

1,000

100%

900

90%

800

80%

700

70%

600 500

50%

412 400

40%

300

33%

30%

200

20%

100 0

58%

60%

4 Number of positions in the Match

N=60*

Number of applications received

N=59

43

36

32

Number of interview invitations sent

Number of applicants interviewed

Number of applicants ranked

N=59

N=59

10% 0%

Percentage of applications rejected

N=60*

Percentage of applicants receiving an in-depth review

N=54

N=59

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type 18% of Dermatology programs consider all applicant groups 100% N=57

90% 80%

74%

70% 60% 50% 40%

35%

30%

30%

26%

26%

U.S. IMG

Non-U.S. IMG

19%

20% 10% 0% U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic Physician

Canadian

25

Fifth Pathway

Emergency Medicine (N=104)

NRMP Program Director Survey Results, 2014

26

Figure EM-1

Emergency Medicine Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview (N=101) Percent Citing Factor

Average Rating

USMLE Step 1/COMLEX Level 1 score 97%

3.9

Letters of recommendation in the specialty 99% Medical Student Performance Evaluation (MSPE/Dean's Letter) USMLE Step 2 CK/COMLEX Level 2 CE score

4.8

91%

3.9

94%

4.0

Personal Statement Graduate of U.S. allopathic medical school Grades in required clerkships Gaps in medical education

67%

3.0 4.0

83%

3.8

88%

3.8

72%

Honors in clinical clerkships

82%

4.0

Perceived commitment to specialty

81%

4.1

Class ranking/quartile

83%

3.7

Evidence of professionalism and ethics

69%

4.4

Personal prior knowledge of the applicant

68%

4.3

Audition elective/rotation within your department Leadership qualities Honors in clerkship in desired specialty Grades in clerkship in desired specialty Alpha Omega Alpha (AOA) membership

4.4

87%

3.9

80%

4.6

86%

4.6

90%

Pass USMLE Step2 CS/COMLEX Lvl2 PE Perceived interest in program

3.9

50%

3.9

65%

Consistency of grades Other life experience

3.7

75%

3.8

52%

3.5

72%

Volunteer/extracurricular experiences

63%

Graduate of highly regarded U.S. medical school

61%

Demonstrated involvement and interest in research

3.6 3.4 3.1

43%

Visa status*

3.9

37%

Applicant was flagged with Match violation by the NRMP

29%

Interest in academic career

30%

Honors in basic sciences

¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

27

3.0 3.3

39%

4.3

78%

Fluency in language spoken by your patient population USMLE/COMLEX Step 3 score 100%

3.5

22%

Gold Society membership Away rotation in your specialty at another institution

4.6

3.2

22% 18% 50%

0% 1

2

3.4 3

4

5

Figure EM-2

Emergency Medicine Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants (N=101) Percent Citing Factor

Interactions with faculty during interview and visit 89% Interpersonal skills 93% Interactions with house staff during interview and visit 91% Feedback from current residents 88% USMLE Step 1/COMLEX Level 1 score 86% Letters of recommendation in the specialty 87% USMLE Step 2 CK/COMLEX Level 2 CE score 80% Medical Student Performance Evaluation (MSPE/Dean's Letter) 75% Perceived commitment to specialty 66% Evidence of professionalism and ethics 61% Perceived interest in program 62% Leadership qualities 74% Personal prior knowledge of the applicant 63% Class ranking/quartile 63% Graduate of U.S. allopathic medical school 62% Personal Statement 43% Audition elective/rotation within your department 75% Grades in required clerkships 60% Passing USMLE Step 2 CS/COMLEX Level 2 PE 44% Honors in clinical clerkships 57% Honors in clerkship in desired specialty 71% Gaps in medical education 41% Grades in clerkship in desired specialty 71% Alpha Omega Alpha (AOA) membership 50% Other life experience 58% Consistency of grades 31% Volunteer/extracurricular experiences 51% Demonstrated involvement and interest in research 28% Graduate of highly regarded U.S. medical school 41% Other post‐interview contact 36% Interest in academic career 23% Visa status* 23% Applicant was flagged with Match violation by the NRMP 23% 20% Fluency in language spoken by your patient population Gold Society membership 28% 16% Honors in basic sciences Second interview/visit 26% Away rotation in your specialty at another institution 63% USMLE/COMLEX Step 3 score 11% 0% 1 100% 50% ¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

28

Average Rating

4.8 4.8 4.7 4.6 3.8 4.7 4.0 3.8 4.1 4.5 4.0 4.1 4.4 3.8 4.1 3.0 4.5 3.8 3.9 4.0 4.4 3.6 4.4 3.9 3.7 3.8 3.8 3.4 3.8 3.9 3.6 4.0 4.5 3.6 3.6 2.9 3.4 4.3 3.5 2

3

4

5

Emergency Medicine Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure EM-3

Percentage of Programs That Use USMLE Step 1 Score Scores required?

Would your program consider applicants who fail the exam on the first attempt?

N=97

100%

90%

80%

80%

69%

70%

60%

50%

30%

50% 40%

31%

30%

20%

19%

20%

10% 0%

76%

70%

60%

40%

N=94

100%

90%

10%

0% Yes, pass only

Yes, target score

5%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score Would your program consider applicants who fail the exam on the first attempt?

Scores required? N=96

N=85

100%

100%

90%

90%

80%

80%

70%

70%

60%

60%

54%

50%

50%

40%

40%

30% 20%

20%

10%

10%

0%

0% Yes, pass only

Yes, target score

48%

30%

24%

22%

52%

No

Never

0% often

Seldom

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews Scores Below Which Programs Generally Do Not Grant Interviews

Scores Above Which Programs Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=62

N=46

N=41

USMLE Step 2 CK N=34

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean. NRMP Program Director Survey Results, 2014

29

Emergency Medicine Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure EM-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores USMLE Step 2 CS

USMLE Step 3

N=88

100%

N=55

100% 90%

90%

80%

80%

66%

70%

73%

70%

60%

60%

50%

50%

40%

40%

34%

30%

30%

20%

20%

N=88

10% 0%

15%

Yes

0%

No

13%

N=55

10%

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores COMLEX-USA Level 1* 100%

COMLEX-USA Level 2-CE* 100%

N=68

90%

90%

80%

80%

70%

70%

60%

60%

40%

40%

37%

40% 30%

24%

20%

20%

10%

10%

0%

48%

50%

50%

30%

N=66

Yes, pass only

Yes, target score

0%

No

29% 23%

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores COMLEX-USA Level 2-PE* 100%

COMLEX-USA Level 3* 100%

N=58

90%

90%

80%

80%

70%

50%

30%

60% 50% 40%

31%

30% 20%

20%

10%

10% 0%

78%

70%

59%

60%

40%

N=45

Yes, pass only

Yes, target score

10% 0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

30

11%

11%

Yes, pass only

Yes, target score

No

Figure EM-5

Emergency Medicine Program's Interview Activities

Average Number of Positions, Applications Received, Interview Invitations Sent, and Applicants Interviewed and Ranked 1,000

Average Percentage of Applicants Rejected and Reviewed 100%

900

90%

830

800

80%

700

70%

600

60%

500

56%

50%

41%

400

40%

300

30%

174

200

138

20%

123

100

10%

11 0 Number of positions in the Match

N=104*

Number of applications received

N=104

Number of interview invitations sent

Number of applicants interviewed

N=101

N=103

0%

Number of applicants ranked

Percentage of applications rejected

N=104*

Percentage of applicants receiving an in-depth review

N=99

N=104

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type 20% of Emergency Medicine programs consider all applicant groups 100% N=101

90% 80%

72%

77%

70% 60% 47%

50% 40%

35%

30%

24%

22%

20% 10% 0% U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic Physician

Canadian

31

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Family Medicine (N=236)

NRMP Program Director Survey Results, 2014

32

Figure FM-1

Family Medicine Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview (N=227) Percent Citing Factor

USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's Letter)

91%

3.8

83% 87%

Personal Statement

87%

4.0 4.1 3.9

78%

Grades in required clerkships Gaps in medical education

4.0

80%

USMLE Step 2 CK/COMLEX Level 2 CE score Graduate of U.S. allopathic medical school

4.1

68%

3.9

81%

4.3

Honors in clinical clerkships Perceived commitment to specialty

52%

4.5 56%

Evidence of professionalism and ethics

70%

Personal prior knowledge of the applicant

69%

Audition elective/rotation within your department

70%

Leadership qualities

3.5 4.6 4.2 4.0 3.9

60%

Honors in clerkship in desired specialty

Other life experience Volunteer/extracurricular experiences

4.2

81%

4.2

65%

3.7

63%

3.8

65%

4.3

56%

4.8

38% 3.2

8% 20%

Honors in basic sciences Gold Society membership

2.9 3.5

25%

Away rotation in your specialty at another institution

3.2

12% 42%

Fluency in language spoken by your patient population

33

3.3

10%

Interest in academic career

NRMP Program Director Survey Results, 2014

3.6

40%

Applicant was flagged with Match violation by the NRMP

¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

3.8

54%

Demonstrated involvement and interest in research

USMLE/COMLEX Step 3 score 100%

3.4

31%

Graduate of highly regarded U.S. medical school Visa status*

4.1

51%

Alpha Omega Alpha (AOA) membership

Consistency of grades

3.9

44%

Grades in clerkship in desired specialty

Perceived interest in program

3.7

87%

Class ranking/quartile

Pass USMLE Step2 CS/COMLEX Lvl2 PE

Average Rating

3.7

24% 50%

0% 1

2

3.4 3

4

5

Figure FM-2

Family Medicine Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants (N=227) Percent Citing Factor

Interactions with faculty during interview and visit 93% Interpersonal skills 94% Interactions with house staff during interview and visit 91% Feedback from current residents 84% USMLE Step 1/COMLEX Level 1 score 79% Letters of recommendation in the specialty 67% USMLE Step 2 CK/COMLEX Level 2 CE score 82% Medical Student Performance Evaluation (MSPE/Dean's Letter) 69% Perceived commitment to specialty 84% Evidence of professionalism and ethics 69% Perceived interest in program 67% Leadership qualities 59% Personal prior knowledge of the applicant 64% Class ranking/quartile 53% Graduate of U.S. allopathic medical school 62% Personal Statement 68% Audition elective/rotation within your department 61% Grades in required clerkships 50% Passing USMLE Step 2 CS/COMLEX Level 2 PE 77% Honors in clinical clerkships 36% Honors in clerkship in desired specialty 30% Gaps in medical education 61% Grades in clerkship in desired specialty 41% Alpha Omega Alpha (AOA) membership 27% Other life experience 52% Consistency of grades 45% Volunteer/extracurricular experiences 53% Demonstrated involvement and interest in research 12% Graduate of highly regarded U.S. medical school 31% Other post‐interview contact 43% 8% Interest in academic career Visa status* 29% Applicant was flagged with Match violation by the NRMP 25% Fluency in language spoken by your patient population 34% Gold Society membership 21% Honors in basic sciences 13% Second interview/visit 36% Away rotation in your specialty at another institution 8% USMLE/COMLEX Step 3 score 17% 100% 50% 0% 1 ¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

34

Average Rating

4.8 4.8 4.8 4.8 3.9 3.8 4.0 4.0 4.5 4.6 4.2 4.1 4.3 3.7 4.0 3.8 4.4 3.9 4.2 3.8 4.0 4.2 4.0 3.7 3.8 3.8 4.0 3.1 3.7 4.1 3.5 4.4 4.9 3.9 3.8 3.4 3.8 3.7 3.7 2

3

4

5

Family Medicine Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure FM-3

Percentage of Programs That Use USMLE Step 1 Score Scores required?

Would your program consider applicants who fail the exam on the first attempt?

N=219

100%

90%

80%

80%

70% 60%

70%

57%

60%

60%

50%

42%

50%

40%

40%

30%

30%

20%

20%

10% 0%

N=205

100%

90%

10%

0% Yes, pass only

Yes, target score

35%

5%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score Would your program consider applicants who fail the exam on the first attempt?

Scores required? N=213

N=194

100%

100%

90%

90%

80%

80%

70%

70%

60% 50%

60%

50%

50%

41%

40%

40%

30%

30%

20%

20%

8%

10% 0%

68%

10% 0%

Yes, pass only

Yes, target score

19%

13%

No

Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews Scores Below Which Programs Generally Do Not Grant Interviews

Scores Above Which Programs Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=71

N=65

N=63

USMLE Step 2 CK N=59

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean. NRMP Program Director Survey Results, 2014

35

Family Medicine Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure FM-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores USMLE Step 2 CS

USMLE Step 3

N=208

100%

89%

90%

90%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

30%

20%

0%

20%

11%

N=208

10%

N=126

100%

Yes

80%

13%

N=126 6%

10% 0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores COMLEX-USA Level 1* 100%

COMLEX-USA Level 2-CE* 100%

N=200

90%

90%

80%

80%

70% 60%

70%

61%

60%

56%

50%

50% 40%

40%

36%

30%

30%

20%

20%

10% 0%

N=193

4% Yes, pass only

Yes, target score

32% 12%

10% 0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores COMLEX-USA Level 2-PE* 100%

COMLEX-USA Level 3* 100%

N=191

90% 80%

70%

60%

60%

50%

50%

40%

40%

30%

30%

20%

16% 9%

10% Yes, pass only

77%

80%

75%

70%

0%

N=117

90%

Yes, target score

20%

0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

16% 7%

10%

36

Yes, pass only

Yes, target score

No

Figure FM-5

Family Medicine Program's Interview Activities

Average Number of Positions, Applications Received, Interview Invitations Sent, and Applicants Interviewed and Ranked 1,149

1,000

Average Percentage of Applicants Rejected and Reviewed 100%

900

90%

800

80%

700

70%

600

60%

500

50%

400

40%

300

30%

200

0

80

64

Number of applicants interviewed

Number of applicants ranked

10%

7 Number of positions in the Match

N=236*

Number of applications received

N=228

Number of interview invitations sent

29%

20%

106

100

68%

N=223

N=225

0%

Percentage of applications rejected

N=236*

Percentage of applicants receiving an in-depth review

N=215

N=228

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type 36% of Family Medicine programs consider all applicant groups 100% 95%

N=224

90% 79%

80%

77%

70%

63%

60%

53% 47%

50% 40% 30% 20% 10% 0% U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic Physician

Canadian

37

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Internal Medicine (N=197)

NRMP Program Director Survey Results, 2014

38

Figure IM-1

Internal Medicine Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview (N=194) Percent Citing Factor

USMLE Step 1/COMLEX Level 1 score Letters of recommendation in the specialty

Average Rating

92%

4.1 73%

3.8

Medical Student Performance Evaluation (MSPE/Dean's Letter)

90%

4.3

USMLE Step 2 CK/COMLEX Level 2 CE score

89%

4.2

Personal Statement Graduate of U.S. allopathic medical school Grades in required clerkships Gaps in medical education Honors in clinical clerkships

66% 79%

4.0

70%

4.1

73%

4.1

65%

Perceived commitment to specialty Class ranking/quartile

3.3

4.0

51%

3.7

74%

4.0

Evidence of professionalism and ethics

64%

Personal prior knowledge of the applicant

64%

4.4 3.8

Audition elective/rotation within your department

54%

Leadership qualities

53%

3.6 3.8

Honors in clerkship in desired specialty

57%

4.1

Grades in clerkship in desired specialty

59%

4.2

Alpha Omega Alpha (AOA) membership

58%

Pass USMLE Step2 CS/COMLEX Lvl2 PE Perceived interest in program Consistency of grades Other life experience

4.3

75% 3.7

47%

4.0

55% 3.4

46%

Volunteer/extracurricular experiences Graduate of highly regarded U.S. medical school

3.9

3.8

45%

Demonstrated involvement and interest in research

3.7

40%

Applicant was flagged with Match violation by the NRMP

4.9

44%

Interest in academic career

29%

Away rotation in your specialty at another institution

9% 31%

Fluency in language spoken by your patient population

39

3.2

24%

Gold Society membership

NRMP Program Director Survey Results, 2014

3.5

21%

Honors in basic sciences

¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

3.5

28%

Visa status*

USMLE/COMLEX Step 3 score 100%

3.5

38%

4.0 3.1 3.7

21% 50%

0% 1

2

3.5 3

4

5

Figure IM-2

Internal Medicine Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants (N=194) Percent Citing Factor

Interactions with faculty during interview and visit 92% Interpersonal skills 95% Interactions with house staff during interview and visit 82% Feedback from current residents 73% USMLE Step 1/COMLEX Level 1 score 83% Letters of recommendation in the specialty 65% USMLE Step 2 CK/COMLEX Level 2 CE score 86% Medical Student Performance Evaluation (MSPE/Dean's Letter) 79% Perceived commitment to specialty 55% Evidence of professionalism and ethics 64% Perceived interest in program 55% Leadership qualities 55% Personal prior knowledge of the applicant 59% Class ranking/quartile 71% Graduate of U.S. allopathic medical school 69% Personal Statement 52% Audition elective/rotation within your department 47% Grades in required clerkships 55% Passing USMLE Step 2 CS/COMLEX Level 2 PE 71% Honors in clinical clerkships 51% Honors in clerkship in desired specialty 52% Gaps in medical education 54% Grades in clerkship in desired specialty 52% Alpha Omega Alpha (AOA) membership 51% Other life experience 36% Consistency of grades 46% Volunteer/extracurricular experiences 29% Demonstrated involvement and interest in research 27% Graduate of highly regarded U.S. medical school 40% Other post‐interview contact 21% Interest in academic career 21% Visa status* 36% Applicant was flagged with Match violation by the NRMP 36% 28% Fluency in language spoken by your patient population Gold Society membership 25% Honors in basic sciences 17% Second interview/visit 13% Away rotation in your specialty at another institution 7% USMLE/COMLEX Step 3 score 24% 0% 1 100% 50% ¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

40

Average Rating

4.7 4.7 4.6 4.4 4.1 3.7 4.2 4.2 4.0 4.6 3.9 3.9 4.1 4.1 4.1 3.3 3.8 4.1 4.2 4.1 4.2 4.1 4.3 4.1 3.5 3.9 3.6 3.4 3.9 3.6 3.6 3.7 4.8 4.0 4.1 3.5 3.3 3.1 3.4 2

3

4

5

Internal Medicine Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure IM-3

Percentage of Programs That Use USMLE Step 1 Score Scores required?

Would your program consider applicants who fail the exam on the first attempt?

N=184

100%

90%

80%

71%

70%

70% 60%

50%

50%

40%

40%

29%

30%

20%

20%

10%

10%

0%

77%

80%

60%

30%

N=173

100%

90%

1% Yes, pass only

Yes, target score

16% 6%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score Would your program consider applicants who fail the exam on the first attempt?

Scores required? N=178

N=167

100%

100%

90%

90%

80%

80%

70%

65%

70%

60%

60%

50%

50%

40% 30%

40% 20%

11%

10%

10% 0%

Yes, pass only

33%

30%

25%

20% 0%

65%

Yes, target score

No

2% Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews Scores Below Which Programs Generally Do Not Grant Interviews

Scores Above Which Programs Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=112

N=100

N=81

USMLE Step 2 CK N=72

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean. NRMP Program Director Survey Results, 2014

41

Internal Medicine Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure IM-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores USMLE Step 2 CS

USMLE Step 3

N=172

100%

86%

90%

90%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

30%

20%

0%

20%

14%

N=172

10%

N=119

100%

76%

13%

N=119 12%

10%

Yes

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores COMLEX-USA Level 1* 100%

COMLEX-USA Level 2-CE* 100%

N=132

90%

90%

80%

80%

70%

70%

60%

60%

55%

40%

40%

28%

30%

17%

20%

27%

23%

20% 10%

10% 0%

50%

50%

50%

30%

N=130

Yes, pass only

Yes, target score

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores COMLEX-USA Level 2-PE* 100%

COMLEX-USA Level 3* 100%

N=131

90%

90%

80%

80%

70%

70%

60%

57%

74%

60%

50%

50% 40%

40%

27%

30% 20%

30% 20%

15%

14%

12%

Yes, pass only

Yes, target score

10%

10% 0%

N=94

Yes, pass only

Yes, target score

0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

42

No

Figure IM-5

Internal Medicine Program's Interview Activities

Average Number of Positions, Applications Received, Interview Invitations Sent, and Applicants Interviewed and Ranked 2,864

1,000

Average Percentage of Applicants Rejected and Reviewed 100%

900

90%

800

80%

700

70%

600

60%

500

50%

61%

400

40%

309 300

178

200

20%

100

10%

18 0 Number of positions in the Match

N=197*

30%

30%

251

Number of applications received

N=190

Number of interview invitations sent

Number of applicants interviewed

N=187

N=189

0%

Number of applicants ranked

Percentage of applications rejected

N=197*

Percentage of applicants receiving an in-depth review

N=178

N=190

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type 39% of Internal Medicine programs consider all applicant groups 97% N=190

90%

85%

82%

80%

76%

74%

70%

63%

60% 50%

44%

40% 30% 20% 10% 0% U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic Physician

Canadian

43

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Internal Medicine/Pediatrics (N=35)

NRMP Program Director Survey Results, 2014

44

Figure IMP-1

Internal Medicine/Pediatrics Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview (N=34) Percent Citing Factor

USMLE Step 1/COMLEX Level 1 score

94%

4.1

Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's Letter) USMLE Step 2 CK/COMLEX Level 2 CE score Personal Statement Graduate of U.S. allopathic medical school Grades in required clerkships

4.1

74%

3.9

85%

3.6

71%

4.2

74%

4.2

82% 68%

Honors in clinical clerkships

68%

Perceived commitment to specialty Class ranking/quartile

4.0

65%

Gaps in medical education

4.2 3.9 4.3

59%

4.2

74%

Evidence of professionalism and ethics

56%

Personal prior knowledge of the applicant

56%

Audition elective/rotation within your department Leadership qualities Honors in clerkship in desired specialty Grades in clerkship in desired specialty Alpha Omega Alpha (AOA) membership Pass USMLE Step2 CS/COMLEX Lvl2 PE Consistency of grades

4.4

65%

4.6

68% 4.0

71%

3.8

59%

3.3

47%

3.5

62%

3.9

47% 2.9

24%

3.9

29%

Applicant was flagged with Match violation by the NRMP

4.8

24%

Interest in academic career

3.0

18%

Honors in basic sciences

3.4

24%

3.8

68%

Away rotation in your specialty at another institution

3.0

9% 15%

Fluency in language spoken by your patient population

45

4.1

41%

Visa status*

NRMP Program Director Survey Results, 2014

4.2

53%

Demonstrated involvement and interest in research

USMLE/COMLEX Step 3 score 100%

3.2 3.7

Graduate of highly regarded U.S. medical school

Gold Society membership

3.7

71%

Other life experience Volunteer/extracurricular experiences

4.4 38%

Perceived interest in program

¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

Average Rating

3.2

21% 50%

0% 1

2

3.6 3 4

5

Figure IMP-2

Internal Medicine/Pediatrics Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants (N=34) Percent Citing Factor

Interactions with faculty during interview and visit 94% Interpersonal skills 86% Interactions with house staff during interview and visit 91% Feedback from current residents 86% USMLE Step 1/COMLEX Level 1 score 89% Letters of recommendation in the specialty 71% USMLE Step 2 CK/COMLEX Level 2 CE score 83% Medical Student Performance Evaluation (MSPE/Dean's Letter) 71% Perceived commitment to specialty 77% Evidence of professionalism and ethics 77% Perceived interest in program 49% Leadership qualities 80% Personal prior knowledge of the applicant 49% Class ranking/quartile 83% Graduate of U.S. allopathic medical school 54% Personal Statement 57% Audition elective/rotation within your department 34% Grades in required clerkships 71% Passing USMLE Step 2 CS/COMLEX Level 2 PE 60% Honors in clinical clerkships 60% Honors in clerkship in desired specialty 57% Gaps in medical education 60% Grades in clerkship in desired specialty 57% Alpha Omega Alpha (AOA) membership 71% Other life experience 51% Consistency of grades 46% Volunteer/extracurricular experiences 66% Demonstrated involvement and interest in research 31% Graduate of highly regarded U.S. medical school 37% Other post‐interview contact 26% Interest in academic career 11% Visa status* 17% Applicant was flagged with Match violation by the NRMP 11% 9% Fluency in language spoken by your patient population Gold Society membership 40% Honors in basic sciences 31% Second interview/visit 11% Away rotation in your specialty at another institution 9% USMLE/COMLEX Step 3 score 11% 0% 1 100% 50% ¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

46

Average Rating

4.7 4.7 4.7 4.6 4.1 3.6 4.2 4.1 4.3 4.2 4.3 3.9 3.6 4.1 4.3 3.4 3.7 4.0 4.4 4.2 4.3 3.8 4.2 3.7 3.4 3.8 3.8 3.3 4.2 3.3 3.8 4.3 4.3 2.3 3.9 3.3 2.8 3.7 4.5 2

3

4

5

Internal Medicine/Pediatrics Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure IMP-3

Percentage of Programs That Use USMLE Step 1 Score Scores required?

Would your program consider applicants who fail the exam on the first attempt?

N=34

100%

90%

76%

80%

80%

70%

60%

50%

50%

40%

40%

24%

29%

30%

20%

20%

10% 0%

71%

70%

60%

30%

N=31

100%

90%

10%

0% Yes, pass only

Yes, target score

0%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score Would your program consider applicants who fail the exam on the first attempt?

Scores required? N=33

N=27

100%

100%

90%

90%

80%

80%

70%

70%

58%

60%

60%

50% 40% 30%

50% 40%

30%

30%

20%

20%

12%

10%

10%

0%

0% Yes, pass only

52%

48%

Yes, target score

No

Never

0% often

Seldom

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews Scores Below Which Programs Generally Do Not Grant Interviews

Scores Above Which Programs Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=23

N=18

N=20

USMLE Step 2 CK N=14

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean. NRMP Program Director Survey Results, 2014

47

Internal Medicine/Pediatrics Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure IMP-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores USMLE Step 2 CS

USMLE Step 3

N=32

100%

88%

90%

90%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

30%

20%

0%

10%

Yes

79%

16%

20%

13%

N=32

10%

N=19

100%

0%

No

N=19

5% Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores COMLEX-USA Level 1* 100%

COMLEX-USA Level 2-CE* 100%

N=22

90%

90%

80%

80%

70%

70%

64%

60%

60%

50%

50%

40%

40%

30%

50% 32%

30%

23%

20%

14%

18%

20% 10%

10% 0%

N=22

Yes, pass only

Yes, target score

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores COMLEX-USA Level 2-PE* 100%

COMLEX-USA Level 3* 100%

N=21

90%

90%

80%

80%

70%

70%

60%

57%

50%

40%

40%

30%

24%

20%

30%

19%

Yes, target score

0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

20%

20% 10%

10% Yes, pass only

73%

60%

50%

0%

N=15

48

7% Yes, pass only

Yes, target score

No

Figure IMP-5

Internal Medicine/Pediatrics Program's Interview Activities

Average Number of Positions, Applications Received, Interview Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and Reviewed

1,000

100%

900

90%

800

80%

700

70%

600

60%

500

42%

400

40%

300

245

30%

200

20%

100 0

48%

50%

69

53

49

Number of interview invitations sent

Number of applicants interviewed

Number of applicants ranked

10%

5 Number of positions in the Match

N=35*

Number of applications received

N=34

N=35

N=35

0%

Percentage of applications rejected

N=35*

Percentage of applicants receiving an in-depth review

N=34

N=34

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type 15% of Internal Medicine/Pediatrics programs consider all applicant groups 100% N=34

90% 80% 70%

62%

60% 47%

50% 40%

35%

35% 26%

30%

21%

20% 10% 0% U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic Physician

Canadian

49

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Neurological Surgery (N=55)

NRMP Program Director Survey Results, 2014

50

Figure NS-1

Neurological Surgery Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview (N=54) Percent Citing Factor

USMLE Step 1/COMLEX Level 1 score

Average Rating

93%

4.4

Letters of recommendation in the specialty 98% Medical Student Performance Evaluation (MSPE/Dean's Letter) USMLE Step 2 CK/COMLEX Level 2 CE score Personal Statement Graduate of U.S. allopathic medical school

4.7

81%

3.8

65%

4.0

78%

3.7

72%

4.3

Grades in required clerkships

59%

Gaps in medical education

61%

Honors in clinical clerkships Perceived commitment to specialty

Leadership qualities

4.6 59%

3.9

74%

4.5

63%

4.3 4.2

67%

4.3

74%

Honors in clerkship in desired specialty

4.3

61%

Grades in clerkship in desired specialty Alpha Omega Alpha (AOA) membership

4.2

80%

Personal prior knowledge of the applicant Audition elective/rotation within your department

3.9

69%

Class ranking/quartile Evidence of professionalism and ethics

4.3

4.3

44% 3.8

81%

Pass USMLE Step2 CS/COMLEX Lvl2 PE

3.9

39%

Perceived interest in program

61%

Consistency of grades

61%

4.3 4.0

Other life experience

57%

3.6

Volunteer/extracurricular experiences

56%

3.5

Graduate of highly regarded U.S. medical school Demonstrated involvement and interest in research

3.8

65%

4.1

80%

Visa status* Applicant was flagged with Match violation by the NRMP Interest in academic career

4.1

59%

NRMP Program Director Survey Results, 2014

51

3.4

15%

3.9

56% 20%

Fluency in language spoken by your patient population

¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

3.4

41%

Gold Society membership

USMLE/COMLEX Step 3 score 100%

4.6

22%

Honors in basic sciences Away rotation in your specialty at another institution

4.0

39%

3.7

4% 50%

0% 1

2

3

4.5 4

5

Figure NS-2

Neurological Surgery Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants (N=54) Percent Citing Factor

Interactions with faculty during interview and visit 94% Interpersonal skills 85% Interactions with house staff during interview and visit 87% Feedback from current residents 85% USMLE Step 1/COMLEX Level 1 score 70% Letters of recommendation in the specialty 89% USMLE Step 2 CK/COMLEX Level 2 CE score 44% Medical Student Performance Evaluation (MSPE/Dean's Letter) 70% Perceived commitment to specialty 78% Evidence of professionalism and ethics 74% Perceived interest in program 74% Leadership qualities 65% Personal prior knowledge of the applicant 56% Class ranking/quartile 33% Graduate of U.S. allopathic medical school 46% Personal Statement 56% Audition elective/rotation within your department 65% Grades in required clerkships 43% Passing USMLE Step 2 CS/COMLEX Level 2 PE 26% Honors in clinical clerkships 50% Honors in clerkship in desired specialty 43% Gaps in medical education 28% Grades in clerkship in desired specialty 39% Alpha Omega Alpha (AOA) membership 48% Other life experience 31% Consistency of grades 37% Volunteer/extracurricular experiences 33% Demonstrated involvement and interest in research 63% Graduate of highly regarded U.S. medical school 43% Other post‐interview contact 46% Interest in academic career 52% Visa status* 20% Applicant was flagged with Match violation by the NRMP 13% Fluency in language spoken by your patient population 13% Gold Society membership 6% Honors in basic sciences 19% Second interview/visit 31% Away rotation in your specialty at another institution 37% USMLE/COMLEX Step 3 score 2% 100% 50% 0% 1 ¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

52

Average Rating

4.8 4.8 4.9 4.7 4.4 4.5 4.2 3.5 4.5 4.6 4.4 4.4 4.6 3.6 4.3 3.8 4.6 3.8 4.1 4.0 4.0 3.9 4.0 4.0 3.9 4.0 3.9 4.1 4.0 4.2 4.2 3.5 4.6 3.7 3.3 3.4 3.9 3.9 5.0 2

3

4

5

Neurological Surgery Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure NS-3

Percentage of Programs That Use USMLE Step 1 Score Scores required?

Would your program consider applicants who fail the exam on the first attempt?

N=52

100%

90%

79%

80%

80%

70%

70%

60%

50%

40%

42%

40%

30%

30%

19%

20%

10% 0%

58%

60%

50%

20%

N=48

100%

90%

10%

2% Yes, pass only

Yes, target score

0%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score Would your program consider applicants who fail the exam on the first attempt?

Scores required? N=47

N=33

100%

100%

90%

90%

80%

80%

70%

70%

60%

60%

47%

50% 40%

50%

39%

40%

32%

30%

30%

21%

20%

20%

10%

10%

0%

0% Yes, pass only

61%

Yes, target score

No

Never

0% often

Seldom

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews Scores Below Which Programs Generally Do Not Grant Interviews

Scores Above Which Programs Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=35

N=19

N=24

USMLE Step 2 CK N=13

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean. NRMP Program Director Survey Results, 2014

53

Neurological Surgery Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure NS-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores USMLE Step 2 CS

USMLE Step 3

N=46

100%

N=28

100% 90%

90%

76%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

30%

24%

20%

75%

21%

20%

N=46

10% 0%

N=28

10%

Yes

0%

No

Yes, pass only

4%

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores COMLEX-USA Level 1* 100%

COMLEX-USA Level 2-CE* 100%

N=17

90%

90%

80%

80%

70%

65%

78%

70%

60%

60%

50%

50%

40%

40%

30%

N=18

30%

24%

20%

20%

12%

10%

10%

0%

0%

Yes, pass only

Yes, target score

No

17% 6% Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores COMLEX-USA Level 2-PE* 100%

COMLEX-USA Level 3* 100%

N=17

90%

82%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

18%

20% 10%

10% 0%

94%

30%

30% 20%

N=16

90%

0% Yes, pass only

Yes, target score

0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

54

6% 0% Yes, pass only

Yes, target score

No

Neurological Surgery Program's Interview Activities

Figure NS-5

Average Number of Positions, Applications Received, Interview Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and Reviewed

1,000

100%

900

90%

800

80%

700

70%

600 500

50%

400

40%

40%

300

30%

202

200

20%

100 0

57%

60%

50

38

27

Number of interview invitations sent

Number of applicants interviewed

Number of applicants ranked

2 Number of positions in the Match

Number of applications received

N=55*

N=53

N=53

N=53

10% 0%

Percentage of applications rejected

N=55*

Percentage of applicants receiving an in-depth review

N=52

N=53

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type 21% of Neurological Surgery programs consider all applicant groups

96%

N=53

90% 80% 70% 60%

53%

50% 40%

40% 26%

30%

40%

42%

U.S. IMG

Non-U.S. IMG

23%

20% 10% 0% U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic Physician

Canadian

55

Fifth Pathway

Neurology (N=60)

NRMP Program Director Survey Results, 2014

56

Figure N-1

Neurology Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview (N=59) Percent Citing Factor

USMLE Step 1/COMLEX Level 1 score

90%

Letters of recommendation in the specialty

92%

Medical Student Performance Evaluation (MSPE/Dean's Letter) USMLE Step 2 CK/COMLEX Level 2 CE score

4.0 4.3

85%

4.2

75%

4.0

Personal Statement

71%

Graduate of U.S. allopathic medical school

71%

Grades in required clerkships Gaps in medical education Honors in clinical clerkships Perceived commitment to specialty Class ranking/quartile

3.7 4.2

63%

4.2

76%

4.1

61%

4.1

71%

4.2

75%

4.0

Evidence of professionalism and ethics

63%

Personal prior knowledge of the applicant

63%

Audition elective/rotation within your department

4.3 4.0 4.0

59%

Leadership qualities

56%

Honors in clerkship in desired specialty

58%

Grades in clerkship in desired specialty Alpha Omega Alpha (AOA) membership Pass USMLE Step2 CS/COMLEX Lvl2 PE Perceived interest in program Consistency of grades

Graduate of highly regarded U.S. medical school Demonstrated involvement and interest in research

4.1 4.1 4.0

56% 3.4

44%

3.4

53%

3.9

58%

3.3

49%

4.0

39%

4.7

34% 3.3

39%

Honors in basic sciences

3.4

22%

Gold Society membership

3.6

31%

Away rotation in your specialty at another institution

3.5

22% 27%

Fluency in language spoken by your patient population

57

3.9

49%

Interest in academic career

NRMP Program Director Survey Results, 2014

4.4

64%

Applicant was flagged with Match violation by the NRMP

¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

4.2

56%

Visa status*

USMLE/COMLEX Step 3 score 100%

3.9

61%

Other life experience Volunteer/extracurricular experiences

Average Rating

3.4 3.7

25% 50%

0% 1

2

3

4

5

Figure N-2

Neurology Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants (N=59) Percent Citing Factor

Interactions with faculty during interview and visit 97% Interpersonal skills 98% Interactions with house staff during interview and visit 93% Feedback from current residents 73% USMLE Step 1/COMLEX Level 1 score 80% Letters of recommendation in the specialty 81% USMLE Step 2 CK/COMLEX Level 2 CE score 68% Medical Student Performance Evaluation (MSPE/Dean's Letter) 73% Perceived commitment to specialty 75% Evidence of professionalism and ethics 61% Perceived interest in program 56% Leadership qualities 59% Personal prior knowledge of the applicant 61% Class ranking/quartile 68% Graduate of U.S. allopathic medical school 51% Personal Statement 54% Audition elective/rotation within your department 47% Grades in required clerkships 49% Passing USMLE Step 2 CS/COMLEX Level 2 PE 53% Honors in clinical clerkships 49% Honors in clerkship in desired specialty 47% Gaps in medical education 47% Grades in clerkship in desired specialty 46% Alpha Omega Alpha (AOA) membership 44% Other life experience 41% Consistency of grades 46% Volunteer/extracurricular experiences 37% Demonstrated involvement and interest in research 44% Graduate of highly regarded U.S. medical school 44% Other post‐interview contact 37% Interest in academic career 39% Visa status* 22% Applicant was flagged with Match violation by the NRMP 22% Fluency in language spoken by your patient population 25% Gold Society membership 25% Honors in basic sciences 20% 22% Second interview/visit 20% Away rotation in your specialty at another institution 19% USMLE/COMLEX Step 3 score 0% 1 100% 50% ¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

58

Average Rating

4.9 4.8 4.7 4.5 3.9 4.2 3.8 4.1 4.3 4.4 4.0 4.1 4.2 4.1 4.1 3.6 4.1 4.0 4.0 4.0 4.2 4.1 4.2 4.1 3.5 4.0 3.3 3.3 4.0 4.0 3.6 3.8 4.7 3.7 3.9 3.4 4.0 3.9 4.0 2

3

4

5

Neurology Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure N-3

Percentage of Programs That Use USMLE Step 1 Score Scores required?

Would your program consider applicants who fail the exam on the first attempt?

N=58

100%

90%

80%

70%

60%

60%

60%

50%

50%

40%

40%

30%

30%

20%

20%

10% 0%

76%

80%

70%

40%

N=51

100%

90%

10%

0% Yes, pass only

Yes, target score

22% 2%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score Would your program consider applicants who fail the exam on the first attempt?

Scores required? N=58

N=49

100%

100%

90%

90%

80%

80%

70%

70%

60% 40%

60%

50%

50%

50% 40%

34%

30%

30%

16%

20%

10%

0%

0% Yes, target score

24%

20%

10% Yes, pass only

73%

No

2% Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews Scores Below Which Programs Generally Do Not Grant Interviews

Scores Above Which Programs Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=28

N=23

N=20

USMLE Step 2 CK N=16

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean. NRMP Program Director Survey Results, 2014

59

Neurology Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure N-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores USMLE Step 2 CS

USMLE Step 3

N=57

100%

N=40

100% 90%

90%

77%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

30%

23%

20%

20%

N=57

10% 0%

68%

20% 13%

N=40

10%

Yes

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores COMLEX-USA Level 1* 100%

COMLEX-USA Level 2-CE* 100%

N=41

90%

90%

80%

80%

70%

70%

60%

60%

51%

50%

50%

40%

40%

30%

27%

22%

30%

20%

20%

10%

10%

0%

Yes, pass only

Yes, target score

N=40

0%

No

40%

38%

Yes, target score

No

23%

Yes, pass only

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores COMLEX-USA Level 2-PE* 100%

COMLEX-USA Level 3* 100%

N=36

90%

90%

80%

80%

70%

70%

47%

50%

50% 40%

40%

28%

30%

25%

20%

20%

10%

10%

0%

68%

60%

60%

30%

N=28

Yes, pass only

Yes, target score

0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

60

25% 7% Yes, pass only

Yes, target score

No

Neurology Program's Interview Activities

Figure N-5

Average Number of Positions, Applications Received, Interview Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and Reviewed

1,000

100%

900

90%

800

80%

700

70%

600

60%

500 400

50%

Percentage of applications rejected

Percentage of applicants receiving an in-depth review

40%

300

30%

200

20%

100 0

48%

50%

443

73

59

51

Number of interview invitations sent

Number of applicants interviewed

Number of applicants ranked

10%

5 Number of positions in the Match

Number of applications received

N=60*

N=60

N=59

N=59

0%

N=60*

N=59

N=60

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type 53% of Neurology programs consider all applicant groups

97%

N=59

90%

81%

80%

80%

71%

70%

85%

71%

60%

53%

50% 40% 30% 20% 10% 0% U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic Physician

Canadian

61

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Obstetrics and Gynecology (N=123)

NRMP Program Director Survey Results, 2014

62

Figure OG-1

Obstetrics and Gynecology Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview (N=117) Percent Citing Factor

Average Rating

USMLE Step 1/COMLEX Level 1 score 97% Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's Letter) USMLE Step 2 CK/COMLEX Level 2 CE score Personal Statement Graduate of U.S. allopathic medical school Grades in required clerkships

4.2

92%

4.1

76%

3.9

84%

4.1

81%

3.5

68%

4.2

75%

4.1

Gaps in medical education

72%

4.2

Honors in clinical clerkships

72%

4.2

Perceived commitment to specialty Class ranking/quartile Evidence of professionalism and ethics Personal prior knowledge of the applicant Audition elective/rotation within your department

58% 72%

4.0

64%

4.1 3.9

62% 65%

Honors in clerkship in desired specialty

67%

Grades in clerkship in desired specialty

62%

Alpha Omega Alpha (AOA) membership

62%

Perceived interest in program

4.4

69%

Leadership qualities

Pass USMLE Step2 CS/COMLEX Lvl2 PE

4.0 4.4 4.4 3.7 4.0

57%

4.0

50%

Consistency of grades

57%

Other life experience

57%

Volunteer/extracurricular experiences

4.2

4.0 3.6 3.7

51%

Graduate of highly regarded U.S. medical school

3.6

38%

Demonstrated involvement and interest in research

3.6

43%

Visa status*

33%

Applicant was flagged with Match violation by the NRMP

33%

4.2 4.8

Interest in academic career

22%

Honors in basic sciences

21%

Gold Society membership

NRMP Program Director Survey Results, 2014

63

3.6 3.7

13% 21%

Fluency in language spoken by your patient population

¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

3.2

35%

Away rotation in your specialty at another institution USMLE/COMLEX Step 3 score 100%

3.5

3.5

14% 50%

0% 1

2

3.7 3 4

5

Figure OG-2

Obstetrics and Gynecology Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants (N=117) Percent Citing Factor

Interactions with faculty during interview and visit 96% Interpersonal skills 91% Interactions with house staff during interview and visit 91% Feedback from current residents 86% USMLE Step 1/COMLEX Level 1 score 79% Letters of recommendation in the specialty 72% USMLE Step 2 CK/COMLEX Level 2 CE score 74% Medical Student Performance Evaluation (MSPE/Dean's Letter) 58% Perceived commitment to specialty 67% Evidence of professionalism and ethics 61% Perceived interest in program 57% Leadership qualities 60% Personal prior knowledge of the applicant 60% Class ranking/quartile 53% Graduate of U.S. allopathic medical school 54% Personal Statement 49% Audition elective/rotation within your department 53% Grades in required clerkships 46% Passing USMLE Step 2 CS/COMLEX Level 2 PE 45% Honors in clinical clerkships 48% Honors in clerkship in desired specialty 54% Gaps in medical education 42% Grades in clerkship in desired specialty 46% Alpha Omega Alpha (AOA) membership 47% Other life experience 42% Consistency of grades 36% Volunteer/extracurricular experiences 34% Demonstrated involvement and interest in research 28% Graduate of highly regarded U.S. medical school 29% Other post‐interview contact 35% Interest in academic career 20% Visa status* 16% Applicant was flagged with Match violation by the NRMP 17% Fluency in language spoken by your patient population 15% Gold Society membership 25% Honors in basic sciences 12% Second interview/visit 22% Away rotation in your specialty at another institution 10% USMLE/COMLEX Step 3 score 11% 0% 1 100% 50% ¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

64

Average Rating

4.8 4.8 4.8 4.7 4.1 3.9 4.0 3.7 4.2 4.5 4.2 4.2 4.1 3.9 4.1 3.4 4.2 4.0 4.2 4.1 4.1 4.2 4.0 4.0 3.7 4.0 3.6 3.7 4.1 4.0 3.7 3.9 4.7 3.8 3.9 3.1 3.5 3.6 4.2 2

3

4

5

Obstetrics and Gynecology Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure OG-3

Percentage of Programs That Use USMLE Step 1 Score Scores required?

Would your program consider applicants who fail the exam on the first attempt?

N=114

100%

80%

90%

75%

80%

70%

60%

50%

50%

40%

40%

25%

30%

20%

19%

20%

10% 0%

75%

70%

60%

30%

N=104

100%

90%

Yes, pass only

Yes, target score

6%

10%

0%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score Would your program consider applicants who fail the exam on the first attempt?

Scores required? N=112

N=97

100%

100%

90%

90%

80%

80%

70%

70%

60%

54%

60%

50%

50%

40% 30%

40%

27%

30%

19%

20%

20%

6%

10%

10% 0%

53% 41%

0% Yes, pass only

Yes, target score

No

Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews Scores Below Which Programs Generally Do Not Grant Interviews

Scores Above Which Programs Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=71

N=46

N=50

USMLE Step 2 CK N=34

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean. NRMP Program Director Survey Results, 2014

65

Obstetrics and Gynecology Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure OG-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores USMLE Step 2 CS

USMLE Step 3

N=109

100%

N=60

100% 90%

90%

79%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

30%

21%

20%

0%

23%

20%

N=109

10%

72%

N=60 5%

10%

Yes

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores COMLEX-USA Level 1* 100%

COMLEX-USA Level 2-CE* 100%

N=72

90%

90%

80%

80%

70%

70% 60%

60%

50%

50%

50%

29% 21%

20%

30%

35% 25%

20% 10%

10% 0%

41%

40%

40% 30%

N=69

Yes, pass only

Yes, target score

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores COMLEX-USA Level 2-PE* 100%

COMLEX-USA Level 3* 100%

N=63

90%

90%

80%

80%

70%

70%

60%

60%

50%

44%

44%

40%

30%

30%

10% 0%

20%

11% Yes, pass only

Yes, target score

20%

10% 0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

76%

50%

40% 20%

N=45

66

4% Yes, pass only

Yes, target score

No

Obstetrics and Gynecology Program's Interview Activities

Figure OG-5

Average Number of Positions, Applications Received, Interview Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and Reviewed

1,000

100%

900

90%

800

80%

700

70%

600

60%

52%

500

50%

425 400 300

30%

200

20%

89

100 0

44%

40%

72

63

Number of applicants interviewed

Number of applicants ranked

10%

5 Number of positions in the Match

N=123*

Number of applications received

N=122

Number of interview invitations sent

N=119

N=122

0%

Percentage of applications rejected

N=123*

Percentage of applicants receiving an in-depth review

N=117

N=122

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type 15% of Obstetrics and Gynecology programs consider all applicant groups

97%

N=116

90% 80%

75%

70% 60%

54% 48%

50% 40%

34%

30%

30% 18%

20% 10% 0% U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic Physician

Canadian

67

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Orthopaedic Surgery (N=87)

NRMP Program Director Survey Results, 2014

68

Figure OS-1

Orthopaedic Surgery Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview (N=85) Percent Citing Factor

USMLE Step 1/COMLEX Level 1 score

95%

Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's Letter)

4.4

92%

4.2

79%

USMLE Step 2 CK/COMLEX Level 2 CE score

82%

Graduate of U.S. allopathic medical school

81%

Grades in required clerkships

4.0

64%

Personal Statement

Honors in clinical clerkships

4.5

74%

4.2 52%

Evidence of professionalism and ethics Personal prior knowledge of the applicant

4.3 53%

Honors in clerkship in desired specialty

4.2

75%

4.5

67%

4.4 4.6

64%

4.1

74%

4.5

69%

Grades in clerkship in desired specialty Alpha Omega Alpha (AOA) membership

4.1

72%

Audition elective/rotation within your department Leadership qualities

3.8

87%

Perceived commitment to specialty Class ranking/quartile

4.0 3.3

Gaps in medical education

4.4

58%

3.9

84%

Pass USMLE Step2 CS/COMLEX Lvl2 PE Perceived interest in program Other life experience

64%

4.2 3.6 3.6

59%

Graduate of highly regarded U.S. medical school Demonstrated involvement and interest in research

3.9

55% 66%

Volunteer/extracurricular experiences

3.9

46%

3.7

69%

Visa status*

19%

Applicant was flagged with Match violation by the NRMP

20%

Interest in academic career

3.8 3.8

12%

Away rotation in your specialty at another institution

32%

Fluency in language spoken by your patient population

9%

69

4.8

40%

Gold Society membership

NRMP Program Director Survey Results, 2014

4.0

25%

Honors in basic sciences

USMLE/COMLEX Step 3 score 100%

3.6

19%

Consistency of grades

¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

Average Rating

3.4 3.7 3.9

0% 50%

0% 1

2

3

4

5

Figure OS-2

Orthopaedic Surgery Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants (N=85) Percent Citing Factor

Interactions with faculty during interview and visit 89% Interpersonal skills 88% Interactions with house staff during interview and visit 86% Feedback from current residents 82% USMLE Step 1/COMLEX Level 1 score 70% Letters of recommendation in the specialty 73% USMLE Step 2 CK/COMLEX Level 2 CE score 48% Medical Student Performance Evaluation (MSPE/Dean's Letter) 57% Perceived commitment to specialty 46% Evidence of professionalism and ethics 64% Perceived interest in program 57% Leadership qualities 57% Personal prior knowledge of the applicant 54% Class ranking/quartile 50% Graduate of U.S. allopathic medical school 61% Personal Statement 46% Audition elective/rotation within your department 62% Grades in required clerkships 48% Passing USMLE Step 2 CS/COMLEX Level 2 PE 11% Honors in clinical clerkships 52% Honors in clerkship in desired specialty 48% Gaps in medical education 33% Grades in clerkship in desired specialty 37% Alpha Omega Alpha (AOA) membership 55% Other life experience 39% Consistency of grades 38% Volunteer/extracurricular experiences 38% Demonstrated involvement and interest in research 48% Graduate of highly regarded U.S. medical school 30% Other post‐interview contact 15% Interest in academic career 23% Visa status* 10% Applicant was flagged with Match violation by the NRMP 12% 2% Fluency in language spoken by your patient population Gold Society membership 11% Honors in basic sciences 25% Second interview/visit 12% Away rotation in your specialty at another institution 21% USMLE/COMLEX Step 3 score 1% 100% 50% 0% 1 ¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

70

Average Rating

4.6 4.6 4.6 4.6 4.2 4.3 4.0 3.9 4.1 4.5 4.0 4.1 4.5 4.0 4.4 3.5 4.7 4.0 4.3 4.1 4.1 4.0 4.2 3.9 3.7 4.0 3.7 3.9 4.0 3.9 3.9 4.0 4.7 3.0 3.8 3.6 3.7 3.5 4.0 2

3

4

5

Orthopaedic Surgery Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure OS-3

Percentage of Programs That Use USMLE Step 1 Score Scores required? N=84

100%

Would your program consider applicants who fail the exam on the first attempt?

93%

90%

80%

80%

70%

70%

60%

50%

40%

37%

40%

30%

30%

20%

0%

61%

60%

50%

10%

N=71

100%

90%

20%

7%

10%

0% Yes, pass only

Yes, target score

3%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score Would your program consider applicants who fail the exam on the first attempt?

Scores required? N=75

N=55

100%

100%

90%

90%

80%

80%

70%

70%

60%

60%

52%

50%

50%

40% 30% 20%

65%

40%

28% 20%

20%

10%

10%

0%

0% Yes, pass only

33%

30%

Yes, target score

No

2% Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews Scores Below Which Programs Generally Do Not Grant Interviews

Scores Above Which Programs Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=65

N=30

N=27

USMLE Step 2 CK N=15

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean. NRMP Program Director Survey Results, 2014

71

Orthopaedic Surgery Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure OS-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores USMLE Step 2 CS

USMLE Step 3

N=65

100%

N=41

100% 90%

90%

80%

80%

66%

70% 60%

60%

50%

50%

40%

40%

34%

30%

30%

20%

20%

N=65

10% 0%

73%

70%

22%

N=41 5%

10%

Yes

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores COMLEX-USA Level 1* 100%

COMLEX-USA Level 2-CE* 100%

N=27

90%

90%

80%

80%

74%

70%

70%

60%

60%

50%

50%

40%

40%

19%

20%

0%

84%

30%

30%

10%

N=25

20%

7%

10%

Yes, pass only

Yes, target score

0%

No

8%

8%

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores COMLEX-USA Level 2-PE* 100%

COMLEX-USA Level 3* 100%

N=26

88%

90% 80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

30%

0%

92%

20%

20% 10%

N=26

90%

8% Yes, pass only

10%

4% Yes, target score

0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

72

4%

4%

Yes, pass only

Yes, target score

No

Figure OS-5

Orthopaedic Surgery Program's Interview Activities

Average Number of Positions, Applications Received, Interview Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and Reviewed

1,000

100%

900

90%

800

80%

700

70%

600

549

60%

500

50%

400

40%

300

30%

200

20%

100 0

49%

46%

72

59

51

Number of interview invitations sent

Number of applicants interviewed

Number of applicants ranked

10%

5 Number of positions in the Match

N=87*

Number of applications received

N=84

N=83

N=83

0%

Percentage of applications rejected

N=87*

Percentage of applicants receiving an in-depth review

N=81

N=84

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type 13% of Orthopaedic Surgery programs consider all applicant groups 99% N=83

90% 80% 70% 60%

51%

50% 40%

27%

30%

23%

20%

20%

16%

14%

10% 0% U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic Physician

Canadian

73

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Otolaryngology (N=46)

NRMP Program Director Survey Results, 2014

74

Figure O-1

Otolaryngology Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview (N=46) Percent Citing Factor

Average Rating

USMLE Step 1/COMLEX Level 1 score 98%

4.3

Letters of recommendation in the specialty 100% Medical Student Performance Evaluation (MSPE/Dean's Letter)

4.6 74%

USMLE Step 2 CK/COMLEX Level 2 CE score Personal Statement

59%

Perceived commitment to specialty

4.2

61%

3.6

85%

4.4 67%

4.3

59%

Evidence of professionalism and ethics

4.0

65%

4.4

70%

Audition elective/rotation within your department

4.4 4.3

63%

Leadership qualities

76%

Honors in clerkship in desired specialty

76%

Grades in clerkship in desired specialty Alpha Omega Alpha (AOA) membership

4.4

74%

Class ranking/quartile Personal prior knowledge of the applicant

3.7

67%

Gaps in medical education Honors in clinical clerkships

4.0

74%

Graduate of U.S. allopathic medical school Grades in required clerkships

3.5

4.4 4.6 4.5

61%

4.0

83%

Pass USMLE Step2 CS/COMLEX Lvl2 PE Perceived interest in program

4.2

46%

Other life experience

3.7

59%

3.8

72%

Graduate of highly regarded U.S. medical school Demonstrated involvement and interest in research

4.3

54%

Consistency of grades Volunteer/extracurricular experiences

4.1

20%

3.9

48%

4.3

80%

Visa status*

4.0

17% 24%

Applicant was flagged with Match violation by the NRMP

4.8 4.2

Interest in academic career

35%

Honors in basic sciences

33% 17%

3.7

39% 13%

3.8

Gold Society membership Away rotation in your specialty at another institution Fluency in language spoken by your patient population USMLE/COMLEX Step 3 score 100% ¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

75

3.9 2.8

4% 50%

0% 1

2

4.0 3 4

5

Figure O-2

Otolaryngology Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants (N=46) Percent Citing Factor

Interactions with faculty during interview and visit 96% Interpersonal skills 96% Interactions with house staff during interview and visit 96% Feedback from current residents 96% USMLE Step 1/COMLEX Level 1 score 71% Letters of recommendation in the specialty 80% USMLE Step 2 CK/COMLEX Level 2 CE score 31% Medical Student Performance Evaluation (MSPE/Dean's Letter) 38% Perceived commitment to specialty 60% Evidence of professionalism and ethics 64% Perceived interest in program 53% Leadership qualities 73% Personal prior knowledge of the applicant 56% Class ranking/quartile 40% Graduate of U.S. allopathic medical school 44% Personal Statement 42% Audition elective/rotation within your department 53% Grades in required clerkships 40% Passing USMLE Step 2 CS/COMLEX Level 2 PE 4% Honors in clinical clerkships 53% Honors in clerkship in desired specialty 51% Gaps in medical education 33% Grades in clerkship in desired specialty 44% Alpha Omega Alpha (AOA) membership 49% Other life experience 40% Consistency of grades 22% Volunteer/extracurricular experiences 42% Demonstrated involvement and interest in research 64% Graduate of highly regarded U.S. medical school 20% Other post‐interview contact 20% Interest in academic career 33% Visa status* 7% Applicant was flagged with Match violation by the NRMP 18% 7% Fluency in language spoken by your patient population 16% Gold Society membership Honors in basic sciences 20% Second interview/visit 2% Away rotation in your specialty at another institution 20% USMLE/COMLEX Step 3 score 2% 100% 50% 0% 1 ¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

76

Average Rating

4.9 4.8 4.8 4.7 3.7 4.3 3.7 3.7 4.5 4.2 4.3 4.3 4.7 3.9 4.5 3.6 4.3 4.1 4.0 4.2 4.2 3.4 4.1 3.7 3.8 3.6 4.1 4.2 4.1 4.3 4.2 4.0 4.8 2.5 3.4 3.0 5.0 3.9 3.0 2

3

4

5

Otolaryngology Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure O-3

Percentage of Programs That Use USMLE Step 1 Score Scores required?

Would your program consider applicants who fail the exam on the first attempt?

N=46

100%

80%

80%

90% 80%

70%

70%

60%

60%

50%

45%

40%

30%

30%

20%

20%

10% 0%

55%

50%

40%

20%

N=40

100%

90%

10%

0% Yes, pass only

Yes, target score

0%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score Would your program consider applicants who fail the exam on the first attempt?

Scores required? N=42

N=27

100%

100%

90%

90%

80%

80%

70%

70%

60%

60%

50%

50%

38%

40% 30%

67%

40%

33%

29%

20%

20%

10%

10%

0%

0% Yes, pass only

33%

30%

Yes, target score

No

0% Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews Scores Below Which Programs Generally Do Not Grant Interviews

Scores Above Which Programs Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=32

N=14

N=15

USMLE Step 2 CK N=8

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean. NRMP Program Director Survey Results, 2014

77

Otolaryngology Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure O-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores USMLE Step 2 CS

USMLE Step 3

N=39

100%

N=28

100%

90%

90%

80%

80%

70%

70%

62%

60%

75%

60%

50%

50%

38%

40%

40%

30%

30%

20%

20%

N=39

10% 0%

14%

N=28 11%

10%

Yes

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores COMLEX-USA Level 1* 100%

COMLEX-USA Level 2-CE* 100%

N=19

80%

74%

70%

60%

60%

50%

50%

40%

40% 30%

30%

16%

20%

11%

10% 0%

79%

80%

70%

20%

N=19

90%

90%

Yes, pass only

Yes, target score

16%

10% 0%

No

5% Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores COMLEX-USA Level 2-PE* 100%

COMLEX-USA Level 3* 100%

N=19

90%

79%

80%

70%

60%

60%

50%

50%

40%

40%

30%

30% 20%

16%

10% 0%

94%

80%

70%

20%

N=16

90%

10%

5% Yes, pass only

Yes, target score

0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

78

6% 0% Yes, pass only

Yes, target score

No

Figure O-5

Otolaryngology Program's Interview Activities

Average Number of Positions, Applications Received, Interview Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and Reviewed

1,000

100%

900

90%

800

80%

700 600

60%

500

50%

400

40%

312

31%

300

30%

200

20%

100 0

67%

70%

46

37

35

Number of interview invitations sent

Number of applicants interviewed

Number of applicants ranked

3 Number of positions in the Match

N=46*

Number of applications received

N=45

N=45

N=45

10% 0%

Percentage of applications rejected

N=46*

Percentage of applicants receiving an in-depth review

N=45

N=45

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type 24% of Otolaryngology programs consider all applicant groups 98% N=46

90% 80% 70%

70% 60% 50%

37%

40% 30%

28%

28%

Osteopathic Physician

Canadian

28%

24%

20% 10% 0% U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

79

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Pathology (N=84)

NRMP Program Director Survey Results, 2014

80

Figure PA-1

Pathology Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview (N=84) Percent Citing Factor

USMLE Step 1/COMLEX Level 1 score

Average Rating

94%

4.3

Letters of recommendation in the specialty 98%

4.5

Medical Student Performance Evaluation (MSPE/Dean's Letter)

83%

4.0

USMLE Step 2 CK/COMLEX Level 2 CE score

86%

4.0

Personal Statement

83%

Graduate of U.S. allopathic medical school

68%

Grades in required clerkships

4.0

60%

Gaps in medical education

3.8

75%

Honors in clinical clerkships Perceived commitment to specialty

3.8

4.1 57%

3.5

93%

Class ranking/quartile Evidence of professionalism and ethics Personal prior knowledge of the applicant Audition elective/rotation within your department

4.6 57% 63%

Grades in clerkship in desired specialty

Perceived interest in program Consistency of grades

4.1 3.9

64%

3.9

54%

4.1

58%

4.1

68%

Alpha Omega Alpha (AOA) membership Pass USMLE Step2 CS/COMLEX Lvl2 PE

4.4

57%

Leadership qualities Honors in clerkship in desired specialty

3.8

3.6

54%

4.0

71%

4.4

67%

4.0

58%

Other life experience

39%

3.5

Volunteer/extracurricular experiences

40%

3.5

Graduate of highly regarded U.S. medical school

61%

Demonstrated involvement and interest in research

60%

4.1 3.7

Visa status*

46%

Applicant was flagged with Match violation by the NRMP

45%

Interest in academic career

Fluency in language spoken by your patient population

81

3.8 3.3

8%

Away rotation in your specialty at another institution

NRMP Program Director Survey Results, 2014

4.2

42%

Gold Society membership

¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

4.8

35%

Honors in basic sciences

USMLE/COMLEX Step 3 score 100%

3.9

50%

42% 26%

3.6

36%

3.5 3

0% 1

4.3 2

4

5

Figure PA-2

Pathology Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants (N=84) Percent Citing Factor

Interactions with faculty during interview and visit 95% Interpersonal skills 93% Interactions with house staff during interview and visit 89% Feedback from current residents 89% USMLE Step 1/COMLEX Level 1 score 89% Letters of recommendation in the specialty 85% USMLE Step 2 CK/COMLEX Level 2 CE score 79% Medical Student Performance Evaluation (MSPE/Dean's Letter) 65% Perceived commitment to specialty 82% Evidence of professionalism and ethics 64% Perceived interest in program 71% Leadership qualities 42% Personal prior knowledge of the applicant 54% Class ranking/quartile 52% Graduate of U.S. allopathic medical school 60% Personal Statement 55% Audition elective/rotation within your department 54% Grades in required clerkships 37% Passing USMLE Step 2 CS/COMLEX Level 2 PE 61% Honors in clinical clerkships 35% Honors in clerkship in desired specialty 36% Gaps in medical education 46% Grades in clerkship in desired specialty 40% Alpha Omega Alpha (AOA) membership 31% Other life experience 25% Consistency of grades 37% Volunteer/extracurricular experiences 21% Demonstrated involvement and interest in research 45% Graduate of highly regarded U.S. medical school 40% Other post‐interview contact 40% Interest in academic career 37% Visa status* 31% Applicant was flagged with Match violation by the NRMP 30% Fluency in language spoken by your patient population 27% Gold Society membership 2% Honors in basic sciences 27% Second interview/visit 21% Away rotation in your specialty at another institution 19% USMLE/COMLEX Step 3 score 31% 0% 1 100% 50% ¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

82

Average Rating

4.8 4.7 4.7 4.7 4.3 4.3 4.1 4.0 4.5 4.5 4.5 4.0 4.2 3.8 4.0 3.8 4.1 3.9 4.0 3.8 3.9 4.2 4.0 4.0 3.2 3.9 3.3 4.0 4.0 4.3 4.1 3.9 4.8 4.5 2.5 3.9 3.9 3.9 3.8 2

3

4

5

Pathology Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure PA-3

Percentage of Programs That Use USMLE Step 1 Score Scores required?

Would your program consider applicants who fail the exam on the first attempt?

N=82

100%

90%

80%

63%

70%

60%

60%

50%

50%

35%

40%

30%

30%

20%

20%

10%

10%

0%

79%

80%

70%

40%

N=77

100%

90%

1% Yes, pass only

Yes, target score

14% 6%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score Would your program consider applicants who fail the exam on the first attempt?

Scores required? N=77

N=72

100%

100%

90%

90%

80%

80%

70%

70%

60%

60%

52%

50% 40%

82%

50% 40%

32%

30%

30%

16%

20%

20%

10%

10%

0%

0% Yes, pass only

Yes, target score

No

13% 6% Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews Scores Below Which Programs Generally Do Not Grant Interviews

Scores Above Which Programs Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=42

N=34

N=33

USMLE Step 2 CK N=27

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean. NRMP Program Director Survey Results, 2014

83

Pathology Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure PA-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores USMLE Step 2 CS

USMLE Step 3

N=73

100% 90%

90%

84%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

30%

16%

20%

0%

64%

30%

20%

N=73

10%

N=61

100%

N=61 7%

10%

Yes

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores COMLEX-USA Level 1* 100%

COMLEX-USA Level 2-CE* 100%

N=62

90%

90%

80%

80%

70%

70% 60%

60%

50%

50% 40%

50%

39%

40%

41%

38%

30%

30% 20%

11%

10% 0%

N=56

Yes, pass only

Yes, target score

21%

20% 10% 0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores COMLEX-USA Level 2-PE* 100%

COMLEX-USA Level 3* 100%

N=55

90%

90%

80%

80%

70%

70%

60%

60%

55%

50%

55%

50% 40%

40%

27%

30%

18%

20%

32%

30% 20%

13%

10%

10% 0%

N=47

Yes, pass only

Yes, target score

0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

84

Yes, pass only

Yes, target score

No

Pathology Program's Interview Activities

Figure PA-5

Average Number of Positions, Applications Received, Interview Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and Reviewed

1,000

100%

900

90%

800

80%

700

70%

600

60%

500

50%

42%

400

349

40%

300

30%

200

20%

100 0

56%

55

41

32

Number of interview invitations sent

Number of applicants interviewed

Number of applicants ranked

4 Number of positions in the Match

N=84*

Number of applications received

N=82

N=82

N=82

10% 0%

Percentage of applications rejected

N=84*

Percentage of applicants receiving an in-depth review

N=80

N=82

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Group 67% of Pathology programs consider all applicant groups 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0%

99%

N=81

93%

93%

91%

94%

91%

U.S. IMG

Non-U.S. IMG

68%

U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic Physician

Canadian

85

Fifth Pathway

Pediatrics (N=121)

NRMP Program Director Survey Results, 2014

86

Figure P-1

Pediatrics Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview (N=120) Percent Citing Factor

Average Rating

USMLE Step 1/COMLEX Level 1 score 98% Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's Letter) USMLE Step 2 CK/COMLEX Level 2 CE score Personal Statement Graduate of U.S. allopathic medical school Grades in required clerkships Gaps in medical education Honors in clinical clerkships

4.0 77%

3.8

87%

4.1

81%

4.1

70% 77%

4.0

69%

Evidence of professionalism and ethics Personal prior knowledge of the applicant Audition elective/rotation within your department Leadership qualities Honors in clerkship in desired specialty Grades in clerkship in desired specialty Alpha Omega Alpha (AOA) membership Pass USMLE Step2 CS/COMLEX Lvl2 PE

4.1

77%

4.0

63%

Perceived commitment to specialty Class ranking/quartile

3.4

56%

Other life experience Volunteer/extracurricular experiences

4.0 54%

3.9 4.0

63%

4.1

66%

3.9

62%

4.2

64%

3.7

39%

3.8

63%

3.6

52%

3.7

55%

3.7

44%

3.4

23%

3.9

33%

Applicant was flagged with Match violation by the NRMP

4.8

30% 18%

Interest in academic career Honors in basic sciences

3.6 3.4

24%

Gold Society membership

3.7

39%

Away rotation in your specialty at another institution

3.5

16% 33%

Fluency in language spoken by your patient population

87

3.9

57%

Visa status*

NRMP Program Director Survey Results, 2014

3.8

65%

Demonstrated involvement and interest in research

¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

4.4

60%

Graduate of highly regarded U.S. medical school

USMLE/COMLEX Step 3 score 100%

4.0

75%

Perceived interest in program Consistency of grades

4.0

3.4 2.7

16% 50%

0% 1

2

3

4

5

Figure P-2

Pediatrics Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants (N=120) Percent Citing Factor

Interactions with faculty during interview and visit 98% Interpersonal skills 95% Interactions with house staff during interview and visit 93% Feedback from current residents 90% USMLE Step 1/COMLEX Level 1 score 90% Letters of recommendation in the specialty 76% USMLE Step 2 CK/COMLEX Level 2 CE score 88% Medical Student Performance Evaluation (MSPE/Dean's Letter) 82% Perceived commitment to specialty 60% Evidence of professionalism and ethics 67% Perceived interest in program 56% Leadership qualities 66% Personal prior knowledge of the applicant 62% Class ranking/quartile 77% Graduate of U.S. allopathic medical school 68% Personal Statement 60% Audition elective/rotation within your department 63% Grades in required clerkships 69% Passing USMLE Step 2 CS/COMLEX Level 2 PE 71% Honors in clinical clerkships 57% Honors in clerkship in desired specialty 52% Gaps in medical education 56% Grades in clerkship in desired specialty 56% Alpha Omega Alpha (AOA) membership 52% Other life experience 46% Consistency of grades 47% Volunteer/extracurricular experiences 57% Demonstrated involvement and interest in research 30% Graduate of highly regarded U.S. medical school 36% Other post‐interview contact 27% Interest in academic career 21% Visa status* 23% Applicant was flagged with Match violation by the NRMP 23% Fluency in language spoken by your patient population 31% Gold Society membership 35% Honors in basic sciences 21% Second interview/visit 18% Away rotation in your specialty at another institution 13% USMLE/COMLEX Step 3 score 11% 0% 1 100% 50% ¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

88

Average Rating

4.7 4.8 4.7 4.6 4.2 3.8 4.1 4.2 4.1 4.5 3.8 4.0 4.2 4.1 4.1 3.4 4.0 3.9 4.3 4.1 4.2 4.2 4.2 4.2 3.6 3.9 3.7 3.4 3.7 3.8 3.6 3.7 4.9 3.4 3.8 3.5 3.5 3.7 3.4 2

3

4

5

Pediatrics Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure P-3

Percentage of Programs That Use USMLE Step 1 Score Scores required?

Would your program consider applicants who fail the exam on the first attempt?

N=116

100%

90%

80%

70%

56%

60%

60%

43%

50%

40%

40%

30%

30%

20%

20%

10% 0%

77%

80%

70%

50%

N=113

100%

90%

10%

1% Yes, pass only

Yes, target score

18% 5%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score Would your program consider applicants who fail the exam on the first attempt?

Scores required? N=113

N=108

100%

100%

90%

90%

80%

80%

70%

70%

60%

60%

50% 40%

38%

50%

42%

40%

30%

30%

20%

20%

27%

20%

6%

10%

10% 0%

67%

0% Yes, pass only

Yes, target score

No

Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews Scores Below Which Programs Generally Do Not Grant Interviews

Scores Above Which Programs Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=54

N=45

N=49

USMLE Step 2 CK N=40

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean. NRMP Program Director Survey Results, 2014

89

Pediatrics Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure P-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores USMLE Step 2 CS

USMLE Step 3

N=111

100% 90%

N=67

100% 90%

82%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

81%

30%

18%

20%

20%

N=111

10% 0%

13%

N=67 6%

10%

Yes

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores COMLEX-USA Level 1* 100%

COMLEX-USA Level 2-CE* 100%

N=100

90%

90%

80%

80%

70%

70%

60%

60%

52%

50%

50%

40%

40%

33%

30%

30%

20%

20%

15%

44% 29%

27%

10%

10% 0%

N=97

Yes, pass only

Yes, target score

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores COMLEX-USA Level 2-PE* 100%

COMLEX-USA Level 3* 100%

N=91

90%

90%

80%

80%

70% 60%

79%

70%

60%

60%

50%

50% 40%

40%

30%

30%

30% 20%

20%

10%

10% 0%

N=61

Yes, pass only

Yes, target score

0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

15% 7%

10%

90

Yes, pass only

Yes, target score

No

Figure P-5

Pediatrics Program's Interview Activities

Average Number of Positions, Applications Received, Interview Invitations Sent, and Applicants Interviewed and Ranked 1,124

1,000

Average Percentage of Applicants Rejected and Reviewed 100%

900

90%

800

80%

700

70%

600

60%

500

50%

400

40%

300

35%

30%

221

192

200

161

20%

100

10%

15 0 Number of positions in the Match

N=121*

58%

Number of applications received

N=118

Number of interview invitations sent

Number of applicants interviewed

N=116

N=116

0%

Number of applicants ranked

Percentage of applications rejected

N=121*

Percentage of applicants receiving an in-depth review

N=114

N=118

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type 42% of Pediatrics programs consider all applicant groups 100% N=118

90%

86%

80%

72%

72%

69%

70%

60%

60% 47%

50% 40% 30% 20% 10% 0% U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic Physician

Canadian

91

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Physical Medicine and Rehabilitation (N=34)

NRMP Program Director Survey Results, 2014

92

Figure PMR-1

Physical Medicine and Rehabilitation Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview (N=33) Percent Citing Factor

USMLE Step 1/COMLEX Level 1 score

91%

Letters of recommendation in the specialty

91%

Medical Student Performance Evaluation (MSPE/Dean's Letter) USMLE Step 2 CK/COMLEX Level 2 CE score Personal Statement Graduate of U.S. allopathic medical school Grades in required clerkships Gaps in medical education

4.0 4.3

88%

4.2

85%

4.0

79%

3.9

64%

Class ranking/quartile Evidence of professionalism and ethics

3.9

73%

4.2 55%

4.5

67%

3.8

76%

4.4 55%

4.3

Consistency of grades Other life experience Volunteer/extracurricular experiences

4.0

45%

4.4

58%

Alpha Omega Alpha (AOA) membership Perceived interest in program

4.1

48%

Honors in clerkship in desired specialty

Pass USMLE Step2 CS/COMLEX Lvl2 PE

3.9

67%

Leadership qualities Grades in clerkship in desired specialty

3.9

76%

Personal prior knowledge of the applicant Audition elective/rotation within your department

3.7

76%

Honors in clinical clerkships Perceived commitment to specialty

3.5

42%

4.2

73%

4.2

58%

4.2

67% 3.6

55%

3.6

67%

Graduate of highly regarded U.S. medical school

3.6

33%

Demonstrated involvement and interest in research

3.8

42%

Visa status*

3.6

33%

Applicant was flagged with Match violation by the NRMP

4.6

39%

Interest in academic career

27%

Gold Society membership

6%

Away rotation in your specialty at another institution

NRMP Program Director Survey Results, 2014

93

3.4 3.5 3.8

39%

Fluency in language spoken by your patient population

¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

2.9

21%

Honors in basic sciences

USMLE/COMLEX Step 3 score 100%

Average Rating

3.9

42%

3.8

33% 50%

0% 1

2

3

4

5

Figure PMR-2

Physical Medicine and Rehabilitation Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants (N=33) Percent Citing Factor

Interactions with faculty during interview and visit 94% Interpersonal skills 94% Interactions with house staff during interview and visit 85% Feedback from current residents 79% USMLE Step 1/COMLEX Level 1 score 82% Letters of recommendation in the specialty 82% USMLE Step 2 CK/COMLEX Level 2 CE score 76% Medical Student Performance Evaluation (MSPE/Dean's Letter) 76% Perceived commitment to specialty 79% Evidence of professionalism and ethics 58% Perceived interest in program 58% Leadership qualities 48% Personal prior knowledge of the applicant 52% Class ranking/quartile 52% Graduate of U.S. allopathic medical school 39% Personal Statement 64% Audition elective/rotation within your department 64% Grades in required clerkships 58% Passing USMLE Step 2 CS/COMLEX Level 2 PE 70% Honors in clinical clerkships 36% Honors in clerkship in desired specialty 33% Gaps in medical education 45% Grades in clerkship in desired specialty 45% Alpha Omega Alpha (AOA) membership 39% Other life experience 52% Consistency of grades 61% Volunteer/extracurricular experiences 36% Demonstrated involvement and interest in research 52% Graduate of highly regarded U.S. medical school 24% Other post‐interview contact 30% Interest in academic career 15% Visa status* 18% Applicant was flagged with Match violation by the NRMP 21% Fluency in language spoken by your patient population 27% Gold Society membership 9% Honors in basic sciences 18% Second interview/visit 9% Away rotation in your specialty at another institution 33% USMLE/COMLEX Step 3 score 27% 100% 50% 0% 1 ¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

94

Average Rating

4.8 4.7 4.7 4.6 4.0 4.2 4.0 4.2 4.5 4.6 4.2 4.1 4.1 3.9 4.0 3.7 4.7 3.8 4.0 4.1 4.5 3.9 4.3 3.8 3.6 4.1 3.7 3.4 3.8 4.1 4.0 3.8 4.9 3.8 3.7 3.7 3.3 4.4 3.8 2

3

4

5

Physical Medicine and Rehabilitation Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure PMR-3

Percentage of Programs That Use USMLE Step 1 Score Scores required?

Would your program consider applicants who fail the exam on the first attempt?

N=31

100%

90%

80%

80%

70%

48%

60%

48%

50%

40%

40%

30%

30%

20%

20%

10% 0%

67%

70%

60% 50%

N=30

100%

90%

10%

3% Yes, pass only

Yes, target score

20% 13%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score Would your program consider applicants who fail the exam on the first attempt?

Scores required? N=31

N=29

100%

100%

90%

90%

80%

80%

70%

70%

60% 50%

60%

45%

40%

50% 40%

32%

30%

30%

23%

20%

20%

10%

10%

0%

83%

0% Yes, pass only

Yes, target score

No

10%

7% Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews Scores Below Which Programs Generally Do Not Grant Interviews

Scores Above Which Programs Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=11

N=12

N=7

USMLE Step 2 CK N=8

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean. NRMP Program Director Survey Results, 2014

95

Physical Medicine and Rehabilitation Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure PMR-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores USMLE Step 2 CS

USMLE Step 3

N=30

100%

N=23

100% 90%

90%

80%

80%

70%

70%

70%

60%

60%

50%

50%

40%

65%

40%

30%

30%

30%

20%

20%

N=30

10% 0%

17%

17%

N=23

10%

Yes

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores COMLEX-USA Level 1* 100%

COMLEX-USA Level 2-CE* 100%

N=31

90%

90%

80%

80%

70%

70% 60%

60% 50%

48%

50%

42%

40%

40%

30%

30%

20%

20%

10%

10% 0%

N=31

Yes, pass only

Yes, target score

45% 32% 23%

10% 0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores COMLEX-USA Level 2-PE* 100%

COMLEX-USA Level 3* 100%

N=29

90%

90%

80%

80%

70% 60%

70%

57%

60%

55%

50%

50%

40%

34%

40% 30%

30%

26% 17%

20%

20%

10%

10% 0%

N=23

Yes, pass only

Yes, target score

10% 0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

96

Yes, pass only

Yes, target score

No

Physical Medicine and Rehabilitation Program's Interview Activities

Figure PMR-5

Average Number of Positions, Applications Received, Interview Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and Reviewed

1,000

100%

900

90%

800

80%

700

70%

600

60%

500 400

349

45%

40%

300

30%

200

20%

86

100 0

51%

50%

68

54

Number of applicants interviewed

Number of applicants ranked

10%

5 Number of positions in the Match

Number of applications received

N=34*

Number of interview invitations sent

N=34

N=34

N=34

0%

Percentage of applications rejected

N=34*

Percentage of applicants receiving an in-depth review

N=34

N=34

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Type 27% of Physical Medicine and Rehabilitation programs consider all applicant groups N=33

100%

100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0%

97% 79%

79% 61% 45%

NRMP Program Director Survey Results, 2014

G M .S .I

M

-U

.S .I

N

on

U

w th Pa Fi fth

97

G

ay

n ad ia an C

O s P h teo y s pat i c hi ia c n

ra d .S .G U

U

.S .S

en

io r

ua te

42%

Plastic Surgery (N=39)

NRMP Program Director Survey Results, 2014

98

Figure PS-1

Plastic Surgery Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview (N=34) Percent Citing Factor

USMLE Step 1/COMLEX Level 1 score

94%

Letters of recommendation in the specialty

94%

4.3 4.8

Medical Student Performance Evaluation (MSPE/Dean's Letter)

62%

USMLE Step 2 CK/COMLEX Level 2 CE score Personal Statement Graduate of U.S. allopathic medical school

3.1

65%

4.4

85%

3.6

74%

4.2

Grades in required clerkships

50%

Gaps in medical education Honors in clinical clerkships Perceived commitment to specialty

Personal prior knowledge of the applicant

Honors in clerkship in desired specialty

4.2

74%

4.2

59%

3.6

68%

4.2

76%

4.4 4.4

65%

4.1

71%

4.5

74%

Grades in clerkship in desired specialty Alpha Omega Alpha (AOA) membership

4.5

56%

4.2

79%

Pass USMLE Step2 CS/COMLEX Lvl2 PE

3.8

53%

Consistency of grades

3.6

62%

Volunteer/extracurricular experiences

3.6

65%

Graduate of highly regarded U.S. medical school

3.8

62%

4.0

82%

3.0 3.9

24% 3%

Fluency in language spoken by your patient population

99

3.1

21% 12%

Away rotation in your specialty at another institution

NRMP Program Director Survey Results, 2014

4.2

47%

Gold Society membership

¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

4.7

29%

Honors in basic sciences

USMLE/COMLEX Step 3 score 100%

3.9

47%

Applicant was flagged with Match violation by the NRMP Interest in academic career

4.2

44%

Other life experience

Visa status*

4.0

26%

Perceived interest in program

Demonstrated involvement and interest in research

3.6

76%

Audition elective/rotation within your department Leadership qualities

3.9

35%

Class ranking/quartile Evidence of professionalism and ethics

Average Rating

3.0

15% 50%

0% 1

2

4.0 3 4

5

Figure PS-2

Plastic Surgery Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants (N=34) Percent Citing Factor

Interactions with faculty during interview and visit 88% Interpersonal skills 91% Interactions with house staff during interview and visit 85% Feedback from current residents 68% USMLE Step 1/COMLEX Level 1 score 56% Letters of recommendation in the specialty 82% USMLE Step 2 CK/COMLEX Level 2 CE score 32% Medical Student Performance Evaluation (MSPE/Dean's Letter) 32% Perceived commitment to specialty 62% Evidence of professionalism and ethics 56% Perceived interest in program 35% Leadership qualities 53% Personal prior knowledge of the applicant 53% Class ranking/quartile 26% Graduate of U.S. allopathic medical school 44% Personal Statement 29% Audition elective/rotation within your department 62% Grades in required clerkships 24% Passing USMLE Step 2 CS/COMLEX Level 2 PE 18% Honors in clinical clerkships 44% Honors in clerkship in desired specialty 47% Gaps in medical education 9% Grades in clerkship in desired specialty 26% Alpha Omega Alpha (AOA) membership 47% Other life experience 38% Consistency of grades 21% Volunteer/extracurricular experiences 29% Demonstrated involvement and interest in research 62% Graduate of highly regarded U.S. medical school 24% Other post‐interview contact 9% Interest in academic career 44% Visa status* 21% 15% Applicant was flagged with Match violation by the NRMP 3% Fluency in language spoken by your patient population Gold Society membership 3% Honors in basic sciences 15% Second interview/visit 0% Away rotation in your specialty at another institution 18% USMLE/COMLEX Step 3 score 12% 100% 50% 0% 1 ¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

100

Average Rating

4.8 4.7 4.8 4.7 4.2 4.5 4.0 3.4 4.5 4.5 4.3 4.3 4.5 4.2 4.1 3.7 4.7 3.8 4.2 4.0 4.6 4.3 4.7 4.1 3.7 4.3 4.0 4.0 4.3 4.0 4.3 4.4 4.4 3.0 4.0 3.4 4.3 3.5 2

3

4

5

Plastic Surgery Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure PS-3

Percentage of Programs That Use USMLE Step 1 Score Scores required?

Would your program consider applicants who fail the exam on the first attempt?

N=35

100% 90%

90%

80%

80%

70%

60%

50%

50%

40%

40%

30%

33%

30%

14%

20%

10% 0%

67%

70%

60%

20%

N=30

100%

86%

10%

0% Yes, pass only

Yes, target score

0%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score Would your program consider applicants who fail the exam on the first attempt?

Scores required? N=35

N=23

100%

100%

90%

90%

80%

80%

70%

70%

57%

60% 50%

50%

40%

40%

30%

30%

23%

20%

20%

10%

0%

0% Yes, target score

35%

20%

10% Yes, pass only

65%

60%

No

0% Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews Scores Below Which Programs Generally Do Not Grant Interviews

Scores Above Which Programs Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=21

N=11

N=14

USMLE Step 2 CK N=8

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean. NRMP Program Director Survey Results, 2014

101

Plastic Surgery Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure PS-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores USMLE Step 2 CS

USMLE Step 3

N=34

100%

N=28

100% 90%

90%

80%

80%

71%

70%

70%

60%

60%

50%

50%

40%

50%

40%

29%

30%

30%

20%

29% 21%

20%

N=34

10% 0%

N=28

10%

Yes

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores COMLEX-USA Level 1* 100%

COMLEX-USA Level 2-CE* 100%

N=9

80%

80%

67%

70%

60%

50%

50% 40%

33%

30%

30%

20%

20%

33%

10%

10% 0%

67%

70%

60%

40%

N=9

90%

90%

0% Yes, pass only

Yes, target score

No

0%

0% Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores COMLEX-USA Level 2-PE* 100%

COMLEX-USA Level 3* 100%

N=8

90%

90%

80%

80%

70%

63%

70%

50%

50%

38%

40%

30%

30%

20%

20%

38%

10%

10% 0%

63%

60%

60%

40%

N=8

0% Yes, pass only

Yes, target score

No

0%

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

102

0% Yes, pass only

Yes, target score

No

Plastic Surgery Program's Interview Activities

Figure PS-5

Average Number of Positions, Applications Received, Interview Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and Reviewed

1,000

100%

900

90%

800

80%

700 600

60%

500

50%

400

40%

300

29%

30%

192

200

20%

100 0

67%

70%

2 Number of positions in the Match

Number of applications received

N=39*

N=38

10%

35

30

25

Number of interview invitations sent

Number of applicants interviewed

Number of applicants ranked

N=37

N=37

0%

Percentage of applications rejected

N=39*

Percentage of applicants receiving an in-depth review

N=36

N=38

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type 18% of Plastic Surgery programs consider all applicant groups

97%

N=33

90% 80% 70% 60% 50%

45% 39%

40%

27%

30%

24%

24%

U.S. IMG

Non-U.S. IMG

18%

20% 10% 0% U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic Physician

Canadian

103

Fifth Pathway

Psychiatry (N=84)

NRMP Program Director Survey Results, 2014

104

Figure PSY-1

Psychiatry Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview (N=83) Percent Citing Factor

USMLE Step 1/COMLEX Level 1 score

87%

Letters of recommendation in the specialty

84%

Medical Student Performance Evaluation (MSPE/Dean's Letter)

Average Rating

3.7 4.1

94%

USMLE Step 2 CK/COMLEX Level 2 CE score Personal Statement Graduate of U.S. allopathic medical school

4.2

84% 92%

4.1

84%

Grades in required clerkships Gaps in medical education

3.9

70%

3.9

89%

4.3

Honors in clinical clerkships Perceived commitment to specialty

3.7

66%

3.7

88%

4.5

Class ranking/quartile

58%

Evidence of professionalism and ethics

71%

Personal prior knowledge of the applicant

70%

3.6 4.6 4.0

Audition elective/rotation within your department

65%

4.1

Leadership qualities

65%

4.1

Honors in clerkship in desired specialty

67%

4.1

Grades in clerkship in desired specialty Alpha Omega Alpha (AOA) membership Pass USMLE Step2 CS/COMLEX Lvl2 PE Perceived interest in program Consistency of grades Other life experience

4.2

71% 3.4

51%

4.0

82%

4.2

60%

4.0

51%

3.8

65%

Volunteer/extracurricular experiences

57%

3.6

Graduate of highly regarded U.S. medical school

58%

3.6

Demonstrated involvement and interest in research

45%

Visa status*

43%

Applicant was flagged with Match violation by the NRMP

3.3 3.9 4.8

54%

Interest in academic career Honors in basic sciences

¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

105

3.4

40%

Away rotation in your specialty at another institution USMLE/COMLEX Step 3 score 100%

2.8

22%

Gold Society membership Fluency in language spoken by your patient population

3.4

30%

3.1

24%

4.0

51% 29% 50%

0% 1

2

3.4 3

4

5

Figure PSY-2

Psychiatry Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants (N=83) Percent Citing Factor

Interactions with faculty during interview and visit 98% Interpersonal skills 99% Interactions with house staff during interview and visit 95% Feedback from current residents 89% USMLE Step 1/COMLEX Level 1 score 73% Letters of recommendation in the specialty 78% USMLE Step 2 CK/COMLEX Level 2 CE score 73% Medical Student Performance Evaluation (MSPE/Dean's Letter) 71% Perceived commitment to specialty 84% Evidence of professionalism and ethics 77% Perceived interest in program 62% Leadership qualities 61% Personal prior knowledge of the applicant 61% Class ranking/quartile 51% Graduate of U.S. allopathic medical school 66% Personal Statement 74% Audition elective/rotation within your department 59% Grades in required clerkships 48% Passing USMLE Step 2 CS/COMLEX Level 2 PE 61% Honors in clinical clerkships 44% Honors in clerkship in desired specialty 48% Gaps in medical education 66% Grades in clerkship in desired specialty 52% Alpha Omega Alpha (AOA) membership 45% Other life experience 54% Consistency of grades 40% Volunteer/extracurricular experiences 39% Demonstrated involvement and interest in research 35% Graduate of highly regarded U.S. medical school 45% Other post‐interview contact 39% Interest in academic career 32% Visa status* 33% Applicant was flagged with Match violation by the NRMP 34% Fluency in language spoken by your patient population 48% Gold Society membership 29% Honors in basic sciences 17% Second interview/visit 17% Away rotation in your specialty at another institution 11% USMLE/COMLEX Step 3 score 27% 0% 1 100% 50% ¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

106

Average Rating

4.9 5.0 4.9 4.8 3.8 3.9 3.9 4.2 4.4 4.8 4.2 4.1 4.1 3.6 4.1 3.7 4.2 3.8 4.1 3.8 3.9 4.2 4.0 3.7 3.9 4.2 3.8 3.6 3.8 3.8 3.7 4.1 4.9 4.2 3.7 3.3 3.6 3.6 3.3 2

3

4

5

Psychiatry Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure PSY-3

Percentage of Programs That Use USMLE Step 1 Score Scores required?

Would your program consider applicants who fail the exam on the first attempt?

N=83

100%

90%

80% 70%

80%

69%

70%

60%

56%

60%

50%

50%

40%

41%

40%

30%

30%

30%

20%

20%

10% 0%

N=71

100%

90%

10%

1% Yes, pass only

Yes, target score

3%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score Would your program consider applicants who fail the exam on the first attempt?

Scores required? N=83

N=70

100%

100%

90%

90%

80%

80%

70% 60%

70%

60%

64%

60%

50%

50%

40%

40%

30%

16%

20%

20%

10%

10%

0%

0% Yes, pass only

30%

30%

24%

Yes, target score

No

6% Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews Scores Below Which Programs Generally Do Not Grant Interviews

Scores Above Which Programs Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=17

N=14

N=14

USMLE Step 2 CK N=12

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean. NRMP Program Director Survey Results, 2014

107

Psychiatry Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure PSY-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores USMLE Step 2 CS

USMLE Step 3

N=80

100%

N=63

100% 90%

90%

80%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

30%

20%

20%

0%

30%

20%

N=80

10%

59%

N=63 11%

10%

Yes

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores COMLEX-USA Level 1* 100%

COMLEX-USA Level 2-CE* 100%

N=72

80%

80% 70%

67%

70%

60%

60%

50%

50%

31%

30%

58%

40%

40%

30%

24% 18%

20%

20% 10% 0%

N=71

90%

90%

3% Yes, pass only

Yes, target score

No

10% 0%

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores COMLEX-USA Level 2-PE* 100%

COMLEX-USA Level 3* 100%

N=70

90% 80% 70%

80%

67%

70%

60%

60%

50%

50%

40%

40%

30%

23%

53%

33%

30% 20%

20%

10%

10% 0%

N=49

90%

Yes, pass only

Yes, target score

No

0%

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

14%

10%

108

Yes, pass only

Yes, target score

No

Figure PSY-5

Psychiatry Program's Interview Activities

Average Number of Positions, Applications Received, Interview Invitations Sent, and Applicants Interviewed and Ranked 1,000

Average Percentage of Applicants Rejected and Reviewed 100%

900

858

90%

800

80%

700

70%

61%

600

60%

500

50%

400

40%

300 200

20%

100

100 0

30%

30%

79

61

Number of applicants interviewed

Number of applicants ranked

10%

7 Number of positions in the Match

N=84*

Number of applications received

N=81

Number of interview invitations sent

N=81

N=83

0%

Percentage of applications rejected

N=84*

Percentage of applicants receiving an in-depth review

N=77

N=81

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type 40% of Psychiatry programs consider all applicant groups 98%

90%

86%

89%

N=83

80%

80% 67%

70%

63%

60% 46%

50% 40% 30% 20% 10% 0% U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic Physician

Canadian

109

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Radiation Oncology (N=44)

NRMP Program Director Survey Results, 2014

110

Figure RO-1

Radiation Oncology Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview (N=43) Percent Citing Factor

USMLE Step 1/COMLEX Level 1 score

Average Rating

95%

4.3

Letters of recommendation in the specialty 100% Medical Student Performance Evaluation (MSPE/Dean's Letter)

4.5

86%

4.0

USMLE Step 2 CK/COMLEX Level 2 CE score Personal Statement

51% 84%

Graduate of U.S. allopathic medical school Grades in required clerkships

3.8 65%

4.2

77%

3.9

Gaps in medical education Honors in clinical clerkships

47%

3.8

72%

4.2

Perceived commitment to specialty

67%

Class ranking/quartile

65%

Evidence of professionalism and ethics

63%

Personal prior knowledge of the applicant Audition elective/rotation within your department

4.1

4.5 4.0 4.6

56%

4.3 4.3

72%

Leadership qualities

60%

4.3

Honors in clerkship in desired specialty

60%

4.3

Grades in clerkship in desired specialty Alpha Omega Alpha (AOA) membership

4.1

70% 60%

Other life experience

58%

Volunteer/extracurricular experiences

4.3 3.7 3.9

53%

Graduate of highly regarded U.S. medical school

4.0

63%

4.4

86%

Visa status*

21%

Applicant was flagged with Match violation by the NRMP

23%

Interest in academic career

Fluency in language spoken by your patient population

111

4.0 3.9 3.7

14% 44% 12%

Away rotation in your specialty at another institution

NRMP Program Director Survey Results, 2014

4.7

28%

Gold Society membership

¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

3.6

53%

Honors in basic sciences

USMLE/COMLEX Step 3 score 100%

4.3

21%

Consistency of grades

Demonstrated involvement and interest in research

3.8

60%

Pass USMLE Step2 CS/COMLEX Lvl2 PE Perceived interest in program

4.3

56%

3.8 3.4

9% 50%

0% 1

2

3

4.5 4

5

Figure RO-2

Radiation Oncology Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants (N=43) Percent Citing Factor

Interactions with faculty during interview and visit 84% Interpersonal skills 86% Interactions with house staff during interview and visit 70% Feedback from current residents 70% USMLE Step 1/COMLEX Level 1 score 57% Letters of recommendation in the specialty 77% USMLE Step 2 CK/COMLEX Level 2 CE score 23% Medical Student Performance Evaluation (MSPE/Dean's Letter) 45% Perceived commitment to specialty 57% Evidence of professionalism and ethics 39% Perceived interest in program 61% Leadership qualities 39% Personal prior knowledge of the applicant 45% Class ranking/quartile 39% Graduate of U.S. allopathic medical school 27% Personal Statement 45% Audition elective/rotation within your department 39% Grades in required clerkships 41% Passing USMLE Step 2 CS/COMLEX Level 2 PE 2% Honors in clinical clerkships 41% Honors in clerkship in desired specialty 23% Gaps in medical education 11% Grades in clerkship in desired specialty 25% Alpha Omega Alpha (AOA) membership 18% Other life experience 32% Consistency of grades 23% Volunteer/extracurricular experiences 20% Demonstrated involvement and interest in research 61% Graduate of highly regarded U.S. medical school 30% Other post‐interview contact 25% Interest in academic career 41% Visa status* 2% Applicant was flagged with Match violation by the NRMP 5% 7% Fluency in language spoken by your patient population 0% Gold Society membership Honors in basic sciences 14% Second interview/visit 7% Away rotation in your specialty at another institution 30% USMLE/COMLEX Step 3 score 2% 100% 50% 0% 1 ¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

112

Average Rating

4.9 4.9 4.8 4.6 3.8 4.4 4.2 4.2 4.4 4.6 4.4 4.2 4.4 4.0 4.0 4.0 4.4 3.7 4.0 3.8 4.3 3.4 4.0 4.0 3.6 4.2 3.7 4.4 3.8 4.5 4.2 4.0 5.0 3.3 3.5 4.3 4.0 4.0 2

3

4

5

Radiation Oncology Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure RO-3

Percentage of Programs That Use USMLE Step 1 Score Scores required?

Would your program consider applicants who fail the exam on the first attempt?

N=41

100%

90%

80%

73%

80%

70%

70%

60%

60%

50%

44%

40%

27%

30%

20%

20%

10% 0%

54%

50%

40% 30%

N=39

100%

90%

10%

0% Yes, pass only

Yes, target score

3%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score Would your program consider applicants who fail the exam on the first attempt?

Scores required? N=35

N=28

100%

100%

90%

90%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40% 30%

37%

43%

40% 30%

23%

20%

20%

10%

10%

0%

0% Yes, pass only

54%

Yes, target score

No

4% Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews Scores Below Which Programs Generally Do Not Grant Interviews

Scores Above Which Programs Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=24

N=10

N=11

USMLE Step 2 CK N=6

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean. NRMP Program Director Survey Results, 2014

113

Radiation Oncology Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure RO-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores USMLE Step 2 CS

USMLE Step 3

N=36

100% 90%

90%

80%

80%

70%

70%

61%

60%

N=23

100%

74%

60%

50%

50%

39%

40%

40%

30%

30%

20%

20%

N=36

10% 0%

22%

N=23

10%

Yes

0%

No

Yes, pass only

4%

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores COMLEX-USA Level 1* 100%

COMLEX-USA Level 2-CE* 100%

N=20

80%

80%

70%

70%

60%

50%

50%

40%

40% 30%

30%

20%

20%

10%

10% 0%

70%

70%

60%

20%

N=20

90%

90%

Yes, pass only

Yes, target score

20% 10%

10% No

0%

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores COMLEX-USA Level 2-PE* 100%

COMLEX-USA Level 3* 100%

N=20

90% 80%

70%

60%

60%

50%

50%

40%

40% 30%

30%

20% 10% Yes, pass only

22%

20%

10% 0%

78%

80%

70%

70%

20%

N=18

90%

Yes, target score

10% No

0%

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

114

0% Yes, pass only

Yes, target score

No

Figure RO-5

Radiation Oncology Program's Interview Activities

Average Number of Positions, Applications Received, Interview Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and Reviewed

1,000

100%

900

90%

800

80%

73%

700

70%

600

60%

500

50%

400

40%

300

30%

169

200 100 0

2 Number of positions in the Match

N=44*

Number of applications received

N=43

26%

20% 10%

32

25

22

Number of interview invitations sent

Number of applicants interviewed

Number of applicants ranked

N=44

N=44

0%

Percentage of applications rejected

N=44*

Percentage of applicants receiving an in-depth review

N=42

N=43

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type 12% of Radiation Oncology programs consider all applicant groups 100% N=42

90% 80% 70% 60%

55%

50%

45%

40% 30% 19%

20%

19% 12%

14%

10% 0% U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic Physician

Canadian

115

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Radiology-Diagnostic (N=75)

NRMP Program Director Survey Results, 2014

116

Figure RD-1

Radiology-Diagnostic Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview (N=74) Percent Citing Factor

Average Rating

USMLE Step 1/COMLEX Level 1 score 99% Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's Letter)

4.2 77%

91%

4.5

USMLE Step 2 CK/COMLEX Level 2 CE score Personal Statement Graduate of U.S. allopathic medical school Grades in required clerkships Gaps in medical education Honors in clinical clerkships

66%

3.9

74%

3.3

82%

4.2

76%

4.5

72%

4.1

81%

Perceived commitment to specialty Class ranking/quartile

3.9

4.1 62%

3.9

85%

4.3

Evidence of professionalism and ethics

64%

Personal prior knowledge of the applicant

64%

4.2 4.1

Audition elective/rotation within your department

59%

Leadership qualities

58%

Honors in clerkship in desired specialty

3.7 4.2

47%

Grades in clerkship in desired specialty Alpha Omega Alpha (AOA) membership

3.9

4.2

50%

3.9

77%

Pass USMLE Step2 CS/COMLEX Lvl2 PE

4.4

31%

Perceived interest in program

65%

4.0

Consistency of grades

64%

4.1

Other life experience Volunteer/extracurricular experiences Graduate of highly regarded U.S. medical school Demonstrated involvement and interest in research

3.6

61%

3.3

50%

3.9

57%

3.5

47%

Visa status*

42%

Applicant was flagged with Match violation by the NRMP

42%

Interest in academic career

3.9 3.2

15% 14%

Fluency in language spoken by your patient population

117

3.8 22%

Away rotation in your specialty at another institution

NRMP Program Director Survey Results, 2014

3.3

41%

Gold Society membership

¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

4.6

27%

Honors in basic sciences

USMLE/COMLEX Step 3 score 100%

4.1

3.0

18% 50%

0% 1

2

3.5 3 4

5

Figure RD-2

Radiology-Diagnostic Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants (N=74) Percent Citing Factor

Interactions with faculty during interview and visit 95% Interpersonal skills 97% Interactions with house staff during interview and visit 85% Feedback from current residents 82% USMLE Step 1/COMLEX Level 1 score 85% Letters of recommendation in the specialty 65% USMLE Step 2 CK/COMLEX Level 2 CE score 53% Medical Student Performance Evaluation (MSPE/Dean's Letter) 78% Perceived commitment to specialty 61% Evidence of professionalism and ethics 51% Perceived interest in program 64% Leadership qualities 57% Personal prior knowledge of the applicant 55% Class ranking/quartile 73% Graduate of U.S. allopathic medical school 62% Personal Statement 49% Audition elective/rotation within your department 50% Grades in required clerkships 59% Passing USMLE Step 2 CS/COMLEX Level 2 PE 24% Honors in clinical clerkships 50% Honors in clerkship in desired specialty 32% Gaps in medical education 42% Grades in clerkship in desired specialty 27% Alpha Omega Alpha (AOA) membership 53% Other life experience 50% Consistency of grades 45% Volunteer/extracurricular experiences 34% Demonstrated involvement and interest in research 39% Graduate of highly regarded U.S. medical school 42% Other post‐interview contact 38% Interest in academic career 31% Visa status* 27% Applicant was flagged with Match violation by the NRMP 22% 8% Fluency in language spoken by your patient population Gold Society membership 19% Honors in basic sciences 26% Second interview/visit 12% Away rotation in your specialty at another institution 8% USMLE/COMLEX Step 3 score 11% 100% 50% 0% 1 ¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

118

Average Rating

4.7 4.7 4.7 4.6 4.1 3.9 3.8 4.3 4.1 4.4 4.2 4.1 4.2 4.4 4.3 3.3 4.3 4.3 3.9 4.2 4.3 4.3 4.3 4.0 3.7 4.2 3.5 3.7 4.1 3.7 3.6 4.0 4.9 3.3 4.1 3.7 3.8 3.2 3.9 2

3

4

5

Radiology-Diagnostic Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure RD-3

Percentage of Programs That Use USMLE Step 1 Score Scores required?

Would your program consider applicants who fail the exam on the first attempt?

N=71

100%

90%

80%

80%

70%

70%

60%

60%

50%

45%

40%

30%

30% 20%

14%

10% 0%

52%

50%

40%

20%

N=62

100%

86%

90%

10%

0% Yes, pass only

Yes, target score

3%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score Would your program consider applicants who fail the exam on the first attempt?

Scores required? N=66

N=44

100%

100%

90%

90%

80%

80%

70%

70%

60%

60%

50%

50%

44% 36%

40% 30% 20%

40% 30%

20%

20%

10%

10%

0%

0% Yes, pass only

50%

48%

Yes, target score

No

2% Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews Scores Below Which Programs Generally Do Not Grant Interviews

Scores Above Which Programs Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=53

N=26

N=33

USMLE Step 2 CK N=15

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean. NRMP Program Director Survey Results, 2014

119

Radiology-Diagnostic Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure RD-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores USMLE Step 2 CS

USMLE Step 3

N=62

100%

N=39

100%

90%

90%

80%

80%

70%

69%

70%

60%

60%

60%

50%

50%

40%

40%

40%

30%

30%

20%

20%

N=62

10% 0%

23%

N=39 8%

10%

Yes

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores COMLEX-USA Level 1* 100%

COMLEX-USA Level 2-CE* 100%

N=29

90%

90%

80%

80%

70%

70%

48%

50%

50% 40%

40%

28%

24%

30%

20%

20%

10%

10%

0%

67%

60%

60%

30%

N=27

Yes, pass only

Yes, target score

No

0%

19%

15%

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores COMLEX-USA Level 2-PE* 100%

COMLEX-USA Level 3* 100%

N=28

90% 80%

70%

60%

60%

50%

50%

40%

40% 30%

21%

20%

20%

11%

10% 0%

76%

80%

68%

70%

30%

N=25

90%

Yes, pass only

Yes, target score

No

0%

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

16% 8%

10%

120

Yes, pass only

Yes, target score

No

Figure RD-5

Radiology-Diagnostic Program's Interview Activities

Average Number of Positions, Applications Received, Interview Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and Reviewed

1,000

100%

900

90%

800

80%

700

70%

600

60%

500

50%

426

400

39%

40%

300

30%

200

20%

106

100 0

56%

84

76

Number of applicants interviewed

Number of applicants ranked

10%

7 Number of positions in the Match

N=75*

Number of applications received

N=74

Number of interview invitations sent

N=71

N=73

0%

Percentage of applications rejected

N=75*

Percentage of applicants receiving an in-depth review

N=73

N=74

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type 28% of Radiology-Diagnostic programs consider all applicant groups 99% N=74

90% 78%

80% 70%

64%

60% 50%

50%

45%

36%

40% 30%

30% 20% 10% 0% U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic Physician

Canadian

121

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Surgery (N=121)

NRMP Program Director Survey Results, 2014

122

Figure GS-1

Surgery Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview (N=115) Percent Citing Factor

Average Rating

USMLE Step 1/COMLEX Level 1 score 97% Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's Letter) USMLE Step 2 CK/COMLEX Level 2 CE score Personal Statement Graduate of U.S. allopathic medical school

4.4

92%

4.3

79%

3.8

87%

4.3

72%

3.5

76%

4.3

Grades in required clerkships

70%

Gaps in medical education

69%

Honors in clinical clerkships Perceived commitment to specialty Class ranking/quartile Evidence of professionalism and ethics Personal prior knowledge of the applicant

Honors in clerkship in desired specialty

4.0

65%

4.0

58%

4.5

62%

4.1 4.0

53%

4.2

68%

4.4

73% 69%

Alpha Omega Alpha (AOA) membership

70%

Perceived interest in program

4.3

70%

Grades in clerkship in desired specialty Pass USMLE Step2 CS/COMLEX Lvl2 PE

4.1

78%

Audition elective/rotation within your department Leadership qualities

3.9

4.2 3.9 4.2

47%

3.9

55%

Consistency of grades

3.9

39%

Other life experience

52%

3.6

Volunteer/extracurricular experiences

50%

3.6

Graduate of highly regarded U.S. medical school

3.8

Demonstrated involvement and interest in research

47%

Visa status*

45%

Applicant was flagged with Match violation by the NRMP

3.5 3.9

29%

Away rotation in your specialty at another institution

3.5

21% 10%

Fluency in language spoken by your patient population

123

3.8

21%

Gold Society membership

NRMP Program Director Survey Results, 2014

4.8

33%

Honors in basic sciences

¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

3.9 27%

Interest in academic career

USMLE/COMLEX Step 3 score 100%

3.9

43%

3.3 3.9

10% 50%

0% 1

2

3

4

5

Figure GS-2

Surgery Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants (N=115) Percent Citing Factor

Interactions with faculty during interview and visit 91% Interpersonal skills 89% Interactions with house staff during interview and visit 86% Feedback from current residents 76% USMLE Step 1/COMLEX Level 1 score 82% Letters of recommendation in the specialty 79% USMLE Step 2 CK/COMLEX Level 2 CE score 78% Medical Student Performance Evaluation (MSPE/Dean's Letter) 58% Perceived commitment to specialty 69% Evidence of professionalism and ethics 53% Perceived interest in program 64% Leadership qualities 59% Personal prior knowledge of the applicant 53% Class ranking/quartile 55% Graduate of U.S. allopathic medical school 62% Personal Statement 51% Audition elective/rotation within your department 48% Grades in required clerkships 41% Passing USMLE Step 2 CS/COMLEX Level 2 PE 38% Honors in clinical clerkships 46% Honors in clerkship in desired specialty 59% Gaps in medical education 38% Grades in clerkship in desired specialty 44% Alpha Omega Alpha (AOA) membership 48% Other life experience 42% Consistency of grades 33% Volunteer/extracurricular experiences 36% Demonstrated involvement and interest in research 34% Graduate of highly regarded U.S. medical school 35% Other post‐interview contact 36% Interest in academic career 31% Visa status* 24% Applicant was flagged with Match violation by the NRMP 14% Fluency in language spoken by your patient population 10% Gold Society membership 18% Honors in basic sciences 17% Second interview/visit 23% Away rotation in your specialty at another institution 12% USMLE/COMLEX Step 3 score 8% 100% 50% 0% 1 ¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

124

Average Rating

4.8 4.7 4.8 4.6 4.4 4.2 4.2 3.8 4.3 4.5 4.1 4.2 4.3 4.0 4.3 3.4 4.2 4.0 4.2 4.1 4.2 4.1 4.2 4.1 3.6 3.9 3.5 3.9 4.0 4.1 3.9 4.1 4.3 3.7 3.9 3.6 4.0 3.7 3.9 2

3

4

5

Surgery Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure GS-3

Percentage of Programs That Use USMLE Step 1 Score Scores required?

Would your program consider applicants who fail the exam on the first attempt?

N=112

100%

91%

90%

90%

80%

80%

70%

70%

60%

60%

50%

45%

40%

30%

30%

20%

0%

53%

50%

40%

10%

N=104

100%

20%

9%

10%

0% Yes, pass only

Yes, target score

2%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score Would your program consider applicants who fail the exam on the first attempt?

Scores required? N=107

N=92

100%

100%

90%

90%

80%

74%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

30%

20% 10% 0%

16%

10%

36%

20% 10% 0%

Yes, pass only

62%

Yes, target score

No

2% Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews Scores Below Which Programs Generally Do Not Grant Interviews

Scores Above Which Programs Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=94

N=76

N=72

USMLE Step 2 CK N=58

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean. NRMP Program Director Survey Results, 2014

125

Surgery Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure GS-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores USMLE Step 2 CS

USMLE Step 3

N=102

100%

N=62

100% 90%

90%

80%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

74%

30%

20%

20%

0%

10%

Yes

16%

20%

N=102

10%

0%

No

10%

N=62

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores COMLEX-USA Level 1* 100%

COMLEX-USA Level 2-CE* 100%

N=54

90%

90%

80%

80%

70%

70%

60%

52% 37%

40%

40%

0%

30%

30%

30%

10%

57%

60% 50%

50%

20%

N=53

20%

11%

13%

10%

Yes, pass only

Yes, target score

No

0%

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores COMLEX-USA Level 2-PE* 100%

COMLEX-USA Level 3* 100%

N=50

90%

90%

80%

80%

70%

64%

60%

50%

50% 40%

40%

26%

30% 20%

20%

10%

10% 0%

80%

70%

60%

30%

N=40

Yes, pass only

Yes, target score

10% No

0%

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

126

10%

10%

Yes, pass only

Yes, target score

No

Figure GS-5

Surgery Program's Interview Activities

Average Number of Positions, Applications Received, Interview Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and Reviewed

1,000

100%

900

90%

800

80%

731

700

70%

62%

600

60%

500

50%

400

40%

300 200

20%

92

100 0

33%

30%

74

55

Number of applicants interviewed

Number of applicants ranked

10%

5 Number of positions in the Match

N=121*

Number of applications received

N=118

Number of interview invitations sent

N=115

N=117

0%

Percentage of applications rejected

N=121*

Percentage of applicants receiving an in-depth review

N=115

N=118

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type 19% of Surgery programs consider all applicant groups 100% N=113

90% 80% 66%

70% 60%

50%

50%

48% 39%

37%

40% 30%

23%

20% 10% 0% U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic Physician

Canadian

127

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Thoracic Surgery (N=12)

NRMP Program Director Survey Results, 2014

128

Figure TS-1

Thoracic Surgery Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview (N=12) Percent Citing Factor

USMLE Step 1/COMLEX Level 1 score

92%

Letters of recommendation in the specialty

92%

Average Rating

4.1 4.7

Medical Student Performance Evaluation (MSPE/Dean's Letter)

83%

4.0

USMLE Step 2 CK/COMLEX Level 2 CE score

83%

4.0

Personal Statement

83%

3.6

Graduate of U.S. allopathic medical school Grades in required clerkships

33% 83%

Gaps in medical education Honors in clinical clerkships Perceived commitment to specialty

4.1 50%

4.0

83%

4.0 50%

Class ranking/quartile Evidence of professionalism and ethics

4.0

33%

4.6

42%

Audition elective/rotation within your department

42%

Honors in clerkship in desired specialty Grades in clerkship in desired specialty Alpha Omega Alpha (AOA) membership

4.3 4.6 4.4

67%

4.0

58%

4.5 4.2

50%

4.0

58%

5.0

42%

Applicant was flagged with Match violation by the NRMP

5.0

17% 3.7

50%

Honors in basic sciences

3.7

25%

Gold Society membership

0%

Away rotation in your specialty at another institution Fluency in language spoken by your patient population

129

4.0

25% 17%

Visa status*

NRMP Program Director Survey Results, 2014

3.8

42%

Volunteer/extracurricular experiences

¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

4.0

33%

Other life experience

USMLE/COMLEX Step 3 score 100%

3.6

42%

Consistency of grades

Interest in academic career

3.6

58%

Perceived interest in program

Demonstrated involvement and interest in research

3.4

50%

Pass USMLE Step2 CS/COMLEX Lvl2 PE

Graduate of highly regarded U.S. medical school

3.5

58%

Personal prior knowledge of the applicant Leadership qualities

4.3

50%

17% 8%

3.5

17%

3.5 3

5.0 0% 1

2

4

5

Figure TS-2

Thoracic Surgery Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants (N=12) Percent Citing Factor

Interactions with faculty during interview and visit 92% Interpersonal skills 92% Interactions with house staff during interview and visit 83% Feedback from current residents 83% USMLE Step 1/COMLEX Level 1 score 75% Letters of recommendation in the specialty 92% USMLE Step 2 CK/COMLEX Level 2 CE score 67% Medical Student Performance Evaluation (MSPE/Dean's Letter) 58% Perceived commitment to specialty 75% Evidence of professionalism and ethics 75% Perceived interest in program 42% Leadership qualities 67% Personal prior knowledge of the applicant 50% Class ranking/quartile 8% Graduate of U.S. allopathic medical school 33% Personal Statement 67% Audition elective/rotation within your department 25% Grades in required clerkships 67% Passing USMLE Step 2 CS/COMLEX Level 2 PE 33% Honors in clinical clerkships 67% Honors in clerkship in desired specialty 67% Gaps in medical education 25% Grades in clerkship in desired specialty 67% Alpha Omega Alpha (AOA) membership 50% Other life experience 33% Consistency of grades 42% Volunteer/extracurricular experiences 17% Demonstrated involvement and interest in research 67% Graduate of highly regarded U.S. medical school 58% Other post‐interview contact 58% Interest in academic career 50% Visa status* 17% Applicant was flagged with Match violation by the NRMP 25% Fluency in language spoken by your patient population 17% 0% Gold Society membership Honors in basic sciences 17% Second interview/visit 17% Away rotation in your specialty at another institution 8% USMLE/COMLEX Step 3 score 0% 100% 50% 0% 1 ¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

130

Average Rating

4.8 4.6 4.8 4.6 4.2 4.6 4.3 3.3 4.2 4.3 4.4 4.1 4.0 5.0 4.5 3.4 4.3 3.9 4.0 4.3 4.3 4.0 4.3 4.3 3.5 4.0 3.0 3.5 4.0 4.1 3.8 4.5 4.0 4.5 3.0 4.0 4.0 2

3

4

5

Thoracic Surgery Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure TS-3

Percentage of Programs That Use USMLE Step 1 Score Scores required?

Would your program consider applicants who fail the exam on the first attempt?

N=12

100%

90%

80%

80%

70%

60%

50%

50%

33%

40%

30%

33%

30%

20%

20%

8%

10% 0%

67%

70%

58%

60%

40%

N=6

100%

90%

Yes, pass only

Yes, target score

10% 0%

No

0% Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score Would your program consider applicants who fail the exam on the first attempt?

Scores required? N=12

N=5

100%

100%

90%

90%

80%

80%

70%

70%

60%

60%

50%

42%

80%

50%

42%

40%

40%

30%

30%

17%

20%

20%

10%

10%

0%

0% Yes, pass only

Yes, target score

No

20% 0% Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews Scores Below Which Programs Generally Do Not Grant Interviews

Scores Above Which Programs Almost Always Grant Interviews

260 250 240 230

USMLE Step 1 not reported because of low response rate

USMLE Step 2 CK not reported because of low response rate

220 210

USMLE Step 2 CK not reported because of low response rate

200 190 180 170

USMLE Step 1 N=5

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean. NRMP Program Director Survey Results, 2014

131

Thoracic Surgery Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure TS-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores USMLE Step 2 CS

USMLE Step 3

N=11

100%

91%

90%

N=6

100% 90%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

30%

20%

67%

33%

20%

N=11

10% 0%

9%

Yes

N=6

10% 0%

No

0% Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores COMLEX-USA Level 1* 100%

COMLEX-USA Level 2-CE* 100%

N=7

90%

90%

80%

80%

70%

70%

60%

60%

50%

43%

30%

29%

29%

20%

10%

10% Yes, pass only

Yes, target score

33%

30%

20%

0%

50%

50% 40%

40%

N=6

No

0%

17%

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores COMLEX-USA Level 3* N=4

100%

N=5

90% 80%

Not reported because of low response rate

70%

60%

60% 50% 40%

40%

30% 20% 10% 0%

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

132

0% Yes, pass only

Yes, target score

No

Figure TS-5

Thoracic Surgery Program's Interview Activities

Average Number of Positions, Applications Received, Interview Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and Reviewed

1,000

100%

900

90%

800

80%

700

70%

62%

600

60%

500

50%

400

40%

300

30%

200

20%

108 100 0

36%

1 Number of positions in the Match

N=12*

Number of applications received

N=12

10%

33

28

23

Number of interview invitations sent

Number of applicants interviewed

Number of applicants ranked

N=12

N=12

0%

Percentage of applications rejected

N=12*

Percentage of applicants receiving an in-depth review

N=12

N=12

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type 17% of Thoracic Surgery programs consider all applicant groups 100% N=12

90% 80% 70% 58%

60%

58% 50%

50%

42%

40% 30%

25%

25%

20% 10% 0% U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic Physician

Canadian

133

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Transitional Year (N=47)

NRMP Program Director Survey Results, 2014

134

Figure TY-1

Transitional Year Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview (N=47) Percent Citing Factor

Average Rating

USMLE Step 1/COMLEX Level 1 score 98%

4.2

Letters of recommendation in the specialty Medical Student Performance Evaluation (MSPE/Dean's Letter) USMLE Step 2 CK/COMLEX Level 2 CE score

53%

3.9

85%

4.2

89%

4.1

Personal Statement

70%

Graduate of U.S. allopathic medical school

68%

Grades in required clerkships

3.9 4.4

53%

Gaps in medical education

68%

Honors in clinical clerkships

70%

4.4 4.4 4.3

Perceived commitment to specialty Class ranking/quartile

28% 72%

4.3

Evidence of professionalism and ethics

66%

Personal prior knowledge of the applicant

68%

4.7 4.3

Audition elective/rotation within your department

66%

Pass USMLE Step2 CS/COMLEX Lvl2 PE

64%

3.8 4.2 4.4

74%

4.0

53%

3.9

47%

3.8

60%

Graduate of highly regarded U.S. medical school

3.6

36%

Demonstrated involvement and interest in research

4.3

32%

Applicant was flagged with Match violation by the NRMP

4.6

40%

Interest in academic career Honors in basic sciences

17% 26%

Gold Society membership

23%

Away rotation in your specialty at another institution

6% 15%

Fluency in language spoken by your patient population

¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

135

3.8

28%

Visa status*

USMLE/COMLEX Step 3 score 100%

4.2

23%

Alpha Omega Alpha (AOA) membership

Volunteer/extracurricular experiences

4.1

28%

Grades in clerkship in desired specialty

Other life experience

4.2

45%

Honors in clerkship in desired specialty

Consistency of grades

3.9

40%

Leadership qualities

Perceived interest in program

4.1

3.9 3.9 3.5 4.0 4.4

9% 50%

0% 1

2

3.3 3

4

5

Figure TY-2

Transitional Year Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants (N=47) Percent Citing Factor

Interactions with faculty during interview and visit 89% Interpersonal skills 89% Interactions with house staff during interview and visit 74% Feedback from current residents 83% USMLE Step 1/COMLEX Level 1 score 91% Letters of recommendation in the specialty 40% USMLE Step 2 CK/COMLEX Level 2 CE score 79% Medical Student Performance Evaluation (MSPE/Dean's Letter) 72% Perceived commitment to specialty 21% Evidence of professionalism and ethics 72% Perceived interest in program 79% Leadership qualities 53% Personal prior knowledge of the applicant 57% Class ranking/quartile 66% Graduate of U.S. allopathic medical school 60% Personal Statement 68% Audition elective/rotation within your department 36% Grades in required clerkships 60% Passing USMLE Step 2 CS/COMLEX Level 2 PE 60% Honors in clinical clerkships 64% Honors in clerkship in desired specialty 23% Gaps in medical education 49% Grades in clerkship in desired specialty 19% Alpha Omega Alpha (AOA) membership 57% Other life experience 45% Consistency of grades 40% Volunteer/extracurricular experiences 47% Demonstrated involvement and interest in research 28% Graduate of highly regarded U.S. medical school 34% Other post‐interview contact 45% Interest in academic career 15% Visa status* 23% Applicant was flagged with Match violation by the NRMP 26% Fluency in language spoken by your patient population 19% Gold Society membership 15% Honors in basic sciences 28% Second interview/visit 15% Away rotation in your specialty at another institution 13% USMLE/COMLEX Step 3 score 15% 100% 50% 0% 1 ¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

136

Average Rating

4.7 4.8 4.6 4.3 4.0 3.9 4.2 4.3 4.1 4.6 4.4 4.2 4.4 4.2 4.2 3.9 4.3 4.2 4.2 4.1 3.9 4.3 4.1 4.0 4.0 4.3 3.9 3.8 4.0 4.0 4.0 4.5 4.8 4.4 3.9 4.1 3.7 3.8 3.7 2

3

4

5

Transitional Year Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure TY-3

Percentage of Programs That Use USMLE Step 1 Score Scores required?

Would your program consider applicants who fail the exam on the first attempt?

N=47

100%

80%

90%

74%

80%

70%

70%

60%

50%

40%

40%

28%

30%

23%

20%

20%

10% 0%

65%

60%

50%

30%

N=43

100%

90%

Yes, pass only

Yes, target score

7%

10%

2%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score Would your program consider applicants who fail the exam on the first attempt?

Scores required? N=44

N=36

100%

100%

90%

90%

80%

80%

70%

70%

60%

60%

50% 40%

50%

41%

40%

32%

27%

30%

30%

20%

20%

10%

10%

0%

0% Yes, pass only

69%

Yes, target score

No

28%

3% Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews Scores Below Which Programs Generally Do Not Grant Interviews

Scores Above Which Programs Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=26

N=16

N=19

USMLE Step 2 CK N=10

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean. NRMP Program Director Survey Results, 2014

137

Transitional Year Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure TY-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores USMLE Step 2 CS

USMLE Step 3

N=44

100% 90%

90%

80%

80%

68%

70%

N=19

100%

84%

70%

60%

60%

50%

50%

40%

40%

32%

30%

30%

20%

20%

N=44

10% 0%

16%

N=19

10%

Yes

0%

No

0% Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores COMLEX-USA Level 1* 100%

COMLEX-USA Level 2-CE* 100%

N=27

90%

90%

80%

80%

70%

70% 60%

60%

48%

50% 40%

50% 40%

33%

30%

30%

19%

20%

38% 31%

31%

Yes, pass only

Yes, target score

20% 10%

10% 0%

N=26

Yes, pass only

Yes, target score

No

0%

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores COMLEX-USA Level 2-PE* 100%

COMLEX-USA Level 3* 100%

N=25

90%

90%

80%

80%

70%

70%

60%

80%

60%

52%

50%

50%

40%

40%

40%

30%

30%

20%

20%

8%

10% 0%

N=15

Yes, pass only

Yes, target score

10% No

0%

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

20%

138

0% Yes, pass only

Yes, target score

No

Figure TY-5

Transitional Year Program's Interview Activities

Average Number of Positions, Applications Received, Interview Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and Reviewed

1,000

100%

900

90%

800

80%

700

70%

600

60%

541

500

55%

50%

400

40%

300

34%

30%

200

20%

99

100

78

78

Number of applicants interviewed

Number of applicants ranked

10%

10 0 Number of positions in the Match

N=47*

Number of applications received

N=46

Number of interview invitations sent

N=46

N=45

0%

Percentage of applications rejected

N=47*

Percentage of applicants receiving an in-depth review

N=45

N=46

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type 17% of Transitional Year programs consider all applicant groups 100% N=47

90% 80%

74%

70% 60% 50% 40%

38%

34%

30%

30%

23%

19%

20% 10% 0% U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic Physician

Canadian

139

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Vascular Surgery (N=22)

NRMP Program Director Survey Results, 2014

140

Figure VS-1

Vascular Surgery Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview (N=20) Percent Citing Factor

USMLE Step 1/COMLEX Level 1 score

Average Rating

95%

3.8

Letters of recommendation in the specialty 100% Medical Student Performance Evaluation (MSPE/Dean's Letter)

4.7 70%

USMLE Step 2 CK/COMLEX Level 2 CE score

80%

Personal Statement

80%

3.9 3.6 3.9

Graduate of U.S. allopathic medical school

55%

Grades in required clerkships

3.9

50%

Gaps in medical education Honors in clinical clerkships Perceived commitment to specialty

30%

4.1

80%

4.8 55%

Evidence of professionalism and ethics

55%

Honors in clerkship in desired specialty

4.0 4.2

65%

Pass USMLE Step2 CS/COMLEX Lvl2 PE

4.2 3.8 4.5

65% 3.7

50%

Other life experience

3.7

50%

Graduate of highly regarded U.S. medical school

3.8

55%

4.0

75%

3.9

45%

3.5

10% 10%

Gold Society membership Away rotation in your specialty at another institution

3.0 3.7

30% 15%

Fluency in language spoken by your patient population

141

4.6

25%

Honors in basic sciences

NRMP Program Director Survey Results, 2014

3.7

45%

Applicant was flagged with Match violation by the NRMP

¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

3.9

40%

Volunteer/extracurricular experiences

USMLE/COMLEX Step 3 score 100%

3.6

45%

Consistency of grades

Interest in academic career

4.0

75%

Alpha Omega Alpha (AOA) membership

Visa status*

3.3

60% 65%

Demonstrated involvement and interest in research

4.5

45%

Grades in clerkship in desired specialty

Perceived interest in program

4.0

60%

Audition elective/rotation within your department Leadership qualities

3.5

70%

Class ranking/quartile Personal prior knowledge of the applicant

4.0

3.3

15% 50%

0% 1

2

3

4.3 4

5

Figure VS-2

Vascular Surgery Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants (N=20) Percent Citing Factor

Interactions with faculty during interview and visit 95% Interpersonal skills 100% Interactions with house staff during interview and visit 85% Feedback from current residents 60% USMLE Step 1/COMLEX Level 1 score 75% Letters of recommendation in the specialty 95% USMLE Step 2 CK/COMLEX Level 2 CE score 70% Medical Student Performance Evaluation (MSPE/Dean's Letter) 55% Perceived commitment to specialty 60% Evidence of professionalism and ethics 55% Perceived interest in program 60% Leadership qualities 40% Personal prior knowledge of the applicant 50% Class ranking/quartile 50% Graduate of U.S. allopathic medical school 35% Personal Statement 40% Audition elective/rotation within your department 30% Grades in required clerkships 40% Passing USMLE Step 2 CS/COMLEX Level 2 PE 35% Honors in clinical clerkships 50% Honors in clerkship in desired specialty 40% Gaps in medical education 10% Grades in clerkship in desired specialty 45% Alpha Omega Alpha (AOA) membership 50% Other life experience 40% Consistency of grades 35% Volunteer/extracurricular experiences 25% Demonstrated involvement and interest in research 60% Graduate of highly regarded U.S. medical school 40% Other post‐interview contact 40% Interest in academic career 45% Visa status* 20% Applicant was flagged with Match violation by the NRMP 5% 0% Fluency in language spoken by your patient population 10% Gold Society membership Honors in basic sciences 25% Second interview/visit 5% Away rotation in your specialty at another institution 15% USMLE/COMLEX Step 3 score 20% 100% 50% 0% 1 ¹ Ratings on a scale from 1 (not at all important) to 5 (very important). * International Medical Graduates only

NRMP Program Director Survey Results, 2014

142

Average Rating

4.9 4.7 4.7 4.2 3.9 4.7 3.9 3.8 4.7 4.5 4.6 3.9 3.9 3.8 4.3 3.6 4.0 4.1 3.7 3.7 4.0 3.0 4.1 4.1 3.6 4.2 2.8 3.9 3.9 3.6 4.2 3.5 5.0 2.5 3.4 3.0 4.0 4.0 2

3

4

5

Vascular Surgery Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure VS-3

Percentage of Programs That Use USMLE Step 1 Score Scores required?

Would your program consider applicants who fail the exam on the first attempt?

N=21

100%

81%

80%

90% 80%

70%

60%

50%

50%

40%

40%

30%

32%

30%

19%

20%

10% 0%

68%

70%

60%

20%

N=19

100%

90%

10%

0% Yes, pass only

Yes, target score

0%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score Would your program consider applicants who fail the exam on the first attempt?

Scores required? N=21

N=15

100%

100%

90%

90%

80%

80%

71%

70%

60%

50%

50%

40%

40%

30%

30%

20%

67%

70%

60%

14%

20%

14%

10%

10%

0%

0% Yes, pass only

Yes, target score

33%

No

0% Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews Scores Below Which Programs Generally Do Not Grant Interviews

Scores Above Which Programs Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=11

N=8

N=8

USMLE Step 2 CK N=6

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean. NRMP Program Director Survey Results, 2014

143

Vascular Surgery Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure VS-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores USMLE Step 2 CS

USMLE Step 3

N=21

100%

N=15

100% 90%

90%

76%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30% 20%

20%

N=21

0%

33%

30%

24%

10%

53%

13%

N=15

10%

Yes

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores COMLEX-USA Level 1* 100%

COMLEX-USA Level 2-CE* 100%

N=13

90%

90%

80%

80%

70%

70%

60%

60%

50%

50%

38%

40% 30%

38%

50%

40%

33%

30%

23%

20%

20%

10%

10%

0%

N=12

Yes, pass only

Yes, target score

No

0%

17%

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores COMLEX-USA Level 2-PE* 100%

COMLEX-USA Level 3* 100%

N=11

90%

90%

80%

80%

70%

70%

60%

60%

50%

45% 27%

27%

20%

10%

10% Yes, pass only

Yes, target score

No

0%

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

30%

30%

20%

0%

50%

50% 40%

40% 30%

N=10

144

20%

Yes, pass only

Yes, target score

No

Vascular Surgery Program's Interview Activities

Figure VS-5

Average Number of Positions, Applications Received, Interview Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and Reviewed

1,000

100%

900

90%

800

80%

700 600

60%

500

50%

400

40%

300

27%

30%

200

20%

100 0

69%

70%

54 1 Number of positions in the Match

Number of applications received

N=22*

N=21

10%

22

17

14

Number of interview invitations sent

Number of applicants interviewed

Number of applicants ranked

N=22

N=22

0%

Percentage of applications rejected

N=22*

Percentage of applicants receiving an in-depth review

N=21

N=21

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type 38% of Vascular Surgery programs consider all applicant groups

95%

N=21

90% 80%

71%

70%

62%

60% 48%

50%

52% 43%

43%

40% 30% 20% 10% 0% U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic Physician

Canadian

145

Fifth Pathway

U.S. IMG

Non-U.S. IMG