Abstract
Purpose: Situational Judgment Tests (SJTs) are increasingly utilized in medical trainee recruitment decisions yet little is known of their potential biases. This study was designed to evaluate the Computer-Based Assessment for Sampling Personal Characteristics (CASPer) SJT scores of ophthalmology residency applicants and compare these to Step 1 and Step 2 scores in different demographic groups.
Methods: All applicants to the ophthalmology residency match completed CASPer during the 2022-2023 recruitment cycle. Applicant scores were cross-referenced within the SF Match Residency Application System to collect data on applicant gender, self-identified Under-Represented in Medicine (URiM) status, and International Medical Graduate (IMG) status, as well as Step 1 and Step 2 scores.
Results: A total of 760 of 765 (99.3%) of applicants with CASPer scores were identified in SF Match, 41% of which were female, 15% URiM, and 11% IMG. Males scored slightly higher on all three tests, with the mean difference in Step 1 (4.3) reaching a statistical significance (Cohen’s d=0.29, p
Conclusions: The CASPer SJT demonstrated significant bias against URiM and IMG ophthalmology residency applicants. This bias was even greater than Step 1 and Step 2 performance, suggesting the continued need for caution when utilizing any standardized testing in recruitment decisions.
Received Date
31-May-2024
Accepted Date
23-Aug-2024
Recommended Citation
Moore, Daniel B.; Rosenberg, Jamie B.; Moon, Jee-Young; Pettey, Jeff; and Faridi, Ambar
(2024)
"Underrepresented in Medicine and International Graduate Bias in the CASPer Situational Judgment Test for Ophthalmology Residency Applicants in 2022-2023,"
Journal of Academic Ophthalmology: Vol. 16:
Iss.
2, Article 12.
Available at:
https://www.aupojournal.org/jao/vol16/iss2/12
