Jordanian medical students’ perspective on the impact of a Pass/Fail USMLE Step 1: A Cross-Sectional Investigation

Hamza Ghazzal; Yousef Omar; Dunia Jaber; Rahaf Melhem; Ibrahim Alzoraiqi; Ahmad Toubasi; Heba Kalbouneh

doi:10.58877/japaj.v2i2.141

Authors

Hamza Ghazzal School of Medicine, The University of Jordan, Amman, Jordan
Yousef Omar School of Medicine, The University of Jordan, Amman, Jordan
Dunia Jaber School of Medicine, The University of Jordan, Amman, Jordan
Rahaf Melhem School of Medicine, The University of Jordan, Amman, Jordan
Ibrahim Alzoraiqi School of Medicine, The University of Jordan, Amman, Jordan
Ahmad Toubasi School of Medicine, The University of Jordan, Amman, Jordan
Heba Kalbouneh Department of Anatomy and Histology, School of Medicine, The University of Jordan, Amman, Jordan

DOI:

https://doi.org/10.58877/japaj.v2i2.141

Keywords:

medical education, USMLE, International Medical Student, International Medical Graduate, Pass/Fail

Abstract

Purpose of the study: to discuss Jordanian medical students’ perspective on USMLE step 1 pass/fail score and its impact on their clinical future.

Study Design: This cross-sectional study was conducted among medical students at all six schools of medicine in Jordan. An online self-administered questionnaire was used, consisting of 33 questions assessing the participants’ socio-demographics, socio-academics, intentions to apply for the USMLE step 1 examination and their attitudes toward the conversion of USMLE step 1 to pass/fail scoring system.

Results: A total number of 504 medical students completed the survey. Among participating students, 44.4% agreed that USMLE should be pass/fail, while only 26.8% were against it. Furthermore, 82.3% of the students agreed that by this change, Step 2 CK will carry more weight in selecting applicants for residency. Moreover, 86.7% of respondents believed that more students will participate in research activities which were ranked as the second most important item for residency matching.

Conclusion: Converting USMLE step 1 scoring system to a pass/fail score will likely increase the weight of Step 2 Clinical Knowledge (CK) score as well as on the research experience for selecting applicants for residency.

References

O’Donnell MJ, Obenshain SS, Erdmann JB. Background essential to the proper use of results of step 1 and step 2 of the USMLE. Acad Med [Internet]. 1993 [cited 2022 Dec 25];68(10):734–9. Available from: https://pubmed.ncbi.nlm.nih.gov/8397597/ DOI: https://doi.org/10.1097/00001888-199310000-00002

USMLE Step 1 Transition to Pass/Fail Only Score Reporting | USMLE [Internet]. [cited 2022 Mar 25]. Available from: https://www.usmle.org/usmle-step-1-transition-passfail-only-score-reporting

Thompson RH, Lohse CM, Husmann DA, Leibovich BC, Gettman MT. Predictors of a Successful Urology Resident Using Medical Student Application Materials. Urology [Internet]. 2017 Oct 1 [cited 2022 Dec 25];108:22–8. Available from: https://pubmed.ncbi.nlm.nih.gov/28751165/ DOI: https://doi.org/10.1016/j.urology.2017.06.046

Nagasawa DT, Beckett JS, Lagman C, Chung LK, Schmidt B, Safaee M, et al. United States Medical Licensing Examination Step 1 Scores Directly Correlate with American Board of Neurological Surgery Scores: A Single-Institution Experience. World Neurosurg [Internet]. 2017 Feb 1 [cited 2022 Dec 25];98:427–31. Available from: https://pubmed.ncbi.nlm.nih.gov/27890766/ DOI: https://doi.org/10.1016/j.wneu.2016.11.091

Ehrlich H, Sutherland M, McKenney M, Elkbuli A. Implications of the United States Medical Licensing Examination Step 1 Examination Transition to Pass/Fail on Medical Students Education and Future Career Opportunities. Am Surg [Internet]. 2021 Aug 1 [cited 2022 Mar 11];87(8):1196–202. Available from: https://pubmed.ncbi.nlm.nih.gov/33345588/ DOI: https://doi.org/10.1177/0003134820973382

Wallach SL, Williams C, Chow RT, Jadhav N, Kuehl S, Raj JM, et al. Internal medicine resident perspectives on scoring USMLE as pass/fail. https://doi.org/101080/2000966620201796366 [Internet]. 2020 Sep 2 [cited 2022 Sep 18];10(5):381–5. Available from: https://www.tandfonline.com/doi/abs/10.1080/20009666.2020.1796366 DOI: https://doi.org/10.1080/20009666.2020.1796366

Lewis CE, Hiatt JR, Wilkerson L, Tillou A, Parker NH, Hines OJ. Numerical Versus Pass/Fail Scoring on the USMLE: What Do Medical Students and Residents Want and Why? J Grad Med Educ [Internet]. 2011 Mar 1 [cited 2022 Mar 25];3(1):59–66. Available from: https://pubmed.ncbi.nlm.nih.gov/22379524/ DOI: https://doi.org/10.4300/JGME-D-10-00121.1

McDade W, Vela MB, Sánchez JP. Anticipating the Impact of the USMLE Step 1 Pass/Fail Scoring Decision on Underrepresented-in-Medicine Students. Academic Medicine [Internet]. 2020 [cited 2022 Mar 11];1318–21. Available from: https://journals.lww.com/academicmedicine/Fulltext/2020/09000/Anticipating_the_Impact_of_the_USMLE_Step_1.29.aspx DOI: https://doi.org/10.1097/ACM.0000000000003490

Chaudhry HJ, Katsufrakis PJ, Tallia AF. The USMLE Step 1 Decision: An Opportunity for Medical Education and Training. JAMA [Internet]. 2020 May 26 [cited 2022 Mar 25];323(20):2017–8. Available from: https://jamanetwork.com/journals/jama/fullarticle/2762731 DOI: https://doi.org/10.1001/jama.2020.3198

Bowles LT, Melnick DE, Nungester RJ, Golden GS, Swanson DB, Case SM, et al. Review of the score-reporting policy for the United States Medical Licensing Examination. Acad Med [Internet]. 2000 [cited 2022 Sep 17];75(5):426–31. Available from: https://pubmed.ncbi.nlm.nih.gov/10824764/ DOI: https://doi.org/10.1097/00001888-200005000-00008

Huq S, Khalafallah AM, Botros D, Jimenez AE, Lam S, Huang J, et al. Perceived impact of USMLE Step 1 pass/fail scoring change on neurosurgery: program director survey. J Neurosurg [Internet]. 2020 Jun 19 [cited 2022 Dec 25];133(3):928–35. Available from: https://thejns.org/view/journals/j-neurosurg/133/3/article-p928.xml DOI: https://doi.org/10.3171/2020.4.JNS20748

Nungester RJ, Dawson-Saunders B, Kelley PR, Volle RL. Score reporting on NBME examinations. Acad Med [Internet]. 1990 [cited 2022 Sep 17];65(12):723–9. Available from: https://pubmed.ncbi.nlm.nih.gov/2252485/ DOI: https://doi.org/10.1097/00001888-199012000-00002

Girard AO, Qiu C, Lake I V., Chen J, Lopez CD, Yang R. US Medical Student Perspectives on the Impact of a Pass/Fail USMLE Step 1. J Surg Educ. 2022 Mar 1;79(2):397–408. DOI: https://doi.org/10.1016/j.jsurg.2021.09.010

Ganesh Kumar N, Pontell ME, Makhoul AT, Drolet BC. Comprehensive Reform and Greater Equity in Applying to Residency—Trainees’ Mixed Responses to a Pass/Fail USMLE Step 1. J Grad Med Educ [Internet]. 2021 Oct 1 [cited 2022 Sep 17];13(5):711–6. Available from: https://meridian.allenpress.com/jgme/article/13/5/711/472084/Comprehensive-Reform-and-Greater-Equity-in DOI: https://doi.org/10.4300/JGME-D-20-01511.1

Pontell ME, Makhoul AT, Ganesh Kumar N, Drolet BC. The Change of USMLE Step 1 to Pass/Fail: Perspectives of the Surgery Program Director. J Surg Educ [Internet]. 2021 Jan 1 [cited 2022 Sep 18];78(1):91–8. Available from: https://pubmed.ncbi.nlm.nih.gov/32654997/ DOI: https://doi.org/10.1016/j.jsurg.2020.06.034

Choudhary A, Makhoul AT, Ganesh Kumar N, Drolet BC. Impact of Pass/Fail USMLE Step 1 Scoring on the Internal Medicine Residency Application Process: a Program Director Survey. J Gen Intern Med [Internet]. 2021 Aug 1 [cited 2022 Sep 18];36(8):2509–10. Available from: https://link.springer.com/article/10.1007/s11606-020-05984-y DOI: https://doi.org/10.1007/s11606-020-05984-y

Lin LO, Makhoul AT, Hackenberger PN, Ganesh Kumar N, Schoenbrunner AR, Pontell ME, et al. Implications of Pass/Fail Step 1 Scoring: Plastic Surgery Program Director and Applicant Perspective. Plast Reconstr Surg Glob Open [Internet]. 2020 [cited 2022 Sep 18];8(12). Available from: /pmc/articles/PMC7787322/ DOI: https://doi.org/10.1097/GOX.0000000000003266

Chisholm LP, Drolet BC. USMLE Step 1 Scoring Changes and the Urology Residency Application Process: Program Directors’ Perspectives. Urology [Internet]. 2020 Nov 1 [cited 2022 Sep 18];145:79–82. Available from: https://pubmed.ncbi.nlm.nih.gov/32882303/ DOI: https://doi.org/10.1016/j.urology.2020.08.033

Ganesh Kumar N, Makhoul AT, Pontell ME, Drolet BC. Characterizing the Effect of Pass/Fail U.S. Medical Licensing Examination Step 1 Scoring in Neurosurgery: Program Directors’ Perspectives. World Neurosurg [Internet]. 2020 Oct 1 [cited 2022 Sep 18];142:e440–4. Available from: https://pubmed.ncbi.nlm.nih.gov/32688036/ DOI: https://doi.org/10.1016/j.wneu.2020.07.053

Mamidi IS, Gu A, Mulcahy CF, Wei C, Zapanta PE. Perceived Impact of USMLE Step 1 Score Reporting to Pass/Fail on Otolaryngology Applicant Selection. Ann Otol Rhinol Laryngol [Internet]. 2022 May 1 [cited 2022 Sep 18];131(5):506–11. Available from: https://pubmed.ncbi.nlm.nih.gov/34192891/ DOI: https://doi.org/10.1177/00034894211028436

Mun F, Jeong S, Juliano PJ, Hennrikus WL. Perceptions of USMLE Step 1 Pass/Fail Score Reporting Among Orthopedic Surgery Residency Program Directors. Orthopedics [Internet]. 2022 Jan 1 [cited 2022 Sep 18];45(1):e30–4. Available from: https://pubmed.ncbi.nlm.nih.gov/34846244/ DOI: https://doi.org/10.3928/01477447-20211124-08

Tamakuwala S, Dean J, Kramer KJ, Shafi A, Ottum S, George J, et al. Potential Impact of Pass/Fail Scores on USMLE Step 1: Predictors of Excellence in Obstetrics and Gynecology Residency Training. https://doi.org/101177/23821205211037444 [Internet]. 2021 Nov 15 [cited 2022 Sep 18];8:238212052110374. Available from: https://journals.sagepub.com/doi/full/10.1177/23821205211037444 DOI: https://doi.org/10.1177/23821205211037444

Residency Data & Reports | NRMP [Internet]. [cited 2022 Sep 18]. Available from: https://www.nrmp.org/match-data-analytics/residency-data-reports/

Rozenshtein A, Mullins ME, Marx MV. The USMLE Step 1 Pass/Fail Reporting Proposal: The APDR Position. Acad Radiol. 2019 Oct 1;26(10):1400–2. DOI: https://doi.org/10.1016/j.acra.2019.06.004

Salari S, Deng F. A Stepping Stone Toward Necessary Change: How the New USMLE Step 1 Scoring System Could Affect the Residency Application Process. Academic Medicine [Internet]. 2020 [cited 2022 Sep 18];1312–4. Available from: https://journals.lww.com/academicmedicine/Fulltext/2020/09000/A_Stepping_Stone_Toward_Necessary_Change__How_the.27.aspx DOI: https://doi.org/10.1097/ACM.0000000000003501

Salehi PP, Azizzadeh B, Lee YH. Pass/Fail Scoring of USMLE Step 1 and the Need for Residency Selection Reform. Otolaryngol Head Neck Surg [Internet]. 2021 Jan 1 [cited 2022 Sep 18];164(1):9–10. Available from: https://pubmed.ncbi.nlm.nih.gov/32838643/ DOI: https://doi.org/10.1177/0194599820951166

Makhoul AT, Pontell ME, Ganesh Kumar N, Drolet BC. Objective Measures Needed — Program Directors’ Perspectives on a Pass/Fail USMLE Step 1. New England Journal of Medicine [Internet]. 2020 Jun 18 [cited 2022 Sep 18];382(25):2389–92. Available from: https://www.nejm.org/doi/10.1056/NEJMp2006148 DOI: https://doi.org/10.1056/NEJMp2006148

Raborn LN, Janis JE. Current Views on the New United States Medical Licensing Examination Step 1 Pass/Fail Format: A Review of the Literature. J Surg Res [Internet]. 2022 Jun 1 [cited 2022 Sep 18];274:31–45. Available from: https://pubmed.ncbi.nlm.nih.gov/35121548/ DOI: https://doi.org/10.1016/j.jss.2022.01.002

Mun F, Scott AR, Cui D, Lehman EB, Jeong SH, Chisty A, et al. A comparison of orthopaedic surgery and internal medicine perceptions of USMLE Step 1 pass/fail scoring. BMC Med Educ [Internet]. 2021 Dec 1 [cited 2022 Sep 18];21(1):1–8. Available from: https://bmcmededuc.biomedcentral.com/articles/10.1186/s12909-021-02699-4 DOI: https://doi.org/10.1186/s12909-021-02699-4

Goshtasbi K, Abouzari M, Tjoa T, Malekzadeh S, Bhandarkar ND. The Effects of Pass/Fail USMLE Step 1 Scoring on the Otolaryngology Residency Application Process. Laryngoscope [Internet]. 2021 Mar 1 [cited 2022 Sep 18];131(3):E738–43. Available from: https://onlinelibrary.wiley.com/doi/full/10.1002/lary.29072 DOI: https://doi.org/10.1002/lary.29072