PLOS Digital Health· 2023Q1
Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models
- 3,630citations
- Q1SCImago
- 2023year
Short summary
ChatGPT achieved performance at or near the passing threshold on all three USMLE exams (Step 1, Step 2CK, Step 3) without specialized training.
AI-generated from the title and abstract; the full text is not read.
Key points
- ChatGPT scored at or near the passing threshold on USMLE Step 1, Step 2CK, and Step 3.
- No specialized training or reinforcement was provided to ChatGPT for the exams.
- The model showed a high degree of concordance and insight in its explanations.
- Results indicate potential for AI in medical education and clinical decision support.
AI-generated from the title and abstract; the full text is not read.
Abstract
We evaluated the performance of a large language model called ChatGPT on the United States Medical Licensing Exam (USMLE), which consists of three exams: Step 1, Step 2CK, and Step 3. ChatGPT performed at or near the passing threshold for all three exams without any specialized training or reinforcement. Additionally, ChatGPT demonstrated a high level of concordance and insight in its explanations. These results suggest that large language models may have the potential to assist with medical education, and potentially, clinical decision-making.
The authors' abstract, as published at the source. PLOS Digital Health, 2023 · DOI ↗
Continue with a free account
Ask the paper: 3 free questions a day about this paper; save it, get its citation, new summaries every day for your field. Takeaways are Premium.
Continue free on the webSign in with Google or Apple; no card needed. You come back to this paper.
On your phone:
Field: Health Informatics
Health InformaticsMedicine