conversational agent

In a recent interview posted on JMIR TV, JMIR Publications’ CEO Dr Gunther Eysenbach speaks with Dr Andrew Taylor from Yale University School of Medicine about their paper titled “How Does ChatGPT Perform on the United States Medical Licensing Examination? The Implications of Large Language Models for Medical Education and Knowledge Assessment,” published in JMIR Medical Education.  The study examined how ChatGPT performed on the United States Medical Licensing Examination (USMLE) compared to other AI language models such as InstructGPT and GPT-3. The researchers found that ChatGPT’s performance on the exam was comparable to that of a third-year medical student in terms of medical knowledgeRead More →

A study published on February 8, 2023, in JMIR Medical Education, a leading open access journal on digital medical education, evaluated the potential of ChatGPT, a natural language processing model, as a medical education tool. The study found that ChatGPT reaches the equivalent of a passing score for a third-year medical student. Conducted by researchers from Yale University School of Medicine’s Section for Biomedical Informatics and Data Science and University College Dublin, the study aimed to test the performance of ChatGPT and previous-generation large language models on the medical question-answering problem as part of the United States Medical Licensing Examination (USMLE) Step 1 and StepRead More →