ChatGPT outperforms medical students in clinical exams

Share post:

A study by Stanford researchers has found that ChatGPT, a large language model AI system, can outperform first- and second-year medical students in answering challenging clinical care exam questions.

The study, published in JAMA Internal Medicine, found that ChatGPT scored an average of 4.2 points higher than medical students on the case-report section of the exam. ChatGPT also had a higher passing rate, with 93% of its responses receiving a passing grade compared to 85% for medical students.

The researchers believe that ChatGPT’s success is due to its ability to quickly process and synthesize large amounts of medical data. ChatGPT can also generate text that is both informative and engaging, which is important for answering complex clinical questions. However, the study also found that ChatGPT can sometimes make mistakes. For example, ChatGPT may confabulate, or make up information that is not supported by the evidence.

The study’s findings suggest that AI has the potential to revolutionize medical education. ChatGPT could be used to help medical students learn about different diseases and treatments, and it could also be used to provide real-time clinical advice to doctors.

Stanford School of Medicine is already considering how to incorporate AI tools into its curriculum. The school is also considering switching exams from open book to closed book to address concerns about test-taking integrity.

The sources for this piece include an article in Stanford.

Featured Tech Jobs


Related articles

Google Bard chats indexed in Google search

Users of Google Bard are reporting that their conversations with Bard are being indexed and appearing in Google...

Jony Ive and OpenAI working on AI hardware partnership

Jony Ive, the former design lead at Apple, is reportedly in talks with OpenAI CEO Sam Altman about...

AI models show promise in hurricane forecasting

New AI-based weather models are showing promise in hurricane forecasting. These AI weather models work by learning patterns...

Spotify launches AI voice translator for podcasts

Spotify is set to take podcasting to a new level with its new AI voice translation feature which...

Become a member

New, Relevant Tech Stories. Our article selection is done by industry professionals. Our writers summarize them to give you the key takeaways