ChatGPT outperforms medical students in clinical exams

Share post:

A study by Stanford researchers has found that ChatGPT, a large language model AI system, can outperform first- and second-year medical students in answering challenging clinical care exam questions.

The study, published in JAMA Internal Medicine, found that ChatGPT scored an average of 4.2 points higher than medical students on the case-report section of the exam. ChatGPT also had a higher passing rate, with 93% of its responses receiving a passing grade compared to 85% for medical students.

The researchers believe that ChatGPT’s success is due to its ability to quickly process and synthesize large amounts of medical data. ChatGPT can also generate text that is both informative and engaging, which is important for answering complex clinical questions. However, the study also found that ChatGPT can sometimes make mistakes. For example, ChatGPT may confabulate, or make up information that is not supported by the evidence.

The study’s findings suggest that AI has the potential to revolutionize medical education. ChatGPT could be used to help medical students learn about different diseases and treatments, and it could also be used to provide real-time clinical advice to doctors.

Stanford School of Medicine is already considering how to incorporate AI tools into its curriculum. The school is also considering switching exams from open book to closed book to address concerns about test-taking integrity.

The sources for this piece include an article in Stanford.

Featured Tech Jobs


Related articles

Microsoft and OpenAI partner to build a $100 Billion AI supercomputer “Stargate”

In a bold stride towards computational supremacy, Microsoft, in partnership with OpenAI, is reported to be laying the...

US Bill Aims to Unveil AI Training Data Sources Amid Copyright Concerns

In a significant move toward transparency, a bill was introduced in the US Congress on Tuesday by California...

AI presents an “extinction level threat” – US Gov’t Report: Hashtag Trending for Tuesday, March 12, 2024

A new US government report warns that AI presents an “extinction level threat to the human species. Elon Musk is outsourcing his Grok AI code. Hackers have breached the Cybersecurity and Infrastructure Security Agency in the US and a researcher shows how to steal a Tesla by leveraging a feature of the Tesla charging stations.

Robot startup uses ChatGPT to enhance its communications and reasoning skills

Humanoid robot startup Figure has secured a significant $675 million investment from a group of high-profile investors, including...

Become a member

New, Relevant Tech Stories. Our article selection is done by industry professionals. Our writers summarize them to give you the key takeaways