ChatGPT Does Not Pass American College of Gastroenterology Tests

MONDAY, May 22, 2023 (HealthDay News) -- The natural language processing model Chat Generative Pretrained Transformer (ChatGPT) does not pass the American College of Gastroenterology (ACG) Self-Assessment Tests, according to a study published online May 22 in the American Journal of Gastroenterology.

Kelly Suchman, M.D., from the Zucker School of Medicine at Hofstra/Northwell and the Long Island Jewish Medical Center in New Hyde Park, New York, and colleagues assessed ChatGPT-3 and ChatGPT-4 performance on the 2022 and 2021 ACG Self-Assessment Tests. A 70 percent score or higher was required to pass the assessment.

Originally published on, part of the BLOX Digital Content Exchange.