Supporting patient understanding of cervical and ovarian cancer: how well does AI perform?

Authors

Riley Shin, Ashley Shin, Mia Ramirez, Ioana L Bondre, Diego J Aviles, Elizabeth K Nugent

Published in

Proceedings (Baylor University. Medical Center). Pages 1-5. Jul 06, 2026. Epub Jul 06, 2026.

Abstract

As the public increasingly interacts with artificial intelligence (AI) chatbots, we compared the answers from five AI chatbots to standardized questions that patients might ask about ovarian and cervical cancer.
ChatGPT 3.5, Google Gemini 2.0, Reddit Answers, Bootcamp, and DeepSeek were queried with 15 frequently asked questions (FAQs) on cervical cancer and 11 on ovarian cancer. In a blinded, randomized survey, each deidentified response was independently assessed by three gynecologic oncologists using a 4-point scale (1, accurate and comprehensive; 2, accurate but inadequate; 3, accurate but outdated or inaccurate; 4, completely inaccurate). Readability (Flesch-Kincaid grade level) and word count were recorded.
For cervical cancer FAQs, ChatGPT 3.5, Google Gemini 2.0, Reddit Answers, Bootcamp, and DeepSeek received scores of 1.4, 1.6, 2.7, 1.5, and 1.5, respectively. For ovarian cancer FAQs, average scores were 1.3, 1.4, 2.5, 1.2, and 1.4, respectively. All AI chatbot responses were written at a reading level above 11th grade, making them generally difficult for the average American to read.
Although generally rated as accurate and adequate, the answers were frequently off-topic and not generalizable. Healthcare providers should be aware of unintentionally generated misinformation to better counsel patients.

PMID:
42405834
Bibliographic data and abstract were imported from PubMed on 06 Jul 2026.

Read full publication at:
Please sign in to see all details.

Stats

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.