Applicability of Artificial Intelligence-Enabled Chatbots in Medical Physics.

Authors

Avinav Bharati, Deepsekhar Das, Susama R Mandal, Pratik Kumar, Atindra Narayan, Raaj K Bisht, Lalit Takia, Varsha Mishra

Published in

Cureus. Volume 18. Issue 6. Pages e110649. Epub Jun 11, 2026.

Abstract

Aim Chatbots are emerging as a new and valuable tool in healthcare, offering a wide range of applications. Their use as a tool in medical physics has immense future potential. This study aimed to evaluate the performance of three artificial intelligence (AI) chatbots - ChatGPT, DeepSeek, and Gemini - in response to questions or queries related to medical physics in oncology. Materials and methods A total of 11 questions from the field of medical physics pertaining to oncology were formulated by medical physics experts. These queries were presented to the AI chatbots - ChatGPT 5.2, DeepSeek V 3.2, and Gemini 3.0 - on a predetermined date. Responses were obtained by repeating the same question once for each chatbot. The initial responses were noted and evaluated by three experts based on their correctness, completeness, ease of understanding, reliability, and applicability in the national scenario. Results The mean correctness scores were 3.4, 3.81, and 3.09 for ChatGPT, DeepSeek, and Gemini, respectively. Regarding completeness, the DeepSeek gave the maximum responses, that is, 10 complete responses to the 11 questions. No statistically significant difference was foundin real-world applicability score for the three models. Conclusion In terms of performance metrics such as correctness, DeepSeek gave better results. None of the chatbots were seen to be good enough to replicate human intelligence in metrics such as correctness, completeness, or real-world applicability. A symbiotic collaboration between AI chatbots and medical professionals is essential for enhancing healthcare delivery.

PMID:
42437234
Bibliographic data and abstract were imported from PubMed on 12 Jul 2026.

Read full publication at:
Please sign in to see all details.

Stats

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.