Hiring in life sciences? Share your open positions with our professional community. Read more Close

Advertisement

Evaluation of the performance of ChatGPT-4o on oral surgery-related questions in the Japanese National Dental Examination.

Created on 02 Sep 2026

Authors

H Fukuda, M Morishita, O Takahashi, M Sasaguri, M Habu

Published in

International journal of oral and maxillofacial surgery. Sep 01, 2026. Epub Sep 01, 2026.

Abstract

Artificial intelligence (AI) has advanced rapidly in healthcare, with large language models (LLMs) like ChatGPT-4o showing potential in education and clinical support. This study evaluated the performance of ChatGPT-4o on oral surgery-related questions from the Japanese National Dental Examination, focusing on how visual materials impact accuracy. Questions were categorized by type (general knowledge vs clinical practice), number of correct answers required, and presence of visual materials (e.g., radiographs, models). The comparison of correct and incorrect answers according to the number of visual materials was performed using the Mann-Whitney U-test, while logistic regression was used to assess the influence of specific visual content types. ChatGPT-4o performed well on general knowledge questions but showed lower accuracy on questions requiring clinical decision-making . The presence of multiple visual materials significantly reduced accuracy, with panoramic radiographs and dental models showing the strongest negative effects (odds ratios 0.46 and 0.45, respectively; both P = 0.002). Other visual materials, such as computed tomography/magnetic resonance imaging scans, had no significant impact. These findings highlight the strengths of ChatGPT-4o in processing structured textual data and its limitations in interpreting visual or procedural content. Enhancing AI-assisted dental education will require domain-specific training data and the development of multimodal models capable of integrating both text and images. This study informs future applications of AI in oral surgery education.

PMID:
42680602
Bibliographic data and abstract were imported from PubMed on 02 Sep 2026.

Read full publication at:
Please sign in to see all details.

Advertisement

Stats

  • Community rating n/a 0 votes
  • Reviewers' rating n/a 0 votes
  • Your rating

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

  • Recommendations n/a n/a positive of 0 vote(s)
  • Views 11
  • Comments 0

Recommended by

  • No recommendations yet.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.

Advertisement