Hiring in life sciences? Share your open positions with our professional community. Read more Close

Advertisement

Cognitive Evaluation of Multimodal Large Language Models in Dental Radiography.

Created on 16 Nov 2026

Authors

Rongyang Wang, Shuang Zhou, Jiashuo Wang, Wenya Xie, Xiaoxia Che

Published in

Journal of dentistry. Pages 107174. Nov 15, 2026. Epub Nov 15, 2026.

Abstract

We evaluated the cognitive capabilities and safety boundaries of general-purpose, zero-shot multimodal large language models (MLLMs) in dental radiography.
OralMLLM-Bench comprised 27 independently evaluated tasks across periapical, panoramic, and lateral cephalometric radiographs, grouped into four categories: perception, comprehension, prediction, and decision-making. Six MLLMs and two clinician comparators were evaluated across 3,820 assessment units using sensitivity, specificity, balanced accuracy (BA), partial-credit average score (PCAS), and conditional rationale accuracy (CRA).
MLLMs showed relatively stronger performance for selected visually salient findings, with sensitivity up to 0.917 for root filling detection and 0.875 for restoration detection, but lower performance for low-contrast findings and spatial localization. Only 6 of 27 tasks showed significant between-model differences after false discovery rate correction, with no broad, consistent advantage for any model. Agreement with expert image-based reference assessments was generally limited in prediction and decision-making tasks. Errors included artifact-induced false positives, low-contrast-induced false negatives, spatial localization errors, conclusion-rationale inconsistency, and unflagged diagnostic uncertainty.
Under standardized, image-only benchmark conditions, MLLMs showed task-dependent performance and persistent limitations in dental radiography.
OralMLLM-Bench provides a clinically grounded framework for evaluating model capability and safety boundaries across different categories of radiographic interpretation tasks, thereby supporting the development of safer and more clinically reliable AI systems.

PMID:
43035140
Bibliographic data and abstract were imported from PubMed on 16 Nov 2026.

Read full publication at:
Please sign in to see all details.

Advertisement

Stats

  • Community rating n/a 0 votes
  • Reviewers' rating n/a 0 votes
  • Your rating

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

  • Recommendations n/a n/a positive of 0 vote(s)
  • Views 11
  • Comments 0

Recommended by

  • No recommendations yet.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.

Advertisement