Authors
Rongyang Wang, Shuang Zhou, Jiashuo Wang, Wenya Xie, Xiaoxia Che
Published in
Journal of dentistry. Pages 107174. Nov 15, 2026. Epub Nov 15, 2026.
Abstract
We evaluated the cognitive capabilities and safety boundaries of general-purpose, zero-shot multimodal large language models (MLLMs) in dental radiography.
OralMLLM-Bench comprised 27 independently evaluated tasks across periapical, panoramic, and lateral cephalometric radiographs, grouped into four categories: perception, comprehension, prediction, and decision-making. Six MLLMs and two clinician comparators were evaluated across 3,820 assessment units using sensitivity, specificity, balanced accuracy (BA), partial-credit average score (PCAS), and conditional rationale accuracy (CRA).
MLLMs showed relatively stronger performance for selected visually salient findings, with sensitivity up to 0.917 for root filling detection and 0.875 for restoration detection, but lower performance for low-contrast findings and spatial localization. Only 6 of 27 tasks showed significant between-model differences after false discovery rate correction, with no broad, consistent advantage for any model. Agreement with expert image-based reference assessments was generally limited in prediction and decision-making tasks. Errors included artifact-induced false positives, low-contrast-induced false negatives, spatial localization errors, conclusion-rationale inconsistency, and unflagged diagnostic uncertainty.
Under standardized, image-only benchmark conditions, MLLMs showed task-dependent performance and persistent limitations in dental radiography.
OralMLLM-Bench provides a clinically grounded framework for evaluating model capability and safety boundaries across different categories of radiographic interpretation tasks, thereby supporting the development of safer and more clinically reliable AI systems.
PMID:
43035140
Bibliographic data and abstract were imported from PubMed on 16 Nov 2026.
Read full publication at:
Please sign in
to see all details.
Advertisement
Stats
- Recommendations n/a n/a positive of 0 vote(s)
- Views 11
- Comments 0