Hiring in life sciences? Share your open positions with our professional community. Read more Close

Advertisement

Can Dental Professionals Distinguish Human-Authored From AI-Generated Scientific Abstracts? A Blinded Cross-Sectional Study.

Created on 06 Nov 2026

Authors

Sholem Hack, Mahmoud Masri, Yusef Reema, Amir Laviv, Rebecca Attal, Ameen Biadsee, Ameer Biadsee

Published in

European journal of dental education : official journal of the Association for Dental Education in Europe. Nov 05, 2026. Epub Nov 05, 2026.

Abstract

To evaluate whether dental professionals can distinguish human-authored from generative artificial intelligence (GenAI)-generated dental research abstracts under blinded conditions and to explore differences in detectability across contemporary large language models (LLMs).
In this exploratory blinded cross-sectional study, 23 dental professionals (10 general dentists, 7 specialists, 6 dental students) evaluated 60 abstracts derived from 15 published dental research articles: the 15 published abstracts and 45 GenAI-generated abstracts produced from the main text of the same articles by Claude Sonnet 4.6, GPT-5.4 and Gemini 3. Participants classified each abstract as human-authored, AI-generated or 'Unsure' and rated confidence, quality and credibility on five-point scales. Discrimination was assessed using sensitivity, specificity, balanced accuracy and signal-detection measures, with a probit mixed-effects model accounting for variability between participants, abstracts and source articles.
Of 1377 classifications, 10.0% were 'Unsure'. Balanced accuracy was 56.0% (95% CI 49.6%-62.4%) and did not differ significantly from chance (p = 0.070). In the mixed-effects model, discrimination was weak and not statistically significant (d' = 0.39, 95% CI -0.08-0.86) and participants showed no systematic response bias. Detectability did not differ between LLMs (p = 0.157) or expertise groups (p = 0.99). Confidence was not calibrated to accuracy (mean 3.58 for correct vs. 3.61 for incorrect classifications, p = 0.75) and GenAI-generated abstracts were not rated lower than human-authored abstracts in quality or credibility. Findings were consistent across sensitivity analyses.
Dental professionals showed limited ability to distinguish human-authored from fully GenAI-generated dental research abstracts, regardless of expertise or LLM and their confidence did not reflect their accuracy. These exploratory findings support explicit training in AI literacy and critical appraisal within dental education, rather than reliance on stylistic intuition.

PMID:
42989818
Bibliographic data and abstract were imported from PubMed on 06 Nov 2026.

Read full publication at:
Please sign in to see all details.

Advertisement

Stats

  • Community rating n/a 0 votes
  • Reviewers' rating n/a 0 votes
  • Your rating

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

  • Recommendations n/a n/a positive of 0 vote(s)
  • Views 14
  • Comments 0

Recommended by

  • No recommendations yet.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.

Advertisement