Hiring in life sciences? Share your open positions with our professional community. Read more Close

Advertisement

Version-Specific Performance of ChatGPT in Audiogram Interpretation: Comparison of ChatGPT-4.0 and ChatGPT-5.1.

Created on 28 Oct 2026

Authors

Emel Tahir, Ceren Karaçaylı, Emre Dünder, Emine E Altuntaş

Published in

Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery. Oct 28, 2026. Epub Oct 28, 2026.

Abstract

Large language models (LLMs) are increasingly explored for clinical decision support, yet how successive versions of the same model compare on diagnostic tasks remains unclear. This study aimed to quantify version-specific changes in diagnostic performance by directly comparing ChatGPT-4.0 and ChatGPT-5.1 on standardized pure-tone audiogram interpretation.
Comparative diagnostic performance study.
Controlled experimental study using audiograms generated with simulation software.
One hundred audiograms, including 20 with intentional masking errors, were generated using AudSim Flex® software and submitted to both model versions through a standardized 7-step diagnostic prompt based on ASHA criteria. Two board-certified otolaryngologists with audiological expertise independently scored each response on a 5-point Likert scale, yielding 1400 evaluations per model. Inter-rater agreement was assessed using quadratic weighted Cohen's kappa, and model comparisons were performed with the Wilcoxon signed-rank test.
Inter-rater reliability was acceptable overall (κ = 0.74-0.78), though agreement was lower for degree-of-loss classification with ChatGPT-5.1 (κ = 0.44). ChatGPT-5.1 scored significantly higher than ChatGPT-4.0 on 6 of 7 questions (P < .001), with effect sizes ranging from 0.53 to 0.94. The largest improvement appeared in degree-of-hearing-loss classification (median difference, +1.0 point). Bone conduction threshold identification was the only item without a significant between-version difference (P = .121). Both models performed poorly on audiograms containing masking errors.
ChatGPT-5.1 demonstrated meaningful improvements over ChatGPT-4.0 in audiogram interpretation, particularly in higher-order diagnostic reasoning tasks. However, both versions struggled with clinically flawed input data. These findings underscore the need for version-specific benchmarking and expert oversight when integrating LLMs into audiological practice.

PMID:
42949252
Bibliographic data and abstract were imported from PubMed on 28 Oct 2026.

Read full publication at:
Please sign in to see all details.

Advertisement

Stats

  • Community rating n/a 0 votes
  • Reviewers' rating n/a 0 votes
  • Your rating

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

  • Recommendations n/a n/a positive of 0 vote(s)
  • Views 8
  • Comments 0

Recommended by

  • No recommendations yet.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.

Advertisement