Do S-Detect and ChatGPT Improve Diagnostic Performance and Agreement with BI-RADS Morphologic Descriptors Among Early-career Radiologists?

Authors

Sevgi Unal, Merve G Bulut, Ozge Ertem, Kazim A Sinci, Silanaz Kutlu, Bengisu Sunbul, Miran N Yazici, Remzi Gurfidan, Turkan Ikizceli

Published in

Academic radiology. Nov 10, 2026. Epub Nov 10, 2026.

Abstract

We investigated whether S-Detect and ChatGPT assistance improve early-career radiologists' diagnostic performance in breast ultrasound and their agreement with a senior breast radiologist (SBR) for Breast Imaging Reporting and Data System v5.0 morphologic descriptors.
Ultrasound images of 299 histopathologically confirmed lesions from 268 patients were retrospectively evaluated by the SBR, one junior attending radiologist, three residents, S-Detect, and ChatGPT (single image-only zero-shot inference via the web interface). These four early-career radiologists reassessed lesions with S-Detect and ChatGPT assistance. Histopathology was the reference standard for diagnostic performance, and the SBR for descriptor agreement. Kappa differences were compared using patient-level cluster bootstrapping.
The SBR achieved the highest sensitivity and accuracy, whereas S-Detect achieved the highest specificity. Neither S-Detect nor ChatGPT assistance consistently improved diagnostic performance. S-Detect had the highest standalone agreement for shape, margin, posterior acoustic features, and echo pattern, and S-Detect assistance significantly improved agreement for shape, posterior acoustic features, and echo pattern in selected readers. Histopathologic agreement was highest for the SBR (κ = 0.713; 95% confidence interval [CI], 0.637-0.789), followed by S-Detect (κ = 0.686; 95% CI, 0.604-0.768), without significant difference (difference in kappa, -0.027; 95% CI, -0.128-0.067; Benjamini-Hochberg-adjusted q = 0.877); however, the wide CI could not exclude a clinically meaningful difference. ChatGPT had the lowest agreement (κ = 0.373; 95% CI, 0.271-0.474).
In this biopsy-confirmed cohort, S-Detect showed high specificity and strong descriptor agreement but did not consistently enhance early-career radiologists' diagnostic performance. ChatGPT performance was limited under image-only, single-inference zero-shot conditions and should not be generalized to its overall capability.

PMID:
43009364
Bibliographic data and abstract were imported from PubMed on 11 Nov 2026.

Read full publication at:
Please sign in to see all details.

Stats

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.