Multicohort Evaluation of Acquisition Confounding in Single-Site Lung-CT Malignancy Classification with Frozen Foundation-Model Features.

Authors

Ming-Hsun Lee, Wei-Yang Lin, Yen-Jung Chiu

Published in

Journal of imaging informatics in medicine. Sep 22, 2026. Epub Sep 22, 2026.

Abstract

Frozen foundation-model features are promoted as an annotation-sparing route to medical-image classification, yet whether their performance reflects diagnostic signal or site-specific shortcuts is rarely tested. On a single-site hospital cohort (187 cancer and 194 benign scans, 303 patients), frozen Models-Genesis whole-scan features classified cancer versus benign at an out-of-fold AUC of 0.994 under patient-grouped cross-validation and transferred near chance to two external cohorts. One is LIDC-IDRI, where malignancy is a median radiologist rating, not a confirmed diagnosis. The other carries confirmed diagnoses matching the development endpoint. We tested acquisition as a competing explanation. The two classes had been reconstructed under different protocols (0.7 mm versus 1.0 mm slice spacing), and a classifier reading six acquisition header fields, and no image data, reached 0.996, within 0.001 of the frozen-feature result ( $p=0.73$ ). The near-perfect in-site AUC is therefore most plausibly explained by acquisition-related confounding, which extends beyond reconstruction protocol to scanner model and age, and is not evidence of malignancy discrimination. A second, independently pretrained CT foundation model reproduced the pattern, so it is a property of the data, not one checkpoint. Malignancy-related signal appeared at finer spatial granularity. Narrowing the field of view to one prespecified nodule per scan raised AUC from 0.584 to 0.808, and a nodule-level classifier transferred between external cohorts at 0.682 (95% CI 0.559-0.792) against confirmed benign controls under one of the two encoders. Whole-scan embeddings exposed a cohort-assembly shortcut strong enough to mimic a solved task; the signal that transferred was carried by lesion-level representations.

PMID:
42773336
Bibliographic data and abstract were imported from PubMed on 23 Sep 2026.

Read full publication at:
Please sign in to see all details.

Stats

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.