Knowledge-guided Multimodal Learning for Interpretable Prediction of Pathological Complete Response and Survival in Breast Cancer.

Authors

Wenchuan Zhang, Shuwan Zhang, Yani Wei, Yuanyuan Zhao, Wei Yuan, Xiaoyan Wu, Xunxi Lu, Ting Yin, Libo Yang, Yuhao Yi, Huijuan Shi, Qingjie Lv, Fengling Li, Hong Bu

Published in

Laboratory investigation; a journal of technical methods and pathology. Pages 106169. Oct 09, 2026. Epub Oct 09, 2026.

Abstract

Pretreatment estimation of pathological complete response (pCR) to neoadjuvant chemotherapy may support risk stratification and future response-adapted clinical studies in breast cancer. However, existing deep learning approaches often rely on "black-box" visual pattern recognition, suffering from poor interpretability, high data dependency, and limited generalizability across heterogeneous cohorts. Here, we present CLASP (Clinical Language-Aligned Slide Pathology), a knowledge-driven, multimodal framework that synergizes pathological expert knowledge with vision-language foundation models.
CLASP integrates whole slide image (WSI) features encoded by CONCH, patient-specific clinical data, and 16 hierarchical pathological text priors generated by an ensemble of Large Language Models. Through a novel vision-language feature aggregation module and a multi-task consistency constraint, the model aligns visual biomarkers with semantic concepts to jointly predict pCR and prognosis.
Validated on 1,486 patients from four independent cohorts across multiple medical centers, CLASP achieved strong discriminative performance, yielding an Area Under the Curve (AUC) of 0.881 in internal testing and maintaining robustness in external validation (AUC 0.875 and 0.845), with higher AUC point estimates than the 11 evaluated baseline methods. Notably, CLASP also showed improved data efficiency, achieving competitive performance with as few as 8 training samples (few-shot learning). Interpretability analyses suggested that model-highlighted regions were consistent with recognized pathological features associated with treatment response, such as tumor-infiltrating lymphocytes and stromal architecture.
These findings suggest that pathology-informed multimodal learning may provide a candidate framework for pretreatment risk stratification.

PMID:
42854913
Bibliographic data and abstract were imported from PubMed on 10 Oct 2026.

Read full publication at:
Please sign in to see all details.

Stats

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.