Pretrained models may fail to capture immunological sequences.

Authors

Jiahao Ma, Hongzong Li, Jian-Dong Huang, Ye-Fan Hu, Yifan Chen

Published in

Communications biology. Jul 20, 2026. Epub Jul 20, 2026.

Abstract

Pretrained models, originally developed for vision and textual data, are not a panacea and may fail to fully represent the complexity of sequences in immunological tasks. In studying pretrained immunological sequence modules of a renowned immunogenicity prediction model, pMTnet, we observe that our carefully designed model removing (ablating) the pretrained T cell receptor (TCR) autoencoder in pMTnet can even improve the prediction accuracy. Furthermore, we note the TCR pretraining data, used by pretrained modules within pMTnet, dramatically deviates from a broader and more representative TCR repertoire. Such findings underscore the impacts of the blend of heterogeneous representations and distribution discrepancy in immunological sequences, which necessitate appropriate coordination of different pretrained models and representative databases.

PMID:
42477440
Bibliographic data and abstract were imported from PubMed on 21 Jul 2026.

Read full publication at:
Please sign in to see all details.

Stats

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.