Authors
Stump, E., Dennison, H., Strobbia, P., Stan, G., Dima, R. I.
Abstract
An important underlying requirement for deep learning models is the availability of large datasets, however, in sciences such as chemistry and biology, generating experimental data of sufficient size represents a significant bottleneck. In this work, we probed the extent and nature of limited input data, characterize how several protein language models (pLMs) learned on suboptimal datasets, and investigated augmentation approaches to improve predictive model performance. We found that narrowing the distribution of protein-protein complexes in a limited dataset permits an order-of-magnitude decrease in training dataset size, if a model is only expected to generalize to in-distribution data. Similar results were found in active learning (AL), where both in- and out-of-distribution Matthews Correlation Coefficient (MCC) showed a small but consistent increase upon augmentation of the training set with complexes produced by ESM-3, a generative pLM.
Preprint server:
bioRxiv
The authors list and abstract were imported from bioRxiv on 26 Oct 2026.
Advertisement
Stats
- Recommendations n/a n/a positive of 0 vote(s)
- Views 13
- Comments 0