Adversarial Sequence Mutations in AlphaFold and ESMFold Reveal Nonphysical Structural Invariance, Confidence Failures, and Concerns for Protein Design.

Authors

Jonathan Feldman, Maximilian Brogi, Jeffrey Skolnick

Published in

Computational and structural biotechnology journal. Volume 35. Issue 1. Pages 0142. Epub Jun 29, 2026.

Abstract

AlphaFold has transformed structural biology and spawned an ecosystem of derivative tools for protein design, binding prediction, and drug discovery. However, whether AlphaFold has learned generalizable biophysical principles as opposed to template-based pattern matching remains unclear-a distinction critical for applications beyond its training context. Here, we perform a systematic adversarial evaluation of AlphaFold 3 using point and deletion mutations across 200 proteins. Remarkably, predicted structures remain invariant to mutations of up to 40% of residues-including deliberately destabilizing substitutions-and to deletions of 10%. Notably, this invariance holds even for experimentally validated fold-switching proteins that are known to adopt alternative conformations in response to such mutations, despite the fact that these proteins are small and monomeric-precisely the category where AlphaFold is expected to perform best. Confidence metrics prove unreliable, as they select the most accurate structure at most 35% of the time and consistently correlate with the structural quality of the best available training-set template. ESMFold exhibits greater, though still imperfect, mutational sensitivity, suggesting a tighter coupling between sequence identity and predicted structure that may reflect differences in training objective rather than overall model quality. These findings indicate that AlphaFold may rely heavily on memorized templates rather than biophysical reasoning, with direct implications for mutation-effect interpretation, confidence-guided model selection, and sequence optimization workflows.

PMID:
42376644
Bibliographic data and abstract were imported from PubMed on 30 Jun 2026.

Read full publication at:
Please sign in to see all details.

Stats

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.