The transformer as a candidate canonical cortical microcircuit

Authors

Shah, Y., Yamins, D. L. K.

Abstract

Neuroscience hypothesizes a canonical microcircuit subserving cortical computation across brain systems. In artificial intelligence, neural networks have become a universal computational substrate. Here, we leverage newly available large-scale data and mapping techniques to compare neural network motifs to the brain. We embedded a spectrum of candidate microcircuit architectures within a common spatial macrocircuit, measuring alignment with an extensive battery of cortical signatures. We find that one specific circuit type--the transformer--uniquely captures fine-grained unit-level circuit details, population-level functional maps and neuronal activity patterns, and systems-level wiring efficiency and behavioral demands. The key ingredient enabling the transformer's success is a learned multiplicative component making relational information available without extensive long-range wiring. These results suggest striking convergence between computational motifs in natural and artificial intelligence.

Preprint server: bioRxiv
The authors list and abstract were imported from bioRxiv on 04 Nov 2026.

Stats

1-terrible, 9-excellent. How would you rate this preprint? Sign in in to submit your rating.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.