paper

Coordination Among Neural Modules Through a Shared Global Workspace

Anirudh Goyal, Aniket Didolkar, Yoshua Bengio et al. · Mar 1, 2021

The architecture paper: specialised neural modules writing to and reading from a shared, limited-capacity workspace, with attention as the competition for access. The engineered version of exactly the structure Anthropic later observe emerging on its own inside a transformer. The bottleneck is the point. Scarcity is what forces global coordination.

← Back to sources