Topoformer: brain-like topographic organization in Transformer language models through spatial querying and reweighting

Published:

BinHuraib, T., Tuckute, G., Blauch, N.M. (2024). Topoformer: brain-like topographic organization in Transformer language models through spatial querying and reweighting. ICLR Re-Align workshop.

[Paper] [Website] [Code]