Neural Representation Geometry

Overview

Neural representation geometry asks how learned features are organized by distances, directions, neighborhoods, manifolds, and topology, and how this structure supports prediction, memory, transfer, or behavior. Researchers compare models and brains using methods such as CKA, Procrustes alignment, and relative representations, and characterize spaces with covariance spectra, intrinsic-dimension estimates, persistent homology, and Riemannian geometry; sparse autoencoders and interventions probe feature structure and causal roles. Work spans vision and language models, contrastive embeddings, world models, and neural recordings, with evaluations including retrieval, out-of-distribution transfer, compositional generalization, and brain alignment. A central tension is that measured geometry can change under function-preserving coordinate transformations, while similarity or geometric patterns alone do not establish shared computation, causal importance, or better performance; robust, task-aware measures remain an open need.

Latest papers

271 papers18 papers in the last four weeks, down 49% on the four weeks before. 0.1% of all new papers.

Sep 30, 2022

Disentanglement with Biological Constraints: A Theory of Functional Cell Types

Neurons in the brain are often finely tuned for specific task variables. Moreover, such disentangled representations are highly sought after in machine learning. Here we mathematically prove that simple biological constraints on neurons, namely nonnegativity and energy efficiency in both activity and weights, promote such sought after disentangled representations by enforcing neurons to become selective for single factors of task variation. We demonstrate these constraints lead to disentanglement in a variety of tasks and architectures, including variational autoencoders. We also use this theory to explain why the brain partitions its cells into distinct cell types such as grid and object-vector cells, and also explain when the brain instead entangles representations in response to entangled task factors. Overall, this work provides a mathematical understanding of why single neurons in the brain often represent single human-interpretable factors, and steps towards an understanding task structure shapes the structure of brain representation.