cs.LGOct 31, 2026

The Tangled Web They Weave: Exploring Neural Representations with Directed Simplicial Complexes

Authors: Michael Bleher

Organizations: Institute for Mathematics, Heidelberg University, Heidelberg, Germany

Abstract

Understanding how artificial neural networks (ANNs) represent and combine features internally is a central challenge in mechanistic interpretability. Existing neural circuit-discovery methods represent neuron interactions as pairwise edges in a graph. But distributed neural representations consist of large groups of neurons that are inherently linked by higher-order causal dependencies: suppressing a subgroup of neurons in concert may shift the activation of other neurons in the feature representation. We propose a method to construct filtered directed simplicial complexes (DSCs) that give a topological representation of such dependencies, built from the activation profiles of an ANN on a given set of inputs. Our approach treats ANNs as structural causal models and uses counterfactual ablations to test for causal links between groups of internal neurons within specific input contexts. As a proof of concept, we apply the approach to a pair of small multilayer perceptron (MLP) architectures in a synthetic two-dimensional quadrant classification task. In these examples, DSCs recover the designed feature pathways and coordinated class transitions, and the complexes of trained networks are higher-dimensional than those of their handcrafted references. As validation, we compare our method with graph-based circuit-discovery baselines and find that their 1-skeletons agree within the relations that a weight graph can represent. These results support DSCs as context-dependent descriptions of multi-neuron computation and may thus provide a novel, orthogonal framework to study the phenomenon of distributed feature representations and polysemanticity.

Figures & tables

Appendix figures & tables19 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Feature Superposition in Neural Networks: From Theory to Practice

    Sep 6, 2026Dai Shi, Xiaoyu Li, Andi Han +1Feature SuperpositionNeural Network Interpretability

  2. Not all solutions are created equal: An analytical dissociation of functional and representational similarity in deep linear neural networks

    Sep 30, 2026Lukas Braun, Erin Grant, Andrew M. SaxeRepresentational Similarity AnalysisNeural Representation Geometry

  3. Neural Functional Alignment Space: Brain-Referenced Representation of Artificial Neural Networks

    Feb 28, 2026Ruiyu Yan, Hanqi Jiang, Yi Pan +4Neural Representation GeometryCross-Modal Alignment