cond-mat.str-elNov 16, 2026

Self-attention is a Dyson equation for many-body machine learning

Authors: Jarvist Moore Frost

Organizations: Department of Chemistry, Imperial College London, Exhibition Road, London SW7 2AZ, UK · Department of Physics, Imperial College London, Exhibition Road, London SW7 2AZ, UK

Abstract

Why does symmetric sum-pooling (DeepSets) predict ground-state potentials to sub-meV accuracy, yet fail for correlated wavefunctions and excited states? Sum-pooling is a mean-field (Hartree) model: its O(1/N)O(1/N) off-diagonal Jacobian suffices for nearsighted ground-state energies, but erases nonlocal two-body correlations. We show that self-attention is a real-space Dyson iteration whose Boltzmann (softmax) kernel acts as a two-body self-energy. Because physical Hamiltonians act pairwise, Löwdin's 2-RDM theorem and the Galitskii--Migdal relation guarantee that iterating a two-body propagator captures the full energetics of correlated matter. When fitting a fractal backflow determinant, DeepSets blurs the nodal surface onto a mean-field envelope, whereas self-attention recovers the fractal attractor. Seen through this lens, the unreasonable effectiveness of attention is not an accident; in a universe built from pairwise interactions, two-body attention is all you need.

Figures & tables

Explore similar work

CardsList
  1. Clustered Attractor Manifolds and Dynamical Condensation in Self-Attention

    Aug 9, 2026Qucheng Gao, Zuyi Yang, Xiao ChenDynamical SystemsSelf-Attention

  2. Disentangling Attention in Deep Operator Learning: A Controlled Study of Data-Driven and Physics-Informed Architectures

    Sep 3, 2026Amar Alem Koric, Qibang Liu, Seid KoricPDE Operator LearningDeep Operator Networks

  3. Attention by Synchronization in Coupled Oscillator Networks

    Jun 10, 2026Fabio Pasqualetti, Taosha GuoSoftmax AttentionDynamical Systems