Mean-Field Theory

Follow this topic Ask about this topic

Momentum

1 paper in the last four weeks, with none the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 29

All topics

Fluctuations of Nonlinear Observables in Mean Field Neural Network Training
Oct 7, 2026Arnaud Descours, Geoffrey LacourNeural Network Training Dynamics Uncertainty Quantification
UCBL · MaIAGE
Attention Mean Fields Predict Average Representation Dynamics and Reveal Context-Specific Computation
Sep 14, 2026Micah Adler, John W. Byers, Mark CrovellaAttention Head Analysis In-Context Learning
Department of Computer Science, Boston University · Faculty of Computing & Data Sciences, Boston University
A cylindrical neural approximation theorem for conditional laws of McKean-Vlasov equations with common noise
Aug 8, 2026Nacira Agram, Reda Hmioui, Jan RemsMean-Field Theory Neural Network Approximation Theory
Department of Mathematics, KTH Royal Institute of Technology, 100 44 Stockholm, Sweden. · Digital Futures, Sweden. · Grenoble INP – Ensimag, Université Grenoble Alpes, Grenoble, France. +1
Operator Calculus for Population-Based Optimization: Modular Convergence and Finite-Population Guarantees
Jun 12, 2026Pekka Malo, Lauri Viitasaari, Patrik Nummi +3Evolutionary Optimization Optimization Convergence Analysis
Aalto University, Department of Information and Service Management, Finland. · Aalto University, Department of Information and Communications Engineering, Finland. · Indian Institute of Management Ahmedabad, Operations and Decision Sciences, India. +1
Discovering and decoding latent mean-field structure with variational autoencoders
Jun 7, 2026Marco Biroli, Max Welling, Vincenzo VitelliVariational Autoencoders Mean-Field Theory
Department of Physics and the James Franck Institute, University of Chicago, Chicago, IL, USA · CuspAI, Cambridge, England · AMLab, University of Amsterdam, Amsterdam, Netherlands +1
Beyond Linear and Overcomplete Regimes: A Mean-Field Analysis of Bottleneck Autoencoders
Jun 5, 2026Santanu Das, Ramyak Bilas, Pascal Esser +1Autoencoders Mean-Field Theory
STCS department Tata Institute Of Fundamental Research Mumbai, India-400005 · Department of Mathematics Indiana University Bloomington Indiana, USA-47405 · Department of Mathematics Ludwig-Maximilians-Universität München Germany, München-80799 +1
Nonlocal Mean Field Schrödinger Bridge with Learned Interactions
Jun 2, 2026Daisuke Inoue, Dante Kalise, Mathieu LaurièreNeural Surrogate Modeling Schrödinger Bridges
Department of Mathematics, Imperial College London, London SW7 2AZ, United Kingdom. · Shanghai Frontiers Science Center of Artificial Intelligence and Deep Learning, NYU-ECNU Institute of Mathematical Sciences, NYU Shanghai, Shanghai 200126, People’s Republic of China.
The Crowded Embedding Space: A Mean-Field Mechanism for Emergent Marginalization in Retrieval-Augmented Agents
Jun 1, 2026Shwan Ashrafi, Dan RothAlgorithmic Fairness Mean-Field Theory
Oracle AI
Mean-Field Diffuser: Scaling Offline MARL to Thousands of Agents
May 28, 2026Wenhao Li, Xiangfeng Wang, Bo JinMulti-Agent System Optimization Mean Field Games
Tongji University · East China Normal University
Kernel-based potential mean-field games with unbiased random Fourier $U$ -statistics
May 28, 2026Yumiharu NakanoMulti-Agent Coordination Mean Field Games
Department of Mathematical and Computing Science, Institute of Science Tokyo
The incremental voter model: mean-field analysis and convergence to equilibrium
May 27, 2026Fei Cao, Xiaoqian GongOpinion Dynamics Computational Social Science
Amherst College - Department of Mathematics, Amherst, MA 01002, USA
Thinned Mean Field Langevin Dynamics
May 27, 2026Zonghao Chen, Heishiro Kanagawa, François-Xavier Briol +2Langevin Dynamics Mean-Field Theory
University College London · 2Newcastle University · 3The Alan Turing Institute +1
Feature Learning in Wide Neural Networks under $μ$ P: Identifiability and Sparse-Dictionary Decomposition of the Mean-Field Limit
May 23, 2026Akmal XodarevRepresentation Learning Parameter Identifiability
Independent Researcher · Tashkent, Uzbekistan
Move on Muon : A Hamiltonian probability gradient flow perspective of Muon optimizer
May 22, 2026Aratrika Mustafi, Soumya Mukherjee, Bharath K. SriperumbudurMomentum Methods Muon Optimizer
Department of Statistics, Pennsylvania State University
Uniform-in-Time Weak Propagation-of-Chaos in Shallow Neural Networks
May 21, 2026Margalit Glasgow, Joan BrunaShallow Neural Networks Mean-Field Theory
Massachusetts Institute of Technology · Courant Institute School of Mathematics, Computing and Data Science, New York University
Dropout Universality: Scaling Laws and Optimal Scheduling at the Edge-of-Chaos
May 20, 2026Lucas Fernandez SarmientoMean-Field Theory
Carnegie Mellon University (CMU), Pittsburgh, Pennsylvania, USA.
Quantifying Concentration Phenomena of Mean-Field Transformers in the Low-Temperature Regime
May 11, 2026Albert Alcalde, Leon Bungert, Konstantin Riedl +1Transformer Inference Transformer
Department of Mathematics Friedrich-Alexander-University Erlangen-Nürnberg · Institute of Mathematics CAIDAS University of Würzburg · Mathematical Institute University of Oxford Reuben College +1
Quantitative Local Convergence of Mean-Field Stein Variational Gradient Flow
May 10, 2026Lénaïc Chizat, Maria Colombo, Roberto Colombo +1Dynamical Systems Optimization Convergence Analysis
Kinetic theory for Transformers and the lost-in-the-middle phenomenon
May 9, 2026Mitia Duerinckx, Borjan Geshkovski, Stefano RossiSelf-Attention Transformer Attention
Learnability and Competition in High-Dimensional Multi-Component ICA
May 8, 2026Eser Ilke Genc, Samet Demir, Zafer DoganIndependent Component Analysis Unsupervised Representation Learning
MLIP Research Group, KUIS AI Center, Koç University · Department of EEE, Koç University
Training-Induced Escape from Token Clustering in a Mean-Field Formulation of Transformers
May 8, 2026Noboru Isobe, Daisuke Inoue, Masaaki ImaizumiTransformer Clustering
1RIKEN Center for Advanced Intelligence Project · 2Imperial College London · 3The University of Tokyo +1
Population-Aware Imitation Learning in Mean-field Games with Common Noise
May 5, 2026Grégoire Lambrecht, Mathieu LaurièreMean Field Games Adversarial Imitation Learning
Center for Data Science, New York University and NYU Shanghai, New York, United States of America · Shanghai Center for Data Science; NYU-ECNU Institute of Mathematical Sciences at NYU Shanghai; NYU Shanghai, Shanghai, People’s Republic of China.
Continuous-time q-learning for mean-field control with common noise, part-I: Theoretical foundations
Apr 30, 2026Zhenjie Ren, Xiaoli Wei, Xiang Yu +1Stochastic Optimal Control Q-Learning
LaMME, Universit´e ´Evry Paris-Saclay, ´Evry, France · Department of Applied Mathematics, The Hong Kong Polytechnic University, Kowloon, Hong Kong · Department of Industrial Engineering and Operations Research, Columbia University, New York, USA
Gradient Flow Through Diagram Expansions: Learning Regimes and Explicit Solutions
Feb 4, 2026Dmitry Yarotsky, Eugene Golikov, Yaroslav GusevTensor Decomposition Mean-Field Theory
Applied AI Institute, Moscow, Russia · Steklov Mathematical Institute of Russian Academy of Sciences, Moscow, Russia.
Local exponential stability of mean-field Langevin descent-ascent and associated particle system
Feb 2, 2026Geuntaek Seo, Minseop Shin, Pierre Monmarché +1Nash Equilibrium Lyapunov Stability
Mean-Field Model for Two-Layer Neural Networks Trained with Consensus-Based Optimization
Nov 26, 2025William De Deyn, Michael Herty, Giovanni SamaeyNeural Network Optimization Mean-Field Theory
Institut für Geometrie und Praktische Mathematik, RWTH Aachen University, Germany · Department of Computer Science, KU Leuven, Belgium · Extraordinary Professor, Department of Mathematics and Applied Mathematics, University of Pretoria, South Africa
DeepSPoC: A Deep Learning Based Sequential Propagation of Chaos
Aug 29, 2024Kai Du, Yongle Xie, Tao Zhou +1Stochastic Differential Equations Neural PDE Solvers
Shanghai Center for Mathematical Sciences, Fudan University, Shanghai, 200438, China. · Shanghai Center for Mathematical Sciences, Fudan University, Shanghai, 200433, China. · LSEC, Institute of Computational Mathematics and Scientific/Engineering Computing, AMSS, Chinese Academy of Sciences, Beijing, China.
A Functional-Space Mean-Field Theory of Partially-Trained Three-Layer Neural Networks
Oct 28, 2022Zhengdao Chen, Eric Vanden-Eijnden, Joan BrunaNeural Network Generalization Neural Network Optimization
Google Research Mountain View, CA 94043 · Courant Institute, New York University New York, NY 10003
On Universality of Non-Separable Approximate Message Passing Algorithms
Date pendingMax Lovig, Tianhao Wang, Zhou FanMean-Field Theory
Department of Statistics and Data Science, Yale University · Halicioglu Data Science Institute, University of California, San Diego

Oct 7, 2026, cs.LGJ/K move · Enter open · S save

Fluctuations of Nonlinear Observables in Mean Field Neural Network Training

Arnaud Descours, Geoffrey Lacour

UCBL · MaIAGE

Neural Network Training Dynamics Uncertainty Quantification Mean-Field Theory Shallow Neural Networks

Open paper AskPDF arXiv

Mean field limits describe the training dynamics of wide neural networks through the evolution of the empirical distribution of their parameters. Although functional central limit theorems characterize the asymptotic fluctuations of this distribution, quantities of practical interest are typically nonlinear observables of the parameter distribution rather than the distribution itself. In this work, we show how these mean field fluctuations propagate to finite dimensional nonlinear observables for shallow neural networks trained by stochastic gradient descent. Working in the weighted Sobolev space in which the limiting fluctuation process is constructed, we apply a functional Delta method under ordinary Fr{é}chet differentiability, without requiring Lions derivatives with respect to the measure variable. We obtain a central limit theorem for the observables and, under a suitable representation of their differentials, an explicit covariance formula inherited from the underlying mean field fluctuation theory. We also study whether prescribed quantities of interest can be recovered from the selected observations. Under a constant rank assumption, we prove that a quantity of interest factors locally through the observation functional if and only if, throughout a neighborhood, the kernel of the differential of the observation is contained in that of the quantity of interest. Thus, a differential condition expressed directly in the ambient Sobolev space yields an exact nonlinear local factorization. These results provide a framework both for quantifying finite-width uncertainty on observable, statistically or physically meaningful quantities and for assessing whether the chosen observations contain the information required to identify them.

Momentum

Related topics

Latest papers 29