Phase Transitions in Neural Networks

Latest papers

CardsList

35 papers9 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

  1. Deep Learning Theory through the Lens of Statistical Physics: A Topical Review

    Nov 6, 2026Wei Huang, Youjin DengStatistical Physics of LearningNeural Network Generalization

  2. Gradient Descent on Two ReLU Neurons: Global Landscape and Bifurcation Dynamics

    Oct 30, 2026Binghua Li, Mengzhe Li, Denny Wu +1Neural Network Training DynamicsNeural Network Optimization

  3. Scaling and Renormalization in Neural Networks: An Effective Renormalization-Group Description of Grokking

    Oct 26, 2026Min Chen, Junqi Wang, Zeguan Wu +2Renormalization GroupGrokking

  4. A theory of noisy linear recurrent neural network learning dynamics

    Oct 26, 2026John J. Vastola, Kanaka RajanRecurrent Neural NetworksNeural Network Training Dynamics

  5. Phase Transitions in Learning Driven by Extremal Data

    Oct 21, 2026Ethan Levien, Trevor GrandPreMultiple Instance LearningPhase Transitions in Neural Networks

  6. Emergent phases of superposition: from partial to full representation

    Sep 29, 2026Lihao Guo, Yizhou Liu, Jeff GorePhase Transitions in Neural NetworksFeature Superposition

  7. Learning-Induced Dynamical Transition in Recurrent Neural Networks

    Sep 16, 2026Varun VaidyaDynamical SystemsRecurrent Neural Networks

  8. Phases in a class of associative memories via hidden neurons

    Sep 10, 2026Toshihiro Ota, Masato TakiPhase TransitionsHopfield Networks

  9. Percolation Dynamics in Optimization: Variance Cascades and Nested Symmetry

    Sep 2, 2026Sai Niranjan Ramachandran, Suvrit SraPhase Transitions in Neural NetworksStochastic Gradient Descent

  10. Dynamical phase selection controls compute scaling in looped transformers

    Aug 27, 2026Gunn KimCritical Slowing DownInference-Time Scaling

  11. Is Grokking a Loss of Normal Hyperbolicity of the Interpolation Manifold?

    Aug 14, 2026Suvinava BasakGrokkingNeural Network Training Dynamics

  12. Broken Ergodicity and the Violation of the Fluctuation-Dissipation Theorem Lead to Generalization Beyond Overfitting in Machine Learning

    Jul 5, 2026Chan Li, Nigel GoldenfeldDynamical Mean-Field TheoryStatistical Physics of Learning

  13. Can Machines Really See Objects in Images? A Study Based on Syntactic Distance and Visual Self-Referential Instances

    Jun 28, 2026Xingyu Peng, Junran Wu, Yue Hou +9Phase Transitions in Neural NetworksVisual Reasoning

  14. Spectral phase transitions and trainability in neural network learning dynamics

    Jun 26, 2026Chanju Park, Dario Bocchi, Francesco D'Amico +2Random Matrix TheoryNeural Network Training Dynamics

  15. Noise-Driven Escape from Metastable Phases explains Grokking in Deep Neural Networks

    Jun 15, 2026Ibrahim Talha Ersoy, Karoline WiesnerStatistical Physics of LearningNeural Network Generalization

  16. Phase Transitions in Attention: A Bayesian Theory of Copy Head Emergence

    Jun 10, 2026Itay Lavie, Kirsten Fischer, Andrey Lekov +3Softmax AttentionPhase Transitions in Neural Networks

  17. Dimensional Criticality at Grokking Across MLPs and Transformers

    Apr 6, 2026Ping WangNeural Network Training DynamicsPhase Transitions in Neural Networks

  18. Grokking as Dimensional Phase Transition in Neural Networks

    Apr 6, 2026Ping WangPhase Transitions in Neural NetworksGrokking