Neural Scaling Laws

Momentum

9 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 53

All topics
CardsList
  1. Neural Scaling Laws for Jet Generation

    May 27, 2026Oz Amram, Darius A. Faroughy, Tjarko Gerdes +5High-Energy PhysicsAutoregressive Generation

  2. Pretrained Approximators for Low-Thrust Trajectory Cost and Reachability

    May 26, 2026Zhong Zhang, Giacomo Acciarini, Dario Izzo +2Neural Surrogate ModelingTrajectory Optimization

  3. Unified Neural Scaling Laws

    May 25, 2026Ethan Caballero, Priyank Jaini, David Krueger +1Language Model Scaling LawsScaling Laws

  4. Asymmetric Scaling Laws from Sparse Features

    May 22, 2026John Sous, Michael WinerDouble DescentActivation Sparsity

  5. A Boundary-Layer Mechanism for One-Third Scaling in Online Softmax Classification

    May 21, 2026Marcel Kühn, Yoon Thelge, Bernd RosenowStatistical Physics of LearningMulticlass Classification

  6. How Do Electrocardiogram Models Scale?

    May 17, 2026Jiawei Li, Fabio Bonassi, Ming Jin +4Self-Supervised Pre-TrainingElectrocardiography

  7. Scaling Laws and Tradeoffs in Recurrent Networks of Expressive Neurons

    May 12, 2026Aaron Spieler, Georg Martius, Anna LevinaRecurrent Neural NetworksNeural Scaling Laws

  8. How Much is Brain Data Worth for Machine Learning?

    May 10, 2026Lane Lewis, Zhixin Wang, David Schwab +1Neural Scaling LawsData-Efficient Learning

  9. Tokens-per-Parameter Coverage Is Critical for Robust LLM Scaling Law Extrapolation

    May 8, 2026Joshua Shay Kricheli, Alexander Lawrence Reid, Soumajyoti Sarkar +2Parameter EstimationLanguage Model Scaling Laws

  10. On the Invariance and Generality of Neural Scaling Laws

    May 8, 2026Xing Han, Liu Ziyin, Suchi Saria +1Language Model Scaling LawsCross-Domain Generalization

  11. How Big Should a Wireless Foundation Model Be?

    May 8, 2026Wei-Lun Cheng, Wanjiun LiaoWireless Foundation ModelsWireless Communications

  12. Deep Wave Network for Modeling Multi-Scale Physical Dynamics

    May 5, 2026Alexander I. Khrabry, Edward A. Startsev, Andrew T. Powis +1U-NetMulti-Scale Feature Fusion

  13. Prescriptive Scaling Laws for Data Constrained Training

    May 2, 2026Justin Lovelace, Christian Belardi, Srivatsa Kundurthy +2Weight DecayLanguage Model Scaling Laws

  14. A Limit Theory of Foundation Models: A Mathematical Approach to Understanding Emergent Intelligence and Scaling Laws

    Apr 27, 2026Jun Shu, Junxiong Jia, Deyu Meng +1Neural Scaling LawsAI Scaling Laws

  15. OmniMouse: Scaling properties of multi-modal, multi-task Brain Models on 150B Neural Tokens

    Apr 20, 2026Konstantin F. Willeke, Polina Turishcheva, Alex Gilbert +18Neural DecodingVisual Neuroscience

  16. How Much Data is Enough? The Zeta Law of Discoverability in Biomedical Data, featuring the enigmatic Riemann zeta function

    Apr 19, 2026Paul M. ThompsonNeural Scaling LawsData-Efficient Learning

  17. μμpscaling small models: Principled warm starts and hyperparameter transfer

    Feb 11, 2026Yuxin Ma, Nan Chen, Mateo Díaz +3Neural Network OptimizationHyperparameter Transfer

  18. Deriving Neural Scaling Laws from the statistics of natural language

    Feb 7, 2026Francesco Cagnetta, Allan Raventós, Surya Ganguli +1Language Model Scaling LawsNeural Scaling Laws

  19. From Zipf's Law to Neural Scaling through Heaps' Law and Hilberg's Hypothesis

    Dec 15, 2025Łukasz DębowskiNeural Scaling Laws

  20. Random Matrix Theory for Deep Learning: Beyond Eigenvalues of Linear Models

    Jun 16, 2025Zhenyu Liao, Michael W. MahoneyRandom Matrix TheoryNeural Network Generalization