Scaling Laws

Ask about this topic

Recent momentum

+14%

16 papers in the last 28 days · 0.3% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Also in Scaling Laws

Neighbouring directions

Neural Scaling LawsTest-Time ScalingExponentsPower-Law Distribution

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

4 new papers

A weekly snapshot of new work published in Scaling Laws.

Period ending 2026-09-14

4 new papers

A weekly snapshot of new work published in Scaling Laws.

Period ending 2026-09-07

6 new papers

A weekly snapshot of new work published in Scaling Laws.

141 papers

Latest in Scaling Laws

Browse all topics →
CardsList

  1. The Scaling Properties of Implicit Deductive Reasoning in Transformers

    May 5, 2026Enrico Vompa, Tanel TammetTransformer ArchitecturesTheorem

  2. Safety and accuracy follow different scaling laws in clinical large language models

    May 5, 2026Sebastian Wind, Tri-Thien Nguyen, Jeta Sopa +9Large Language Model SafetyInference-Time

  3. InfoLaw: Information Scaling Laws for Large Language Models with Quality-Weighted Mixture Data and Repetition

    May 4, 2026Fengze Liu, Weidong Zhou, Binbin Liu +7Large Language Model PretrainingScaling Laws

  4. Prescriptive Scaling Laws for Data Constrained Training

    May 2, 2026Justin Lovelace, Christian Belardi, Srivatsa Kundurthy +2Scaling LawsCapacity

  5. Stochastic Scaling Limits and Synchronization by Noise in Deep Transformer Models

    Apr 29, 2026Andrea Agazzi, Giuseppe Bruno, Eloy Mosig García +2Transformer ArchitecturesStochastic Differential Equations

  6. Scaling Properties of Continuous Diffusion Spoken Language Models

    Apr 27, 2026Jason Ramapuram, Eeshan Gunesh Dhekane, Amitis Shidani +6Diffusion Language ModelsScaling Laws

  7. Spend Less, Fit Better: Budget-Efficient Scaling Law Fitting via Active Experiment Selection

    Apr 24, 2026Sijie Li, Shanda Li, Haowei Lin +3Bayesian Experimental DesignScaling Laws

  8. How Much Is One Recurrence Worth? Iso-Depth Scaling Laws for Looped Language Models

    Apr 22, 2026Kristian Schwethelm, Daniel Rueckert, Georgios KaissisRecurrenceLarge Models

  9. How Much Data is Enough? The Zeta Law of Discoverability in Biomedical Data, featuring the enigmatic Riemann zeta function

    Apr 19, 2026Paul M. ThompsonScaling LawsSample Size

  10. Scaling Laws of SignSGD in Linear Regression: When Does It Outperform SGD?

    Mar 2, 2026Jihwan Kim, Dogyoon Song, Chulhee YunStochastic Gradient DescentScaling Laws

  11. Bridging Individual and Collective Realism in LLM-Based Human Mobility Simulation via Mobility Scaling-Law Guidance

    Feb 17, 2026Hua Yan, Heng Tan, Yu YangMobilityUser Simulation

  12. Deriving Neural Scaling Laws from the statistics of natural language

    Feb 7, 2026Francesco Cagnetta, Allan Raventós, Surya Ganguli +1Scaling LawsLarge Models

  13. Optimal Learning Rate Schedules under Functional Scaling Laws: Power Decay and Warmup-Stable-Decay

    Feb 6, 2026Binghui Li, Zilin Wang, Fengling Chen +3Learning RatesScaling Laws

  14. PluRel: Synthetic Data unlocks Scaling Laws for Relational Foundation Models

    Feb 3, 2026Vignesh Kothapalli, Rishabh Ranjan, Valter Hudovernik +4Relational Deep LearningSynthetic Data

  15. Beyond Scaling Law: A Data-Efficient Distillation Framework for Reasoning

    Aug 13, 2025Xiaojun Wu, Xiaoguang Jiang, Huiyang Li +11Scaling Laws

  16. Tensorization is a powerful but underexplored tool for compression and interpretability of neural networks

    May 26, 2025Safa Hamreras, Sukhbinder Singh, Román OrúsTensor NetworksNeural Network

  17. Data Scaling Laws in Imitation Learning for Robotic Manipulation

    Oct 24, 2024Fanqi Lin, Yingdong Hu, Pingyue Sheng +3Imitation LearningRobot Policies

  18. Branch Scaling Manifests as Implicit Architectural Regularization for Improving Generalization in Overparameterized ResNets

    Mar 7, 2024Zixiong Yu, Guhan Chen, Jianfa Lai +2Over-Parameterized Neural NetworksResidual Connections

  19. Multiperiodic Processes: Ergodic Sources with a Sublinear Entropy

    Feb 17, 2023Łukasz DębowskiScaling Laws

  20. SMELT: Scaling Laws for Compute-Matched MoE Looped Transformers

    Date pendingShaowen Wang, Ge Zhang, Kairong Luo +6Transformer LayersTransformer Architectures

  21. Teaching Vision-Language Models to Use the Scale They Are Given: Label-Free Equivariance Training for Metric Physical Reasoning

    Date pendingKaizhen Tan, Yang Feng, Heqing Du +3Large Vision Language ModelsVisual Grounding