cs.LGSep 3, 2026

Coupled Scaling: A Representational Accessibility Framework for Neural Scaling Laws

Authors: Jie Wang

Organizations: School of Civil and Commercial Law, Southwest University of Political Science and Law

Abstract

Existing theories derive neural scaling from data geometry or a specified data-model spectrum, but systems trained on the same data can scale differently when architecture or optimization changes the representations they can efficiently reach. We introduce Coupled Scaling, a task-conditioned framework in which finite-budget scaling depends on the relation between task structure and the geometry accessible to an architecture-optimization system. In a solvable mode-truncation model, loss separates into target energy outside architectural support and an unresolved supported tail. For an arbitrary priority order, the residual lies between the best-N supported tail and the tail beyond the largest completed high-value prefix. If the cumulative-tail and coverage log-rates are γA,Tγ_{A,T} and ρA,O,Tρ_{A,O,T}, the residual exponent lies in [ρA,O,TγA,T,γA,T][ρ_{A,O,T}γ_{A,T},γ_{A,T}]. Under bounded off-prefix gain, the completed prefix is rate-determining and αA,O,T=ρA,O,TγA,Tα_{A,O,T}=ρ_{A,O,T}γ_{A,T}; for aA,T,jjbA,Ta_{A,T,j}\asymp j^{-b_{A,T}}, this gives αA,O,T=ρA,O,T(bA,T1)α_{A,O,T}=ρ_{A,O,T}(b_{A,T}-1). A fixed-kernel specialization derives the training-time exponent from the near-zero tail of a task-weighted spectral measure defined independently of the loss fit. The framework separates architectural support from finite-budget acquisition and motivates two tests: static task-relevant geometry should track loss at a common budget, while multiscale geometry should track coupling-specific exponent ordering, including reversal across contrasting tasks. An audit of released emergence trajectories identifies the controls needed for a direct factorial test that measures geometry separately from the scaling fit.

Explore similar work

CardsList
  1. Skaling: Chinchilla's Exponents Meet Kaplan's Coupling

    Aug 7, 2026Mathurin Videau, Badr Youbi-Idrissi, David Lopez-Paz +1Scaling LawsExponents