cs.LGMay 13, 2026

Scale-Sensitive Shattering: Learnability and Evaluability at Optimal Scale

Authors: Shashaank AiyerYishay MansourShay MoranHan ShaoTom Waknine

Organizations: University of Maryland · Tel Aviv University · Google Research · Technion

Abstract

We study the optimal scale at which real-valued function classes exhibit uniform convergence and learnability. Our main result establishes a scale-sensitive generalization of the fundamental theorem of PAC learning: for every bounded real-valued class and every γ>0γ>0, uniform convergence at scale γγ, agnostic learnability at scale γ/2γ/2, and finiteness of the fat-shattering dimension at every scale γ>γγ'>γ are equivalent. This resolves a question by Anthony and Bartlett (Cambridge Univ. Press 1999) on the precise scales governing learnability, refuting a conjecture attributed there to Phil Long that a multiplicative 2-factor gap is unavoidable, and improves the upper bounds of Bartlett and Long (JCSS 1998), which incur such a loss. The key technical ingredient is a direct bound on empirical \ell_\infty covering numbers, avoiding the standard detour through packing numbers. As a consequence, we obtain sharp asymptotic metric-entropy bounds in terms of the fat-shattering scale γγ: an O(log2n)O(\log^2 n) bound holds already at scale γ/2γ/2, while an O(logn)O(\log n) bound holds at scale 2γ. We further show that the O(log2n)O(\log^2 n) bound is sometimes tight. These results resolve open questions by Alon et al. (JACM 1997) and Rudelson and Vershynin (Ann. of Math. 2006). As an application, we establish a sharp dichotomy for bounded integral probability metrics: every such IPM is either estimable or cannot be weakly evaluated within any multiplicative factor c<3c<3, while 33-weak evaluability always holds, resolving an open question from Aiyer et al. (ICML 2026). We also highlight several open questions on quantitative sample complexity and evaluability.

Explore similar work

CardsList
  1. An Optimal Agnostic PAC Algorithm

    Aug 6, 2026Markus Engelund Mathiasen, Jian Qian, Nikita ZhivotovskiyOptimal Sample ComplexitySample Complexity