cs.LGOct 21, 2026

A Sharp Dynamic Haussler Lemma

Authors: Shihao Shao, Dacheng Tao

Organizations: College of Computing and Data Science, Nanyang Technological University

Abstract

Haussler's covering lemma (JCTA 1995) gives the sharp (C/δ)d(C/δ)^d metric-entropy bound for binary VC classes under normalized ℓ1\ell_1 distance. We prove a sharp global dynamic analogue for bounded real-valued classes in normalized ℓp\ell_p, for every 1≤p<∞1\le p<\infty. Writing d=sfat⁡ε/32(F)d=\operatorname{sfat}_{\varepsilon/32}(\mathcal F), we obtain a global dynamic cover of size at most (C/εp)d(C/\varepsilon^p)^d for every horizon and 0<ε<1/20<\varepsilon<1/2. Here a single family of deterministic causal experts, fixed independently of the instance sequence, covers every target on every sequence. For 0<ε<1/40<\varepsilon<1/4, a matching worst-case lower bound (c/ε)pd(c/\varepsilon)^{pd} holds already for binary classes on one fixed sequence, even with real-valued experts. The constants are universal, independent of pp. For p=2p=2, this resolves the horizon-independent sequential ℓ2\ell_2 covering problem of Rakhlin, Sridharan, and Tewari (PTRF 2015) in a stronger global form. For p=1p=1, it gives the sharp (C/δ)Ldim⁡(H)(C/δ)^{\operatorname{Ldim}(\mathcal H)} global dynamic covering bound for binary classes, resolving questions of Alon, Ben-Eliezer, Dagan, Moran, Naor, and Yogev (STOC 2021) and Malliaris and Moran (Trans. AMS 2024). Our proof combines rank-decreasing correction schedules and accurate sampled prefixes with exact continuations after target identification. Shared-parent routing distributes these continuations among eligible prefixes, eliminating the logarithmic overhead.

Explore similar work

CardsList
  1. Uniform convergence at optimal rate and scale

    Oct 17, 2026Noga Alon, Steve Hanneke, Shay Moran +1Generalization Bounds

  2. Scale-Sensitive Shattering: Learnability and Evaluability at Optimal Scale

    May 13, 2026Shashaank Aiyer, Yishay Mansour, Shay Moran +2Agnostic LearningStatistical Learning Theory

  3. Tight list replicability bounds via a novel sphere covering theorem

    Jun 4, 2026Ari Blondal, Hamed Hatami, Pooya Hatami +2ML ReproducibilityStatistical Learning Theory