stat.MLOct 18, 2026

Strictly Replicable Realizable Learning: Unknown Marginals, Finite-Class Interpolation, and the Cost of Shared Randomness

Authors: Guangjian Zhang

Abstract

Strict replicability requires two independent training samples, processed with the same random seed, to produce exactly the same hypothesis. We study realizable Boolean learning under unknown and known instance marginals. For unknown marginals, we obtain the worst-case sample complexity Θ(((log⁡M)2/ρ2+log⁡(1/δ))/ε)Θ(((\log M)^2/ρ^2+\log(1/δ))/\varepsilon) for classes of cardinality at most MM, throughout a fixed small-parameter range. This resolves the distribution-free finite-class sample-complexity question up to universal constants and rules out a general ρ−1ρ^{-1} dependence. The upper bound uses a truncated-power distribution with a hard empirical-error budget. For known marginals, a control-variate learner uses O(((1+log⁡M)3/2/ρ+log⁡(1/δ))/ε)O(((1+\log M)^{3/2}/ρ+\log(1/δ))/\varepsilon) samples, and explicit uniform-marginal instances establish the matching class-size exponent. On a product of dd finite threshold chains of length kk, we determine the exact rate Θ((dklog⁡(1+d/(kρ))+log⁡(1/δ))/ε)Θ((dk\log(1+\sqrt d/(kρ))+\log(1/δ))/\varepsilon). We also characterize deterministic learning, the very-small-ρρ regime for arbitrary finite classes, and every cardinality-replicability regime for finite classes of VC dimension one. A VC-covering-number bound yields the fixed-accuracy exponent 3/23/2 independently of cardinality. Finally, we separate statistical complexity from implementation costs: we prove a sharp fixed-block trade-off, short-seed existence bounds, and a shared rejection-filter reduction from optimal learning of the full Boolean class to efficient public sampling of ordinary Bernoulli product distributions. Detailed proofs include the geometric lower bounds, the discrete posterior-kernel comparison, and the finite-bit constructions.

Figures & tables

Appendix figures & tables3 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. The Sample Complexity of Replicable Realizable PAC Learning

    Feb 23, 2026Kasper Green Larsen, Markus Engelund Mathiasen, Chirag Pabbaraju +1PAC LearningSample Complexity

  2. Replicable Composition

    Apr 12, 2026Kiarash Banihashem, MohammadHossein Bateni, Hossein Esfandiari +2Sample ComplexityML Reproducibility