stat.MLNov 15, 2026

Minimax Estimation of Discrete Distributions under Hockey-stick Divergence

Authors: Manaka Ueno, Geoffrey Wolfer

Organizations: Department of Electrical Engineering and Computer Science, Tokyo University of Agriculture and Technology, Tokyo

Abstract

We initiate the study of estimating a discrete distribution with respect to the hockey-stick divergence from independent samples. We provide non-asymptotic upper and lower bounds on the minimax expected loss in terms of the alphabet size, the number of samples, and the divergence parameter. The upper bounds are achieved by add-constant estimators, while the lower bound is derived via a Bayes risk argument. Both upper bounds and lower bounds reveal a transition between polynomial and exponential regimes as the parameters of the problem vary.

Explore similar work

CardsList
  1. Improved Distribution Estimation in ℓ∞\ell_\infty

    May 28, 2026Doron Cohen, Aryeh Kontorovich, Yonatan LivshitzMinimax Estimation

  2. Minimax Lower Bounds of Kernel Discrepancy Estimation: MMD, HSIC, KSD

    Jul 27, 2026Jose Cribeiro-Ramallo, Florian Kalinke, Zoltán SzabóMaximum Mean DiscrepancyMinimax Estimation

  3. Simultaneous estimation of multiple discrete unimodal distributions under stochastic order constraints

    Mar 12, 2026Yasuhiro Yoshida, Noriyoshi Sukegawa, Jiro IwanagaDensity Estimation