cs.LGAug 7, 2026

Dirichlet Follow-the-Leader Closes the Gap in Simultaneous Multiclass U-Calibration

Authors: Pahan Dewasurendra

Organizations: Johns Hopkins University

Abstract

Can one forecaster attain the optimal regret rate for every bounded proper loss and also adapt to every smooth proper loss? Recent work answered this up to a dimension gap. Its self-concordant perturbation gives roughly K5/4TK^{5/4}\sqrt{T} worst-case regret and incurs an additional βKlogKβ\sqrt{K}\log K for ββ-smooth losses. We close both gaps with a one-line forecaster. After observing class counts ct1c_{t-1}, draw the next prediction from Dir(ct1)\operatorname{Dir}(c_{t-1}), on the face of classes seen so far. This is a fresh Bayesian bootstrap of the outcomes. The analysis rests on an exact identity: averaging any bounded proper loss under Dir(α)\operatorname{Dir}(α) equals a discrete derivative of its Dirichlet-averaged Bayes risk. The identity makes the be-the-perturbed-leader term telescope to a nonpositive Jensen gap. A one-count likelihood ratio then bounds stability by the inverse square root of that class's count. The resulting single, horizon-free algorithm satisfies supEReg4STT4KT\sup_{\ell}\mathbb{E}\operatorname{Reg}_{\ell}\leq 4\sqrt{S_T T}\leq 4\sqrt{K T} and EReg52β(1+logT)\mathbb{E}\operatorname{Reg}_{\ell}\leq \frac{5}{2}β(1+\log T) for every ββ-smooth proper loss. Here STS_T is the number of observed classes. Known lower bounds show that both rates are optimal in their nontrivial regimes. The proof covers nondifferentiable losses and changes of the active simplex face.

Explore similar work

CardsList
  1. Toward Simultaneously Optimal Regret in U-Calibration

    Jun 16, 2026Rafael Frongillo, Haipeng Luo, Nishant A. Mehta +1Linear RegretRegret

  2. Calibeating for general proper losses: A Bregman divergence approach

    May 17, 2026Maximilian Fichtl, Cristóbal Guzmán, Nishant A. MehtaBregman DivergencesLinear Regret