cs.LGMay 9, 2026

A Complete Characterization of Learnability for Adversarial Noisy Bandits

Authors: Steve HannekeKun Wang

Organizations: Department of Computer Science, Purdue University

Abstract

We study adversarial noisy bandits given a known function class F\mathcal{F}. In each round, the adversary selects a function fFf \in \mathcal{F}, the learner chooses an arm, and then observes a noisy reward determined by the chosen arm and the function ff. The goal is to minimize the cumulative regret R(T)R(T), defined as the difference between the learner's performance and that of the best fixed arm in hindsight over TT rounds. We say that a function class F\mathcal{F} is learnable if there exists an algorithm achieving sublinear regret. Our main result is a complete characterization of learnability for adversarial noisy bandits. The characterization is given in terms of a convexified variant of the generalized maximin volume introduced by Hanneke and Wang (2025): namely, the generalized maximin volume evaluated on the convex hull co(F)\operatorname{co}(\mathcal F). We prove that F\mathcal F is learnable if and only if this convexified generalized maximin volume is positive at every scale. This condition characterizes learnability against both oblivious and adaptive adversaries, showing in particular that these two notions of learnability are equivalent in the noisy bandit setting. Our analysis reveals that the key complexity measure is closely connected to two new combinatorial notions, hitting set and distribution covering number, which may be of independent interest. These results establish the first complete characterization of learnability for adversarial noisy bandits.

Explore similar work

CardsList
  1. Best of both worlds: Stochastic & adversarial best-arm identification

    Apr 16, 2026Yasin Abbasi-Yadkori, Peter L. Bartlett, Victor Gabillon +2BanditsStochastic