cs.LGJun 12, 2026

A Complexity Measure for Active Learning in Multi-group Mean Estimation

Authors: Abdellah AznagRachel CummingsAdam N. Elmachtoub

Organizations: Department of Industrial Engineering and Operations Research & Data Science Institute, Columbia University

Abstract

We study a \emph{max-risk} objective for active learning in a multi-group mean estimation dd-armed bandits: a learner adaptively allocates a budget of TT samples across dd groups to minimize the worst-case uncertainty index maxk[d]σk2/nk\max_{k\in[d]}σ_k^2/n_k, where σkσ_k is the standard deviation of the distribution of arm dd, and nkn_k is the number of times arm dd is sampled. We develop a local minimax framework and prove the first general lower bound for this objective, valid for any finite-variance hypothesis class. The bound separates difficulty into three orthogonal factors: a \emph{budget} term, a \emph{heteroscedasticity} index measuring how unevenly the uncertainty is spread across arms, and a model-dependent complexity measure, the \emph{Variance Local Curvature} (VLC\mathrm{VLC}), which captures how much information a local change of variance creates inside the hypothesis class. For smooth classes, the VLC\mathrm{VLC} is a reparametrization of a variance--Fisher information, with closed-form values for common families. Benchmarking against the strongest available upper bound shows near-optimality up to logarithmic factors in broad regimes, and pinpoints a systematic gap in highly heterogeneous instances. Our proof introduces two key ingredients: a loss-induced 1\ell_1 geometry on the decision space, and a representation-based instance generator that reduces hard-instance construction to an explicit random matrix calculation.

Explore similar work

CardsList