cs.LGSep 12, 2026

Prior-Free Competitive Ratios for Improving Bandits: Scale, Curvature and Horizon Are Free, but Not Jointly Under Noise

Authors: Xuan Li

Organizations: University of New South Wales, Sydney, Australia

Abstract

In the improving multi-armed bandits problem, each of kk arms has an unknown nondecreasing, discretely concave reward curve fif_i, and pulling arm ii for the tt-th time yields fi(t)f_i(t). For sufficiently long horizons, Blum and Ravichandran (ALT 2025) proved that randomized algorithms achieve an O(k)O(\sqrt k) approximation to the best single arm when the scale m=f∗(T)m=f^*(T) of the optimal arm is known (T≥2kT\ge2k), and O(klog⁡k)O(\sqrt k\log k) when it is not (T>4kT>4k), against an Ω(k)Ω(\sqrt k) lower bound. The logarithmic factor is unnecessary: a one-page probe-and-commit algorithm achieves competitive ratio 43 k4\sqrt3\,\sqrt k for T≥2⌊k⌋T\ge2\lfloor\sqrt k\rfloor, without any knowledge of the scale, and we determine the optimal ratio for every horizon, Θ(k+k/T)Θ(\sqrt k+k/T), also for unknown horizons. Without noise, no prior is needed at all: a random-marginal probing algorithm reading neither the scale mm, nor the concavity-envelope exponent ββ of Blum, Garicano, Ravichandran and Sharma (UAI 2026), nor the horizon TT, achieves the optimal Θ(kβ/(1+β)+k/T)Θ(k^{β/(1+β)}+k/T) simultaneously for every ββ and every horizon. Under the multiplicative noise model of Blum and Ravichandran, probe-and-commit keeps the same all-horizon order Θ(k+k/T)Θ(\sqrt k+k/T) without knowing the noise level (and Θ(k)Θ(\sqrt k) on the same range), but the price of priors jumps: for any fixed noise level ε∈(0,1/2]\varepsilon\in(0,1/2], the uniform price of adaptation φε(k)φ_\varepsilon(k) --- the worst case over horizons T≥16kT\ge16k of the loss relative to kβ/(1+β)k^{β/(1+β)} for algorithms knowing neither mm nor ββ --- is Θε(log⁡k/log⁡log⁡k)Θ_\varepsilon(\sqrt{\log k/\log\log k}), the lower bound asymptotic in kk at fixed positive ε\varepsilon and matched by a nested random-permutation probing algorithm, whereas knowing either mm or ββ alone restores a constant price.

Figures & tables

Explore similar work

CardsList
  1. Bandits with Multiple Optimal Arms: Minimax Regret and Non-Adaptivity

    Sep 29, 2026Kaixuan Ji, Qiwei Di, Qingyue Zhao +2Multi-Armed BanditsMinimax Regret