cs.LGAug 15, 2026

Does 1/2-Tsallis-INF Also Work Well for Best-Arm Identification?

Authors: Jingxin Zhan, Yuze Han, Zhihua Zhang

Organizations: School of Mathematical Sciences, Peking University · Center for Applied Statistics and School of Statistics, Renmin University of China

Abstract

Regret minimization (RM) and best-arm identification (BAI) are two fundamental objectives in multi-armed bandits. Among regret-minimizing algorithms, 1/21/2-Tsallis-INF is a canonical best-of-both-worlds FTRL algorithm: it achieves logarithmic pseudo-regret in stochastic bandits while retaining minimax-optimal regret in adversarial bandits, without knowing the environment in advance. This raises a natural question: can the same algorithm, without additional exploration, also identify the best arm reliably? We study this question in stochastic bandits by analyzing the failure probability Err⁡t\operatorname{Err}_t, defined as the probability that the empirical best arm determined by the cumulative importance-weighted loss estimates of 1/2-Tsallis-INF differs from the true optimal arm. The main difficulty is that, at the logarithmic-regret scale, suboptimal arms are sampled with probability heuristically of order 1/t1/t. Consequently, importance weighting causes the cumulative estimator to fluctuate on the same linear scale as its mean separation. To overcome this obstacle, guided by a diffusion toy model, we construct a Lyapunov function for the gap process between the estimated cumulative loss of the optimal arm and that of the best competing arm. This leads to polynomial upper bounds on Err⁡t\operatorname{Err}_t: for learning rate ηt=α/tη_t=α/\sqrt t, Err⁡t\operatorname{Err}_t decays at rate t−2+α2μi∗/4+ρt^{-2+α^2μ_{i_*}/4+ρ} for any ρ>0ρ>0, where μi∗μ_{i_*} denotes the mean loss of the true optimal arm. We also establish a lower bound Ω(t−2−ε)Ω(t^{-2-\varepsilon}) for any ε>0\varepsilon>0, showing that the exponent 22 is essentially tight.

Explore similar work

CardsList
  1. On The Complexity of Best-Arm Identification in Non-Stationary Linear Bandits

    Mar 11, 2026Leo Maynard-Zhang, Zhihan Xiong, Kevin Jamieson +1Multi-Armed BanditsBest-Arm Identification

  2. Trading off rewards and errors in multi-armed bandits

    May 1, 2026Akram Erraqabi, Alessandro Lazaric, Michal Valko +2Multi-Armed BanditsExploration-Exploitation Tradeoff

  3. Best of both worlds: Stochastic & adversarial best-arm identification

    Apr 16, 2026Yasin Abbasi-Yadkori, Peter L. Bartlett, Victor Gabillon +2Multi-Armed BanditsBest-Arm Identification