stat.MLOct 14, 2026

High-Probability Regret Bounds for Feel-Good Thompson Sampling

Authors: Xuheng Li, Qingyue Zhao, Quanquan Gu

Organizations: Department of Computer Science, University of California, Los Angeles, CA 90095, USA

Abstract

Feel-good Thompson sampling (FGTS) augments the posterior of vanilla Thompson sampling with an exploration term that favors reward functions with high predicted optimal values. This modification achieves minimax-optimal regret up to logarithmic factors in linear contextual bandits, but existing analyses of its two standard variants establish regret guarantees in expectation. In this paper, we derive the first high-probability regret bounds for both cumulative and current-step FGTS in contextual bandits with general realizable function approximation. Our bounds depend on the corresponding decoupling coefficients and the prior mass near the true reward function. In the dd-dimensional linear setting, both variants satisfy Regret(T)=O(dTlog⁡(2T)+Tlog⁡(1/δ))\mathrm{Regret}(T)=O\big(d\sqrt T\log(2T)+\sqrt T\log(1/δ)\big) with probability at least 1−δ1-δ, where TT is the time horizon. This bound matches the dimension and horizon dependence of algorithms based on the upper confidence bounds, up to logarithmic factors. Relative to the expected-regret guarantees, the cost of controlling the regret with high probability is confined to additive terms with at most linear dependence on log⁡(1/δ)\log(1/δ). The proof ideas are partially developed by GPT-6 Astra under the authors' guidance.

Explore similar work

CardsList
  1. Prior Diffusiveness and Regret in the Linear-Gaussian Bandit

    Jan 5, 2026Yifan Zhu, John C. Duchi, Benjamin Van RoyThompson SamplingMulti-Armed Bandits

  2. Generalized Regret Analysis of Thompson Sampling using Fractional Posteriors

    Sep 12, 2023Prateek Jaiswal, Debdeep Pati, Anirban Bhattacharya +1Thompson SamplingMulti-Armed Bandits

  3. PFN-TS: Thompson Sampling for Contextual Bandits via Prior-Data Fitted Networks

    May 11, 2026Yan Shuo Tan, Kenyon Ng, Ruizhe Deng +3Thompson SamplingPrior-Data Fitted Networks