cs.LGSep 11, 2026

Thompson Sampling for Non-Monotone Convex Ridge Bandits: Monotonicity Is Not Needed for Polynomial Regret

Authors: Xuan Li

Abstract

Bakhtiari, Lattimore and Szepesv'ari (COLT 2025) proved that Thompson sampling (TS) has Bayesian regret O~(d5/2n)\tilde O(d^{5/2}\sqrt n) for bandit convex optimisation with convex \emph{monotone} ridge losses f(x)=(\ipxθ)f(x)=\ell(\ip{x}{\theta}), and asked whether monotonicity of the link is necessary. We give a qualitative negative answer. For every prior on [0,1][0,1]-valued, 11-Lipschitz convex ridge losses with an arbitrary convex, possibly non-monotone, link, and for any fixed measurable selection of minimisers, exact-posterior TS has Bayesian regret O((d+1)4dnlog(e+ndmax{1,\diamK}))=O~(d9/2n)O\big((d+1)^4\sqrt{dn}\,\log(e+nd\max\{1,\diam K\})\big)=\tilde O(d^{9/2}\sqrt n). The monotone proof relies on a single-removal John-ellipsoid dichotomy; we show by an explicit twelve-point configuration that this dichotomy fails for non-monotone links, and replace it by an O(d2)O(d^2) cardinality bound for ``uninformative'' configurations. The bound uses a Boolean rounding argument: a 00-11 matrix within 1/(4r)1/(4r) in max-norm of a rank-rr matrix has rank at most 2r12r-1. We construct d(d+1)d(d+1) uninformative losses, showing that the cardinality bound is tight up to constants in the large-diameter-to-gap regime, and give a self-contained information-ratio-to-regret transfer that is uniform over fixed measurable selections. Whether the d5/2d^{5/2} dependence of the monotone case can be retained remains open.

Explore similar work

Jun 8, 2026cs.LG

Asymptotic Optimality of Thompson Sampling for Risk-Averse Bandits with Sub-Gaussian Rewards

We prove that ρ-NPTSSGρ\text{-}\mathrm{NPTS}_{\mathrm{SG}}, an anchor-free nonparametric Thompson Sampling algorithm for risk-averse bandits, achieves regret matching the instance-dependent lower bound to leading order in logn\log n, establishing it as asymptotically optimal for any continuous risk functional ρρ (CVaR, mean-variance, Sharpe ratio, distortion risk measures, and more) on the class of distributions with bounded density and sub-Gaussian tails, including Gaussian arms. Both this result and its bounded-support counterpart require only continuity of ρρ: strictly weaker than the dominance condition of prior parametric Thompson Sampling results, and strictly weaker than the Lipschitz condition of UCB-type algorithms, yielding the first instance-optimal guarantees for non-Lipschitz functionals such as the Sharpe ratio without parametric reward assumptions. The bounded-support case is developed first as a stepping stone sharing the same proof structure. The key technical contributions are a discretisation lemma (bounded support) and a truncated discretisation lemma (sub-Gaussian tails), each projecting the growing-alphabet Dirichlet posterior onto a fixed grid via the Dirichlet aggregation property, holding all polynomial prefactors at fixed degree independent of sample size and breaking the super-exponential barrier that blocked prior proofs.
Joel Q. L. Chang
Jan 5, 2026cs.LG

Prior Diffusiveness and Regret in the Linear-Gaussian Bandit

We prove that Thompson sampling exhibits O~(σdT+drTr(Σ0))\tilde{O}(σd \sqrt{T} + d r \sqrt{\mathrm{Tr}(Σ_0)}) Bayesian regret in the linear-Gaussian bandit with a N(μ0,Σ0)\mathcal{N}(μ_0, Σ_0) prior distribution on the coefficients, where dd is the dimension, TT is the time horizon, rr is the maximum 2\ell_2 norm of the actions, and σ2σ^2 is the noise variance. In contrast to existing regret bounds, this shows that to within logarithmic factors, the prior-dependent burn-in'' term $d r \sqrt{\mathrm{Tr}(Σ_0)}$ decouples additively from the minimax (long run) regret $σd \sqrt{T}$. Previous regret bounds exhibit a multiplicative dependence on these terms. We establish these results via a new elliptical potential'' lemma, and also provide a lower bound indicating that the burn-in term is unavoidable.
Yifan Zhu, John C. Duchi, Benjamin Van Roy
Jul 14, 2026stat.ML

Thompson Sampling Is 2-Competitive for Mistakes

We consider Bayesian bandit models and prove that Thompson sampling makes at most twice the expected number of mistakes (selections of a suboptimal arm) as any other policy. Our analysis applies as long as the latent arm processes are independent and each arm evolves only when played. For stochastic bandits with best arm defined via mean reward, this confirms a conjecture of Guha and Munagala from 2014, where the factor 22 is already best possible. The result holds under any nonincreasing sequence of round weights, including fixed horizon and geometric discounting.
Mark Sellke, Gregory Valiant