cs.LGOct 13, 2026

Follow the Perturbed Leader for Linear Bandits: T\sqrt{T} Regret over General Convex Sets

Authors: Chen-Yu Wei

Organizations: University of Virginia

Abstract

We give the first adversarial linear bandit algorithm based on Follow-the-Perturbed-Leader (FTPL) that achieves T\sqrt{T} regret over general convex action sets. Our algorithm attains O~(d5/4T)\widetilde{\mathcal{O}}(d^{5/4}\sqrt{T}) regret using only linear optimization oracles, and the near-optimal O~(dT)\widetilde{\mathcal{O}}(d\sqrt{T}) regret when an optimal-design exploration distribution is further available. This improves on the T2/3T^{2/3} regret of the FTPL algorithm of Dani and Hayes (2006) for general convex sets, and generalizes the T\sqrt{T} regret of Lévy et al. (2026) over two special action sets (hypercube and Euclidean ball). Compared to previous oracle-efficient linear bandit algorithms based on continuous exponential weights, the FTPL approach generally has better computational efficiency, and is much simpler to implement. The key algorithmic element is a perturbation distribution that adapts to the estimated rewards. Its simplest form, an adaptive Gaussian perturbation, is straightforward to implement and already attains the regret bound above. We further extend it to two general constructions, random-weighting and elliptical perturbations, each covering distributions from light tails (Gaussian) to heavy tails (Student-t2t_2). On the technical side, we develop a systematic way to analyze the stability term in the FTPL regret through the Fisher information of the perturbation distribution. This builds a general framework for FTPL beyond existing ones such as the hazard rate and the FTRL-FTPL duality.

Explore similar work

Oct 28, 2025

Self-Concordant Perturbations for Linear Bandits

We consider the adversarial linear bandits setting and present a unified algorithmic framework that bridges Follow-the-Regularized-Leader (FTRL) and Follow-the-Perturbed-Leader (FTPL) methods, extending the known connection between them from the full-information setting. Within this framework, we introduce self-concordant perturbations, a family of probability distributions that mirror the role of self-concordant barriers previously employed in the FTRL-based SCRiBLe algorithm. Using this idea, we design a novel FTPL-based algorithm that combines self-concordant regularization with efficient stochastic exploration. Our approach achieves a regret of O(dnln⁡n)\mathcal{O}(d\sqrt{n \ln n}) on both the dd-dimensional hypercube and the ℓ2\ell_2 ball. On the ℓ2\ell_2 ball, this matches the rate attained by SCRiBLe. For the hypercube, this represents a d\sqrt{d} improvement over these methods and matches the optimal bound up to logarithmic factors.
Mar 26, 2026

Parameter-Free Dynamic Regret for Unconstrained Linear Bandits

We study dynamic regret minimization in unconstrained adversarial linear bandit problems. In this setting, a learner must minimize the cumulative loss relative to an arbitrary sequence of comparators u1,…,uT\boldsymbol{u}_1,\ldots,\boldsymbol{u}_T in Rd\mathbb{R}^d, but receives only point-evaluation feedback on each round. We provide a simple approach to combining the guarantees of several bandit algorithms, allowing us to optimally adapt to the number of switches ST=∑tI{ut≠ut−1}S_T = \sum_t\mathbb{I}\{\boldsymbol{u}_t \neq \boldsymbol{u}_{t-1}\} of an arbitrary comparator sequence. In particular, we provide the first algorithm for linear bandits achieving the optimal regret guarantee of order O(d(1+ST)T)\mathcal{O}\big(\sqrt{d(1+S_T) T}\big) up to poly-logarithmic terms without prior knowledge of STS_T, thus resolving a long-standing open problem.
Mar 30, 2026

A Perturbation Approach to Unconstrained Linear Bandits

We revisit the standard perturbation-based approach of Abernethy et al. (2008) in the context of unconstrained Bandit Linear Optimization (uBLO). We show the surprising result that in the unconstrained setting, this approach effectively reduces Bandit Linear Optimization (BLO) to a standard Online Linear Optimization (OLO) problem. Our framework improves on prior work in several ways. First, we derive expected-regret guarantees when our perturbation scheme is combined with comparator-adaptive OLO algorithms, leading to new insights about the impact of different adversarial models on the resulting comparator-adaptive rates. We also extend our analysis to dynamic regret, obtaining the first guarantees with optimal PT\sqrt{P_T} path-length dependencies without prior knowledge of PTP_T. We then develop the first high-probability guarantees for both static and dynamic regret in uBLO. Finally, we discuss lower bounds on the static regret, and prove the folklore Ω(dT)Ω(\sqrt{dT}) rate for adversarial linear bandits on the Euclidean ball, which is of independent interest.