stat.MLOct 6, 2026

Nash Social Welfare for Multi Armed Bandits: Trajectory-wise Expected and High Probability Regret

Authors: Avishek Ghosh

Organizations: Department of Computer Science and Engineering Indian Institute of Technology, Bombay

Abstract

We study fair multi-armed bandits under the Nash Social Welfare (NSW) objective, which measures performance via the geometric mean of accumulated rewards. Existing work defines Nash regret as NRT=μ⋆−(∏t=1TEμIt)1/T\mathrm{NR}_T = μ^\star - (\prod_{t=1}^T \mathbb{E}μ_{I_t})^{1/T}, where μItμ_{I_t} is the mean reward of the recommended arm ItI_t and TT is the horizon. Since it applies the geometric mean to per-round marginal expectations, it ignores the joint distribution of rewards across rounds, leaving the NSW fairness motivation unaddressed at the trajectory level. We propose \emph{trajectory-wise Nash regret} NR~T=μ⋆−E[(∏t=1TμIt)1/T]\widetilde{\mathrm{NR}}_T = μ^\star - \mathbb{E}[(\prod_{t=1}^T μ_{I_t})^{1/T}], which computes the geometric mean over complete sample paths before taking expectations, capturing NSW fairness more faithfully. By Jensen's inequality, NR~T≥NRT\widetilde{\mathrm{NR}}_T \geq \mathrm{NR}_T, making it a strictly stronger metric. We also introduce \emph{high probability Nash regret} NR^T=μ⋆−(∏tμIt)1/T\widehat{\mathrm{NR}}_T = μ^\star - (\prod_t μ_{I_t})^{1/T}, giving the first high probability regret bounds in fair bandits. Our two-phase algorithm, Round Robin Nash Confidence Bound (\texttt{RR-NCB}), combines round robin exploration with a Nash confidence bound index policy. We show NR~T≤O~(klog⁡T/T)\widetilde{\mathrm{NR}}_T \leq \widetilde{\mathcal{O}}(\sqrt{k\log T/T}) and, with probability 1−δ1-δ, NR^T≤O~(klog⁡(kT/δ)/T)\widehat{\mathrm{NR}}_T \leq \widetilde{\mathcal{O}}(\sqrt{k\log(kT/δ)/T}), matching the optimal O~(k/T)\widetilde{\mathcal{O}}(\sqrt{k/T}) rate despite the stronger metrics. Optimality follows from a lower bound via AM-GM and standard kk-armed bandit minimax arguments. Simulations validate our theory.

Figures & tables

Explore similar work

CardsList
  1. Improved Algorithms for Nash Welfare in Linear Bandits

    Jan 30, 2026Dhruv Sarkar, Nishant Pandey, Sayak Ray ChowdhuryStochastic Multi-Armed BanditsAlgorithmic Fairness

  2. Price of Fairness in Bandits: A Tight Minimax Characterization

    Jul 15, 2026Dhruv Sarkar, Soumyadeep Dutta, Sayak Ray ChowdhuryBanditsMinimax