stat.MLJul 15, 2026

Price of Fairness in Bandits: A Tight Minimax Characterization

Authors: Dhruv SarkarSoumyadeep DuttaSayak Ray Chowdhury

Organizations: 1Indian Institute of Technology Kharagpur · 2Mohamed bin Zayed University of Artificial Intelligence · 3Indian Institute of Technology Kanpur

Abstract

In bandit problems, standard regret-minimizing algorithms treat exploration as an amortized cost, which can expose early participants to unfair ex-ante losses in settings such as clinical trials. Recent work addresses this by evaluating the sequence of per-round expected rewards through the generalized pp-mean, interpolating between utilitarian welfare (p=1p=1), Nash welfare (p0p\to0), and Rawlsian fairness (pp\to-\infty). Although tight guarantees are known for p0p\ge0, the strictly fair regime q=p>0q=-p>0 remains unresolved because negative-power means are dominated by the smallest per-round rewards. For σσ-sub-Gaussian rewards with nonnegative means, the best prior algorithm relied on uniform early exploration and achieved regret O(k(q+1)/2/T)O(k^{(q+1)/2}/\sqrt{T}), while the only general lower bound was the classical Ω(σk/T)Ω(σ\sqrt{k/T}). Thus it was unclear whether the extra dependence on kk was intrinsic to strict fairness or an artifact of uniform exploration. We close this gap by identifying the exact polynomial price of strict fairness. Using a needle-in-haystack construction, we prove an algorithm-independent lower bound Ω(σkmax(1,q)/T)Ω(σ\sqrt{k^{\max(1,q)}/T}); for q>1q>1, this shows that the penalty kq/2k^{q/2} is information-theoretically unavoidable. We then introduce \textsf{UCB-HARE} (Harmonic Anchored Rank Exploration), which replaces uniform exploration with an inverse-weighted harmonic rank schedule protected by a certified positive-mean anchor. Its regret is O~(σkmax(1,q)/T)\widetilde{O}(σ\sqrt{k^{\max(1,q)}/T}), matching the lower bound up to logarithmic factors. Experiments on synthetic instances confirm that \textsf{UCB-HARE} improves over uniform-exploration baselines, with gains increasing as qq grows.

Explore similar work

Jan 30, 2026cs.LG

Improved Algorithms for Nash Welfare in Linear Bandits

Nash regret has recently emerged as a principled fairness-aware performance metric for stochastic multi-armed bandits, motivated by the Nash Social Welfare objective. Although this notion has been extended to linear bandits, existing results suffer from suboptimality in ambient dimension dd, stemming from proof techniques that rely on restrictive concentration inequalities. In this work, we resolve this open problem by introducing new analytical tools that yield an order-optimal Nash regret bound in linear bandits. Beyond Nash regret, we initiate the study of pp-means regret in linear bandits, a unifying framework that interpolates between fairness and utility objectives and strictly generalizes Nash regret. We propose a generic algorithmic framework, FairLinBandit, that works as a meta-algorithm on top of any linear bandit strategy. We instantiate this framework using two bandit algorithms: Phased Elimination and Upper Confidence Bound, and prove that both achieve sublinear pp-means regret for the entire range of pp. Extensive experiments on linear bandit instances generated from real-world datasets demonstrate that our methods consistently outperform the existing state-of-the-art baseline.
Dhruv Sarkar, Nishant Pandey, Sayak Ray Chowdhury
Jul 24, 2026cs.LG

Discrepancy-Rounded Fair Bandits with Static and Time-Varying Exposure Floors

Minimum-exposure constraints arise in recommendation, content curation, and regulated allocation when each provider, arm, or group must receive guaranteed exposure inside a period rather than only in aggregate. We study stochastic bandits with exact exposure floors and show that the right object is a rounding problem: a fractional fair schedule is realized as integral pulls, and the exposure error is exactly a discrepancy vector. The main contribution is a blockwise model with time-varying floors. BDQ-UCB satisfies every block floor deterministically and has fair regret governed by the nonmandatory budget RR, not the horizon TT, with high-probability regret O(KRlog(KT))O(\sqrt{KR\log(KT)}). A MOSS residual variant attains O(KR)O(\sqrt{KR}), and a matching lower bound gives the minimax rate Θ(KR)Θ(\sqrt{KR}), even with positive mandatory exposure; a kl-UCB++^{++} residual rule adds instance-dependent optimality. The formulation becomes essential for overlapping group floors: per-arm rounding can violate a group constraint by Ω(s)Ω(s) in the group size, whereas Beck--Fiala null-space rounding meets every group floor within the block budget with violation below the arm degree tt, and composes with UCB at the same RR-parametrized regret. For learned group plans, we close disjoint systems at Θ~(KT)\widetildeΘ(\sqrt{KT}), give a dual-ledger decomposition explaining why naive index rules fail under overlap, and prove a plan-sampling rule that is pathwise feasible under an initial cover-slack condition and attains a conditional O~(KT)\widetilde O(\sqrt{KT}) guarantee, leaving the condition-free overlap rate open. Experiments on synthetic floors, MovieLens-100k genre exposure, and deployment stress tests show exact feasibility without penalty tuning and regret competitive with tuned Lagrangian baselines.
Ibne Farabi Shihab, Joyanta Jyoti Mondal, Anuj Sharma
May 3, 2026cs.LG

Multi-User Dueling Bandits: A Fair Approach using Nash Social Welfare

Learning from human preference data is becoming a useful tool, from fine-tuning large language models to training reinforcement learning agents. However, in most scenarios, the model is trained on the average preference of all human evaluators, which, under large variations of preferences, can be unfair to minority groups. In this work, we consider fairness in dueling bandits, a standard framework for online learning from preference data. We assume that each user has a (potentially distinct) Condorcet winner, which is an arm preferred to every other arm. Using these user-specific Condorcet winners as reference points, we evaluate and score arms according to their performance relative to the corresponding winner. To promote fairness across heterogeneous users, we adopt the well-established Nash Social Welfare objective, which maximizes the product of user utilities, thereby inherently penalizing inequality and preventing the marginalization of any single user. Within this framework, we construct a hard instance to establish a regret lower bound of Ω(T2/3min(K,D)13)Ω(T^{2/3}\min(K,D)^\frac{1}{3}) for a time horizon TT, KK arms, and DD users, which, to the best of our knowledge, is the first result quantifying the cost of fairness in dueling bandits with heterogeneous preferences. We then present the Fair-Explore-Then-Commit and Fair-εε-Greedy algorithms with a Condorcet winner identification phase. We further derive their regret upper bounds that match the lower-bound dependence on TT up to logarithmic factors.
Maheed H. Ahmed, Mahsa Ghasemi