cs.LGMay 31, 2026

Fairness in two-player zero-sum games with bandit feedback

Authors: S AkashPratik Gajane

Abstract

We study two-player zero-sum games (TPZSGs) with bandit feedback under fairness constraints requiring every action to be played with probability at least α/mα/m. Existing instance-dependent results target pure\textit{pure} Nash equilibria, while fairness generically produces mixed\textit{mixed} equilibria, a harder learning target. Our key technical tool is a reparametrization: every fair strategy decomposes as p=(α/m)1+(1α)p~p = (α/m)\mathbf{1} + (1-α)\widetilde{p} with p~Δm\widetilde{p} \in Δ_m, and substituting into the payoff form yields pAq=p~A~qp^{\top}Aq = \widetilde{p}^{\top}\widetilde{A} q for a fair payoff matrix A~:=(1α)A+α1c\widetilde{A} := (1-α)A + α\mathbf{1} c^{\top}, where cj=1miA(i,j)c_j = \tfrac{1}{m}\sum_i A(i,j) is the column-mean vector. The fair game on AA is then equivalent to a standard zero-sum game on A~\widetilde{A}, so equilibrium existence, KKT structure, and LP basis stability reduce to classical results applied to A~\widetilde{A}. We derive the fair minimax value, fair Nash equilibrium, fair regret, and a clean dual representation showing the price of fairness is at most α(11/m)α(1-1/m) and vanishes whenever the unconstrained equilibrium already has full support. Our main result is an O~(T2/3)\widetilde{O}(T^{2/3}) regret bound for an Explore-Then-Commit algorithm, Fair-ETC-TPZSG\texttt{Fair-ETC-TPZSG}, applicable to general mixed fair equilibria, together with a discussion of why naive action elimination does not readily improve it. When the fair equilibrium has a single dominant action, equivalently when p~\widetilde{p}^{\star} is a vertex of ΔmΔ_m, the bound sharpens to instance-dependent O~(1/Δ~(α)2)\widetilde{O}(1/\widetildeΔ(α)^{2}), where Δ~(α)\widetildeΔ(α) is the LP-margin gap.

Explore similar work

Apr 17, 2026cs.LG

The Harder Path: Last Iterate Convergence for Uncoupled Learning in Zero-Sum Games with Bandit Feedback

We study the problem of learning in zero-sum matrix games with repeated play and bandit feedback. Specifically, we focus on developing uncoupled algorithms that guarantee, without communication between players, the convergence of the last-iterate to a Nash equilibrium. Although the non-bandit case has been studied extensively, this setting has only been explored recently, with a bound of O(T1/8)\mathcal{O}(T^{-1/8}) on the exploitability gap. We show that, for uncoupled algorithms, guaranteeing convergence of the policy profiles to a Nash equilibrium is detrimental to the performance, with the best attainable rate being Ω(T1/4)Ω(T^{-1/4}) in contrast to the usual Ω(T1/2)Ω(T^{-1/2}) rate for convergence of the average iterates. We then propose two algorithms that achieve this optimal rate up to constant and logarithmic factors. The first algorithm leverages a straightforward trade-off between exploration and exploitation, while the second employs a regularization technique based on a two-step mirror descent approach.
Côme Fiegel, Pierre Ménard, Tadashi Kozuno +2
Jul 15, 2026stat.ML

Price of Fairness in Bandits: A Tight Minimax Characterization

In bandit problems, standard regret-minimizing algorithms treat exploration as an amortized cost, which can expose early participants to unfair ex-ante losses in settings such as clinical trials. Recent work addresses this by evaluating the sequence of per-round expected rewards through the generalized pp-mean, interpolating between utilitarian welfare (p=1p=1), Nash welfare (p0p\to0), and Rawlsian fairness (pp\to-\infty). Although tight guarantees are known for p0p\ge0, the strictly fair regime q=p>0q=-p>0 remains unresolved because negative-power means are dominated by the smallest per-round rewards. For σσ-sub-Gaussian rewards with nonnegative means, the best prior algorithm relied on uniform early exploration and achieved regret O(k(q+1)/2/T)O(k^{(q+1)/2}/\sqrt{T}), while the only general lower bound was the classical Ω(σk/T)Ω(σ\sqrt{k/T}). Thus it was unclear whether the extra dependence on kk was intrinsic to strict fairness or an artifact of uniform exploration. We close this gap by identifying the exact polynomial price of strict fairness. Using a needle-in-haystack construction, we prove an algorithm-independent lower bound Ω(σkmax(1,q)/T)Ω(σ\sqrt{k^{\max(1,q)}/T}); for q>1q>1, this shows that the penalty kq/2k^{q/2} is information-theoretically unavoidable. We then introduce \textsf{UCB-HARE} (Harmonic Anchored Rank Exploration), which replaces uniform exploration with an inverse-weighted harmonic rank schedule protected by a certified positive-mean anchor. Its regret is O~(σkmax(1,q)/T)\widetilde{O}(σ\sqrt{k^{\max(1,q)}/T}), matching the lower bound up to logarithmic factors. Experiments on synthetic instances confirm that \textsf{UCB-HARE} improves over uniform-exploration baselines, with gains increasing as qq grows.
Dhruv Sarkar, Soumyadeep Dutta, Sayak Ray Chowdhury
May 10, 2026cs.LG

Near-Optimal Last-Iterate Convergence for Zero-Sum Games with Bandit Feedback and Opponent Actions

Last-iterate convergence of learning dynamics in games has attracted significant recent attention. In two-player zero-sum games with bandit feedback, where only the loss of the selected action pair is observed, Fiegel et al. (2025) show a separation between average-iterate and last-iterate convergence in duality gap: while the optimal t^(-1/2) rate after t rounds is achievable for the former via standard no-regret algorithms, the latter cannot converge faster than t^(-1/3) in expectation or t^(-1/4) with high probability. However, in many practical settings, such as preference learning, the players observe not only their loss but also the opponent's action. This raises a natural question: can such additional information enable faster last-iterate convergence? We answer this question affirmatively, showing that t^(-1/2) last-iterate convergence is achievable with high probability in this setting, via an efficient algorithm that updates its strategy infrequently by solving an estimated log-barrier-regularized game. We identify fundamental obstacles preventing standard analysis for multi-armed bandits, the single-player case, from generalizing to games, and develop a novel analysis to overcome them. Experiments confirm that our algorithm indeed converges faster than naive baselines and prior methods that do not exploit opponent-action feedback. Finally, we note that our results also improve those for dueling bandits, a special case with skew-symmetric game matrices.
Soumita Hait, Ping Li, Haipeng Luo +1