cs.LGSep 28, 2026

Polylogarithmic Nash Regret in Matrix Games with Bandit Feedback

Authors: Yuheng Zhang

Organizations: University of Illinois Urbana-Champaign

Abstract

We study Nash regret minimization in unknown finite matrix games with bandit payoff feedback and observed opponent actions. We develop Optimistic Payoff Balancing (OPB), which achieves instance-dependent O(log⁡2T)\mathcal{O}(\log^2 T) Nash regret against arbitrary adaptive opponents, including games with nonunique equilibria. This resolves the open problem posed by Maiti et al. (2025), extending their polylogarithmic guarantee under bandit feedback from 2×22\times2 games to arbitrary finite dimensions. To handle nonunique equilibria, we construct a reference strategy that leaves room for local adjustments. We order independent payoff differences by estimation accuracy and scale these adjustments by uncertainty, allowing the learner to exploit the opponent's imbalance to offset estimation costs. Our result thus shows that observing opponent actions suffices for polylogarithmic Nash regret in general finite matrix games.

Figures & tables

Explore similar work

CardsList
  1. Optimal last-iterate convergence in matrix games with bandit feedback using the log-barrier

    Apr 16, 2026Come Fiegel, Pierre Menard, Tadashi Kozuno +2Imperfect-Information GamesMinimax

  2. Near-Optimal Last-Iterate Convergence for Zero-Sum Games with Bandit Feedback and Opponent Actions

    May 10, 2026Soumita Hait, Ping Li, Haipeng Luo +1Imperfect-Information GamesBandits