cs.LGSep 3, 2026

Robust PAC Learning of Concurrent Stochastic Games

Authors: Angel Y. He, David Parker

Organizations: Department of Engineering Science · University of Oxford · Department of Computer Science

Abstract

We introduce the first Probably Approximately Correct (PAC) learning framework for general-sum concurrent stochastic games (CSGs) with transition uncertainty, while addressing the challenge of Nash equilibrium (NE) existence. Our algorithm maintains data-driven L1L^1 confidence sets over transition kernels and solves a robust CSG to compute a social-welfare optimal ε\varepsilon-NE, using a robust MDP-based exploration mechanism to drive joint state-action coverage. Crucially, we introduce a Nash margin characterisation that enables principled reasoning about equilibrium existence: the framework either returns an ε\varepsilon-approximate NE whose social-welfare value is ε\varepsilon-close to optimal, or provides a sound certificate that no exact NE exists. Under a minimum reachability condition preach>0p_{\mathrm{reach}}>0 over relevant state-action pairs, the algorithm terminates after a polynomial number of trajectory samples, with sample complexity O~(Rmax⁡2H4∣S∣2∣A∣/(preachε2))\widetilde{O}\left( {R_{\max}^2 H^4 |S|^2 |A| / (p_{\mathrm{reach}} \varepsilon^2)} \right). Empirical results on benchmark CSGs demonstrate near-optimal performance, correct handling of equilibrium (non-)existence, and sample complexity consistent with theory.

Explore similar work

CardsList
  1. Algorithms for Equilibria in Concurrent Stopping Games

    Jul 27, 2026Léonard Brice, Thomas A. Henzinger, K. S. ThejaswiniNash EquilibriumZero--Sum Differential Game