Self-Play

Follow this topic Ask about this topic

Recent momentum

-50%

6 papers in the last 28 days · 0.2% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-14

3 new papers

A weekly snapshot of new work published in Self-Play.

Period ending 2026-09-07

3 new papers

A weekly snapshot of new work published in Self-Play.

86 papers

Latest in Self-Play

Open your feed →

Constant Swap Regret in General-Sum Games via Optimistic Transition Matrices
Sep 15, 2026Tung MaiImperfect-Information Games Self-Play
The Surprising Effectiveness of Approximate Value Iteration in Self-Play
Sep 8, 2026Raphael Boige, Amine Boumaza, Bruno ScherrerSelf-Play Value Functions
SQL-Zero: Self-Evolving Text-to-SQL
Sep 7, 2026Daniel Machado Pedrozo, Julia Soares Dollis, Bryan Lincoln Marques de Oliveira +3Text-To-Sql Self-Play
Local Updates, Global Learning (LUGL): Playing Games with non-incremental Learners
Sep 3, 2026David Milec, Spyridon Samothrakis, Michael Fairbank +1Imperfect-Information Games Deep Q-Networks
What Emerges and What Breaks in Self-Play Driving
Aug 31, 2026Laur Sisask, Ardi Tampuu, Tambet MatiisenSelf-Play Autonomous Driving
Beyond Uncertainty: Multi-Solver Disagreement Rewards for Self-Evolving Reasoning Curricula
Aug 30, 2026Vinoth Selvendran, Zhanming ZhangCurriculum Self-Play
SPADE: Self-Play in Adaptive Synthetic Executable Environments
Aug 19, 2026Bo Liu, Simon Yu, Yiding Jiang +15Self-Play Llm-Driven Code Synthesis
Do LLMs Beat Nash? Testing Decentralized Coordination in Self-Play Multi-Agent Games
Aug 12, 2026Deborah Sinishaw, Qile Zhu, Edwin Meriaux +1Multi-Agent Coordination Multi-Agent Large Language Model Systems
Social Gym and SPaRTan: Benchmarking and Improving LLM Social Reasoning via Multi-Agent Game Tournaments
Aug 10, 2026Keyu He, Xuhui Zhou, Maarten SapSelf-Play Footsiesgym
Solver-Guided Reasoning for Mixed-Equilibrium Strategies
Aug 7, 2026Han Wang, Philippe Beardsell, Boning Li +4Equilibrium LLM Reasoning Methods
Is Inter-Seed Cross-Play Enough? Evaluating the Robustness of Zero-Shot Coordination Algorithms to Implementation Details
Aug 4, 2026Maksymilian Wolski, Nicholas Hoernle, Johannes Forkel +1Multi-Agent Coordination Multi-Agent Reinforcement Learning
SearchMaster: Grounded and Regulated Self-Play for Search Agents
Aug 3, 2026Wentao Tan, Qiong Cao, Jiaqi Wang +1Search Agents Agentic Pipeline
Does the Competitive Component of Adversarial Self-Play Improve Legal Reasoning? A Controlled Negative Result
Aug 3, 2026Miseog Shawn KimSelf-Play Decision-Aware Evaluation
Self-Play Meets Skill Evolution: Self-Evolving Search Agents that Pose, Solve, and Remember
Jul 31, 2026Zenghuang Fu, Zhaoyang Li, Qiuyuan Ai +6Skill Evolution Self-Evolving Agents
Pictura: Perspective-View Self-Play at Scale for Driving
Jul 28, 2026Yuan Yin, Elias Ramzi, Marc Lafon +8Waymo Open Motion Dataset Self-Play
GPT-Red: Automated Red Teaming via Self-Play at Scale
Jul 28, 2026Eric Wallace, Christopher A. Choquette-Choo, Nikhil Kandpal +15Red-Teaming Language Model Evasion Attacks
Training with (Swap) Regret Loss in a Single-Layer Self-Attention Model: A Case Study on the Probability Simplex
Jul 25, 2026Chanwoo Park, Asuman OzdaglarPlan Regret Regret
Skill Self-Play: Pushing the Frontier of LLM Capability with Co-Evolving Skills
Jul 24, 2026Siyuan Huang, Pengyu Cheng, Haotian Liu +10Skill Evolution Self-Evolution
Audio-Zero: Label-Free Self-Evolution for Fine-Grained Audio Reasoning
Jul 22, 2026Siqian Tong, Xuan Li, Chaozhuo Li +5Audio Reasoning Audio Generation and Processing
TerraZero: Procedural Driving Simulation for Zero-Demonstration Self-Play at Scale
Jul 14, 2026Zhouchonghao Wu, Akshay Rangesh, Weixin Li +4Autonomous Driving Simulation Waymo Open Motion Dataset
World Models as Adversaries: Multi-Agent Self-Play Fine-Tuning for Robust Motion Planning
Jul 12, 2026Tong Nie, Yuewen Mei, Junlin He +3Safe Motion Planning Autonomous Driving
AlphaZero in Sparsely Rewarded Games: Limits and Auxiliary Supervision
Jul 9, 2026Brent Kong, Tejas Ram, Tony Yue YuSelf-Play Monte Carlo Tree Search
A Gold-Standard Study of What Makes a Lightweight Game-Playing Agent Strong
Jul 7, 2026Nima Kelidari, Mohammadsaeed Haghi, Mahdi SalmaniImperfect-Information Games Self-Play
FootsiesGym: A Fighting Game Benchmark for Two-Player Zero-Sum Imperfect-Information Games
Jul 7, 2026Chase McDonald, Nathan Tsang, Wesley N. KerrImperfect-Information Games Footsiesgym
More Convincing, Not More Correct: Self-Play Reward Hacking of Reference-Free LLM Judges
Jul 7, 2026Chenyu ZhouLarge Language Model Judges Llm-As-A-Judge
Anchored Self-Play for Code Repair
Jul 3, 2026Caroline Choi, Zeyneb Kaya, Shirley Wu +3Self-Play Bug
Towards Learning Representations of Policies in Two-Player Zero-Sum Imperfect-Information Games
Jul 1, 2026Kevin Wang, Kevin Yang, Arjun Prakash +1Imperfect-Information Games Self-Play
Attractor States Emerge in Multi-Turn LLM Conversations
Jun 29, 2026Ting-Wen Ko, Jonas GeipingAttractors Self-Play
How Much Due Diligence Before You Bid? Learning in Intractable Takeover Auctions
Jun 28, 2026Zain NaboulsiFirst-Price Auctions Minimax
Triadic Werewolf: A Jester Role for Multi-Hop Theory of Mind in LLMs
Jun 26, 2026Avni MittalSelf-Play Game-Theoretic Framework
Parametric Open Source Games
Jun 25, 2026Aleksandar Todorov, Jesse ten Napel, Alexander MüllerNash Equilibria Self-Play
EMAgnet: Parameter-Space EMA Regularization for Policy Gradient Self-Play in Large Games
Jun 22, 2026Tristan Maidment, JB Lanier, Chase McDonald +5Self-Play Imperfect-Information Games
Superhuman AI for Generals.io Using Self-Play Reinforcement Learning
Jun 22, 2026Matej Straka, Viliam Lisý, Martin SchmidSelf-Play Simulation-Based Reinforcement Learning
GARIP: A Running-Average Moving Reference for Last-Iterate Self-Play in Two-Player Zero-Sum Games
Jun 21, 2026Can SavcıSelf-Play Optimization Convergence Analysis
Scaling Self-Play for End-to-End Driving
Jun 17, 2026Luke Rowe, Roger Girgis, Rodrigue de Schaetzen +6Autonomous Driving Simulation Autonomous Driving
TerraTransfer: Learning End-to-End Driving Policies Without Expert Demonstrations
Jun 16, 2026Zikang Xiong, Weixin Li, Zhouchonghao Wu +6Autonomous Driving Imitation Learning
Discovering Lattice Reduction Strategies via Self-Play
Jun 13, 2026Mohamed Malhou, Kristin Lauter, Ludovic PerretLattice Self-Play
Self-Driving Negotiator: An interactive, verifiable benchmark for social negotiation and theory of mind under hidden intent
Jun 13, 2026Ashutosh KumarNegotiation Dead Reckoning
Human-like autonomy emerges from self-play and a pinch of human data
Jun 11, 2026Daphne Cornelisse, Julian Hunt, Zixu Zhang +4Self-Play Naturalistic Driving Data
Teacher-Free Self-Training Amplifies but Does Not Compound: A Pass@ $K$ Crossover on a Free-Verifier DomainTeacher-Free Self-Training Amplifies but Does Not Compound: A Pass@K Crossover on a Free-Verifier Domain
Jun 5, 2026Igor Lima StrozziSelf-Teacher Self-Play
CoPark: Learning Reactive Parking via Self-Play
Jun 2, 2026Jiarong Wei, Yanxing Chen, Sinuo Song +3Autonomous Parking Collision Avoidance
Learn from Your Mistakes: Tree-like Self-Play for Secure Code LLMs
Jun 2, 2026Wenqi Chen, Ziyan Zhang, Bin Wang +3Large Language Model Safety Vulnerable Code
A Theoretical Framework for Self-Play Theorem Proving Algorithms
Jun 1, 2026Thomas Chen, Zhiyuan LiTheorem Self-Play
S-SPPO: Semantic-Calibrated Self-Play Preference Optimization
Jun 1, 2026Xiwen Chen, Wenhui Zhu, Jingjing Wang +13Self-Play Reinforcement Learning From Human Feedback
SCOPE: Self-Play via Co-Evolving Policies for Open-Ended Tasks
May 29, 2026Wai-Chung Kwan, Aryo Pradipta Gema, Joshua Ong Jun Leang +1Self-Play Instruction-Tuned Large Language Models
When and How Human Curation Backfires: Preference Alignment under Multi-Model Self-Consuming Loop
May 28, 2026Yang Zhang, Xiukun Wei, Xueru ZhangArtificial Intelligence Alignment Cross-Model Consistency
DUEL: Adversarial Self-Play for Multimodal Reasoning
May 24, 2026Lin Qiu, Hanqing Zeng, Yao Liu +3Visual Reasoning Self-Play
Self-Play Reinforcement Learning under Imperfect Information in Big 2
May 21, 2026Aalok PatwaSelf-Play Imperfect-Information Games
Superhuman Safe and Agile Racing through Multi-Agent Reinforcement Learning
May 21, 2026Ismail Geles, Leonard Bauersfeld, Markus Wulfmeier +1Multi-Agent Reinforcement Learning Multi-Robot Systems
Survive or Collapse: The Asymmetric Roles of Data Gating and Reward Grounding in Self-Play RL
May 21, 2026Sophia Xiao Pu, Zhaotian Weng, Chengzhi Liu +4Self-Play Collapse
GeoX: Mastering Geospatial Reasoning Through Self-Play and Verifiable Rewards
May 19, 2026Kyeongjin Ahn, Seungeon Lee, Krishna P. Gummadi +1Geoquery Verifiable Rewards
GAE Falls Short in Imperfect-Information Self-Play Reinforcement Learning
May 19, 2026Zhiyuan Fan, Gabriele FarinaProximal Policy Optimization Self-Play
Transitivity Meets Cyclicity: Explicit Preference Decomposition for Dynamic Large Language Model Alignment
May 17, 2026Yucong Huang, Xiucheng Li, Kaiqi Zhao +1Preference Alignment Reinforcement Learning From Human Feedback
PopuLoRA: Co-Evolving LLM Populations for Reasoning Self-Play
May 16, 2026Roger Creus Castanyer, Geoffrey Bradway, Lorenz Wolf +3Self-Play Reinforcement Learning Base-To-Thinking Gap
Data-Augmented Game Starts for Accelerating Self-Play Exploration in Imperfect Information Games
May 14, 2026JB Lanier, Nathan Monette, Pierre Baldi +1Imperfect-Information Games Exploration-Exploitation Dilemma
Offline Two-Player Zero-Sum Markov Games with KL Regularization
May 13, 2026Claire Chen, Yuheng Zhang, Xinyu Liu +3Mean Field Games Nash Equilibria
Seirênes: Adversarial Self-Play with Evolving Distractions for LLM Reasoning
May 12, 2026Chi Zhang, Haibo Qiu, Qiming Zhang +3LLM Reasoning Methods Recursive Reasoner
Beyond Self-Play and Scale: A Behavior Benchmark for Generalization in Autonomous Driving
May 11, 2026Aron Distelzweig, Faris Janjoš, Andreas Look +7Autonomous Driving Self-Play
G-Zero: Self-Play for Open-Ended Generation from Zero Data
May 11, 2026Chengsong Huang, Haolin Liu, Tong Zheng +7Self-Evolution Self-Play
Team-Based Self-Play With Dual Adaptive Weighting for Fine-Tuning LLMs
May 11, 2026Wu Li, Yigeng Zhou, Zesheng Shi +3Self-Play Large Language Model Alignment

Sep 15, 2026 · cs.GTJ/K move · Enter open · S save

Constant Swap Regret in General-Sum Games via Optimistic Transition Matrices

Tung Mai

We give deterministic and uncoupled learning dynamics for finite multiplayer general-sum games under full-information feedback that achieve constant individual swap regret, independent of the horizon

T

. With

n

players and at most

m

actions each, the individual swap regret of every player is

O(\sqrt{n} m \log m \log^{5/2}(nm))

at every finite horizon. Each player predicts the deviation gains, then uses these predictions to update a row-stochastic transition matrix, and plays its stationary distribution. The proof combines a potential argument exploiting stationarity with a two-scale higher-order prediction analysis, using rooted-tree representations to handle the nonlinear dependence of deviation gains on the stationary distributions. An adversarially robust variant, obtained through a generic common-prefix switching wrapper, preserves the self-play bound up to a universal constant and guarantees individual swap regret at most

7\sqrt{m T \log m}

in the adversarial setting.

Imperfect-Information Games Self-Play Multi-Agent Reinforcement Learning

Open paper Ask about it PDF