Self-Play RL

RL: Reinforcement Learning

Follow this topic Ask about this topic

Momentum

6 papers in the last four weeks, up 50% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 53

All topics

GeoX: Mastering Geospatial Reasoning Through Self-Play and Verifiable Rewards
May 19, 2026Kyeongjin Ahn, Seungeon Lee, Krishna P. Gummadi +1Self-Play RL Geospatial Reasoning
KAIST · MPI-SWS · MPI-SP
GAE Falls Short in Imperfect-Information Self-Play Reinforcement Learning
May 19, 2026Zhiyuan Fan, Gabriele FarinaReinforcement Learning Self-Play RL
MIT
Transitivity Meets Cyclicity: Explicit Preference Decomposition for Dynamic Large Language Model Alignment
May 17, 2026Yucong Huang, Xiucheng Li, Kaiqi Zhao +1Reward Modeling LLM Alignment
Harbin Institute of Technology, Shenzhen, China.
PopuLoRA: Co-Evolving LLM Populations for Reasoning Self-Play
May 16, 2026Roger Creus Castanyer, Geoffrey Bradway, Lorenz Wolf +3Self-Play RL RL for Language Model Reasoning
Vmax
Data-Augmented Game Starts for Accelerating Self-Play Exploration in Imperfect Information Games
May 14, 2026JB Lanier, Nathan Monette, Pierre Baldi +1RL Benchmarks Self-Play RL
University of California Irvine · University of Oxford
Offline Two-Player Zero-Sum Markov Games with KL Regularization
May 13, 2026Claire Chen, Yuheng Zhang, Xinyu Liu +3Nash Equilibrium Reinforcement Learning
1California Institute of Technology. · University of Illinois Urbana-Champaign. · University of Virginia. +2
Beyond Self-Play and Scale: A Behavior Benchmark for Generalization in Autonomous Driving
May 11, 2026Aron Distelzweig, Faris Janjoš, Andreas Look +7Autonomous Driving Benchmarks Self-Play RL
University of Freiburg · Bosch Center for Artificial Intelligence · Coburg University of Applied Sciences +1
G-Zero: Self-Play for Open-Ended Generation from Zero Data
May 11, 2026Chengsong Huang, Haolin Liu, Tong Zheng +7Open-Ended Generation Self-Play RL
Washington University in St. Louis · University of Virginia · University of Maryland +1
Team-Based Self-Play With Dual Adaptive Weighting for Fine-Tuning LLMs
May 11, 2026Wu Li, Yigeng Zhou, Zesheng Shi +3LLM Alignment Self-Play RL
Harbin Institute of Technology, Shenzhen, China · Beijing Academy of Artificial Intelligence, Beijing, China
Breaking the Impasse: Dual-Scale Evolutionary Policy Training for Social Language Agents
May 9, 2026Minzheng Wang, Run Luo, Yanbo Wang +6Reinforcement Learning Self-Play RL
MAIS, Institute of Automation, Chinese Academy of Sciences · School of Artificial Intelligence, University of Chinese Academy of Sciences · National University of Singapore +1
The Attacker in the Mirror: Breaking Self-Consistency in Safety via Anchored Bipolicy Self-Play
May 8, 2026Gabriele La Malfa, Emanuele La Malfa, Saar Cohen +4Self-Play RL Language Model Safety Evaluation
Department of Informatics, King’s College London · Department of Computer Science, University of Oxford · Institute for Decentralized AI +1
SPARK: Self-Play with Asymmetric Reward from Knowledge Graphs
May 7, 2026Hyobin Park, Taeseop Kim, Dong-Geol ChoiAI for Science Self-Play RL
ANTLAB, South Korea · Hanbat National University, South Korea
A Structural Threshold in Decision Capacity Governs Collapse in Self-Play Reinforcement Learning
May 4, 2026Arahan KujurGame-Playing Agents Self-Play RL
Independent Researcher
When Actions Disappear: Adversarial Action Removal in Self-Play Reinforcement Learning
May 4, 2026Arahan KujurSelf-Play RL Adversarial Robustness
Independent Researcher
ANCORA: Learning to Question via Manifold-Anchored Self-Play for Verifiable Reasoning
Apr 30, 2026Chengcao YangSelf-Play RL RL for Language Model Reasoning
Wuhan University Wuhan, China
Scaling Self-Play with Self-Guidance
Apr 22, 2026Luke Bailey, Kaiyue Wen, Kefan Dong +2Self-Play RL Automated Theorem Proving
Stanford University
Bootstrapping Post-training Signals for Open-ended Tasks via Rubric-based Self-play on Pre-training Text
Apr 21, 2026Chengyu Huang, Sheng-Yen Chou, Zhengxin Zhang +1Self-Play RL LLM Post-Training
Department of Computer Science, Cornell University
Stratagem: Learning Transferable Reasoning via Trajectory-Modulated Game Self-Play
Apr 20, 2026Xiachong Feng, Deyi Yin, Xiaocheng Feng +9Self-Play RL RL for Language Model Reasoning
The University of Hong Kong · Harbin Institute of Technology · Harbin Institute of Technology, Shenzhen
Improving LLM Code Reasoning via Semantic Equivalence Self-Play with Formal Verification
Apr 18, 2026Antonio Valerio Miceli Barone, Poon Tsz NokAdversarial Training Self-Play RL
School of Informatics, University of Edinburgh
Teaching Models to Teach Themselves: Reasoning at the Edge of Learnability
Jan 26, 2026Shobhita Sundaram, John Quan, Ariel Kwiatkowski +3Self-Play RL RL for Language Model Reasoning
1MIT · 2Meta FAIR · 3New York University
Scalable Decision Making for Games of Imperfect Information
Nov 10, 2025Samuel Sokota, Eugene Vinitsky, Hengyuan Hu +3Game-Playing Agents Inference-Time Search
Carnegie Mellon University · NYU Tandon School of Engineering · Stanford University +1
OpenSIR: Open-Ended Self-Improving Reasoner
Nov 1, 2025Wai-Chung Kwan, Joshua Ong Jun Leang, Pavlos Vougiouklis +3Self-Play RL RL for Language Model Reasoning
University of Edinburgh · Imperial College London · Huawei Technologies Research & Development (UK) Limited +1
Chasing Moving Targets with Online Self-Play Reinforcement Learning for Safer Language Models
Jun 9, 2025Mickel Liu, Liwei Jiang, Yancheng Liang +4Self-Play RL Adversarial Attacks on LLMs
Paul G. Allen School of Computer Science & Engineering, University of Washington, Seattle, WA, USA · Department of Computer Science, Stanford University, Stanford, CA, USA

May 19, 2026, cs.AIJ/K move · Enter open · S save

GeoX: Mastering Geospatial Reasoning Through Self-Play and Verifiable Rewards

Kyeongjin Ahn, Seungeon Lee, Krishna P. Gummadi, Meeyoung Cha

KAIST · MPI-SWS · MPI-SP

Self-Play RL Geospatial Reasoning VLM Reasoning Reinforcement Learning with Verifiable Rewards Visually Grounded Reasoning Spatial Reasoning

Open paper AskPDF arXiv

Geospatial reasoning requires solving image-grounded problems over the complex spatial structure of a scene. However, developing this capability is hindered by the cost of annotating a vast and combinatorial question space. We propose GeoX, a self-play framework that acquires spatial logic through executable programs that yield verifiable rewards, without relying on large-scale human-curated data Given a satellite or aerial image, our framework employs a single multimodal policy that proposes spatial problems as executable programs and solves them under three reasoning modes-abduction, deduction, and induction-over spatial primitives and an image understanding tool. A verifier executes each program to covert a reward signal that jointly optimizes the two roles via reinforcement learning. GeoX consistently improves its base VLMs by up to 5.5 points on average, matching or exceeding conventional baselines trained on millions of curated data. Along-side the proposed method, we release a benchmark for geospatial understanding accumulated through self-play.

Momentum

Related topics

Latest papers 53