RL Benchmarks

RL: Reinforcement Learning

Follow this topic Ask about this topic

Momentum

10 papers in the last four weeks, up 233% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 62

All topics

Physical Atari: A Robust and Accessible Platform for Real-time Reinforcement Learning on Robots
May 29, 2026Khurram Javed, Joseph Modayil, Gloria Kennickell +2RL Benchmarks Reinforcement Learning
Keen Technologies · Openmind Research Institute · University of Alberta, Canada
When Does Deep RL Beat Calibrated Baselines? A Benchmark Study on Adaptive Resource Control
May 26, 2026Guilin Zhang, Chuanyi Sun, Kai Zhao +3RL Control RL Benchmarks
The George Washington University, Washington, DC, USA
Benchmarking the Limits of In-Context Reinforcement Learning for Ad-Hoc Teamwork
May 23, 2026Yuheng Jing, Kai Li, Ziwen Zhang +8RL Benchmarks Multi-Agent Coordination
C2DL, Institute of Automation, Chinese Academy of Sciences · School of Artificial Intelligence, University of Chinese Academy of Sciences · University of Science and Technology of China +5
Mahjax: A GPU-Accelerated Mahjong Simulator for Reinforcement Learning in JAX
May 20, 2026Soichiro Nishimori, Shinri Okano, Keigo Habara +3RL Benchmarks Game-Playing Agents
The University of Tokyo, Tokyo, Japan. · Nara Institute of Science and Technology, Nara, Japan. · Independent Researcher. +5
JAXenstein: Accelerated Benchmarking for First-Person Environments
May 19, 2026Ruo Yu Tao, George KonidarisRL Benchmarks Partially Observable RL
Department of Computer Science, Brown University, USA
Offline Reinforcement Learning for Plasma Control in Nuclear Fusion: Codebase and Benchmark
May 19, 2026Yang Fu, Haomin Bao, Rohit Sonker +4RL Benchmarks Offline RL
Central South University · Chongqing University · Carnegie Mellon University +1
ARC-RL: A Reinforcement Learning Playground Inspired by ARC Raiders
May 19, 2026Carlo Romeo, Andrew D. BagdanovRL Benchmarks Robotics Simulation
Media Integration and Communication Center – University of Florence
Data-Augmented Game Starts for Accelerating Self-Play Exploration in Imperfect Information Games
May 14, 2026JB Lanier, Nathan Monette, Pierre Baldi +1RL Benchmarks Self-Play RL
University of California Irvine · University of Oxford
Towards Affordable Energy: A Gymnasium Environment for Electric Utility Demand-Response Programs
May 12, 2026Jose E. Aguilar Escamilla, Lingdong Zhou, Xiangqi Zhu +1RL Benchmarks Reinforcement Learning
Department of Electrical Engineering and Computer Science, Oregon State University, USA
Block-R1: Rethinking the Role of Block Size in Multi-domain Reinforcement Learning for Diffusion Large Language Models
May 12, 2026Yan Jiang, Ruihong Qiu, Zi HuangRL Benchmarks Reinforcement Learning
The University of Queensland
gym-invmgmt: An Open Benchmarking Framework for Inventory Management Methods
May 12, 2026Reza Barati, Qinmin Vivian HuInventory Control RL Benchmarks
Department of Computer Science Toronto Metropolitan University, Toronto, ON, Canada
Higher Resolution, Better Generalization: Unlocking Visual Scaling in Deep Reinforcement Learning
May 11, 2026Raphael Trumpp, Ömer Veysel Çağatan, Barış Akgün +1RL Benchmarks Robot Policy Generalization
TUM School of Engineering and Design · Technical University of Munich · KUIS AI Center +2
When (and How) to Trust the Expert: Diagnosing Query-Time Expert-Guided Reinforcement Learning
May 9, 2026Yann Berthelot, Philippe Preux, Riad AkrourRL Control RL Benchmarks
UMR 9189 – CRIStAL · CNRS, Inria, Centrale Lille · Saint-Gobain Research Paris +3
Forge: Quality-Aware Reinforcement Learning for NP-Hard Optimization in LLMs
May 9, 2026Xiaozhe Li, Xinyu Fang, Shengyuan Ding +5RL Benchmarks Reinforcement Learning
Tongji University1 · Shanghai AI Lab2 · Zhejiang University3 +3
Causal Reinforcement Learning for Complex Card Games: A Magic The Gathering Benchmark
May 7, 2026Cristiano da Costa Cunha, Ajmal Mian, Tim French +1RL Benchmarks Structural Causal Models
Department of Computer Science and Software Engineering, University of Western Australia, 6009 WA Australia
Coopetition-Gym v1: A Formally Grounded Platform for Mixed-Motive Multi-Agent Reinforcement Learning under Strategic Coopetition
May 3, 2026Vik Pant, Eric YuRL Benchmarks Game Theory
Faculty of Information University of Toronto · Faculty of Information and Department of Computer Science University of Toronto
Forager: a lightweight testbed for continual learning with partial observability in RL
May 1, 2026Steven Tang, Xinze Xiong, Anna Hakhverdyan +7RL Benchmarks Loss of Plasticity
Department of Computing Science, University of Alberta, Canada · Alberta Machine Intelligence Institute (Amii) · CIFAR AI Chair
Multi-action Tangled Program Graphs for Multi-task Reinforcement Learning with Continuous Control
Apr 28, 2026Quentin Vacher, Nicolas Beuve, Mickaël Dardaillon +1RL Benchmarks Genetic Programming
IETR · Univ Rennes, INSA Rennes, CNRS, IETR – UMR 6164, F-35000 Rennes, France
SpecRLBench: A Benchmark for Generalization in Specification-Guided Reinforcement Learning
Apr 27, 2026Zijian Guo, İlker Işık, H. M. Sabbir Ahmad +1RL Benchmarks Reinforcement Learning
Boston University
NASimJax: A GPU-Accelerated Policy Learning Framework for Penetration Testing
Mar 20, 2026Raphael Simon, José Carrasquel, Elli Makdis Antoun +2RL Benchmarks Partially Observable RL
CISS Department, Royal Military Academy, Belgium · AI Lab, Vrije Universiteit Brussel, Belgium
Two-Bridge: Exclusive Objectives and Extended Horizon StarCraft II Benchmark
Feb 19, 2026Sourav Panda, Tanmay Ambadkar, Shreyash Kale +2RL Benchmarks Game-Playing Agents
Pennsylvania State University, PA, USA.
Multi-Agent Reinforcement Learning for V2X Resource Allocation: Disentangling MARL Challenges Through Benchmarking
Feb 18, 2026Siyuan Wang, Lei Lei, Pranav Maheshwari +2RL Benchmarks Reinforcement Learning
College of Engineering, University of Guelph, Guelph, Ontario, Canada · College of Electrical Engineering and Computer Sciences, Ningbo University, Ningbo, 315211, China
Beyond Success Rates: Trainability and Extractability for Offline GCRL
Feb 5, 2026Jan Malte Töpperwien, Aditya Mohan, Marius LindauerRL Benchmarks Offline RL
Institute of Artificial Intelligence (LUH|AI), Leibniz University Hannover · L3S Research Center
GraphAllocBench: A Flexible Benchmark for Preference-Conditioned Multi-Objective Policy Learning
Jan 28, 2026Zhiheng Jiang, Yunzhe Wang, Ryan Marr +3Multi-Objective Reinforcement Learning RL Benchmarks
University of California, Los Angeles · USC Institute for Creative Technologies · U.S. Army DEVCOM Army Research Laboratory
KAGE-Bench: Fast Known-Axis Visual Generalization Evaluation for Reinforcement Learning
Jan 20, 2026Egor Cherepanov, Daniil Zelezetsky, Alexey K. Kovalev +1RL Benchmarks Reinforcement Learning
1AXXX, Moscow, Russia · 2MIRAI, Moscow, Russia
The HydroGym Reinforcement Learning Platform for Fluid Dynamics
Dec 19, 2025Christian Lagemann, Sajeda Mokbel, Miro Gondrum +18RL Control RL Benchmarks
Department of Mechanical Engineering, University of Washington, Seattle, WA 98195, United States · AI Institute in Dynamic Systems, University of Washington, Seattle, WA 98195, United States · Chair of Fluid Mechanics and Institute of Aerodynamics, RWTH Aachen University, Aachen, Germany +9
Octax: Accelerated CHIP-8 Arcade Environments for Reinforcement Learning in JAX
Oct 2, 2025Waris Radji, Thomas Michel, Hector PiteauRL Benchmarks Reinforcement Learning
Univ. Lille, Inria, CNRS, Centrale Lille, UMR 9189-CRIStAL, France · Independent Researcher
HARL-A: An Extensible Benchmark Framework for Heterogeneous Multi-Agent Adversarial Reinforcement Learning in IsaacLab
Sep 26, 2025Isaac Peterson, Christopher Allred, Jacob Morrey +1RL Benchmarks Robotic RL
Utah State University · US DEVCOM Army Research Laboratory
PuzzleJAX: A Benchmark for Reasoning and Learning
Aug 22, 2025Sam Earle, Graham Todd, Yuchen Li +5RL Benchmarks Game-Playing Agents
New York University · University of Malta · University of the Witwatersrand +1
SafeOR-Gym: A Benchmark Suite for Safe Reinforcement Learning Algorithms on Practical Operations Research Problems
Jun 2, 2025Asha Ramanujam, Adam Elyoumi, Hao Chen +5RL Benchmarks Constrained RL
Davidson School of Chemical Engineering, Purdue University, West Lafayette, IN · Energy Sciences, ExxonMobil Technology and Engineering Company, Annandale, NJ · Energy Sciences, ExxonMobil Technology and Engineering Company, Annadale, NJ

May 29, 2026, cs.ROJ/K move · Enter open · S save

Physical Atari: A Robust and Accessible Platform for Real-time Reinforcement Learning on Robots

Khurram Javed, Joseph Modayil, Gloria Kennickell, Richard S. Sutton+1

Keen Technologies · Openmind Research Institute · University of Alberta, Canada

RL Benchmarks Reinforcement Learning Robotic RL Robust RL

Open paper AskPDF arXiv

We built a robot called the Robotroller that actuates an Atari CX40+ controller and a device called the Atari Devbox that renders the game frame and the reward signal from the Arcade Learning Environment on a screen. The Robotroller and the Atari Devbox, together with an off-the-shelf camera and a desktop computer, constitute a system that can be used to study reinforcement learning algorithms in the physical world. We call the full system Physical Atari. In this paper, we detail the key decisions that make Physical Atari a robust and accessible platform. To make the system robust, we designed the Robotroller so that all movement is done through bearings, which reduces wear. Additionally, we wrote software that monitors the state of the servos at a high frequency and intervenes to limit stress. To make the system accessible, we used affordable off-the-shelf components and parts that can be manufactured using consumer 3D printers. Physical Atari can be built for under $1,000 and has been used for weeks of non-stop reinforcement learning experiments without any mechanical failures. We used it to validate that reinforcement learning algorithms can learn directly on robots and show that even small distribution shifts between learning and deployment can significantly degrade the performance of policies. Our results underscore the importance of on-device adaptation for strong performance on robots.

Momentum

Related topics

Latest papers 62