Reinforcement Learning

Also known as RL

Follow this topic Ask about this topic

Momentum

144 papers in the last four weeks, up 243% on the four weeks before. 1.4% of all new papers.

Jul 13Week of Sep 28

Latest papers 1,138

All topics

Beyond One-Size-Fits-All: Diagnosis-Driven Online Reinforcement Learning with Offline Priors
Jun 24, 2026Guozheng Ma, Lu Li, Zilin Wang +2Reinforcement Learning RL Post-Training
Nanyang Technical University · Mila - Quebec AI Institute · Université de Montréal +1
The Generalization Spectrum: A Chromatographic Approach to Evaluating Learning Algorithms
Jun 24, 2026Jinghan Zhang, Zerui Cheng, Shiqi Chen +5Neural Network Generalization Reinforcement Learning
1ByteDance Seed · 2Hong Kong University of Science and Technology · 3Princeton University +1
FactorLibrary: From Polynomials to Circuits via Recursive Subgoals
Jun 24, 2026Rohan Pandey, Michael Ruofan Zeng, Weikun K. Zhang +5Circuit Discovery Reinforcement Learning
University of Washington, Seattle, WA, USA.
Compositional Behavioral Semantics for State Abstraction in Reinforcement Learning
Jun 24, 2026Yivan Zhang, Ziyan Luo, Manuel BaltieriReinforcement Learning State Abstraction
The University of Tokyo · RIKEN AIP · Mila - Quebec Artificial Intelligence Institute +3
Minimax PAC Bounds for Learning in Exogenous Contextual MDPs
Jun 23, 2026Corentin Pla, Hugo Richard, Marc Abeille +1Markov Decision Processes Reinforcement Learning
CREST, ENSAE · Criteo AI Lab · FairPlay Joint Team +1
Bias-Controlled Primal-Dual Natural Actor-Critic: Optimal Rates for Constrained Multi-Objective Average-Reward RL
Jun 23, 2026Ankur Naskar, Swetha Ganesh, Vaneet AggarwalMulti-Objective Reinforcement Learning Reinforcement Learning
Indian Institute of Science, Bengaluru, India · Purdue University, USA
Accelerating Disaggregated RL for Visual Generative LLMs with Diffusion-Based Parallelism and Trainer-Assisted Generation
Jun 23, 2026Sijie Wang, Zhengyu Qing, Zhiqiang Tan +6Reinforcement Learning Distributed RL
School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen · Data Science and Analytics Thrust, The Hong Kong University of Science and Technology (Guangzhou) · Huawei Technologies Ltd.
Towards Scalable Multi-Task Reinforcement Learning with Large Decision Models
Jun 23, 2026Thibaut KulakReinforcement Learning Transformer
NeoInstinct SA
Supervised Reinforcement Learning for the Coordination of Distributed Energy Resources
Jun 23, 2026Haoyuan Deng, Yihong Zhou, Thomas Morstyn +1Reinforcement Learning RL Fine-Tuning
The University of Hong Kong, Hong Kong SAR, China · University of Oxford, Oxford, U.K. · The University of Hong Kong Shenzhen Institute of Research and Innovation, Shenzhen, China
An Introduction to Causal Reinforcement Learning
Jun 23, 2026Elias Bareinboim, Junzhe Zhang, Sanghack LeeReinforcement Learning Causal Inference
Department of Computer Science Columbia University New York, USA · Graduate School of Data Science Seoul National University Seoul, Republic of Korea
SPIRAL: Learning to Search and Aggregate
Jun 22, 2026Jubayer Ibn Hamid, Ifdita Hasan Orney, Michael Y. Li +5Reinforcement Learning RL for Language Model Reasoning
Stanford University
Group-Graph Policy Optimization for Long-Horizon Agentic Reinforcement Learning
Jun 22, 2026Yunan Wang, Minghui Song, Zihan Zhang +6Agentic RL Reinforcement Learning
1Peking University · 2Microsoft Corporation
Evo-RAD: Navigating Rare Retinal Disease Diagnosis via Self-Evolving Agentic Retrieval
Jun 22, 2026Wangding Xia, Ye Du, Jiashi Lin +3Reinforcement Learning Rare Disease Diagnosis
Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China · School of Computer Science, Northwestern Polytechnical University, Xi’an, China · Centre for Innovation and Precision Eye Health, Yong Loo Lin School of Medicine, National University of Singapore, Singapore 119228, Singapore +3
GeoRouteNet: Geometry-Enhanced Non-Autoregressive Neural Solver for the Traveling Salesman Problem
Jun 22, 2026Xiang LiTraveling Salesperson Problem Graph Neural Networks
College of Computer Science, Yangtze University, Jingzhou, China
What are Key Factors for Updates in RL for LLM Reasoning?
Jun 21, 2026Peidong Wang, Demi Wang, Xufang Luo +5Reinforcement Learning RL for Language Model Reasoning
School of Computer Science and Engineering, Northeastern University, Shenyang 110819, China · *Work done during internship at Microsoft Research Asia. · 2Microsoft Research +1
Select-to-Act: Hierarchical Reinforcement Learning via Adaptive Language Guidance
Jun 21, 2026Hanping Zhang, Adam Koziak, Yuhong GuoReinforcement Learning Hierarchical RL
School of Computer Science, Carleton University, Ottawa, Canada · Canada CIFAR AI Chair, Amii, Canada
Learning at the Right Pace: Adaptive Data Scheduling Improves LLM Reinforcement Learning
Jun 21, 2026Zicheng Xu, Ruixuan Zhang, Yu-Neng Chuang +7Reinforcement Learning RL for Language Model Reasoning
Johns Hopkins University · Rice University · University of Haifa +2
Drowning in Routine: Signal Dilution in Multi-Turn Agent Training
Jun 20, 2026Yann Pernot, Vi RetaultReinforcement Learning Credit Assignment in RL
Mila - Québec AI Institute · Polytechnique Montréal
Deep RL for Fast Long-Horizon Operations Scheduling on NASA's Carruthers Geocorona Observatory Mission
Jun 20, 2026Alex Zhang, Jackson Craig, Lara WaldropReinforcement Learning Long-Horizon Planning
Department of Electrical and Computer Engineering, University of Illinois Urbana-Champaign, IL, USA
Reinforcement Learning-Based Traffic Signal Control for IoT-Enabled Intersections
Jun 20, 2026Yousef AlSaqabiReinforcement Learning Intelligent Transportation Systems
Department of Electrical Engineering, Kuwait University, Kuwait
IRumAI: Reinforcement Learning for Indian Rummy
Jun 20, 2026Vignesh MohanReinforcement Learning Game-Playing Agents
EURECOM Sophia Antipolis, France
Discretizing Reward Models
Jun 19, 2026Vijay Viswanathan, Shiqi Wang, Devamanyu Hazarika +4Reward Modeling Reinforcement Learning
1Carnegie Mellon University · 2Meta Superintelligence Labs
The Two-Hump Problem: Bridging the Difficulty Gap in Mathematical Reinforcement Learning
Jun 19, 2026Lucas Fagan, Michele Tarquini, Ali Shehper +6RL Benchmarks Reinforcement Learning
Department of Mathematics, California Institute of Technology, Pasadena, CA, USA · Institute of Mathematics, University of Zurich, Zurich, Switzerland · Zero Latency Labs +1
FAST: A Framework for Aligned Sampling and Training in Parallel Reinforcement Learning for Autonomous Driving
Jun 19, 2026Bonan Wang, Letian Tao, Bin Shuai +7Reinforcement Learning RL for Autonomous Driving
School of Vehicle and Mobility, Tsinghua University, Beijing 100084, China · Didi Voyager Labs, DiDi Autonomous Driving · School of Vehicle and Mobility and the College of AI, Tsinghua University, Beijing 100084, China
A Reward-Petri-Net Interpretation of Temporal Behavior Trees
Jun 19, 2026Till Schmeil, Günther Waxenegger-Wilfing, Sebastian SchirmerReinforcement Learning Reward Shaping
University of Würzburg, Germany · German Aerospace Center (DLR), Germany
Objective-Behavior Alignment: Diagnostics for MORL Policy Selection
Jun 19, 2026Antonio Mone, Zuzanna Osika, Florian Felten +4Multi-Objective Reinforcement Learning Reinforcement Learning
Delft University of Technology, the Netherlands · ETH Zurich, Switzerland & herve.review, Belgium · ETH Zurich, Switzerland
NASDAQ: Normalized Observation Space Dynamics-Augmented Q-Learning
Jun 19, 2026Xinwei Liu, Junyuan Liang, Zicong Hong +2Reinforcement Learning Q-Learning
Sun Yat-sen University, China · EPFL, Switzerland · Purdue University, USA
Reward-free Pretraining for Reinforcement Learning via Occupancy Coverage Maximization
Jun 19, 2026Marco Pratticò, Pietro Novelli, Massimiliano Pontil +1Reinforcement Learning Exploration-Exploitation Tradeoff
Computational Statistics and Machine Learning - Istituto Italiano di Tecnologia, 16100 Genova, Italy · 2AI Centre, Computer Science Department, University College London, London, UK.
Inverting the Bellman Equation: From $Q$ -Values to World Models
Jun 19, 2026Alistair Letcher, Mattie Fellows, Alexander D. Goldie +3Reinforcement Learning Model-Free RL
FLAIR, University of Oxford · Google DeepMind · Mila, University of Montreal
ReFPO: Reflow Regularization for Flow Matching Policy Gradients
Jun 19, 2026Ge Wang, Yibo Peng, Fan Feng +10Policy Gradient Reinforcement Learning
Ising AI · CUHK-Shenzhen · FNii-Shenzhen

Jun 24, 2026, cs.LGJ/K move · Enter open · S save

Beyond One-Size-Fits-All: Diagnosis-Driven Online Reinforcement Learning with Offline Priors

Guozheng Ma, Lu Li, Zilin Wang, Pierre-Luc Bacon+1

Nanyang Technical University · Mila - Quebec AI Institute · Université de Montréal+1

Reinforcement Learning RL Post-Training Offline-To-Online RL

Open paper AskPDF arXiv

Online reinforcement learning (RL) agents increasingly depend on knowledge acquired offline to achieve practical efficiency. Originally studied in offline-to-online RL, this paradigm now spans foundation model post-training and embodied intelligence, with prior types expanding from offline datasets and pre-trained policies to increasingly diverse knowledge sources such as multimodal foundation models and generative world models. Offline priors have become central to how deep RL is developed and deployed. However, this reliance introduces a challenge that the prevailing benchmark-driven paradigm cannot resolve: because prior validity varies across deployments and shifts during training, no single approach to managing it is universally optimal, and benchmark rankings offer limited guidance for real-world deployments. Rather than pursuing universal solutions, we argue that the field should shift to diagnosis-driven tension management, in which deployment-specific evidence guides how the learner relates to its priors throughout training, enabling both flexible and adaptive deployment. We support this position with a framework characterizing how priors reshape online optimization through three functional roles, controlled experiments demonstrating help-or-hurt reversals, cross-domain evidence from foundation model post-training to embodied intelligence, and engagement with five substantive counterarguments.

Momentum

Related topics

Latest papers 1,138