Reinforcement Learning

Also known as RL

Follow this topic Ask about this topic

Momentum

144 papers in the last four weeks, up 243% on the four weeks before. 1.4% of all new papers.

Jul 13Week of Sep 28

Latest papers 1,138

All topics

The World Model Remembers, the Actor Forgets: Dream Rehearsal for Continual Model-Based RL
Jul 22, 2026Gurp NijjerGenerative Replay Reinforcement Learning
Quantegra Research, Canada
SLPO: Scaling Latent Reasoning via a Surrogate Policy
Jul 22, 2026Runyang You, Zhiyuan Liu, Yongqi Li +1Reinforcement Learning RL for Language Model Reasoning
The Hong Kong Polytechnic University · Sichuan University · Work done as an intern at PolyU.
Off-Context GRPO: Learning to Reason on Hard Problems using Privileged Information
Jul 21, 2026Priyank Agrawal, Ankur Samanta, Shervin Ghasemlou +4Reinforcement Learning RL for Language Model Reasoning
1Meta AI · 2Columbia University · *Work done at Meta
A Reinforcement-Learning-Augmented Liquid-Fueled Reactor Network Model for Predicting Lean Blowout in Gas Turbine Combustors
Jul 21, 2026Philip John, Eloghosa Ikponmwoba, Pinaki Pal +1Reinforcement Learning Reduced-Order Modeling
Department of Mechanical and Industrial Engineering Louisiana State University, Baton Rouge, LA 70803, USA · 2Transportation and Power Systems Division Argonne National Laboratory, 9700 S. Cass Ave, Lemont, IL 60439, USA
Conservative Query and Adaptive Regularization for Offline RL Under Uncertainty Estimation
Jul 21, 2026Li-Rong Zhou, Qin-Wen Luo, Sheng-Jun HuangReinforcement Learning Offline RL
Nanjing University of Aeronautics and Astronautics, Nanjing, China
Comparative Study of Multi-Agent Actor-Critic Algorithms in Parameterized Action Reinforcement Learning
Jul 21, 2026Ubayd Ali Bapoo, Clement N NyirendaReinforcement Learning Soft Actor-Critic
Department of Computer Science University of the Western Cape Cape Town, South Africa
Reinforcement Learning for Delivery Drone-Based Participatory Sensing in Dynamic Environments
Jul 21, 2026Xin Ouyang, Songxin Lei, Xusen Guo +3RL Control Reinforcement Learning
The Hong Kong University of Science and Technology (Guangzhou) Guangzhou, China · Beijing Institute of Technology Beijing, China
From Trajectories to Instructions: Language-Conditioned Meta-Reinforcement Learning
Jul 21, 2026Garvit Singla, Uma Maheswari Natarajan, Raghuram Bharadwaj DiddigiReinforcement Learning Meta-Learning
International Institute of Information Technology Bangalore, India
Exposure-Based Reinforcement Learning to Rank
Jul 21, 2026Harrie Oosterhuis, Rolf Jagerman, Zhen Qin +1Reinforcement Learning Learning to Rank
University of Amsterdam · Google DeepMind
Planning as Emergent Behavior in Reinforcement Learning with Relational Hidden States
Jul 20, 2026Armin SommerReinforcement Learning Model-Free RL
ETH Zurich, Switzerland
The Open Ant: A Robot Platform for Reinforcement Learning Research
Jul 20, 2026Elena Sorina Lupu, Patrick Spieler, Khurram Javed +4Reinforcement Learning Robotics Simulation
Openmind Research Institute, Canada · Keen Technologies · Department of Computing Science, University of Alberta, Canada
RRPO: Reference-Relative Policy Optimization with Stratified Conditional Rollouts
Jul 20, 2026Yuxin Xiong, Xunyi Jiang, Rohan Surana +8Reinforcement Learning RL for Language Model Reasoning
University of California San Diego · 2Adobe Research
Neuro-Symbolic Meta-Policies for Temporal Knowledge-Graph Memory under Partial Observability
Jul 20, 2026Taewoon Kim, Vincent François-Lavet, Michael CochezReinforcement Learning Partially Observable RL
HumemAI, The Netherlands · Vrije Universiteit Amsterdam, The Netherlands · ELLIS Institute Finland & Abo Akademi University, Finland
Towards Torque-Driven Reinforcement Learning for Quadruped Locomotion
Jul 20, 2026Jordan Dowdy, Jean Chagas VazReinforcement Learning Terrain-Aware Robot Locomotion
Department of Electrical and Computer Engineering at the University of Louisville. · Faculty of Electrical and Computer Engineering, University of Louisville, Louisville, KY, 40208, USA.
LLM-as-a-Coach: Experiential Learning for Non-Verifiable Tasks
Jul 20, 2026Tianzhu Ye, Li Dong, Guanheng Chen +4Reinforcement Learning Rubric-Based RL
Microsoft Research · Tsinghua University · Peking University
PRIME: Plasticity Recovery in Multi-Agent Environments for UAV-Assisted Emergency Communication Networks
Jul 20, 2026Wen Qiu, Zhiqiang He, Wei Zhao +1Non-Stationary RL Reinforcement Learning
Department of Information and Communication Engineering, Kitami Institute of Technology, Japan · Graduate School of Informatics and Engineering, University of Electro-Communications, Japan · School of Computer Science and Technology, Anhui University of Technology, China
Theoretical Foundations of $\max$ @ $k$ Reinforcement Learning
Jul 20, 2026Riccardo Poiani, Martino Bernasconi, Andrea CelliReinforcement Learning Policy Learning
Bocconi University
Generalize and Guide: Decomposing Rewards for Few-Shot Inverse Reinforcement Learning
Jul 20, 2026Ziyi Liu, Grace ZhangReinforcement Learning Learning from Demonstration
University of Southern California
Reinforcement Learning: From Algorithms To Foundation Models
Jul 20, 2026Zihan DingReinforcement Learning RL for Video Generation
Department of Electrical Computer Engineering, Princeton University
TraversRL: Traversable Pedestrian Pathway Generation With Reinforcement Learning
Jul 20, 2026Bin Han, Robert Wolfe, Bill HoweRemote Sensing Image Understanding Reinforcement Learning
University of Washington · Rutgers University
TimeLens2: Generalist Video Temporal Grounding with Multimodal LLMs
Jul 19, 2026Yuhan Zhu, Changlian Ma, Xiangyu Zeng +12Temporal Video Grounding Reinforcement Learning
Nanjing University · Shanghai AI Laboratory · Shanghai Jiao Tong University +3
Rethinking the Suitability of Reinforcement Learning Algorithms Under Practical Transfer Constraints
Jul 19, 2026Hany Hamed, Abhishek Naik, Colin Bellinger +1Domain Randomization Reinforcement Learning
University of Alberta · 3Alberta Machine Intelligence Institute (Amii) · 7Generative Bionics +4
WAR: Workload-Aware Rollouts for Synchronous Agentic Reinforcement Learning
Jul 19, 2026Ryan Xu, Atlas Zhao, David Bao +1Agentic RL Reinforcement Learning
Scalable Causal Imitation Learning
Jul 18, 2026Eylam Tagor, Mingxuan Li, Elias BareinboimReinforcement Learning Imitation Learning
Department of Computer Science, Columbia University
Enhancing Personalized Bladder Cancer Treatment Through Reinforcement Learning: A Recurrent Patient State Transition Decision Support Framework
Jul 18, 2026Divyansh Chawla, Anshu Garg, Isshaan SinghReinforcement Learning Healthcare
School of Computer Science and Engineering, Vellore Institute of Technology, Chennai-600 0127, Tamil Nadu, INDIA
Principled Direction-Free Intrinsic Motivation through Model-Free Epistemic Free-Energy Estimators
Jul 18, 2026Alireza Furutanpey, Schahram DustdarFree Energy Calculation Intrinsic Reward Methods
Coovally, Barcelona, Spain · Distributed Systems Group, TU Vienna, Austria · ICREA Barcelona, Spain
From Optimal Policies to Individual Differences: Rethinking Reinforcement Learning for Biology
Jul 17, 2026Patrick Govoni, Palina Bartashevich, Clémence Bergerot +3Reinforcement Learning
Institute for Theoretical Biology, Humboldt Universität zu Berlin, Berlin, Germany · Faculty of Life Sciences, Thaer-Institute for Agricultural and Horticultural Sciences, Humboldt Universität zu Berlin, Berlin, Germany · Science of Intelligence, Cluster of Excellence, Berlin, Germany +1
Building2Building: A Large Scale Benchmark for Generalizable Real-World Reinforcement Learning
Jul 17, 2026Vincent Taboga, Justin Veilleux, Doseok Jang +2RL Benchmarks Reinforcement Learning
1Mila - Quebec AI Institute · 2Université de Montréal - Département d’Informatique et de Recherche Opérationnelle
Differentiable Reinforcement Learning for Path Tracking by an Agile Fish-Like Robot
Jul 17, 2026Prashanth Chivkula, Kartik Loya, Venkata Ravindhra Reddy Varikuti +1Robotic Control RL Control
Department of Mechanical Engineering, Clemson University, USA
Physics-enhanced reinforcement learning for real-time optimal control of dynamical systems
Jul 17, 2026Matteo Tomasetto, Nicolò Botteghi, Gabriele Bruni +1RL Control Reinforcement Learning
Department of Mechanical Engineering, Politecnico di Milano, Milano, Italy · MOX - Department of Mathematics, Politecnico di Milano, Milano, Italy

Jul 22, 2026, cs.LGJ/K move · Enter open · S save

The World Model Remembers, the Actor Forgets: Dream Rehearsal for Continual Model-Based RL

Gurp Nijjer

Quantegra Research, Canada

Generative Replay Reinforcement Learning Replay-Based Continual Learning Continual RL Model-Based RL Catastrophic Forgetting

Open paper AskPDF arXiv

Model-based reinforcement-learning agents of the DreamerV3 family forget catastrophically when trained on task sequences, even when an unbounded replay buffer preserves every earlier experience. We ask a question the continual-RL literature has assumed an answer to but never measured: which component forgets? Under never-clear replay, pre-registered component-level probes (n=3 seeds throughout) show that the world model retains essentially everything measurable about old tasks -- reward discrimination (retention ratio ~1.0), value estimates, and termination structure -- while the actor's behavior collapses. Forgetting in this regime is a channel problem, not a memory problem. We demonstrate this by intervention: with the world model frozen and identical imagined rollouts, reinforcement learning in imagination fails to recover a lost skill (0/3 seeds), while supervised self-imitation on the world model's own graded dreams recovers it on 3/3 seeds with zero environment interaction. Interleaved during training, this graded dream rehearsal yields a task-label-free, parameter-constant continual learner: 3/3 four-task chains retained where plain replay passes 0/3, 3/3 eight-task chains, and consistent gains over matched real-episode cloning (paired difference +0.13, bootstrap 95% CI [0.07, 0.24], complete seed separation). The dream-grading step is load-bearing: we characterize two scoring failure modes, provide an offline selection gauge that caught both before they contaminated results, and give a realized-first grading rule that closes them. All experiments were pre-registered with committed protocols; every refuted hypothesis is reported.

Momentum

Related topics

Latest papers 1,138