Offline RL

RL: Reinforcement Learning

Follow this topic Ask about this topic

Momentum

29 papers in the last four weeks, up 222% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 189

All topics

Cross-Domain Energy-Guided Diffusion Generation for Off-Dynamics Reinforcement Learning
May 24, 2026Yu Yang, Yihong Guo, Anqi Liu +1Diffusion Model Guidance Reinforcement Learning
Duke University · Johns Hopkins University
Bilevel Optimization of Synthetic Trajectories for Multi-Turn LLM Fine-Tuning
May 23, 2026Shresth Verma, Mauricio Tec, Cheol Woo Kim +2Synthetic Data Augmentation Offline RL
Harvard University Cambridge, MA · Georgia Institute of Technology Atlanta, GA
Generative OOD-regularized Model-based Policy Optimization
May 23, 2026Aysin Tumay, Jiahe Huang, Elise Jortberg +1Offline RL OOD Detection
University of California, San Diego · Abiomed
Abstraction for Offline Goal-Conditioned Reinforcement Learning
May 21, 2026Clarisse Wibault, Alexander Goldie, Antonio Villares +2Hierarchical RL State Abstraction
FLAIR, MLRG · University of Oxford · FLAIR +1
Target-Aligned Bellman Backup for Cross-domain Offline Reinforcement Learning
May 21, 2026Wei Liu, Ting LongOffline RL Cross-Domain Transfer Learning
School of Artificial Intelligence Jilin University China
Compositional Transduction with Latent Analogies for Offline Goal-Conditioned Reinforcement Learning
May 20, 2026Junseok Kim, Dohyeong Kim, Mineui Hong +1Reinforcement Learning Robotic RL
Department of Electrical and Computer Engineering and ASRI, Seoul National University · Independent researcher · Robotics Institute, Carnegie Mellon University
Offline Reinforcement Learning for Plasma Control in Nuclear Fusion: Codebase and Benchmark
May 19, 2026Yang Fu, Haomin Bao, Rohit Sonker +4RL Benchmarks Offline RL
Central South University · Chongqing University · Carnegie Mellon University +1
Precision Physical Activity Prescription via Reinforcement Learning for Functional Actions
May 19, 2026Gefei Lin, Rui Miao, Jennifer Sacheck +1Reinforcement Learning Offline RL
Department of Statistics, The George Washington University · Department of Mathematical Sciences, The University of Texas at Dallas · Department of Behavioral and Social Sciences, Brown University
COOPO: Cyclic Offline-Online Policy Optimization Algorithm
May 18, 2026Qisai Liu, Zhanhong Jiang, Joshua Russell Waite +3Offline RL Sample-Efficient RL
Department of Mechanical Engineering, Iowa State University, Ames, IA 50011, USA. · Department of Computer Science, Iowa State University, Ames, IA 50011, USA. · Translational AI Center, Iowa State University, Ames, IA 50011, USA.
ISEP: Implicit Support Expansion for Offline Reinforcement Learning via Stochastic Policy Optimization
May 18, 2026Yifei Chen, Shaoqin Zhu, Xiaoqiang JiPolicy Optimization Offline RL
The Chinese University of Hong Kong, Shenzhen
Offline Reinforcement Learning with Universal Horizon Models
May 15, 2026Hojun Chung, Junseo Lee, Songhwai OhOffline RL Model-Based RL
Interdisciplinary Program in Artificial Intelligence and ASRI, Seoul National University · Department of Electrical and Computer Engineering, Seoul National University
Peng's Q( $λ$ ) for Conservative Value Estimation in Offline Reinforcement Learning
May 14, 2026Byeongchan Kim, Min-hwan OhReinforcement Learning Value Function Estimation
Seoul National University
Q-Flow: Stable and Expressive Reinforcement Learning with Flow-Based Policy
May 13, 2026JaeHyeok Doo, Byeongguk Jeon, Seonghyeon Ye +2Reinforcement Learning Offline RL
1KAIST
Trajectory-Level Data Augmentation for Offline Reinforcement Learning
May 13, 2026Tobias Schmähling, Matthias Burkhardt, Tobias WindischData Augmentation Offline RL
University of Applied Sciences Kempten, Kempten, Germany.
Generative Support Realignment for Cross-Domain Offline Reinforcement Learning
May 13, 2026Minung Kim, Jeongmo Kim, Gwanwoo Choi +1Offline RL Cross-Domain Transfer Learning
Graduate School of Artificial Intelligence Ulsan National Institute of Science and Technology (UNIST)
Offline Two-Player Zero-Sum Markov Games with KL Regularization
May 13, 2026Claire Chen, Yuheng Zhang, Xinyu Liu +3Nash Equilibrium Reinforcement Learning
1California Institute of Technology. · University of Illinois Urbana-Champaign. · University of Virginia. +2
Model-based Bootstrap of Controlled Markov Chains
May 12, 2026Ziwei Su, Imon Banerjee, Diego KlabjanMarkov Decision Processes Off-Policy Evaluation
Department of Industrial Engineering and Management Sciences Northwestern University Evanston, IL 60208
Robust Probabilistic Shielding for Safe Offline Reinforcement Learning
May 11, 2026Maris F. L. Galesloot, Thomas Rhemrev, Nils JansenOffline RL Safe RL
Radboud University · Nijmegen, The Netherlands · Ruhr University & Radboud University +1
Learning to Compress Time-to-Control: A Reinforcement Learning Framework for Chronic Disease Management
May 10, 2026Prabhjot Singh, Abhishek Gupta, Chris Betz +4Reinforcement Learning Type 1 Diabetes
Altitude
ACSAC: Adaptive Chunk Size Actor-Critic with Causal Transformer Q-Network
May 10, 2026Qian Chen, Junqiao Zhao, Hongtu Zhou +4Reinforcement Learning Transformer-Based RL
Tongji University
MSPR: Multi-scale Predictive Representations for Goal-conditioned Reinforcement Learning
May 10, 2026Valliappan Chidambaram Adaikkappan, Sai Rajeswar, Pietro Mazzaglia +1Offline RL Predictive Representation Learning
Mila, McGill University · Qualcomm Research
Offline Policy Optimization with Posterior Sampling
May 8, 2026Hongqiang Lin, Dongxu Zhang, Yiding Sun +3OOD Generalization Posterior Sampling
Zhejiang University · Xi’an Jiaotong University · Institute of Automation, Chinese Academy of Sciences +1
Q-MMR: Off-Policy Evaluation via Recursive Reweighting and Moment Matching
May 7, 2026Xiang Li, Nan JiangOff-Policy Evaluation Value Function Estimation
Nanjing University · UIUC
Hitting Time Isomorphism for Multi-Stage Planning with Foundation Policies
May 7, 2026Magnus Victor Boock, Abdullah Akgül, Mustafa Mert Çelikok +1Sequential Decision Making Offline RL
Department of Mathematics and Computer Science University of Southern Denmark
Entropy-Regularized Adjoint Matching for Offline Reinforcement Learning
May 7, 2026Abdelghani Ghanem, Mounir GhoghoFlow Matching Offline RL
College of Computing Mohammed VI Polytechnic University Rabat 11103, Morocco
Beyond Autoregressive RTG: Conditioning via Injection Outside Sequential Modeling in Decision Transformer
May 7, 2026Yongyi Wang, Hanyu Liu, Lingfeng Li +6Efficient Transformer Inference Reinforcement Learning
School of Computer Science Peking University Beijing, China 100871
Offline Reinforcement Learning for Rotation Profile Control in Tokamaks
May 7, 2026Rohit Sonker, Hiro Josep Farre Kaga, Jiayu Chen +5RL Control Offline RL
1Robotics Institute, Carnegie Mellon University · 2Princeton University · 4The University of Hong Kong +2
Adaptive Q-Chunking for Offline-to-Online Reinforcement Learning
May 7, 2026Nandiraju Gireesh, Yuanliang Ju, He WangQ-Learning Offline RL
Peking University · Galbot · University of Toronto
Beyond Penalization: Diffusion-based Out-of-Distribution Detection and Selective Regularization in Offline Reinforcement Learning
May 6, 2026Qingjun Wang, Hongtu Zhou, Hang Yu +5Diffusion-Based OOD Detection Offline RL
School of Computer Science and Technology, Tongji University, Shanghai, China · MOE Key Lab of Embedded System and Service Computing, Tongji University, Shanghai, China · Shanghai Innovation Institute
Adaptive Estimation and Optimal Control in Offline Contextual MDPs without Stationarity
May 5, 2026Riddhiman Bhattacharyya, Sayak Chakrabarty, Imon BanerjeeNon-Stationary RL Markov Decision Processes
Department of Statistics, University of California, Santa Cruz Santa Cruz, California, USA · Department of Computer Science Northwestern University Evanston, IL, USA · Department of Industrial Engineering and Management Sciences Northwestern University Evanston, IL, USA

May 24, 2026, cs.LGJ/K move · Enter open · S save

Cross-Domain Energy-Guided Diffusion Generation for Off-Dynamics Reinforcement Learning

Yu Yang, Yihong Guo, Anqi Liu, Pan Xu

Duke University · Johns Hopkins University

Diffusion Model Guidance Reinforcement Learning Diffusion-Based Planning Offline RL

Open paper AskPDF arXiv

Off-dynamics offline reinforcement learning seeks to learn a target-domain policy from a large source dataset and a limited target dataset under mismatched transition dynamics. Existing approaches such as reward augmentation and data filtering are constrained to the source dataset and cannot synthesize new target behavior to improve coverage beyond the collected source trajectories. While recent model-based methods attempt to address this by learning target-aware dynamics, the generated experience is constructed only at the transition level, which leads to accumulated errors over long horizons. These limitations necessitate a shift toward trajectory-level generation for off-dynamics offline RL. We propose CEDGE, a Cross-domain Energy-guided Diffusion GEneration framework. CEDGE trains a trajectory diffusion model on source-domain trajectories and adapts the generated samples to the target domain through energy guidance. This guidance is derived by minimizing the distribution mismatch between the source and desired target-domain trajectories and is decomposed into return, domain, and behavior energy components. The resulting energy-guided trajectories are useful both for direct planning and as synthetic data for policy learning. Since target adaptation is achieved via energy guidance rather than retraining the diffusion model, CEDGE can be efficiently adapted to new target dynamics compared to previous methods. Experiments on the ODRL benchmark demonstrate that trajectory-level energy-guided generation improves diffusion planning under dynamics shifts and produces synthetic data that improves downstream target policy learning.

Momentum

Related topics

Latest papers 189