Offline Reinforcement Learning

Ask about this topic

Recent momentum

-27%

8 papers in the last 28 days · 0.1% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

4 new papers

A weekly snapshot of new work published in Offline Reinforcement Learning.

Period ending 2026-09-14

1 new paper

A weekly snapshot of new work published in Offline Reinforcement Learning.

Period ending 2026-09-07

3 new papers

A weekly snapshot of new work published in Offline Reinforcement Learning.

127 papers

Latest in Offline Reinforcement Learning

Browse all topics →
CardsList

  1. From Reward-Free Representations to Preferences: Rethinking Offline Preference-Based Reinforcement Learning

    May 31, 2026Jun-Jie Yang, Chia-Heng Hsu, Kui-Yuan Chen +1Offline Reinforcement LearningReinforcement Learning From Human Feedback

  2. Behavior-Invariant Task Representation Learning with Transformer-based World Models for Offline Meta-Reinforcement Learning

    May 30, 2026Fuyuan Qian, Menglong Zhang, Song Wang +1Offline Reinforcement LearningSparse Rewards

  3. Regularized Offline Policy Optimization with Posterior Hybrid Bayesian Belief

    May 30, 2026Hongqiang Lin, Pengfei Wang, Nenggan ZhengOffline Reinforcement LearningPosterior

  4. Drift Q-Learning

    May 29, 2026Anas Houssaini, Mohamad H. Danesh, Amin Abyaneh +3Flow-Based PolicyOffline Reinforcement Learning

  5. A Lecture Note on Offline RL and IRL, Part II: Foundations of Inverse Reinforcement Learning and Dynamic Discrete Choice Models

    May 29, 2026Enoch Hyunwook KangEntropy Regularized Reinforcement LearningOffline Reinforcement Learning

  6. Efficient and Uncertainty-Aware Diffusion Framework for Offline-to-Online Reinforcement Learning

    May 29, 2026Ha Manh Bui, Metod Jazbec, Eric Nalisnick +1Offline Reinforcement LearningDiffusion Policies

  7. UNIQ: Conformal Calibration for Adaptive Conservatism in Offline Reinforcement Learning

    May 28, 2026Aditya UpadhyayOffline Reinforcement LearningReliable Uncertainty Quantification

  8. BORA: Bridging Offline Reinforcement Learning and Online Residual Adaptation for Real-World Dexterous VLA Models

    May 28, 2026Zhongxi Chen, Yifan Han, Yanming Shao +5Imitation LearningOffline Reinforcement Learning

  9. Mean-Field Diffuser: Scaling Offline MARL to Thousands of Agents

    May 28, 2026Wenhao Li, Xiangfeng Wang, Bo JinMulti-Agent Reinforcement LearningOffline Reinforcement Learning

  10. Information-Directed Offline-to-Online Reinforcement Learning

    May 28, 2026Keru ChenOffline Reinforcement LearningImportance Sampling

  11. Efficient Post-training of LLMs for Code Generation With Offline Reinforcement Learning

    May 27, 2026Mingze Wu, Abhinav Anand, Shweta Verma +1Code GenerationLLM Post-Training Methods

  12. SeqRoute: Global Budget-Aware Sequential LLM Routing via Offline Reinforcement Learning

    May 25, 2026Zhongling Xu, Shunan Zheng, Wei WangLarge Language Model RoutingToken Budgets

  13. Unifying Value Alignment and Assignment in Cross-Domain Offline Reinforcement Learning with Heterogeneous Datasets

    May 24, 2026Zhongjian Qiao, Jiafei Lyu, Chenjia Bai +3Offline Reinforcement LearningBehavioral Alignment

  14. Cross-Domain Energy-Guided Diffusion Generation for Off-Dynamics Reinforcement Learning

    May 24, 2026Yu Yang, Yihong Guo, Anqi Liu +1Offline Reinforcement LearningDiffusion Policies

  15. Bilevel Optimization of Synthetic Trajectories for Multi-Turn LLM Fine-Tuning

    May 23, 2026Shresth Verma, Mauricio Tec, Cheol Woo Kim +2Large Language Model Fine-TuningOffline Reinforcement Learning

  16. Generative OOD-regularized Model-based Policy Optimization

    May 23, 2026Aysin Tumay, Jiahe Huang, Elise Jortberg +1Offline Reinforcement LearningOut-Of-Distribution

  17. Score-Based One-step MeanFlow Policy Optimization

    May 22, 2026Kyungyoon Kim, Donghyeon Ki, Hee-Jun Ahn +1Flow-Based PolicyOffline Reinforcement Learning

  18. Target-Aligned Bellman Backup for Cross-domain Offline Reinforcement Learning

    May 21, 2026Wei Liu, Ting LongOffline Reinforcement LearningBellman Equation

  19. ReversedQ: Opportunities for Faster Q-Learning in Episodic Online Reinforcement Learning

    May 20, 2026Sofia R. Miskala-Dinc, Aviva PrinsQ-LearningModel-Free Reinforcement Learning

  20. Offline Reinforcement Learning for Plasma Control in Nuclear Fusion: Codebase and Benchmark

    May 19, 2026Yang Fu, Haomin Bao, Rohit Sonker +4Plasma Shape ControlJoint Reinforcement Learning

  21. COOPO: Cyclic Offline-Online Policy Optimization Algorithm

    May 18, 2026Qisai Liu, Zhanhong Jiang, Joshua Russell Waite +3Offline Reinforcement LearningLearning-Augmented Algorithms

  22. ISEP: Implicit Support Expansion for Offline Reinforcement Learning via Stochastic Policy Optimization

    May 18, 2026Yifei Chen, Shaoqin Zhu, Xiaoqiang JiOffline Reinforcement Learning

  23. Decoupling KL and Trajectories: A Unified Perspective for SFT, DAgger, Offline RL, and OPD in LLM Distillation

    May 16, 2026Anhao Zhao, Haoran Xin, Yingqi Fan +3On-Policy DistillationKnowledge Distillation

  24. Offline Reinforcement Learning with Universal Horizon Models

    May 15, 2026Hojun Chung, Junseo Lee, Songhwai OhOffline Reinforcement LearningOn-Policy

  25. Peng's Q(λλ) for Conservative Value Estimation in Offline Reinforcement Learning

    May 14, 2026Byeongchan Kim, Min-hwan OhOffline Reinforcement LearningModel-Free Reinforcement Learning

  26. ROAD: Adaptive Data Mixing for Offline-to-Online Reinforcement Learning via Bi-Level Optimization

    May 14, 2026Letian Yang, Xu Liu, Yiqiang Lu +3Offline Reinforcement LearningLearning-Augmented Algorithms

  27. Trajectory-Level Data Augmentation for Offline Reinforcement Learning

    May 13, 2026Tobias Schmähling, Matthias Burkhardt, Tobias WindischOffline Reinforcement Learning

  28. Bridging Domain Gaps with Target-Aligned Generation for Offline Reinforcement Learning

    May 13, 2026Minung Kim, Jeongmo Kim, Gwanwoo Choi +1Offline Reinforcement LearningBridging Language

  29. Model-based Bootstrap of Controlled Markov Chains

    May 12, 2026Ziwei Su, Imon Banerjee, Diego KlabjanMultiplier BootstrapOffline Reinforcement Learning

  30. Discrete Flow Matching for Offline-to-Online Reinforcement Learning

    May 12, 2026Fairoz Nower Khan, Nabuat Zaman Nahim, Peizhong JuOffline Reinforcement LearningFlow-Based Policy

  31. RankQ: Offline-to-Online Reinforcement Learning via Self-Supervised Action Ranking

    May 11, 2026Andrew Choi, Wei XuOffline Reinforcement LearningJoint Reinforcement Learning

  32. Robust Probabilistic Shielding for Safe Offline Reinforcement Learning

    May 11, 2026Maris F. L. Galesloot, Thomas Rhemrev, Nils JansenOffline Reinforcement LearningShielding

  33. Adaptive Action Chunking via Multi-Chunk Q Value Estimation

    May 11, 2026Yongjae Shin, Jongseong Chae, Seongmin Kim +2Offline Reinforcement LearningAction Chunks

  34. Towards Differentially Private Reinforcement Learning with General Function Approximation

    May 7, 2026Yi He, Xingyu ZhouDifferential PrivacyOffline Reinforcement Learning

  35. Hitting Time Isomorphism for Multi-Stage Planning with Foundation Policies

    May 7, 2026Magnus Victor Boock, Abdullah Akgül, Mustafa Mert Çelikok +1Offline Reinforcement LearningPlanning Methods

  36. Entropy-Regularized Adjoint Matching for Offline Reinforcement Learning

    May 7, 2026Abdelghani Ghanem, Mounir GhoghoOffline Reinforcement LearningFlow-Based Policy

  37. Beyond Autoregressive RTG: Conditioning via Injection Outside Sequential Modeling in Decision Transformer

    May 7, 2026Yongyi Wang, Hanyu Liu, Lingfeng Li +6Transformer ArchitecturesSequence Modeling

  38. Offline Reinforcement Learning for Rotation Profile Control in Tokamaks

    May 7, 2026Rohit Sonker, Hiro Josep Farre Kaga, Jiayu Chen +5Iterative Reinforcement LearningOffline Reinforcement Learning

  39. Adaptive Policy Selection and Fine-Tuning under Interaction Budgets for Offline-to-Online Reinforcement Learning

    May 6, 2026Alper Kamil Bozkurt, Xiaoan Xu, Shangtong Zhang +2Offline Reinforcement LearningOff-Policy Evaluation

  40. Data-dependent Exploration for Online Reinforcement Learning from Human Feedback

    May 6, 2026Zhen-Yu Zhang, Yuting Tang, Jiandong Zhang +2Reinforcement Learning From Human FeedbackExploration-Exploitation Dilemma

  41. Beyond Penalization: Diffusion-based Out-of-Distribution Detection and Selective Regularization in Offline Reinforcement Learning

    May 6, 2026Qingjun Wang, Hongtu Zhou, Hang Yu +5Offline Reinforcement LearningOut-Of-Distribution Detection

  42. Decoupled Guidance Diffusion for Adaptive Offline Safe Reinforcement Learning

    May 4, 2026Rufeng Chen, Zhaofan Zhang, Zhejiang Yang +2Reward GradientsOffline Reinforcement Learning

  43. AdamO: A Collapse-Suppressed Optimizer for Offline RL

    May 3, 2026Nan Qiao, Sheng Yue, Shuning Wang +1Offline Reinforcement LearningAdam

  44. Towards Efficient and Expressive Offline RL via Flow-Anchored Noise-conditioned Q-Learning

    May 3, 2026Sungyoung Lee, Dohyeong Kim, Eshan Balachandar +2Offline Reinforcement LearningFlow-Based Policy

  45. Model-Based Reinforcement Learning with Double Oracle Efficiency in Policy Optimization and Offline Estimation

    May 1, 2026Haichen Hu, Jian Qian, David Simchi-LeviOffline Reinforcement LearningMarkov Decision Processes

  46. Pessimism-Free Offline Learning in General-Sum Games via KL Regularization

    Apr 30, 2026Claire Chen, Yuheng ZhangKullback-Leibler RegularizationOffline Reinforcement Learning

  47. Lyapunov-Guided Self-Alignment: Test-Time Adaptation for Offline Safe Reinforcement Learning

    Apr 29, 2026Seungyub Han, Hyungjin Kim, Jungwoo LeeOffline Reinforcement LearningHierarchical Reinforcement Learning

  48. TSN-Affinity: Similarity-Driven Parameter Reuse for Continual Offline Reinforcement Learning

    Apr 28, 2026Dominik Żurek, Kamil Faber, Marcin Pietron +2Offline Reinforcement LearningEfficient Continual Learning

  49. Improving Zero-Shot Offline RL via Behavioral Task Sampling

    Apr 28, 2026Nazim Bendib, Nicolas Perrin-Gilbert, Olivier SigaudOffline Reinforcement LearningOnline

  50. DLM: Unified Decision Language Models for Offline Multi-Agent Sequential Decision Making

    Apr 26, 2026Zhuohui Zhang, Bin Cheng, Bin HeMulti-Agent Reinforcement LearningOffline Reinforcement Learning

  51. Learning from Demonstration with Failure Awareness for Safe Robot Navigation

    Apr 25, 2026Xianghui Wang, Siwei Cheng, Shanze Wang +3Social Robot NavigationMotion Imitation

  52. CODA: Coordination via On-Policy Diffusion for Multi-Agent Offline Reinforcement Learning

    Apr 25, 2026Marcel Hedman, Kale-ab Abebe Tessera, Juan Claude Formanek +5Multi-Agent Reinforcement LearningOffline Reinforcement Learning

  53. Preserve Support, Not Correspondence: Dynamic Routing for Offline Reinforcement Learning

    Apr 24, 2026Zhancun Mu, Guangyu Zhao, Yiwu Zhong +1Offline Reinforcement LearningBehavior Cloning

  54. When Policies Cannot Be Retrained: A Unified Closed-Form View of Post-Training Steering in Offline Reinforcement Learning

    Apr 23, 2026Elias Hossain, Mohammad Jahid Ibna Basher, Ivan Garibay +2Offline Reinforcement LearningLLM Post-Training Methods

  55. Fisher Decorator: Refining Flow Policy via a Local Transport Map

    Apr 20, 2026Xiaoyuan Cheng, Haoyu Wang, Wenxuan Yuan +4Flow-Based PolicyOffline Reinforcement Learning

  56. SutureFormer: Learning Surgical Trajectories via Goal-conditioned Offline RL in Pixel Space

    Mar 19, 2026Huanrong Liu, Chunlin Tian, Tongyu Jia +8Trajectory PredictionImitation Learning

  57. Safe Flow Q-Learning: Offline Safe Reinforcement Learning with Reachability-Based Flow Policies

    Mar 16, 2026Mumuksh Tayal, Manan Tayal, Ravi PrakashOffline Reinforcement LearningFlow-Based Policy

  58. Latent Policy Steering through One-Step Flow Policies

    Mar 5, 2026Hokyun Im, Andrey Kolobov, Jianlong Fu +1Offline Reinforcement LearningFlow-Based Policy

  59. Temporal Consistency Improves Generalization in Contextual Offline Meta Reinforcement Learning

    Mar 3, 2026Mohammadreza Nakheai, Aidan Scannell, Kevin Luck +1Offline Reinforcement LearningDeepmind Control Suite

  60. Conservative Equilibrium Discovery in Offline Game-Theoretic Multiagent Reinforcement Learning

    Feb 27, 2026Austin A. Nguyen, Michael P. WellmanOffline Reinforcement LearningMulti-Agent Reinforcement Learning