Offline Reinforcement Learning

Ask about this topic

Recent momentum

-27%

8 papers in the last 28 days · 0.1% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

4 new papers

A weekly snapshot of new work published in Offline Reinforcement Learning.

Period ending 2026-09-14

1 new paper

A weekly snapshot of new work published in Offline Reinforcement Learning.

Period ending 2026-09-07

3 new papers

A weekly snapshot of new work published in Offline Reinforcement Learning.

127 papers

Latest in Offline Reinforcement Learning

Browse all topics →
CardsList

  1. Offline Reinforcement Learning for Distribution-Grid Protection

    Sep 21, 2026Julian Oelhaf, Alexander Luce, Christian Bergler +2Offline Reinforcement Learning

  2. Lifted Bellman Linear Programming for Offline Reinforcement Learning

    Sep 21, 2026Hyukjun Yang, Jongchan Park, Narim Jeong +1Offline Reinforcement Learning

  3. Learning Reliable Parking Policies via Offline Reinforcement Learning with Quantized Action Representations

    Sep 17, 2026Zewei Yang, Zengqi Peng, Jun MaAutonomous DrivingOffline Reinforcement Learning

  4. Learning Multimodal One-step Flow Policy via Value-weighted Optimal Transport

    Sep 14, 2026Jaehun Shon, Jinha Choi, Jongwook Jeon +1Flow-Based PolicyOffline Reinforcement Learning

  5. Offline Reinforcement Learning for Wind Farm Control: A Wind Tunnel Study under Dynamic Wind Directions

    Sep 14, 2026Yuhan Su, Hongyang Dong, Simone Tamaro +3Offshore Wind TurbineUrban Wind

  6. Certified Safety Curation: Distribution-Free Guarantees for Safe Offline Reinforcement Learning

    Sep 14, 2026Adam Haroon, Cody FlemingOffline Reinforcement LearningSafety Constraints

  7. Routing Dense Layouts with History-Aware Offline Reinforcement Learning using LSTM

    Sep 8, 2026Afsara Khan, Austin RovinskiAdaptive RoutingOffline Reinforcement Learning

  8. Multi-step Proximal Policy Improvement in Offline Reinforcement Learning

    Sep 3, 2026Soohyun Choi, Seonvin Cho, Songnam HongOffline Reinforcement LearningProximal Policy Optimization

  9. Out-of-Distribution Generalisation with Sequence Models in Offline Multi-Agent Reinforcement Learning

    Sep 3, 2026Oussama Hidaoui, Omer Ebead, Ulrich Armel Mbou Sob +14Multi-Agent Reinforcement LearningOffline Reinforcement Learning

  10. Confounding Masquerading as Improvement: A Systematic Evaluation of Offline Reinforcement Learning for Stroke Antithrombotic Treatment in a 129,000-Patient Registry

    Aug 31, 2026Kihun RheeStrokeOffline Reinforcement Learning

  11. Redistribution-based Cost Inference Improves Sparse Safe Offline RL

    Aug 12, 2026Ebenezer Gelo, Geraud Nangue Tasse, Steven James +1Offline Reinforcement LearningSparse Rewards

  12. Unmasking Toxic Mimicry in Medical Offline Reinforcement Learning for ICU Sepsis Management via Counterfactual Clinical Audits

    Aug 11, 2026Hangqi Ren, Junyi LiaoSepsisMimic-Iv Datasets

  13. Critic-Free Pretraining for Efficient Online Reinforcement Learning Fine-Tuning

    Aug 11, 2026Daoyi Li, Yixian Zhang, Wenbo Ding +2Offline Reinforcement LearningSoft Actor-Critic

  14. CODS: Iterative Bellman-Residual Data Selection for Reusable Offline Reinforcement Learning

    Aug 7, 2026Ibne Farabi Shihab, Sanjeda Akter, Abu Sa-Adat Mohamed Moon-Im Al Ahsan +2Offline Reinforcement LearningBellman Equation

  15. Training a Conditioned Video Game Agent on a VLM Annotated Dataset

    Aug 6, 2026Katrin Schmid, Iuri FrosioOffline Reinforcement LearningVideo Dataset

  16. Convex-Hull-Neighborhood Smooth Dual Generalization: Controlling Local Correction Propagation in Offline RL

    Aug 4, 2026Yi Yang, Zhennan Chen, Mingfeng Lv +3Offline Reinforcement LearningOut-Of-Distribution

  17. Diffusion Policy with Behavioral Advantage Correction for Offline Reinforcement Learning

    Aug 3, 2026Botao Dong, Longyang Huang, Ning Pang +1Offline Reinforcement LearningDiffusion Policies

  18. ReBRAC-v2: The Return of the King

    Aug 2, 2026Denis Tarasov, Robert K. KatzschmannOffline Reinforcement LearningNormalizing Flows

  19. RedFlow: Redirect Failure into Action-Level Corrections for Flow-matching VLA Policy

    Jul 30, 2026Zhengyang Yan, Junhao Li, Fangqi Zhu +6Flow-Matching Vision-Language-ActionFlow-Based Policy

  20. Learning from the Unseen: Offline Reinforcement Learning with Hidden Actions

    Jul 28, 2026Zeyu Bian, Ying Zhou, Yifan CuiOffline Reinforcement LearningOff-Policy Evaluation

  21. A Unified Algorithmic Framework for Hybrid Reinforcement Learning in Tabular MDPs with Shifted Transition Dynamics

    Jul 28, 2026Zheshun Wu, Renjie Zheng, Jinhang Zuo +2Offline Reinforcement LearningMarkov Decision Processes

  22. Sparse Gaussian-Mixture-Model Q-Functions via Hadamard Overparametrization for Online Reinforcement Learning

    Jul 26, 2026Minh Vu, Konstantinos SlavakisOffline Reinforcement LearningRiemannian Optimization

  23. Expert Behavior Prior Reinforcement Learning

    Jul 23, 2026Gong Gao, Weidong Zhao, Xianhui Liu +1Offline Reinforcement LearningDeep Reinforcement Learning

  24. TOUR: A Trajectory-Level Unlearning Benchmark for Offline Reinforcement Learning

    Jul 23, 2026Chaofan Pan, Lingfei Ren, Xiangyu Jiang +6Offline Reinforcement LearningTrajectory-Level Credit

  25. Offline RL with Hierarchical Action Chunking

    Jul 23, 2026Ahad JawaidGoal-Conditioned Reinforcement LearningOffline Reinforcement Learning

  26. Conservative Query and Adaptive Regularization for Offline RL Under Uncertainty Estimation

    Jul 21, 2026Li-Rong Zhou, Qin-Wen Luo, Sheng-Jun HuangOffline Reinforcement LearningConservatism

  27. REGEN: Replay-recycling for Expert-to-Generalist distillation with Offline Reinforcement Learning

    Jul 21, 2026Yunjie Chen, Xiaoxin Chen, Fang WangOffline Reinforcement LearningDeep Reinforcement Learning

  28. Evaluating covariate balance for long time horizon Markov decision processes

    Jul 16, 2026Joshua Spear, Rebecca Pope, Neil J SebireCovariate ShiftOffline Reinforcement Learning

  29. RENEW: Towards Learning World Models and Repairing Model Exploitation from Preferences

    Jul 15, 2026Logan Mondal Bhamidipaty, Mykel Kochenderfer, Subramanian RamamoorthyOffline Reinforcement LearningReinforcement Learning From Human Feedback

  30. Active Offline-to-Online Reinforcement Learning

    Jul 13, 2026Alper Kamil Bozkurt, Shangtong Zhang, Yuichi MotaiOffline Reinforcement LearningLimited Data

  31. Robo-ValueRL: Reliable Value Estimation for Offline-to-Online Reinforcement Learning

    Jul 10, 2026Wenke Xia, Pei Ren, Wenbo Yu +10Offline Reinforcement LearningValue Functions

  32. Shortcut Trajectory Planning for Efficient Offline Reinforcement Learning

    Jul 10, 2026Guanquan Wang, Yoshimasa TsuruokaDiffusion PlanningOffline Reinforcement Learning

  33. Feedback Manipulation Regularization: Enabling Offline Agent Alignment for Imitation Learning

    Jul 8, 2026Benjamin Poole, Minwoo LeeImitation LearningOffline Reinforcement Learning

  34. Fitted Occupancy-Ratio Evaluation without Bellman Completeness

    Jul 6, 2026Lars van der Laan, Nathan KallusBellman EquationOffline Reinforcement Learning

  35. Learning to Control LLM Agent Harnesses with Offline Reinforcement Learning

    Jul 5, 2026Haiwen Yi, Xinyuan SongLarge Language Model AgentsControl System Operator Learning

  36. CDCP: Conditional Diffusion Model with Contextual Prompts for Multi-task Offline Safe Reinforcement Learning

    Jul 4, 2026Jiayi Guan, Tianle Zhang, Li Shen +8Offline Reinforcement LearningDiscrete Diffusion Model

  37. Generalization in offline RL: The structure is more important than the amount of pessimism

    Jul 2, 2026Max Weltevrede, Matthijs T. J. Spaan, Wendelin BöhmerOffline Reinforcement LearningPessimism

  38. SPLC: Social Preference Learning for Crowd Robot Navigation

    Jul 2, 2026Zixuan Chen, Hao Fu, Haiwen Hu +1Social Robot NavigationHuman-Robot Collaboration

  39. AETDICE: Unified Framework and Offline Optimization for Nonlinear Multi-Objective RL

    Jun 30, 2026Woosung Kim, Youngjun Suh, Jinho Lee +2Constrained Reinforcement LearningMulti-Objective Optimization

  40. Offline Reinforcement Learning for Fluid Controls: Data-based Multi-observational Policy Extraction

    Jun 30, 2026Deepak Akhare, Luning Sun, Xin-Yang Liu +4Offline Reinforcement LearningDeep Reinforcement Learning

  41. Exploration and Online Transfer with Behavioral Foundation Models

    Jun 29, 2026Louis Bagot, Mathieu Lefort, Laëtitia MatignonOffline Reinforcement LearningAutonomous Exploration Strategies

  42. RS-Diffuser: Risk-Sensitive Diffusion Planning with Distributional Value Guidance

    Jun 26, 2026Shiqiang GongDiffusion PlanningOffline Reinforcement Learning

  43. Offline Multi-agent Continual Cooperation via Skill Partition and Reuse

    Jun 24, 2026Yuchen Xiao, Lei Yuan, Ruiqi Xue +2Unsupervised Skill DiscoveryMulti-Agent Reinforcement Learning

  44. Offline Reinforcement Learning for Warehouse SLAM Throughput Control

    Jun 22, 2026Tina Dongxu Li, Mouhacine Benosman, Rajat Kumar +3Offline Reinforcement LearningKoopman Operator

  45. Scalable Maximum Entropy Reinforcement Learning for Diffusion Policies via Adjoint Matching

    Jun 21, 2026Serge Thilges, Onur Celik, Denis Blessing +2Diffusion PoliciesOffline Reinforcement Learning

  46. Horizon Adaptive Offline Policy Learning via Value Stitching

    Jun 19, 2026Kexin Zheng, Xianyuan Zhan, Xintao YanOffline Reinforcement LearningExponential Horizon Dependence

  47. Sim2O: Efficient Offline-to-Online MARL via Joint Action Composition

    Jun 19, 2026Bingchang Song, Yiqin YangMulti-Agent Reinforcement LearningOffline Reinforcement Learning

  48. Off-Policy Evaluation for Missingness-Aware Policies in MDPs with Rewards Missing Not at Random

    Jun 18, 2026Ziheng Wei, Annie Qu, Rui MiaoOff-Policy EvaluationMissing Data

  49. OnDeFog: Online Decision Transformer under Frame Dropping

    Jun 18, 2026Daiki Yotsufuji, Kenta Nishihara, Shoma Shimizu +2Offline Reinforcement LearningLearning-Augmented Algorithms

  50. Insulin4RL: Real-Time Insulin Management in the Intensive Care Unit for Offline Reinforcement Learning

    Jun 17, 2026Thomas Frost, Steve HarrisIntensive Care UnitOffline Reinforcement Learning

  51. When Does Trajectory-Level Supervision Permit Efficient Offline Reinforcement Learning?

    Jun 16, 2026Xuanfei Ren, Tengyang XieOffline Reinforcement LearningLearning-Augmented Algorithms

  52. Reversal Q-Learning

    Jun 16, 2026Aditya Oberai, Seohong Park, Sergey LevineFlow-Based PolicyOffline Reinforcement Learning

  53. Diffusion Offline Reinforcement Learning for Fair and Energy-Efficient UAV-Assisted Wireless Networks

    Jun 15, 2026Eslam Eldeeb, Hirley AlvesWireless NetworksOffline Reinforcement Learning

  54. Individual Control Barrier Functions-Guided Diffusion Model for Safe Offline Multi-Agent Reinforcement Learning

    Jun 10, 2026Qingyun Guo, Junyi Shi, Jianuo Huang +1Multi-Agent Reinforcement LearningOffline Reinforcement Learning

  55. Fast and Highly Expressive Policy Learning for Offline Reinforcement Learning via Bootstrapped Flow Q-Learning

    Jun 9, 2026Thanh Nguyen, Tri Ton, Hongbin Choe +2Flow-Based PolicyQ-Learning

  56. Safe-RULE: Safe Reinforcement UnLEarning

    Jun 8, 2026Shixiong Jiang, Taozheng Zhu, Fanxin KongOffline Reinforcement LearningDeep Reinforcement Learning

  57. Counterfactual Transport Flows for Offline Conservative Trajectory Refinement

    Jun 8, 2026Lena Krieger, Xuan Zhao, Zhuo Cao +3Offline Reinforcement LearningTrajectory Prediction

  58. Neuro-Symbolic Injection of LTLf Constraints in Autoregressive Reinforcement Learning Policies

    Jun 6, 2026Ashkan Ansarifard, Matteo Mancanelli, Elena Umili +1Linear Temporal LogicsOffline Reinforcement Learning

  59. Step-by-Step Optimization-like Reasoning in LLMs over Expanding Search Spaces

    Jun 3, 2026Nicolás Astorga, Nabeel Seedat, Mihaela van der SchaarPrompt OptimizationLlm-Based Optimization Modeling

  60. Offline-to-Online Learning in Linear Bandits

    Jun 3, 2026Kushagra Chandak, Toshinori Kitamura, Xiaoqi TanLinear BanditsOffline Reinforcement Learning