Offline Reinforcement Learning

Ask about this topic

Momentum

121 papers in the last four weeks, up 267% on the four weeks before. 1.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 778

All topics
CardsList

  1. Just-In-Time Reinforcement Learning: Continual Learning in LLM Agents Without Gradient Updates

    Jan 26, 2026Yibo Li, Zijie Lin, Ailin Deng +5Large Language Model Reinforcement LearningOffline Reinforcement Learning

    National University of Singapore, Singapore.

  2. PEARL: Self-Evolving Assistant for Time Management with Reinforcement Learning

    Jan 17, 2026Bingxuan Li, Jeonghwan Kim, Cheng Qian +4ScheduleAssistant

    University of Illinois at Urbana-Champaign · Viven

  3. Agile and Generalized Legged Locomotion via Attention-Based Neural Map Encoding

    Jan 13, 2026Chong Zhang, Victor Klemm, Fan Yang +1Agile LocomotionSensorimotor Experience

    1Robotic Systems Lab, ETH Zurich, Switzerland · 2Secure, Reliable, and Intelligent Systems Lab, ETH Zurich, Switzerland · 3ETH AI Center, Switzerland

  4. Mimic Human Cognition, Master Multi-Image Reasoning: A Meta-Action Framework for Enhanced Visual Understanding

    Jan 12, 2026Jianghao Yin, Qingbin Li, Kun Sun +10Recent Vision-Language ModelsTheory-Of-Mind Reasoning

    East China Normal University · ByteDance

  5. Precision autotuning for linear solvers via contextual bandit-based RL

    Jan 2, 2026Erin Carson, Xinye ChenSolver IterationsFull-Precision Performance

    Charles University Prague, Czech · Sorbonne Université, CNRS, LIP6 Paris, France

  6. Soft Fitted Q-Iteration without Bellman Completeness: Occupancy Reweighting and Temperature Annealing

    Dec 30, 2025Lars van der Laan, Nathan KallusEntropy Regularized Reinforcement LearningBoltzmann Policies

    Department of Statistics, University of Washington · Netflix · Cornell University

  7. Meta-RL with Bayesian Linear Task Models

    Dec 24, 2025Jingyang You, Hanna KurniawatiOffline Reinforcement LearningVariational Inference

    School of Computing Australian National University

  8. The HydroGym Reinforcement Learning Platform for Fluid Dynamics

    Dec 19, 2025Christian Lagemann, Sajeda Mokbel, Miro Gondrum +18Fluid DynamicsFluid Controls

    Department of Mechanical Engineering, University of Washington, Seattle, WA 98195, United States · AI Institute in Dynamic Systems, University of Washington, Seattle, WA 98195, United States · Chair of Fluid Mechanics and Institute of Aerodynamics, RWTH Aachen University, Aachen, Germany +9

  9. Statistical analysis of Inverse Entropy-regularized Reinforcement Learning

    Dec 7, 2025Denis Belomestny, Alexey Naumov, Artemy Rubtsov +1Entropy Regularized Reinforcement LearningOffline Reinforcement Learning

  10. Auto-exploration for online reinforcement learning

    Dec 6, 2025Caleb Ju, Guanghui LanStochastic ExplorationOffline Reinforcement Learning

  11. Attention Trajectories as a Diagnostic Axis for Deep Reinforcement Learning

    Nov 25, 2025Charlotte Beylier, Hannah Selder, Arthur Fleig +2Offline Reinforcement LearningSaliency

    Max Planck Institute for Human Cognitive and Brain Sciences · Center for Scalable Data Analytics and Artificial Intelligence (ScaDS.AI) Dresden/Leipzig · Leipzig, Germany +2

  12. Reinforcement Learning to Initialize Newton-Raphson for AC Power Flow with Quantum Annealing-Based Environment Updates

    Nov 25, 2025Zeynab Kaseb, Matthias Moller, Lindsay Spoor +4Optimal Power FlowQuantum Annealing

    Electrical Sustainable Energy, Delft University of Technology, P.O. Box 5031, 2600 GA Delft, The Netherlands. · Applied Mathematics, Delft University of Technology, P.O. Box 5031, 2600 GA Delft, The Netherlands. · Leiden Institute of Advanced Computer Science, Leiden University, P.O. Box 9512, 2300 RA Leiden, The Netherlands. +3

  13. SEBA: Sample-Efficient Black-Box Attacks on Visual Reinforcement Learning

    Nov 12, 2025Tairan Huang, Yulin Jin, Junxu Liu +2Black-Box Adversarial AttacksOffline Reinforcement Learning

    The Hong Kong Polytechnic University Hong Kong, China

  14. A Quantitative Comparison of Centralised and Distributed Reinforcement Learning-Based Control for Soft Robotic Arms

    Nov 4, 2025Linxin Hou, Qirui Wu, Zhihang Qin +3Multi-Agent Reinforcement LearningSoft Robotics

    Department of Electrical and Computer Engineering, National University of Singapore · Department of Computer Science, National University of Singapore · Department of Mechanical Engineering, National University of Singapore

  15. Zero-Human Demonstration End-to-end Autonomous Driving with Trajectory Scorer

    Oct 28, 2025Zhenxin Li, Nadine Chang, Wenhao Yao +9Causality-Aware End-To-End Autonomous DrivingAutonomous Driving

    Institute of Trustworthy Embodied AI, Fudan University · *Work done during an internship at NVIDIA. · NVIDIA +3

  16. CLARity: Reasoning Consistency Alone Can Teach Reinforced Experts

    Oct 10, 2025Jiuheng Lin, Cong Jiang, Zirui Wu +2Offline Reinforcement Learning

    Wangxuan Institute of Computer Technology, Peking University

  17. TaoSR-AGRL: Adaptive Guided Reinforcement Learning Framework for E-commerce Search Relevance

    Oct 9, 2025Jianhui Yang, Yiming Jin, Pengkun Jiao +6RelevanceAgentic Commerce

    Tsinghua University Beijing, China · Taobao & Tmall Group of Alibaba Beijing, China · Taobao & Tmall Group of Alibaba Hangzhou, China +1

  18. The Alignment Auditor: A Bayesian Framework for Verifying and Refining LLM Objectives

    Oct 7, 2025Matthieu Bou, Nyal Patel, Arjun Jagota +2Large Language Model AlignmentOffline Reinforcement Learning

    1Imperial College London · 2Amazon AGI

  19. Finite-Time Convergence of Single-Trajectory Chi-Square Robust Q-Learning With Linear Function Approximation

    Oct 2, 2025Saptarshi Mandal, Yashaswini Murthy, R. SrikantQ-LearningOffline Reinforcement Learning

    ECE, UIUC · ORIE, UT Austin · ECE, CSL, and the director of NCSA at UIUC

  20. Reward function compression facilitates goal-dependent reinforcement learning

    Sep 8, 2025Gaia Molinaro, Anne G. E. CollinsGoal-Conditioned Reinforcement LearningReward Functions

    University of California, Berkeley Berkeley, CA 94704

  21. ReST-RL: Reinforcing LLM Reasoning through Unified Self-Training and Value-Guided Search

    Aug 27, 2025Sining Zhoubian, Dan Zhang, Jie TangLLM Reasoning StrategiesLarge Language Model Reinforcement Learning

    Department of Computer Science and Technology, Tsinghua University · Work done when interned at Z.ai. · School of Electronics and Computer Scinence, Univeristy of Southampton

  22. Integrated Noise and Safety Management in UAM via A Unified Reinforcement Learning Framework

    Aug 22, 2025Surya Murthy, Zhenyu Gao, John-Paul Clarke +1Multi-UavAir Traffic Control

    Graduate Research Assistant, Oden Institute for Computational Engineering and Sciences, The University of Texas at Austin · Postdoctoral Fellow, Department of Aerospace Engineering and Engineering Mechanics, The University of Texas at Austin · Professor and Ernest Cockrell, Jr. Memorial Chair in Engineering, Department of Aerospace Engineering and Engineering Mechanics, The University of Texas at Austin +1

  23. ProMed: Shapley Information Gain Guided Reinforcement Learning for Proactive Medical LLMs

    Aug 19, 2025Hongxin Ding, Baixiang Huang, Yue Fang +8Offline Reinforcement Learning

    National Engineering Research Center of Software Engineering, Peking University, China · School of Computing and Data Science, The University of Hong Kong · School of Computer Science, Peking University, Beijing, China +2

  24. Nested-ReFT: Efficient Reinforcement Learning for Large Language Model Fine-Tuning via Off-Policy Rollouts

    Aug 13, 2025Maxime Heuillet, Yufei Cui, Boxing Chen +2Mathematical Reasoning BenchmarksLarge Language Model Fine-Tuning

    Universit´e Laval (IID), Canada · Mila - Qu´ebec AI Institute, Canada · Huawei Noah’s Ark Lab (Montreal Research Center), Canada +1

  25. PERRY: Policy Evaluation with Confidence Intervals using Auxiliary Data

    Jul 26, 2025Aishwarya Mandyam, Jason Meng, Ge Gao +4Policy EvaluationConfidence Intervals

    Stanford University · Gladstone Institutes · Stanford University[cs.LG]

  26. RAD: Retrieval High-quality Demonstrations to Enhance Decision-making

    Jul 21, 2025Lu Guo, Yixiang Shan, Zhengbang Zhu +5Model-Based Reinforcement LearningOffline Reinforcement Learning

    School of Artificial Intelligence, Jilin University, Changchun, China · School of Computer Science, Shanghai Jiao Tong University, Shanghai, China

  27. A Technical Survey of Reinforcement Learning Techniques for Large Language Models

    Jul 5, 2025Saksham Sahai Srivastava, Vaneet AggarwalLarge Language Model Reinforcement LearningOffline Reinforcement Learning

    University of Georgia, Athens, GA, USA · Purdue University, West Lafayette, IN, USA

  28. Discrete Compositional Generation via General Soft Operators and Robust Reinforcement Learning

    Jun 20, 2025Marco Jiralerspong, Esther Derman, Danilo Vucetic +5Kullback-Leibler RegularizationRejection Sampling

    1Université de Montréal · 2Mila · 5Independent +1

  29. Adaptive Reinforcement Learning for Unobservable Random Delays

    Jun 17, 2025John Wikman, Alexandre Proutiere, David BromanOffline Reinforcement LearningMujoco

    EECS and Digital Futures, KTH Royal Institute of Technology, Stockholm, Sweden.

  30. ProteinZero: Self-Improving Protein Generation via Online Reinforcement Learning

    Jun 9, 2025Ziwen Wang, Jiajun Fan, Ruihan Guo +3Protein DesignProtein

    Siebel School of Computing and Data Science, University of Illinois Urbana-Champaign, Urbana, IL, USA · DOE Center for Advanced Bioenergy and Bioproducts Innovation, University of Illinois Urbana-Champaign, Urbana, IL, USA

  31. SafeOR-Gym: A Benchmark Suite for Safe Reinforcement Learning Algorithms on Practical Operations Research Problems

    Jun 2, 2025Asha Ramanujam, Adam Elyoumi, Hao Chen +5Safety ConstraintsOperations Research

    Davidson School of Chemical Engineering, Purdue University, West Lafayette, IN · Energy Sciences, ExxonMobil Technology and Engineering Company, Annandale, NJ · Energy Sciences, ExxonMobil Technology and Engineering Company, Annadale, NJ

  32. Normalizing Flows are Capable Models for Continuous Control

    May 29, 2025Raj Ghugare, Benjamin EysenbachNormalizing FlowsOffline Reinforcement Learning

    Department of Computer Science Princeton University

  33. Fully Offline Reinforcement Learning

    May 28, 2025Mattie Fellows, Clarisse Wibault, Uljad Berdica +3Model-Based Reinforcement LearningOffline Reinforcement Learning

    Foerster Lab for AI Research (FLAIR), Department of Engineering Science, University of Oxford · Machine Learning Research Group, Department of Engineering Science, University of Oxford

  34. Fox in the Henhouse: Supply-Chain Backdoor Attacks Against Reinforcement Learning

    May 26, 2025Shijie Liu, Andrew C. Cullen, Paul Montague +2Offline Reinforcement LearningKernel-Resident Tool Governance Gateway

    School of Computing and Information Systems, University of Melbourne, Parkville, Australia · DST Group, Adelaide

  35. Model-Free Robust Average-Reward Reinforcement Learning with Sample Complexity Analysis

    May 18, 2025Zachary Roch, George Atia, Yue WangModel-FreeOffline Reinforcement Learning

    Department of Electrical and Computer Engineering, University of Central Florida, Orlando, Florida, USA. · Department of Computer Science, University of Central Florida, Orlando, Florida, USA.

  36. HERB: Human-augmented Efficient Reinforcement learning for Bin-packing

    Apr 23, 2025Gojko Perovic, Nuno Ferreira Duarte, Atabak Dehban +3Scalable Robot LearningOffline Reinforcement Learning

    BioRobotics Institute, Scuola Superiore Sant’Anna, Pisa, Italy, and with the Department of Excellence in Robotics and AI, Scuola Superiore Sant’Anna, Pisa, Italy. · Institute for Systems and Robotics, Instituto Superior Técnico, Universidade de Lisboa, 1049-001 Lisbon, Portugal.

  37. Towards More Efficient, Robust, Instance-adaptive, and Generalizable Sequential Decision making

    Apr 12, 2025Zhiyong WangSequential Decision MakingOffline Reinforcement Learning

    Department of Computer Science and Engineering, The Chinese University of Hong Kong

  38. A Survey of Reinforcement Learning-Based Motion Planning for Autonomous Driving: Lessons Learned from a Driving Task Perspective

    Mar 31, 2025Zhuoren Li, Guizhe Jin, Ran Yu +8Autonomous DrivingMotion Planning

    College of Automotive and Energy Engineering, Tongji University, Shanghai 201804, China

  39. Distributionally Robust Reinforcement Learning with Human Feedback

    Mar 1, 2025Debmalya Mandal, Paulius Sasnauskas, Goran RadanovicReinforcement Learning From Human FeedbackDistributional Reinforcement Learning

    Dept. of Computer Science University of Warwick, UK · Department of Computing Science University of Alberta, Edmonton, Canada · Max-Planck Institute for Software Systems, Germany

  40. Dynamic Optimizations of LLM Ensembles with Two-Stage Reinforcement Learning Agents

    Feb 6, 2025Selim Furkan Tekin, Gaowen Liu, Ramana Rao Kompella +1Large Language Model Reinforcement LearningEnsemble

    Georgia Institute of Technology · Cisco Systems

  41. RL-STaR: Theoretical Analysis of Reinforcement Learning Frameworks for Self-Taught Reasoner

    Oct 31, 2024Fu-Chieh Chang, Yu-Ting Lee, Hui-Ying Shih +2Large Language Model Reinforcement LearningLLM Reasoning Strategies

    MediaTek Research, Taipei, Taiwan · Graduate Institute of Communication Engineering, National Taiwan University, Taipei, Taiwan · Department of Mathematical Sciences, National Chengchi University, Taipei, Taiwan +2

  42. Streaming Deep Reinforcement Learning Finally Works

    Oct 18, 2024Mohamed Elsayed, Elena Sorina Lupu, Gautham Vasan +1Offline Reinforcement LearningQ-Learning

    Department of Computing Science, University of Alberta, Edmonton, Canada · Alberta Machine Intelligence Institute (Amii) · Canada CIFAR AI Chair

  43. A Survey on Reinforcement Learning Applications in SLAM

    Aug 26, 2024Mohammad Dehghani Tezerjani, Mohammad Khoshnazar, Mohammadhamed Tangestanizadeh +2Simultaneous Localization And MappingRobot Navigation

    Computer Science and Engineering, University of North Texas, Denton, USA · Institute of Artificial Intelligence, University of Bremen, Bremen, Germany · Computer Science and Engineering, University of California Santa Cruz, Santa Cruz, USA +1

  44. ProSpec RL: Plan Ahead, then Execute

    Jul 31, 2024Liangliang Liu, Yi Guan, BoRan Wang +5Model-Free Reinforcement LearningOffline Reinforcement Learning

    1The Faculty of Computing, Harbin Institute of Technology, Harbin, China · 2The Artificial Intelligence Institute, Harbin Institute of Technology, ShenZhen, China · 3The Artificial Intelligence Institute, Harbin Institute of Technology, Harbin, China

  45. Open-Vocabulary Object-Goal Navigation by Generalizing Semantic Mapping with Dense CLIP

    Jul 12, 2024Meng Wei, Chenyang Wan, Tai Wang +6Vision-Language NavigationOpen-Vocabulary

    Shanghai AI Lab · Zhejiang University · The University of Hong Kong

  46. Decision-Centered Abstractions via Orthogonal Estimation of Difference-of-Q Functions

    Jun 12, 2024Defu Cao, Angela ZhouOffline Reinforcement LearningReward Functions

    University of Southern California

  47. Lipschitz-Regularized Critics Lead to Policy Robustness Against Transition Dynamics Uncertainty

    Apr 22, 2024Xulin Chen, Ruipeng Liu, Zhenyu Gan +1Proximal Policy OptimizationOffline Reinforcement Learning

    College of Engineering & Computer Science, Syracuse University

  48. Distributionally Robust Reinforcement Learning with Interactive Data Collection: Fundamental Hardness and Near-Optimal Algorithms

    Apr 4, 2024Miao Lu, Han Zhong, Tong Zhang +1Distributional Reinforcement LearningOffline Reinforcement Learning

    †Department of Management Science and Engineering, Stanford University. · ‡Center for Data Science, Peking University. · §Department of Computer Science, University of Illinois Urbana-Champaign.

  49. Fading Expert Guidance: Bridging Model-Based and Learning-Based Control for Abortable Autonomous Overtaking

    Aug 18, 2023Jinxiong Lu, Gokhan Alcan, Ville KyrkiReinforcement Learning ControlRobust Trajectory

    Intelligent Robotics Group, Department of Electrical Engineering and Automation, Aalto University, 02150 Espoo, Finland

  50. Robust Recurrent Reinforcement Learning under Evolving Hidden Disturbances with Application to Rover Wheel Slip

    Jul 29, 2023Saki Omi, Hyo-Sang Shin, Namhoon Cho +2Offline Reinforcement LearningWheel

    Space Robotics Research Group, Interdisciplinary Centre for Security, Reliability and Trust, University of Luxembourg · School of Aerospace, Transport and Manufacturing, Cranfield University, Cranfield, U.K. · Department of Aerospace Engineering, Seoul National University, Seoul, South Korea

  51. Reinforcement Learning with Temporal-Logic-Based Causal Diagrams

    Jun 23, 2023Yash Paliwal, Rajarshi Roy, Jean-Raphaël Gaglione +5Offline Reinforcement LearningLinear Temporal Logics

    Arizona State University, Arizona, USA · Max Planck Institute for Software Systems, Kaiserslautern, Germany · University of Texas at Austin, Texas, USA +3

  52. Discovering Temporal Structure: An Overview of Hierarchical Reinforcement Learning

    Date pendingMartin Klissarov, Akhil Bagaria, Ziyan Luo +3Hierarchical Reinforcement LearningOffline Reinforcement Learning

    Mila, McGill University · Amazon · Amii, University of Alberta Canada CIFAR AI Chair

  53. AsyncFlow: An Asynchronous Streaming RL Framework for Efficient LLM Post-Training

    Date pendingZhenyu Han, Ansheng You, Haibo Wang +16Asynchronous ExecutionEfficient Large Language Model

    Huawei · Individual Researcher

  54. CMoE: Contrastive Mixture of Experts for Motion Control and Terrain Adaptation of Humanoid Robots

    Date pendingShihao Ma, Hongjin Chen, Zijun Xu +6Full-Body Humanoid ControlTerrain

    College of Intelligent Robotics and Advanced Manufacturing, Fudan University, Shanghai, China, 200433

  55. UBCL: A Reinforcement Learning Framework for Controllable and Diverse Player Behaviors

    Date pendingAtahan Cilan, Atay ÖzgövdeBehavior CloningOffline Reinforcement Learning

    Turkish Aerospace, Istanbul, Turkey · Department of Computer Engineering, Boğaziçi University, Istanbul, Turkey

  56. DiffusionOPD: A Unified Perspective of On-Policy Distillation in Diffusion Models

    Date pendingQuanhao Li, Junqiu Yu, Kaixun Jiang +7Diffusion-Based Reinforcement Learning MethodsOnline-Policy Distillation

    Fudan University, China · Alibaba Group, China

  57. CoSkill: Joint Reinforcement Learning of Reasoning and Meta-Skill Agents for Hierarchical Skill Evolution

    Date pendingJinyuan Feng, Dongmin Li, Yiqun Chen +4Self-Evolving Skill LibrariesReusable Agent Skills

    Institute of Automation, Chinese Academy of Sciences · Renmin University of China · ByteDance

  58. Using Reward Uncertainty to Induce Diverse Behaviour in Reinforcement Learning

    Date pendingAnthony GX-Chen, Ankit Anand, Gheorghe Comanici +7Reward FunctionsOffline Reinforcement Learning

    New York University · Google DeepMind