Offline Reinforcement Learning

Ask about this topic

Momentum

121 papers in the last four weeks, up 267% on the four weeks before. 1.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 778

All topics
CardsList

  1. FERPO: Forward Entropy-Regularized Policy Optimization

    Oct 1, 2026Sebastian Sanokowski, Alireza Sarmadi, Majid KhadivEntropy Regularized Reinforcement LearningOffline Reinforcement Learning

    Applied and Theoretical Aspects of Robot Intelligence (ATARI) Lab, Munich Institute of Robotics and Machine Intelligence (MIRMI), Technical University of Munich

  2. Bellman Meets Lyapunov: Unsupervised Reinforcement Learning via Mastering Chaos

    Oct 1, 2026Tristan Shah, Wooyoung Chung, Volodomyr Makarenko +2Offline Reinforcement LearningReward Functions

    Texas Tech University · Purdue University

  3. Token-Level Video Reinforcement Learning

    Oct 1, 2026Yifan Wang, Gordon Guocheng Qian, Yanyu Li +2Frozen Vision-Language ModelsOffline Reinforcement Learning

    Northeastern University

  4. Q-Learning for Reachability in MEC-Free MDPs

    Oct 1, 2026Lu-Chin Chang, Suguman BansalQ-LearningMarkov Decision Processes

    Georgia Institute of Technology

  5. Function-Structured Reinforcement Learning with Executable Verifiers for Mathematical Reasoning

    Oct 1, 2026Zihan Liu, Xurong XieMathematical ReasoningReinforcement Learning With Verifiable Reward

    Department of Computer Science, University College London, UK · Institute of Software, Chinese Academy of Sciences, China

  6. Continual Reinforcement Learning with Neuroevolution

    Oct 1, 2026Eleni Nisioti, Andrea Cossu, Kathrin Korte +1NeuroevolutionPlasticity

    IT University of Copenhagen · University of Pisa · Sakana AI

  7. Towards Optimal Policy Improvement

    Oct 1, 2026Yaniv Oren, Viliam Vadocz, Wiktor Zabka +7Boltzmann PoliciesMarkov Decision Processes

    Department of Intelligent Systems, TU Delft · Centrum Wiskunde & Informatica, Amsterdam · Department of Computer Science, ETH Zürich +3

  8. Flow Matching Reinforcement for 3D Mesh Generation via Dynamic Homing Optimization

    Oct 1, 2026Zhen Zhou, Zhiwei Ning, Puhua Jiang +6MeshesGeometric Guidance

    Tencent Hunyuan · Shanghai Jiao Tong University · Communication University of China

  9. Does Scaling Reinforcement Learning Really Require More Training?

    Oct 1, 2026Bangji Yang, Jiajun Fan, Hongbo Ma +2Offline Reinforcement LearningSequential Scaling

    University of Illinois at Urbana-Champaign · Tsinghua University

  10. eRLT: Efficient VLA Reinforcement Learning via Action-Relevant Token Routing

    Oct 1, 2026Dehao Huang, Jianbang Liu, Jianpan Gao +7Diffusion-Based Vision-Language-ActionsOffline Reinforcement Learning

    Southern University of Science and Technology, Shenzhen, China. · Beijing Zhongguancun Academy, Beijing, China. · Samsung Robotics eXperience. +2

  11. Scalable Multi-Task Inverse Reinforcement Learning

    Sep 30, 2026Allen Tran, Jia Wan, Nathan Kallus +1Multi-Turn Reinforcement LearningOffline Reinforcement Learning

    Netflix · Massachusetts Institute of Technology · Cornell Tech

  12. ALER: Adaptive Learnable Experience Rewriting for Reinforcement Learning

    Sep 30, 2026Oleg Shchendrigin, Egor Cherepanov, Aleksandr I. Panov +1Prioritized Experience ReplayOffline Reinforcement Learning

    Innopolis University, Innopolis, Russia · MIRIAI, Moscow, Russia · Cognitive AI Systems Lab, Moscow, Russia

  13. Reinforcement Learning-Guided Graph Transformations for SpTRSV Optimization

    Sep 30, 2026Buse YılmazMultiplex Graph TransformersGraph Edge Sparsification

    Department of Computer Engineering, MEF University, Huzur, Maslak Ayazağ̆a Cd., İstanbul, Turkey.

  14. Role-Adaptive Policy Optimization for Offline Reinforcement Learning

    Sep 30, 2026Seonvin Cho, Soohyun Choi, Songnam HongFrictive Policy OptimizationOffline Reinforcement Learning

    Department of Electronic Engineering, Hanyang University Seoul, Republic of Korea

  15. CATCH: A Controllable Analysis Testbed for Reward Hacking in Coding RL

    Sep 30, 2026Shouli Wang, Yanfeng Jia, Zhihao Ou +6Reinforcement Learning With Verifiable RewardOffline Reinforcement Learning

    Tsinghua University · Beihang University · Southern University of Science and Technology +2

  16. MatrixReward: Reward from Rubric Matrix for Open-Ended Generation

    Sep 30, 2026Zihan Shen, Qi Liu, Zixuan Yang +4Reward SignalReasoning Benchmark

    Zhejiang University · Qwen Business Unit of Alibaba · Renmin University of China

  17. CAST: Causal Advantage-Structured Training with Spatially Grounded Compositional Rewards for Diffusion Models

    Sep 30, 2026Shu Yu, Chaochao LuDiffusion ModelsImage Generation

    Shanghai Artificial Intelligence Laboratory, Shanghai, China · Shanghai Innovation Institute, Shanghai, China · Fudan University, Shanghai, China

  18. Aligning Thoughts with Answers: Probability Rewards to Tame Thinking Drift

    Sep 30, 2026Pengzhan Sun, Shiu-hong Kao, Shijie Li +4Weak Visual GroundingOffline Reinforcement Learning

    National University of Singapore · A*STAR Institute of Advanced Intelligence and Computing, Singapore · South China University of Technology +2

  19. Frame Differential On-Policy Self-Distillation for Video Reasoning

    Sep 30, 2026Haiying He, Xin Zheng, Shaoli Hu +4Unsupervised On-Policy Self-DistillationOffline Reinforcement Learning

    HKUST · NKU · SEU +1

  20. Loop-Free Inverse Reinforcement Learning via Sequential Value Recovery with Q-Score Matching

    Sep 30, 2026Yang chen, Yitan Zhang, Michael Witbrock +1Offline Reinforcement LearningValue Functions

    Shanghai Artificial Intelligence Laboratory · University of Auckland

  21. Robust Risk-Sensitive Reinforcement Learning from Corrupted Human Feedback

    Sep 30, 2026Xinyi Ni, Lifeng LaiReinforcement Learning From Human FeedbackConditional-Value-At-Risk

    Department of Electrical and Computer Engineering, University of California, Davis, CA 95616, USA

  22. PRICE the Action Chunks: Physical Relational Credit Assignment for Embodied Reinforcement Learning

    Sep 30, 2026Yangang Zou, Jiajun Lu, Weitao Zhou +6Offline Reinforcement LearningCredit Assignment

    School of Data Science, Fudan University · Shanghai Innovation Institute · Beihang University +4

  23. DODGER: Safety-Guided Reinforcement Learning for Robot Navigation Among Dynamic Obstacles

    Sep 30, 2026Sanghyuk Park, Kwanwoo Lee, Taekyung Kim +2Obstacle AvoidanceRobot Navigation

    Department of Intelligence and Information, Seoul National University, Republic of Korea · Department of Robotics, University of Michigan, Ann Arbor, MI, USA · Department of Mechanical Engineering, Yonsei University, Republic of Korea +1

  24. Reinforcement Learning with Complex (valued) Memories

    Sep 29, 2026Sathya Kamesh Bhethanabhotla, Efstratios Gavves, André BiedenkappRecurrent Neural NetworksOffline Reinforcement Learning

    University of Freiburg

  25. Learning to Prove, Not Just to Answer: Reinforcement Learning from Formal Verification for Natural-Language Logical Reasoning

    Sep 29, 2026Qili Zhang, Qianren Mao, Hanze Cai +11LLM Reasoning StrategiesReasoning Benchmark

    Zhongguancun Laboratory · Beihang University · Nanyang Technological University +1

  26. Adaptive Reward Routing: Dynamic Multi-Reward Optimization for Joint Audio-Video Diffusion via Forward-Process RL

    Sep 29, 2026Songlin Yang, Xiaotong Zhao, Jiacheng Zhang +5Diffusion-Based Reinforcement Learning MethodsDiffusion Alignment

    Tencent Video · The University of Hong Kong

  27. ReF-HIL: Shaping the Critic around Human Action Neighborhoods for Efficient Human-in-the-Loop Reinforcement Learning

    Sep 29, 2026Shaoyin Luo, Song Wang, Shibo Xia +5Reinforcement Learning From Human FeedbackHuman-In-The-Loop

    Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China

  28. Physics-Informed Multi-Agent Coordination for Hospital Patient Flow Optimization

    Sep 29, 2026Guoqing Zhang, Rafik Hadfi, Takayuki ItoMulti-Agent CoordinationQueue Control

    Graduate School of Informatics, Kyoto University, Kyoto, Japan

  29. Diffusion Policy Improvement with Proposal-Conditioned Refinement Flows

    Sep 29, 2026Junhyun Ha, Juho Lee, Byoungwoo ParkFlow PoliciesDiffusion-Based Reinforcement Learning Methods

    KAIST

  30. Inducing Process Supervision from Outcome-Only Reinforcement Learning

    Sep 29, 2026Shengda Fan, Xin Cong, Zhong Zhang +2Process Reward ModelProcess-Level Supervision

    Renmin University of China · Tsinghua University · University of Electronic Science and Technology of China +1

  31. Multi-Channel Mitigation of Source-Trust Shortcuts in Fact-Checking RL Agents

    Sep 29, 2026Jianchang Su, Yiwei Yang, Wei ZhangFact-CheckingAI Trustworthiness

    University of Connecticut · University of California, Santa Cruz

  32. DORA: Divergence-Oriented Data-Relay Algorithm for Partially Connected Robot Teams

    Sep 28, 2026Jonathan Diller, Fernando Cladera, Camillo Jose Taylor +1Multi-UavHuman-Centric Mission Planning

    GRASP Laboratory, University of Pennsylvania, Philadelphia, PA 19104, USA

  33. Reward-rate Policy Gradient for Efficient Machine Learning Engineering Agents

    Sep 28, 2026Muhang Tian, Sherry YangReward-Only Policy Optimization VariantsAgentic Reinforcement Learning

    New York University

  34. StructRL: Online Structured Reinforcement Learning for Long-Horizon Vision-Language-Action Tasks

    Sep 28, 2026Ziyi Yin, Sangmin Woo, Kang Zhou +4Long-Horizon ManipulationOffline Reinforcement Learning

    The Pennsylvania State University · Work done during an internship at Amazon · Amazon AWS AI

  35. Fully Decentralized and Safety-Aware Multi-Agent Reinforcement Learning for Control on Networks

    Sep 28, 2026Theodore Rogalski, Shirantha WelikalaMulti-Agent Reinforcement LearningOffline Reinforcement Learning

    Electrical & Computer Engineering Department Stevens Institute of Technology Hoboken, USA

  36. ChronoSRL: Temporal Geometry for Self-Supervised Reinforcement Learning

    Sep 28, 2026Nico Bohlinger, Jan PetersGoal-Conditioned Reinforcement LearningOffline Reinforcement Learning

    Technical University of Darmstadt, Germany · Robotics Institute Germany (RIG); German Research Center for AI (DFKI); hessian.AI

  37. X-Reset: Scaling Object-Centric Reinforcement Learning via Cross-Embodiment Resets

    Sep 28, 2026Prithwish Dan, Chenyang Ma, Wei ZhanRobotic Manipulation PoliciesOffline Reinforcement Learning

    Applied Intuition · University of North Carolina at Chapel Hill · University of California, Berkeley

  38. An RL View of OPD: Least Square Policy Distillation for Sample-Efficient LLM Reasoning

    Sep 28, 2026Shangzhe Li, Yuxiao Yang, Tianrun Yu +4LLM Reasoning StrategiesOffline Reinforcement Learning

    University of North Carolina at Chapel Hill · Brigham Young University · NVIDIA

  39. Scalable In-Context Reinforcement Learning with Recurrent Algorithm Distillation

    Sep 28, 2026Yuanqing Ma, Zhenrui Zheng, Chenjun XiaoOffline Reinforcement Learning

    The Chinese University of Hong Kong, Shenzhen

  40. PIVOT: Pivot-Aware On Policy Self Distillation for Multi-Turn VLM Agents

    Sep 28, 2026Jiazhou Zhou, Hu Zhou, Yucheng Chen +3Reinforcement Learning With Verifiable RewardOffline Reinforcement Learning

    AI Thrust, The Hong Kong University of Science and Technology (Guangzhou) · International Digital Economy Academy (IDEA) · The Hong Kong Polytechnic University +2

  41. SIPO: Selective-Inference Policy Optimization for Tree-Structured Agentic RL

    Sep 28, 2026Zenghuang Fu, Ningqi Chen, Mingda Jia +10Frictive Policy OptimizationAgentic Reinforcement Learning

    University of Chinese Academy of Sciences · Institute of Automation, Chinese Academy of Sciences · The University of Hong Kong +4

  42. Unified Trajectory Matching Policy Optimization: Diverse T2I Generation and VLA Generalization

    Sep 28, 2026Zhiyuan Ma, Jiaming Li, Lingzhen Li +7Text-To-ImageOffline Reinforcement Learning

    School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, China

  43. Summarize Before Grounding: Query-Guided Chunk Condensation for Long-Video Temporal Grounding

    Sep 28, 2026Nanxing Hu, Xiaoyue Duan, Qiwei Yan +3Video Temporal GroundingTemporal Grounding

    Beihang University · University of the Chinese Academy of Sciences · Institute of automation, Chinese academy of science

  44. Deep Weighted Bellman Residual Minimization for Q∗Q^* Estimation

    Sep 28, 2026Lican Kang, Jerry Zhijian Yang, Cheng Yuan +1Offline Reinforcement LearningBellman Equation

    Institute for Math and AI, Wuhan University, Wuhan, 430072, China · Hubei Key Laboratory of Computational Science, Wuhan University, Wuhan, 430072, China · School of Artificial Intelligence, Wuhan University, Wuhan, 430072, China +1

  45. Verifying Neural Networks with Reinforcement Learning

    Sep 28, 2026Hai Duong, Thanh Le, ThanhVu NguyenNeural Network VerificationReinforcement Learning With Verifiable Reward

    Department of Computer Science George Mason University Fairfax, VA, USA · Unaffiliated Yokosuka, Japan

  46. FlexLoop: Depth-Elastic Looped Policies for Adaptive Test-Time Computation in Deep RL

    Sep 28, 2026Xun Wang, Ruishuo Chen, Yu Chen +2Offline Reinforcement LearningLoop

    Institute for Interdisciplinary Information Sciences, Tsinghua University

  47. Model-Informed Safe Reinforcement Learning for Bipedal Locomotion via Step-to-Step Prediction

    Sep 28, 2026Victor Paredes, Ayonga HereidScalable Robot LearningGait Dynamics

    Mechanical and Aerospace Engineering, The Ohio State University, Columbus, OH, USA.

  48. DORA: Dynamic Online Reinforcement Agent for Token Pruning in Vision Transformers

    Sep 28, 2026Kaixuan He, Song Chen, Yi KangVisual Token PruningVision Transformer

    University of Science and Technology of China, Hefei, China · Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Hefei, China

  49. Evolving Support Priorities in Empathetic Reinforcement Learning

    Sep 28, 2026Pengyu Huang, Zhiyuan Han, Wenwen Tong +6EmpathyReinforcement Learning From Human Feedback

    University of Science and Technology of China, Hefei, China · SenseTime Research, Shanghai, China · Institute of Artificial Intelligence, Hefei Comprehensive National Science Center

  50. Evolution of fairness in multi-objective reinforcement learning framework

    Sep 28, 2026Jingyi Zhang, Xin Ou, Guozhong Zheng +3Game TheoryMulti-Objective Reinforcement Learning

    School of Physics and Information Technology, Shaanxi Normal University, Xi’an 710061, P. R. China · School of Physical Science and Technology, Inner Mongolia University, Hohhot 010021, China · School of Physics, Ningxia University, Yinchuan 750021, P. R. China

  51. Counterfactual Rollout Replay: Forkable Environments as Free Process Rewards for Software Engineering Agents

    Sep 27, 2026Yuanhao Li, Hongbo Wang, Xuhong Chen +2Counterfactual LearningSoftware Engineering

    State Key Laboratory of Networking and Switching Technology Beijing University of Posts and Telecommunications, Beijing 100876, China · University of Luxembourg, Luxembourg

  52. QwenGyre: An Elastic Reinforcement Learning Framework for Training xLong-Horizon Agents

    Sep 27, 2026Weiqi Wang, Yuxin Zhou, Mouxiang Chen +9Large Language Model Reinforcement LearningOffline Reinforcement Learning

    Alibaba Token Hub, Alibaba Group · University of Science and Technology of China · Tsinghua University

  53. Reliable Replay through Spatial Coherence in Online Continual Learning

    Sep 27, 2026Haixiang Sun, Jiefu Zhang, Yinghao He +4Prioritized Experience ReplayReplay-Based Continual Learning

    Purdue University West Lafayette, IN 47907, USA

  54. Climbing the Hill: Prompt Injection Red-Teaming Against Frontier Models with Curriculum Reinforcement Learning

    Sep 27, 2026Chenlong Yin, Xiaolong Jin, Wei Zou +2Attacker Large Language ModelRed-Teaming

    The Pennsylvania State University · Purdue University

  55. Safe Score Matching: Diffusion Policies with Hamilton-Jacobi Reachability for Online Safe Reinforcement Learning

    Sep 27, 2026Boyang Li, Matthew Kim, Sylvia Lee HerbertHamilton-Jacobi ReachabilitySafety Constraints

    University of California San Diego

  56. Temporal Gradient Inversion for Private Trajectory Reconstruction in Embodied Reinforcement Learning

    Sep 24, 2026Sudip Bhujel, Shanghao Shi, Ruiquan Huang +2Gradient-Based AttacksOffline Reinforcement Learning

    Department of Computer Science, University of Kentucky · Department of Computer Science and Engineering, Washington University in St. Louis

  57. PoEM: Predicting RL Outcomes from Existing Policies

    Sep 24, 2026Kimia Hamidieh, Giannis Daras, Antonio TorralbaOffline Reinforcement LearningPoetry

    MIT CSAIL

  58. MQSS-Selector: RL-Guided Pass Selection for an MLIR Compilation Pipeline

    Sep 24, 2026Andre Youssefi, Ercüment Kaya, Minh Chung +3Offline Reinforcement LearningSoftware

    Leibniz Supercomputing Centre · Technical University of Munich · Munich Quantum Valley +1

  59. Rufus-Air: An Open LLM Post-Training Recipe

    Sep 24, 2026Chia-Yuan Chang, Renyuan Cheng, Rui Feng +19Post-TrainingOffline Reinforcement Learning

    Amazon

  60. Right Choice of Classification Algorithms Based on Reinforcement Learning for Prediction of Non-Alcoholic Fatty Liver

    Sep 24, 2026Hasan Samadbin, Arman DaliriCholangiocarcinomaClassifier

    Department of Computer Engineering, Karaj Branch, Islamic Azad University, Karaj, Iran