Offline Reinforcement Learning

Ask about this topic

Momentum

121 papers in the last four weeks, up 267% on the four weeks before. 1.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 778

All topics
CardsList

  1. Beyond Chain-of-Thought: Rewrite as a Universal Interface for Generative Multimodal Embeddings

    Apr 24, 2026Peixi Wu, Ke Mei, Feipeng Ma +15Multimodal EmbeddingsRewrite

    WeChat Vision, Tencent Inc. · Zhejiang University · Tsinghua University +1

  2. Preserve Support, Not Correspondence: Dynamic Routing for Offline Reinforcement Learning

    Apr 24, 2026Zhancun Mu, Guangyu Zhao, Yiwu Zhong +1Offline Reinforcement LearningGoal-Conditioned Value Function

    School of Intelligence Science and Technology, Peking University

  3. When Policies Cannot Be Retrained: A Unified Closed-Form View of Post-Training Steering in Offline Reinforcement Learning

    Apr 23, 2026Elias Hossain, Mohammad Jahid Ibna Basher, Ivan Garibay +2Off-Policy LearningOffline Reinforcement Learning

    College of Engineering and Computer Science University of Central Florida, Orlando, FL, USA

  4. Parallel-SFT: Improving Zero-Shot Cross-Programming-Language Transfer for Code RL

    Apr 22, 2026Zhaofeng Wu, Shiqi Wang, Boya Peng +5Cross-Lingual TransferOffline Reinforcement Learning

    Meta Superintelligence Labs · MIT

  5. V-tableR1: Process-Supervised Multimodal Table Reasoning with Critic-Guided Policy Optimization

    Apr 22, 2026Yubo Jiang, Yitong An, Xin Yang +7Multimodal ReasoningVisual Reasoning

    School of Astronautics, Beihang University, Beijing 102206, China · Longcat Interaction Team, Meituan, Beijing 100102, China · Tianmushan Laboratory, Beihang University, Hangzhou 311115, China

  6. Maximum Entropy Semi-Supervised Inverse Reinforcement Learning

    Apr 22, 2026Julien Audiffren, Michal Valko, Alessandro Lazaric +1Offline Reinforcement Learning

    1CMLA, ENS Cachan · 2SequeL team, INRIA Lille - Nord Europe · 3Adobe Research

  7. Efficient Reinforcement Learning using Linear Koopman Dynamics for Nonlinear Robotic Systems

    Apr 21, 2026Wenjian Hao, Yuxuan Fang, Zehui Lu +1Model-Based Reinforcement LearningKoopman Operator

    School of Aeronautics and Astronautics, Purdue University, West Lafayette, IN 47907, USA · independent researcher

  8. Visual Reasoning through Tool-supervised Reinforcement Learning

    Apr 21, 2026Qihua Dong, Gozde Sahin, Pei Wang +4Visual ReasoningRecent Vision-Language Models

    1Northeastern University · 2Amazon AGI

  9. Safe Continual Reinforcement Learning in Non-stationary Environments

    Apr 21, 2026Austin Coursey, Abel Diaz-Gonzalez, Marcos Quinones-Grueiro +1Reinforcement Learning ControlSafety Constraints

    Institute for Software Integrated Systems, Vanderbilt University

  10. FASTER: Value-Guided Sampling for Fast RL

    Apr 21, 2026Perry Dong, Alexander Swerdlow, Dorsa Sadigh +1Diffusion-Based Reinforcement Learning MethodsOffline Reinforcement Learning

    Stanford University

  11. Pause or Fabricate? Training Language Models for Grounded Reasoning

    Apr 21, 2026Yiwen Qiu, Linjuan Wu, Yizhou Liu +9LLM Reasoning StrategiesTool-Grounded Reasoning

    1Zhejiang University · 2Tencent · 3Xiaohongshu Inc.

  12. RL-ABC: Reinforcement Learning for Accelerator Beamline Control

    Apr 21, 2026Anwar Ibrahim, Fedor Ratnikov, Maxim Kaledin +2Reinforcement Learning ControlOffline Reinforcement Learning

  13. CXRMate-2: Structured Multimodal Temporal Embeddings and Tractable Reinforcement Learning for Clinically Acceptable Chest X-ray Radiology Report Generation

    Apr 21, 2026Aaron Nicolson, Elizabeth J. Cooper, Hwan-Jin Yoon +7Chest X-RayRadiology Report Generation

    Australian e-Health Research Centre, CSIRO Health and Biosecurity, Brisbane & Melbourne, Australia · Princess Alexandra Hospital, Metro South Health, Brisbane, Australia · Queensland Digital Health Centre, University of Queensland, Brisbane, Australia +2

  14. Bounded Ratio Reinforcement Learning

    Apr 20, 2026Yunke Ao, Le Chen, Bruce D. Lee +5Proximal Policy OptimizationOffline Reinforcement Learning

    ETH Zurich · MPI for Intelligent Systems · University of Alberta +2

  15. Different Paths to Harmful Compliance: Behavioral Side Effects and Mechanistic Divergence Across LLM Jailbreaks

    Apr 20, 2026Md Rysul Kabir, Zoran TiganjLarge Language Model JailbreaksJailbreaks

    Department of Computer Science Luddy School of Informatics, Computing, and Engineering Indiana University Bloomington

  16. StepPO: Step-Aligned Policy Optimization for Agentic Reinforcement Learning

    Apr 20, 2026Daoyu Wang, Qingchuan Li, Mingyue Cheng +4Agentic Reinforcement LearningFrictive Policy Optimization

    State Key Laboratory of Cognitive Intelligence, University of Science and Technology of China

  17. LiteResearcher: A Scalable Agentic RL Training Framework for Deep Research Agent

    Apr 20, 2026Wanli Li, Bince Qu, Bo Pan +5Agentic Reinforcement LearningDeep Research

    Zhejiang University · Simplex AI · The Hong Kong Polytechnic University

  18. Internalizing Outcome Supervision into Process Supervision: A New Paradigm for Reinforcement Learning for Reasoning

    Apr 19, 2026Fei Ding, Yongkang Zhang, Runhao Liu +4Process Reward ModelProcess-Level Supervision

    Alibaba Group · Tsinghua University

  19. Web-Gewu: A Browser-Based Interactive Playground for Robot Reinforcement Learning

    Apr 18, 2026Kaixuan Chen, Linqi YeScalable Robot LearningEmbodied Artificial Intelligence

    School of Future Technology, Shanghai University, Shanghai 200444, China

  20. NaviFormer: A Deep Reinforcement Learning Transformer-like Model to Holistically Solve the Navigation Problem

    Apr 18, 2026Daniel Fuertes, Andrea Cavallaro, Carlos R. del-Blanco +2Path PlanningOffline Reinforcement Learning

    Grupo de Tratamiento de Im´agenes, Information Processing and Telecommunications Center, ETSI Telecomunicaci´on, Universidad Polit´ecnica de Madrid, 28040 Madrid, Spain · Idiap Research Institute, Martigny, Switzerland

  21. EasyVideoR1: Easier RL for Video Understanding

    Apr 18, 2026Chuanyu Qin, Chenxu Yang, Qingyi Si +6Video UnderstandingOffline Reinforcement Learning

    Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China · School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China

  22. Debate as Reward: A Multi-Agent Reward System for Scientific Ideation via RL Post-Training

    Apr 17, 2026Moein Salimi, Babak Hosseini Mohtasham, Amin Aghakasiri +6Scientific IdeationLarge Language Model Reinforcement Learning

    Sharif University of Technology · University of Tehran · Sharif University of Technology[cs.AI]

  23. DARLING: Detection Augmented Reinforcement Learning with Non-Stationary Guarantees

    Apr 17, 2026Argyrios Gerogiannis, Yu-Han Huang, Venugopal V. VeeravalliModel-Free Reinforcement LearningOffline Reinforcement Learning

    ECE and CSL, The Grainger College of Engineering University of Illinois at Urbana-Champaign

  24. Safe Deep Reinforcement Learning for Building Heating Control and Demand-side Flexibility

    Apr 17, 2026Colin Jüni, Mina Montazeri, Yi Guo +3Hvac ControlDemand Response

    Urban Energy Systems Laboratory, Swiss Federal Laboratories for Materials Science and Technology, Dubendorf, Switzerland. · School of Automation, Beijing Institute of Technology, Haidian District, Beijing, China · Reliability and Risk Engineering Laboratory, ETH Zürich, CH-8092, Switzerland.

  25. Fuzzy Logic Theory-based Adaptive Reward Shaping for Robust Reinforcement Learning (FARS)

    Apr 17, 2026Hürkan Şahin, Van Huyen Dang, Erdi Sayar +2Potential-Based Reward ShapingOffline Reinforcement Learning

    Automatic Control Group (RAT), Paderborn University, 33098 Paderborn, Germany

  26. Flexible Empowerment at Reasoning with Extended Best-of-N Sampling

    Apr 17, 2026Taisuke KobayashiStochastic ExplorationOffline Reinforcement Learning

    National Institute of Informatics and The Graduate University for Advanced Studies, SOKENDAI Japan

  27. RAD-2: Scaling Reinforcement Learning in a Generator-Discriminator Framework

    Apr 16, 2026Hao Gao, Shaoyu Chen, Yifan Zhu +4Diffusion PlanningAutonomous Driving

    Huazhong University of Science & Technology · Horizon Robotics

  28. Beyond Single-Model Optimization: Preserving Plasticity in Continual Reinforcement Learning

    Apr 16, 2026Lute Lillo, Nick CheneyReplay-Based Continual LearningOffline Reinforcement Learning

    Department of Computer Science University of Vermont USA

  29. RL-STPA: Adapting System-Theoretic Hazard Analysis for Safety-Critical Reinforcement Learning

    Apr 16, 2026Steven A. Senczyszyn, Timothy C. Havens, Nathaniel Rice +3HazardOffline Reinforcement Learning

    Michigan Technological University · ARiA · DEVCOM

  30. WavAlign: Enhancing Intelligence and Expressiveness in Spoken Dialogue Models via Adaptive Hybrid Post-Training

    Apr 16, 2026Yifu Chen, Shengpeng Ji, Qian Chen +9Speech Language ModelsPreference Alignment Learning

    Zhejiang University · Tongyi Fun Team, Alibaba Group · Beijing University of Technology

  31. Mean Flow Policy Optimization

    Apr 16, 2026Xiaoyi Dong, Xi Sheryl Zhang, Jian ChengFlow PoliciesDiffusion-Based Reinforcement Learning Methods

    C2DL, Institute of Automation, Chinese Academy of Sciences · School of Artificial Intelligence, University of Chinese Academy of Sciences · AiRiA +1

  32. NetForge RL: A Multi-Agent Simulation Environment for Cyber Defense with Durative Actions

    Apr 10, 2026Igor JankowskiCybersecurityMulti-Agent Simulations

  33. TensorHub: Scalable and Elastic Weight Transfer for LLM RL Training

    Apr 10, 2026Chenhao Ye, Huaizheng Zhang, Mingcong Han +11Large Language Model Reinforcement LearningOffline Reinforcement Learning

    ByteDance Seed · University of Wisconsin–Madison

  34. Less Data Approximates More: Earning Faithful Confidence in High-Stakes Domains

    Apr 9, 2026Haokai Ma, Lee Yan Zhen, Gang Yang +4Supervised FinetuningFaithfulness

    National University of Singapore, Singapore · Singapore Management University, Singapore

  35. RefineRL: Advancing Competitive Programming with Self-Refinement Reinforcement Learning

    Apr 1, 2026Shaopeng Fu, Xingxing Zhang, Li Dong +1Large Language Model Reinforcement LearningLLM Reasoning Strategies

    Work done during an internship at Microsoft Research · KAUST · Microsoft Research

  36. TIR-Agent: Training an Explorative and Efficient Agent for Image Restoration

    Mar 29, 2026Guoli Jia, Yisheng Zhang, Haote Hu +11Image RestorationOffline Reinforcement Learning

    Tsinghua University, Beijing, China · Data Science & Artificial Intelligence Research Institute, China Unicom, Beijing, China · Hunan University, Changsha, China +2

  37. End-to-End Efficient RL for Linear Bellman Complete MDPs with Deterministic Transitions

    Mar 24, 2026Zakaria Mhammedi, Alexander Rakhlin, Nneka OkoloMarkov Decision ProcessesBellman Equation

    Google Research, NYC · MIT

  38. Learning to Remember: Attentive Reinforcement Learning for Edge Serverless Autoscaling

    Mar 21, 2026Faraz Shaikh, Gianluca Reali, Mauro FemminellaEdge PlatformsRate Scaling

    Department of Engineering, University of Perugia, Perugia, Italy · Consorzio Nazionale Interuniversitario per le Telecomunicazioni (CNIT), 43124 Parma, Italy

  39. SutureFormer: Learning Surgical Trajectories via Goal-conditioned Offline RL in Pixel Space

    Mar 19, 2026Huanrong Liu, Chunlin Tian, Tongyu Jia +8Surgical RobotsImitation Learning

    Faculty of Science and Technology, University of Macau, Macau, China · University of Macau Advanced Research Institute in Hengqin, Zhuhai, China · Senior Department of Urology, The Chinese PLA General Hospital, Beijing, China +4

  40. Complementary RL: Towards Efficient Experience-Driven Agent Learning

    Mar 18, 2026Dilxat Muhtar, Jiashun Liu, Wei Gao +8Offline Reinforcement LearningReinforcement Learning Baseline

    Alibaba Group · HKUST

  41. RL unknotter, hard unknots and unknotting number

    Mar 9, 2026Anne Dranowski, Yura Kabkov, Daniel TubbenhauerOffline Reinforcement LearningUpper Bounds

  42. Learning When to Trust in Contextual Social Bandits

    Mar 9, 2026Majid Ghasemi, Mark CrowleyContextual Bandit FrameworkAI Trustworthiness

    Department of Electrical & Computer Engineering University of Waterloo, Canada

  43. Relating Reinforcement Learning to Dynamic Programming-Based Planning

    Mar 8, 2026Filip V. Georgiev, Kalle G. Timperi, Başak Sakçak +1Offline Reinforcement LearningSequential Decision Making

    Center for Applied Computing, Faculty of Information Technology and Electrical Engineering, University of Oulu, Finland · Dept. of Advanced Computing Sciences, Maastricht University, the Netherlands

  44. Expert Knowledge-driven Reinforcement Learning for Autonomous Racing via Trajectory Guidance and Dynamics Constraints

    Mar 6, 2026Bo Leng, Weiqi Zhang, Zhuoren Li +4Autonomous RacingAutonomous Driving

    College of Automotive and Energy Engineering, Tongji University, Shanghai, 201804, China · School of Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore, 639798, Singapore

  45. Latent Policy Steering through One-Step Flow Policies

    Mar 5, 2026Hokyun Im, Andrey Kolobov, Jianlong Fu +1Model-Based Reinforcement LearningFlow Policies

    Department of Artificial Intelligence, Yonsei University · Microsoft Research

  46. Conservative Equilibrium Discovery in Offline Game-Theoretic Multiagent Reinforcement Learning

    Feb 27, 2026Austin A. Nguyen, Michael P. WellmanEquilibriumModel-Based Reinforcement Learning

    University of Michigan

  47. EMO-R3: Reflective Reinforcement Learning for Emotional Reasoning in Multimodal Large Language Models

    Feb 27, 2026Yiyang Fang, Wenke Huang, Pei Fu +5Multimodal Large Language ModelsEmotion Recognition

    School of Computer Science, Wuhan University. · MiLM Plus, Xiaomi Inc.

  48. A Model-Free Universal AI

    Feb 26, 2026Yegon Kim, Juho LeeModel-FreeOffline Reinforcement Learning

    Graduate School of AI, KAIST, Seoul, South Korea

  49. TabSieve: Explicit In-Table Evidence Selection for Tabular Prediction

    Feb 12, 2026Yongyao Wang, Ziqi Miao, Lu Yang +4Tabular LearningOffline Reinforcement Learning

    Gaoling School of Artificial Intelligence, Renmin University of China · Shanghai AI Laboratory

  50. Dr. MAS: Stable Reinforcement Learning for Multi-Agent LLM Systems

    Feb 9, 2026Lang Feng, Longtao Zheng, Shuo He +2Multi-Agent Large Language Model SystemsLarge Language Model Reinforcement Learning

    Nanyang Technological University, Singapore

  51. High-Speed Vision-Based Flight in Clutter with Safety-Shielded Reinforcement Learning

    Feb 9, 2026Jiarui Zhang, Chengyong Lei, Chengjiang Dai +4QuadrotorObstacle Avoidance

    Institute of Cyber-Systems and Control, College of Control Science and Engineering, Zhejiang University, Hangzhou 310027, China · Differential Robotics, Hangzhou 311121, China.

  52. rePIRL: Learn PRM with Inverse RL for LLM Reasoning

    Feb 8, 2026Xian Wu, Kaijie Zhu, Ying Zhang +2Process Reward ModelLarge Language Model Reinforcement Learning

    Meta AI · Department of Computer Science, University of California, Santa Barbara · Independent Researcher +1

  53. An evidence-guided reinforcement learning method to improve psychiatric reasoning in small language models

    Feb 6, 2026Xinxin Lin, Guangxin Dai, Yi Zhong +25Clinical Reasoning TrainingMental Health

    The Chinese University of Hong Kong, Shatin, N.T., Hong Kong SAR, China · Shandong University, Jinan, China · Peking University Sixth Hospital, Beijing, China +6

  54. CodeScaler: Scaling Code LLM Training and Test-Time Inference via Reward Models

    Feb 4, 2026Xiao Zhu, Xinyu Zhou, Boyu Zhu +5Test-Time ScalingLarge Language Model Training

    LARK, HKUST(GZ) · Kuaishou Technology · UCL +3

  55. Agile Reinforcement Learning through Separable Neural Architecture and Applications

    Jan 30, 2026Rajib Mostakim, Reza T. Batley, Sourav SahaOffline Reinforcement LearningDeep Learning Architectures

    Department of Mechanical Engineering, Bangladesh University of Engineering and Technology, Dhaka, Bangladesh · Kevin T. Crofton Department of Aerospace and Ocean Engineering, Virginia Polytechnic Institute and State University, Blacksburg, VA, USA

  56. Offline Reinforcement Learning of High-Quality Behaviors Under Robust Style Alignment

    Jan 30, 2026Mathieu Petitbois, Rémy Portelas, Sylvain LamprierGoal-Conditioned Reinforcement LearningGoal-Conditioned Value Function

    Ubisoft La Forge, Bordeaux, France · Université d’Angers, Angers, France

  57. Tracking Drift: Variation-Aware Entropy Scheduling for Non-Stationary Reinforcement Learning

    Jan 27, 2026Tongxi Wang, Zhuoyang Xia, Xinran Chen +1Entropy Regularized Reinforcement LearningOffline Reinforcement Learning

    School of Future Technology, Southeast University, Nanjing, China · School of Automation, Southeast University, Nanjing, China

  58. Reversible Simplex Supervision with Post-Action Debt Accounting for Goal-Reaching RL

    Jan 27, 2026Mehdi Heydari Shahna, Joongheon Kim, Jouni MattilaOffline Reinforcement Learning

    Faculty of Engineering and Natural Sciences, Tampere University, Tampere, Finland · Department of Electrical and Computer Engineering, Korea University, Seoul, Republic of Korea

  59. Teaching Models to Teach Themselves: Reasoning at the Edge of Learnability

    Jan 26, 2026Shobhita Sundaram, John Quan, Ariel Kwiatkowski +3Curriculum Reinforcement LearningSelf-Play

    1MIT · 2Meta FAIR · 3New York University

  60. ART for Diffusion Sampling: A Reinforcement Learning Approach to Timestep Schedule

    Jan 26, 2026Yilie Huang, Wenpin Tang, Xunyu ZhouTimestepDiffusion Sampling

    Department of Industrial Engineering and Operations Research, Columbia University, New York, NY 10027, USA. · Department of Industrial Engineering and Operations Research & Data Science Institute, Columbia University, New York, NY 10027, USA.