Offline-To-Online RL

RL: Reinforcement Learning

Follow this topic Ask about this topic

Momentum

5 papers in the last four weeks, up 67% on the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 40

All topics

Completion-Aware Cross-Fidelity Offline-to-Online Reinforcement Learning for Multi-Line Bus Holding
Sep 30, 2026Yifan Zhang, Qifan Zhang, Liang ZhengRL Control Reinforcement Learning
Central South University, Changsha, Hunan, China
Diffusion Policy Improvement with Proposal-Conditioned Refinement Flows
Sep 29, 2026Junhyun Ha, Juho Lee, Byoungwoo ParkPolicy Optimization Offline RL
KAIST
Visuomotor Robotic Pruning in Planar Orchards Using Hybrid Reinforcement Learning
Sep 21, 2026Abhinav Jain, Cindy Grimm, Stefan LeeVisuomotor Policy Learning Robotics
Collaborative Robotics and Intelligent Systems (CoRIS) Institute, Oregon State University, Corvallis OR 97331, USA
SCQ: Stabilizing Conservative Q-Learning with Sigmoid-Bounded Entropy
Sep 14, 2026Xiefeng Wu, Shu Zhang, Zhaojie Chu +1Robotic RL Offline RL
School of Computer Science, Wuhan University, Wuhan, China · School of Electronic Information, Wuhan University, Wuhan, China · School of Internet, Anhui University, Hefei, China
Real-World Reinforcement Learning with MPC Scaffolding for Dexterous Manipulation
Sep 14, 2026Emek Barış Küçüktabak, Karankumar Patel, Zhaodong Yang +3Dexterous Manipulation Contact-Rich Robotic Manipulation
Honda Research Institute USA, San Jose, CA, USA · Skild AI, San Mateo, CA, USA · Georgia Institute of Technology, Atlanta, GA, USA
From Prior-Guided Heuristics to Deployable Agents: Accelerating Demonstration-Driven Reinforcement Learning for Deadline-Constrained Network Control
Sep 3, 2026Vincenzo Norman Vitale, Mohammad Solki, Antonia Maria Tulino +2Learning from Demonstration Multi-Agent Reinforcement Learning
DIETI, University of Naples Federico II, Via Claudio 21, Naples, 80125, Italy · New York University, 6 MetroTech Center, Brooklyn, New York, 11201, USA · University of Southern California, 3740 McClintock Ave., Los Angeles, 90089, California, USA +2
Learning Loco-Manipulation From SMPC Demonstrations With Sparse Offline-to-Online RL
Aug 12, 2026Martin Schuck, Maks Sorokin, Simone Manni +5Robot Skill Learning Sparse-Reward RL
1RAI Institute · 2Technical University of Munich · ETH Zurich
Critic-Free Pretraining for Efficient Online Reinforcement Learning Fine-Tuning
Aug 11, 2026Daoyi Li, Yixian Zhang, Wenbo Ding +2Reinforcement Learning Critic-Free RL
Tsinghua University
Do You Really Need to Pretrain Q-Functions for Online RL Fine-Tuning?
Jul 29, 2026Perry Dong, Ron Polonsky, Dorsa Sadigh +1Continuous Control RL Fine-Tuning
Stanford University
A Unified Algorithmic Framework for Hybrid Reinforcement Learning in Tabular MDPs with Shifted Transition Dynamics
Jul 28, 2026Zheshun Wu, Renjie Zheng, Jinhang Zuo +2Non-Stationary RL Regret Minimization in RL
Southern University of Science and Technology · Harbin Institute of Technology, Shenzhen Shenzhen, Guangdong, China · Southern University of Science and Technology Shenzhen, Guangdong, China +4
Active Offline-to-Online Reinforcement Learning
Jul 13, 2026Alper Kamil Bozkurt, Shangtong Zhang, Yuichi MotaiOffline RL RL Fine-Tuning
Virginia Commonwealth University, USA · University of Virginia, USA
Robo-ValueRL: Reliable Value Estimation for Offline-to-Online Reinforcement Learning
Jul 10, 2026Wenke Xia, Pei Ren, Wenbo Yu +10Value Function Estimation Robotic Manipulation
1Gaoling School of Artificial Intelligence, Renmin University of China · 2Beijing Innovation Center of Humanoid Robotics · 3Beijing Forestry University +4
Pessimism's Paradox: Conservative Offline Training Amplifies Reward Hacking During Online Adaptation in Reasoning Models
Jun 29, 2026Subramanyam Sahoo, Aman Chadha, Vinija Jain +1Reward Modeling Reward Hacking
1Horizon Research · 2Apple · 3Meta +1
Beyond One-Size-Fits-All: Diagnosis-Driven Online Reinforcement Learning with Offline Priors
Jun 24, 2026Guozheng Ma, Lu Li, Zilin Wang +2Reinforcement Learning RL Post-Training
Nanyang Technical University · Mila - Quebec AI Institute · Université de Montréal +1
Supervised Reinforcement Learning for the Coordination of Distributed Energy Resources
Jun 23, 2026Haoyuan Deng, Yihong Zhou, Thomas Morstyn +1Reinforcement Learning RL Fine-Tuning
The University of Hong Kong, Hong Kong SAR, China · University of Oxford, Oxford, U.K. · The University of Hong Kong Shenzhen Institute of Research and Innovation, Shenzhen, China
Sim2O: Efficient Offline-to-Online MARL via Joint Action Composition
Jun 19, 2026Bingchang Song, Yiqin YangMulti-Agent Coordination Cooperative MARL
Department of Computer Science and Engineering, Washington University in St. Louis · The Key Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China
QPILOTS: Efficient Test-Time Q-Steering for Flow Policies
Jun 11, 2026Yifan Ruan, Chenyang Cao, Andreas Burger +7Inference-Time Optimization Diffusion Policy
University of Toronto · Vector Institute · LG Electronics
MODIP: Efficient Model-Based Optimization for Diffusion Policies
Jun 9, 2026Zakariae El Asri, Philippe Gratias-Quiquandon, Nicolas Thome +1Robot Policy Learning Robot Policy Adaptation
Sorbonne Université, CNRS, ISIR, F-75005 Paris, France · Institut Universitaire de France (IUF)
Q-VGM: Q-Guided Value-Gradient Matching for Offline-to-Online RL of Flow-Matching VLA Policies
Jun 6, 2026Ziqian Wang, Rui Zhang, Yitian Liu +3Flow Matching Visuomotor Policy Learning
Shanghai Jiao Tong University · University of Michigan, Ann Arbor
Efficient and Uncertainty-Aware Diffusion Framework for Offline-to-Online Reinforcement Learning
May 29, 2026Ha Manh Bui, Metod Jazbec, Eric Nalisnick +1Reinforcement Learning Diffusion Policy
Department of Computer Science, Johns Hopkins University, Baltimore, MD, U.S.A. · AMLab, University of Amsterdam, Amsterdam, Netherlands
BORA: Bridging Offline Reinforcement Learning and Online Residual Adaptation for Real-World Dexterous VLA Models
May 28, 2026Zhongxi Chen, Yifan Han, Bin Qiu +8Contact-Rich Robotic Manipulation Robotic Manipulation
Shanghai Jiao Tong University (SJTU) · CASIA · Shanghai AI Laboratory +1
Information-Directed Offline-to-Online Reinforcement Learning
May 28, 2026Keru ChenRegret Minimization in RL Bayesian RL
School of Electrical, Computer and Energy Engineering, Arizona State University
Moment Matching Q-Learning
May 27, 2026Yiyan, Liang, Sifei Liu +1Q-Learning Offline-To-Online RL
Edgar · School of Data and Information Science, University of North Carolina at Chapel Hill, Chapel Hill, USA.
Trust Region Q Adjoint Matching
May 26, 2026Yonghoon Dong, Kyungmin Lee, Changyeon Kim +2Reinforcement Learning KL-Regularized RL
1KAIST AI · 2Seoul National University · 3RLWRLD
Beyond Action Residuals: Real-World Robot Policy Steering via Bottleneck Latent Reinforcement Learning
May 19, 2026Dongjie Yu, Kun Lei, Zhennan Jiang +2Robot Policy Adaptation Reinforcement Learning
School of Computing and Data Science, The University of Hong Kong, Hong Kong SAR. · Shanghai Qizhi Institute, Shanghai, China. · Shanghai Jiao Tong University, Shanghai, China. +2
ARC-RL: A Reinforcement Learning Playground Inspired by ARC Raiders
May 19, 2026Carlo Romeo, Andrew D. BagdanovRL Benchmarks Robotics Simulation
Media Integration and Communication Center – University of Florence
COOPO: Cyclic Offline-Online Policy Optimization Algorithm
May 18, 2026Qisai Liu, Zhanhong Jiang, Joshua Russell Waite +3Offline RL Sample-Efficient RL
Department of Mechanical Engineering, Iowa State University, Ames, IA 50011, USA. · Department of Computer Science, Iowa State University, Ames, IA 50011, USA. · Translational AI Center, Iowa State University, Ames, IA 50011, USA.
ROAD: Adaptive Data Mixing for Offline-to-Online Reinforcement Learning via Bi-Level Optimization
May 14, 2026Letian Yang, Xu Liu, Yiqiang Lu +3Reinforcement Learning Offline-To-Online RL
Shanghai Jiao Tong University, Shanghai, China · Ant Group, Shanghai, China
Aligning Flow Map Policies with Optimal Q-Guidance
May 12, 2026Christos Ziakas, Alessandra Russo, Avishek Joey BoseFlow Matching Policy Optimization
Imperial College London · Mila
Discrete Flow Matching for Offline-to-Online Reinforcement Learning
May 12, 2026Fairoz Nower Khan, Nabuat Zaman Nahim, Peizhong JuFlow Matching Reinforcement Learning
Department of Computer Science, University of Kentucky

Sep 30, 2026, cs.AIJ/K move · Enter open · S save

Completion-Aware Cross-Fidelity Offline-to-Online Reinforcement Learning for Multi-Line Bus Holding

Yifan Zhang, Qifan Zhang, Liang Zheng

Central South University, Changsha, Hunan, China

RL Control Reinforcement Learning Offline-To-Online RL

Open paper AskPDF arXiv

Exploratory reinforcement learning (RL) on an operating bus fleet is impractical,while policies trained only from historical data cannot acquire new experience. Hybrid Offline-and-Online (H2O) RL combines fixed target replay with simulator interaction, but the inexpensive online simulator can differ from the target in transition and event-duration dynamics. We study this cross-fidelity problem for multi-line bus holding and address a failure mode in which lower generalized passenger time coexists with incomplete passenger journeys.

Momentum

Related topics

Latest papers 40