Hybrid Reinforcement Learning

Hybrid reinforcement learning (RL) combines offline data with online interaction to improve the efficiency and robustness of RL agents. Current research focuses on developing algorithms that leverage both data sources effectively, often employing model architectures like actor-critic methods and hierarchical RL, and addressing challenges such as limited data coverage and mixed-variable action spaces. This approach holds significant promise for applications ranging from robotics and resource optimization to personalized medicine and AI safety, by enabling faster training, improved generalization, and more reliable performance in complex real-world scenarios.

Papers

September 14, 2024

Enhancing EEG Signal Generation through a Hybrid Approach Integrating Reinforcement Learning and Diffusion Models
Yang An, Yuhao Tong, Weikai Wang, Steven W. Su
Diffusion Model Brain Computer Interface Hybrid Reinforcement Learning

August 23, 2024

Mastering the Digital Art of War: Developing Intelligent Combat Simulation Agents for Wargaming Using Hierarchical Reinforcement Learning
Scotty Black
Reinforcement Learning Decision Making Hierarchical Reinforcement Learning Hybrid Reinforcement Learning Digital Art

August 8, 2024

Hybrid Reinforcement Learning Breaks Sample Size Barriers in Linear MDPs
Kevin Tan, Wei Fan, Yuting Wei
Hybrid Reinforcement Learning Linear Markov Decision Process

June 28, 2024

Contextualized Hybrid Ensemble Q-learning: Learning Fast with Control Priors
Emma Cramer, Bernd Frauenknecht, Ramil Sabirov, Sebastian Trimpe
Reinforcement Learning Prior Model Hybrid Reinforcement Learning Ensemble Q Learning

June 11, 2024

Hybrid Reinforcement Learning from Offline Observation Alone
Yuda Song, J. Andrew Bagnell, Aarti Singh
Reinforcement Learning Observational Data Offline Data Hybrid Reinforcement Learning Proof of Concept

May 30, 2024

Hybrid Reinforcement Learning Framework for Mixed-Variable Problems
Haoyan Zhai, Qianli Hu, Jiangning Chen
Bayesian Optimization Search Space Continuous Optimization Hybrid Reinforcement Learning

March 13, 2024

HRLAIF: Improvements in Helpfulness and Harmlessness in Open-domain Reinforcement Learning From AI Feedback
Ang Li, Qiugen Xiao, Peng Cao, Jian Tang, Yi Yuan, Zijie Zhao, Xiaoyuan Chen, Liang Zhang, Xiangyang Li, Kaitong Yang, Weidong Guo, Yukang Gan, Xu Yu, Daniell Wang, Ying Shan
Reinforcement Learning Human Feedback Large Relevance Improvement AI Feedback Hybrid Reinforcement Learning Helpfulness Score

March 7, 2024

A Natural Extension To Online Algorithms For Hybrid RL With Limited Coverage
Kevin Tan, Ziping Xu
Offline Reinforcement Learning Online Algorithm Higher Coverage Rate Hybrid Reinforcement Learning Natural Extension

November 14, 2023

Offline Data Enhanced On-Policy Policy Gradient with Provable Guarantees
Yifei Zhou, Ayush Sekhari, Yuda Song, Wen Sun
Policy Gradient Policy Optimization Offline Data Provable Guarantee Actor Critic Reinforcement Learning Hybrid Reinforcement Learning

October 13, 2023

Hybrid Reinforcement Learning for Optimizing Pump Sustainability in Real-World Water Distribution Networks
Harsh Patel, Yuan Zhou, Alexander P Lamb, Shu Wang, Jieliang Luo
Optimal Control Water Distribution Network Hybrid Reinforcement Learning Power Optimization

May 17, 2023

Reward-agnostic Fine-tuning: Provable Statistical Benefits of Hybrid Reinforcement Learning
Gen Li, Wenhao Zhan, Jason D. Lee, Yuejie Chi, Yuxin Chen
Reinforcement Learning Model Based Offline Reinforcement Learning Provable Benefit Hybrid Reinforcement Learning Reward Fine Tuning Agnostic Exploration Policy Fine Tuning

February 9, 2023

Data Quality-aware Mixed-precision Quantization via Hybrid Reinforcement Learning
Yingchun Wang, Jingcai Guo, Song Guo, Weizhan Zhang
Mixed Precision Quantization Hybrid Reinforcement Learning Bit Width Quantization

November 4, 2022

Mixline: A Hybrid Reinforcement Learning Framework for Long-horizon Bimanual Coffee Stirring Task
Zheng Sun, Zhiqi Wang, Junjia Liu, Miao Li, Fei Chen
Reinforcement Learning Hybrid Reinforcement Learning Bimanual Robot Bimanual Manipulation Task Bimanual Action Hand Arm System

October 13, 2022

Hybrid RL: Using Both Offline and Online Data Can Make RL Efficient
Yuda Song, Yifei Zhou, Ayush Sekhari, J. Andrew Bagnell, Akshay Krishnamurthy, Wen Sun
Policy Gradient Efficient Reinforcement Learning Action Free Offline Hybrid Reinforcement Learning

July 22, 2022

Learn Continuously, Act Discretely: Hybrid Action-Space Reinforcement Learning For Optimal Execution
Feiyang Pan, Tongzhe Zhang, Ling Luo, Jia He, Shuoling Liu
Reinforcement Learning Sequential Decision Making Problem Continual Learner Face Act Algorithmic Trading Hybrid Reinforcement Learning Optimal Execution Hybrid Action Reinforcement Learning

June 25, 2022

Towards Modern Card Games with Large-Scale Action Spaces Through Action Representation
Zhiyuan Yao, Tianyu Shi, Site Li, Yiting Xie, Yuanyuan Qin, Xiongjie Xie, Huan Lu, Yan Zhang
Action Space Action Representation Hybrid Reinforcement Learning Card Game

March 8, 2022

Robot Learning of Mobile Manipulation with Reachability Behavior Priors
Snehal Jauhri, Jan Peters, Georgia Chalvatzaki
Reinforcement Learning Robot Learning Mobile Manipulation Actor Critic Reinforcement Learning Hybrid Reinforcement Learning

Hybrid Reinforcement Learning

Papers

Enhancing EEG Signal Generation through a Hybrid Approach Integrating Reinforcement Learning and Diffusion Models

Mastering the Digital Art of War: Developing Intelligent Combat Simulation Agents for Wargaming Using Hierarchical Reinforcement Learning

Hybrid Reinforcement Learning Breaks Sample Size Barriers in Linear MDPs

Contextualized Hybrid Ensemble Q-learning: Learning Fast with Control Priors

Hybrid Reinforcement Learning from Offline Observation Alone

Hybrid Reinforcement Learning Framework for Mixed-Variable Problems

HRLAIF: Improvements in Helpfulness and Harmlessness in Open-domain Reinforcement Learning From AI Feedback

A Natural Extension To Online Algorithms For Hybrid RL With Limited Coverage

Offline Data Enhanced On-Policy Policy Gradient with Provable Guarantees

Hybrid Reinforcement Learning for Optimizing Pump Sustainability in Real-World Water Distribution Networks

Reward-agnostic Fine-tuning: Provable Statistical Benefits of Hybrid Reinforcement Learning

Data Quality-aware Mixed-precision Quantization via Hybrid Reinforcement Learning

Mixline: A Hybrid Reinforcement Learning Framework for Long-horizon Bimanual Coffee Stirring Task

Hybrid RL: Using Both Offline and Online Data Can Make RL Efficient

Learn Continuously, Act Discretely: Hybrid Action-Space Reinforcement Learning For Optimal Execution

Towards Modern Card Games with Large-Scale Action Spaces Through Action Representation

Robot Learning of Mobile Manipulation with Reachability Behavior Priors