Offline Reinforcement Learning

May 22, 2023

Achieving the Minimax Optimal Sample Complexity of Offline Reinforcement Learning: A DRO-Based Approach
Yue Wang, Jinjun Xiong, Shaofeng Zou
Offline Reinforcement Learning Sample Complexity Robust Optimization Distributionally Robust Optimization Transition Kernel
Offline Primal-Dual Reinforcement Learning for Linear MDPs
Germano Gabbianelli, Gergely Neu, Nneka Okolo, Matteo Papini
Offline Reinforcement Learning Optimal Policy Primal Dual Near Optimal Policy Linear MDPs Average Reward MDPs Primal Dual Reinforcement Learning
Offline Reinforcement Learning with Additional Covering Distributions
Chenjie Mao
Offline Reinforcement Learning Optimal Policy Distribution Data Finite Sample Guarantee Sample Efficient Offline Reinforcement Learning

May 16, 2023

Revisiting the Minimalist Approach to Offline Reinforcement Learning
Denis Tarasov, Vladislav Kurenkov, Alexander Nikulin, Sergey Kolesnikov
Offline Reinforcement Learning

May 13, 2023

More for Less: Safe Policy Improvement With Stronger Performance Guarantees
Patrick Wienhöft, Marnix Suilen, Thiago D. Simão, Clemens Dubslaff, Christel Baier, Nils Jansen
Offline Reinforcement Learning Performance Guarantee Policy Improvement Probabilistic Guarantee Improved Bound High Performing Policy

May 5, 2023

A Survey on Offline Model-Based Reinforcement Learning
Haoyang He
Timely Survey Offline Reinforcement Learning Model Based Reinforcement Learning Model Based Action Free Offline Model Based Offline Reinforcement Learning

May 4, 2023

Federated Ensemble-Directed Offline Reinforcement Learning
Desik Rengarajan, Nitin Ragothaman, Dileep Kalathil, Srinivas Shakkottai
Offline Reinforcement Learning Federated Prompt Cooperation Federated Offline Reinforcement Learning Federated Learning Platform

April 25, 2023

Contrastive Energy Prediction for Exact Energy-Guided Diffusion Sampling in Offline Reinforcement Learning
Cheng Lu, Huayu Chen, Jianfei Chen, Hang Su, Chongxuan Li, Jun Zhu
Reinforcement Learning Diffusion Model Offline Reinforcement Learning Diffusion Sampling Intermediate Language Guided Sampling Contrastive Energy

April 19, 2023

CASOG: Conservative Actor-critic with SmOoth Gradient for Skill Learning in Robot-Assisted Intervention
Hao Li, Xiao-Hu Zhou, Xiao-Liang Xie, Shi-Qi Liu, Zhen-Qiu Feng, Zeng-Guang Hou
Offline Reinforcement Learning Natural Gradient Actor Critic Skill Learning Robotic Intervention Vascular Intervention Robot

April 17, 2023

April 10, 2023

Uncertainty-driven Trajectory Truncation for Data Augmentation in Offline Reinforcement Learning
Junjie Zhang, Jiafei Lyu, Xiaoteng Ma, Jiangpeng Yan, Jun Yang, Le Wan, Xiu Li
Data Augmentation Offline Reinforcement Learning Model Based Offline Reinforcement Learning Synthetic Trajectory Trajectory Truncation

March 30, 2023

March 29, 2023

Learning Excavation of Rigid Objects with Offline Reinforcement Learning
Shiyu Jin, Zhixian Ye, Liangjun Zhang
Offline Reinforcement Learning Optimal Trajectory Rigid Object Learning Excavation

March 28, 2023

Offline RL with No OOD Actions: In-Sample Learning via Implicit Value Regularization
Haoran Xu, Li Jiang, Jianxiong Li, Zhuoran Yang, Zhaoran Wang, Victor Wai Kin Chan, Xianyuan Zhan
Offline Reinforcement Learning Implicit Regularization Q$ Learning Distribution State

March 26, 2023

March 24, 2023

Optimal Transport for Offline Imitation Learning
Yicheng Luo, Zhengyao Jiang, Samuel Cohen, Edward Grefenstette, Marc Peter Deisenroth
Offline Reinforcement Learning Optimal Transport Offline Imitation Learning Reward Engineering

March 20, 2023

Neural Constraint Satisfaction: Hierarchical Abstraction for Combinatorial Generalization in Object Rearrangement
Michael Chang, Alyssa L. Dayan, Franziska Meier, Thomas L. Griffiths, Sergey Levine, Amy Zhang
Offline Reinforcement Learning Visual Input Object Rearrangement Constraint Learning Rearrangement Task Combinatorial Generalization Multilevel Abstraction

Offline Reinforcement Learning

Papers

Achieving the Minimax Optimal Sample Complexity of Offline Reinforcement Learning: A DRO-Based Approach

Offline Primal-Dual Reinforcement Learning for Linear MDPs

Offline Reinforcement Learning with Additional Covering Distributions

Revisiting the Minimalist Approach to Offline Reinforcement Learning

More for Less: Safe Policy Improvement With Stronger Performance Guarantees

A Survey on Offline Model-Based Reinforcement Learning

Federated Ensemble-Directed Offline Reinforcement Learning

Contrastive Energy Prediction for Exact Energy-Guided Diffusion Sampling in Offline Reinforcement Learning

CASOG: Conservative Actor-critic with SmOoth Gradient for Skill Learning in Robot-Assisted Intervention

Hyper-Decision Transformer for Efficient Online Policy Adaptation

Causal Decision Transformer for Recommender Systems via Offline Reinforcement Learning

Uncertainty-driven Trajectory Truncation for Data Augmentation in Offline Reinforcement Learning

Finetuning from Offline Reinforcement Learning: Challenges, Trade-offs and Practical Solutions

MAHALO: Unifying Offline Reinforcement Learning and Imitation Learning from Observations

Learning Excavation of Rigid Objects with Offline Reinforcement Learning

Offline RL with No OOD Actions: In-Sample Learning via Implicit Value Regularization

Balancing policy constraint and ensemble size in uncertainty-based offline reinforcement learning

Exploring Novel Quality Diversity Methods For Generalization in Reinforcement Learning

Optimal Transport for Offline Imitation Learning

Neural Constraint Satisfaction: Hierarchical Abstraction for Combinatorial Generalization in Object Rearrangement