Offline RL

RL: Reinforcement Learning

Follow this topic Ask about this topic

Momentum

29 papers in the last four weeks, up 222% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 189

All topics

Certified Safety Curation: Distribution-Free Guarantees for Safe Offline Reinforcement Learning
Sep 14, 2026Adam Haroon, Cody FlemingOffline RL Safety Filtering
Iowa State University Ames, IA, USA
Adaptive Agent Design
Sep 14, 2026Raj Kiriti Velicheti, Subhonmesh Bose, Tamer BaşarReinforcement Learning Q-Learning
Department of Electrical and Computer Engineering and the Coordinated Science Laboratory at the University of Illinois, Urbana-Champaign, Urbana, IL 61801
SCQ: Stabilizing Conservative Q-Learning with Sigmoid-Bounded Entropy
Sep 14, 2026Xiefeng Wu, Shu Zhang, Zhaojie Chu +1Robotic RL Offline RL
School of Computer Science, Wuhan University, Wuhan, China · School of Electronic Information, Wuhan University, Wuhan, China · School of Internet, Anhui University, Hefei, China
Offline Reinforcement Learning for Wind Farm Control: A Wind Tunnel Study under Dynamic Wind Directions
Sep 14, 2026Yuhan Su, Hongyang Dong, Simone Tamaro +3RL Control Reinforcement Learning
Intelligent Control and Smart Energy (ICSE) Research Group, School of Engineering, University of Warwick, Coventry CV4 7AL, U.K. · Wind Energy Institute, Technical University of Munich, 85748 Garching bei München, Germany
Direct Diversity Optimization for Diverse Successful Trajectories in Preference Post-Training
Sep 9, 2026Junwon Ko, Dong-Jae Lee, Minchan Kwon +2Offline RL Preference Optimization
School of Electrical Engineering, KAIST Daejeon, Republic of Korea
Optimal Value Inference for Reinforcement Learning
Sep 9, 2026Nan Lu, Ethan Lee, James M. Robins +2Reinforcement Learning Value Function Estimation
Routing Dense Layouts with History-Aware Offline Reinforcement Learning using LSTM
Sep 8, 2026Afsara Khan, Austin RovinskiReinforcement Learning Offline RL
New York University Brooklyn, New York, USA
Multi-step Proximal Policy Improvement in Offline Reinforcement Learning
Sep 3, 2026Soohyun Choi, Seonvin Cho, Songnam HongOffline RL Policy Learning
Department of Electronic Engineering, Hanyang University, Seoul, Republic of Korea
Recursive Value Learning for Long-Horizon Offline Goal-Conditioned RL
Sep 2, 2026Hyeonseong Jeon, Youngwoon LeeReinforcement Learning Offline RL
1Yonsei University · 2Seoul National University
WiSDoM: Wireless Sparse Decision Transformer with Mixture-of-Experts for Multi-Task Mobile Network Optimization
Aug 31, 2026Fatih Temiz, Shavbo Salehi, Melike Erol-KantarciSparse Mixture-of-Experts Decision Transformer
School of Electrical Engineering and Computer Science, University of Ottawa, Ottawa, Canada
Three Steps at a Time: Learning Representations from Action Sequences in Contrastive RL
Aug 31, 2026Michal Korniak, Kamil Dybek, Benjamin Eysenbach +2Reinforcement Learning Offline RL
ETH Zurich · University of Warsaw · Princeton University +3
Confounding Masquerading as Improvement: A Systematic Evaluation of Offline Reinforcement Learning for Stroke Antithrombotic Treatment in a 129,000-Patient Registry
Aug 31, 2026Kihun RheeOff-Policy Evaluation Offline RL
AI Research Center, JLK Inc., Seoul, South Korea
Redistribution-based Cost Inference Improves Sparse Safe Offline RL
Aug 12, 2026Ebenezer Gelo, Geraud Nangue Tasse, Steven James +1Credit Assignment in RL Step-Level Credit Assignment in RL
University of the Witwatersrand · University of the Witwatersrand Johannesburg, South Africa
Unmasking Toxic Mimicry in Medical Offline Reinforcement Learning for ICU Sepsis Management via Counterfactual Clinical Audits
Aug 11, 2026Hangqi Ren, Junyi LiaoCounterfactual Evaluation Offline RL
School of Engineering, Vanderbilt University, Nashville, TN, USA · Pratt School of Engineering, Duke University, Durham, NC, USA
Dynamics Models for Offline Hyperparameter Selection in Real-World RL
Aug 11, 2026Jordan Coblin, Han Wang, Martha White +1RL Control Offline RL
University of Alberta · Alberta Machine Intelligence Institute (Amii) · Canada CIFAR AI Chair at Amii
Observational Policy Ranking for SMB Financial Guidance from Multi-Action Accounting Logs
Aug 10, 2026Shrutendra Harsola, Vignesh Subrahmaniam, Vikas Raturi +7Causal Effect Estimation Conditional Average Treatment Effect Estimation
1Foresight-AI, Intuit
CODS: Iterative Bellman-Residual Data Selection for Reusable Offline Reinforcement Learning
Aug 7, 2026Ibne Farabi Shihab, Sanjeda Akter, Abu Sa-Adat Mohamed Moon-Im Al Ahsan +2Offline RL
Department of Computer Science, Iowa State University · Department of Computer Science & Engineering, BRAC University · Department of Civil, Construction & Environmental Engineering, Iowa State University
Learning Clinical-Trial Strategy: Offline Policy Training for Decision Agents
Aug 4, 2026William Bolton, Philip TorrClinical Decision-Making Imitation Learning
Department of Engineering Science, University of Oxford, Oxford, United Kingdom.
Convex-Hull-Neighborhood Smooth Dual Generalization: Controlling Local Correction Propagation in Offline RL
Aug 4, 2026Yi Yang, Zhennan Chen, Mingfeng Lv +3OOD Generalization Offline RL
1Xiamen University · 2Nanjing University · 3Zhejiang Gongshang University
Diffusion Policy with Behavioral Advantage Correction for Offline Reinforcement Learning
Aug 3, 2026Botao Dong, Longyang Huang, Ning Pang +1Distribution Shift Value Function Estimation
Botao Dong is with the School of Chemistry, Chemical Engineering and Biotechnology, Nanyang Technological University, Singapore 637459
ReBRAC-v2: The Return of the King
Aug 2, 2026Denis Tarasov, Robert K. KatzschmannReinforcement Learning Offline RL
Soft Robotics Lab, D-MAVT ETH Zurich, Switzerland
RMSWeb: Reflection, Failure-Mode Mining, and Salvage-DS for Web Agent Reinforcement Learning
Jul 31, 2026Chengbo Liu, Lifang Zhou, Ruijie Yan +8Reward Shaping Offline RL
1Microsoft, Beijing, China · 2Southeast University, Nanjing, China
RedFlow: Redirect Failure into Action-level Corrections for Flow-matching VLA Policy
Jul 30, 2026Zhengyang Yan, Junhao Li, Fangqi Zhu +6Robot Policy Learning Policy Optimization
The Hong Kong University of Science and Technology
Learning from the Unseen: Offline Reinforcement Learning with Hidden Actions
Jul 28, 2026Zeyu Bian, Ying Zhou, Yifan CuiCausal Effect Estimation Off-Policy Evaluation
Department of Statistics, Florida State University · Department of Statistics, University of Connecticut · Center for Data Science, Zhejiang University
$N_0$ -VTLA: Scaling Vision-Tactile-Language-Action Model with Latent Tactile Tokens
Jul 26, 2026NeoteAI Team, Fudan TEAI TeamLong-Horizon Robotic Manipulation Contact-Rich Robotic Manipulation
NeoteAI Team · Fudan TEAI Team
Label-free Industrial Fault Detection via Adversarial Inverse Reinforcement Learning: A System for Run-to-Failure Prognostics
Jul 25, 2026Dhiraj Neupane, Mohamed Reda Bouadjenek, Richard Dazeley +1Reinforcement Learning Industrial Anomaly Detection
Deakin University · Waurn Ponds, Victoria, Australia
TOUR: A Trajectory-Level Unlearning Benchmark for Offline Reinforcement Learning
Jul 23, 2026Chaofan Pan, Lingfei Ren, Xiangyu Jiang +6RL Benchmarks Membership Inference Attacks
1Southwestern University of Finance and Economics · 2Shanxi University
Offline RL with Hierarchical Action Chunking
Jul 23, 2026Ahad JawaidHierarchical RL Offline RL
The University of Texas at Dallas
Conservative Query and Adaptive Regularization for Offline RL Under Uncertainty Estimation
Jul 21, 2026Li-Rong Zhou, Qin-Wen Luo, Sheng-Jun HuangReinforcement Learning Offline RL
Nanjing University of Aeronautics and Astronautics, Nanjing, China
REGEN: Replay-recycling for Expert-to-Generalist distillation with Offline Reinforcement Learning
Jul 21, 2026Yunjie Chen, Xiaoxin Chen, Fang WangRL for Language Models RL for Language Model Reasoning
vivo AI Lab, Shenzhen, China · Department of Computer Science, Sun Yat-Sen University, Guangzhou, China

Sep 14, 2026, cs.LGJ/K move · Enter open · S save

Certified Safety Curation: Distribution-Free Guarantees for Safe Offline Reinforcement Learning

Adam Haroon, Cody Fleming

Iowa State University Ames, IA, USA

Offline RL Safety Filtering

Open paper AskPDF arXiv

Safe offline reinforcement learning assumes a cost function on every transition. We ask what remains possible when safety can be judged only by comparing short clips and occasionally asking whether an episode exceeded its budget. Certified safety curation answers with a filter-then-clone pipeline: a state-only value trained from segment comparisons scores whole trajectories, Learn-then-Test calibration certifies a selection threshold under a distribution-free

(\alpha, \delta)

bound on the unsafe fraction of the selection, and behavior cloning follows. We are not aware of prior work certifying the composition of a training set for offline RL or imitation. Oracle controls justify the design: reweighting individual transitions fails even with an exact value, so the value selects whole trajectories. The policies satisfy the cost budget on eleven of fifteen DSRL tasks, one short of cloning the ground-truth safe subset, which needs a label on every trajectory; the uncertified variant reaches twelve. Retrained on the certified selection, the strongest full-label method becomes safe where no setting of its own cost target rescues it. Refusal is predictable: the certificate's probability has a closed form in the purity the pool attains, which the calibration sample estimates and the scorer enters only through.

Momentum

Related topics

Latest papers 189