Reinforcement Learning

Also known as RL

Follow this topic Ask about this topic

Momentum

144 papers in the last four weeks, up 243% on the four weeks before. 1.4% of all new papers.

Jul 13Week of Sep 28

Latest papers 1,138

All topics

On Gaussian approximation for entropy-regularized Q-learning with function approximation
May 17, 2026Artemy Rubtsov, Rahul Singh, Eric Moulines +2Reinforcement Learning Stochastic Approximation
HSE University, Moscow, Russia · Mohamed Bin Zayed University of AI, UAE · EPITA, France +1
ClaHF: A Human Feedback-inspired Reinforcement Learning Framework for Improving Classification Tasks
May 17, 2026Tianxiang Xu, Xiaoyan Zhu, Xin Lai +1Reward Modeling Reinforcement Learning
School of Computer Science and Technology, Xi’an Jiaotong University
Progressive Generalization Augmentation with Deeply Coupled RND-PPO and Domain-Prioritized Noise Injection for Robust Crop Management Reinforcement Learning
May 17, 2026Wu YangReinforcement Learning Proximal Policy Optimization
Chongho Bridge Group Limited
Deep Reinforcement Learning Framework for Diversified Portfolio Management Across Global Equity Markets
May 17, 2026Kamil Kashif, Robert ŚlepaczukReinforcement Learning Portfolio Optimization
Quantitative Finance Research Group Faculty of Economic Sciences University of Warsaw ul. Dluga 44-50 00-241 Warsaw Poland · Quantitative Finance Research Group Department of Quantitative Finance and Machine Learning Faculty of Economic Sciences University of Warsaw ul. Dluga 44-50 00-241 Warsaw Poland
DISA: Offline Importance Sampling for Distribution-Matching LLM-RL
May 17, 2026Shaobo Wang, Yujie Chen, Yafeng Sun +9Reinforcement Learning RL for Language Model Reasoning
Shanghai Jiao Tong University · The Hong Kong University of Science and Technology (Guangzhou) · The University of Science and Technology of China +2
From Imitation to Interaction: Mastering Game of Schnapsen with Shallow Reinforcement Learning
May 16, 2026Ján Klačan, Sizhong ZhangReinforcement Learning Game-Playing Agents
Vrije Universiteit Amsterdam
The Unlearnability Phenomenon in RLVR for Language Models
May 16, 2026Yulin Chen, He He, Chen ZhaoReinforcement Learning RL for Language Model Reasoning
1New York University · 2NYU Shanghai
Emergence of a Flow-Assisted Casting Strategy for Olfactory Navigation via Memory-Augmented Reinforcement Learning
May 16, 2026Changxu Zhao, Dongxiao Zhao, Xin Bian +1Reinforcement Learning Robot Navigation
State Key Laboratory of Ocean Engineering, School of Ocean and Civil Engineering, Shanghai Jiao Tong University, Shanghai 200240, People’s Republic of China · State Key Laboratory of Fluid Power and Mechatronic Systems, Department of Engineering Mechanics, Zhejiang University, Hangzhou 310027, People’s Republic of China
Learn Where Outcomes Diverge: Efficient VLA RL via Probabilistic Chunk Masking
May 15, 2026Vaidehi Bagaria, Nikshep Grampurohit, Pulkit VermaReinforcement Learning Neural Network Optimization
Indian Institute of Technology Madras
Mind Dreamer: Untethering Imagination via Active Causal Intervention on Latent Manifolds
May 15, 2026Shaojun Xu, Xiaoling Zhou, Yihan Lin +4Reinforcement Learning Credit Assignment in RL
Center for Brain-Inspired Computing Research, Department of Precision Instrument, Tsinghua University, Beijing, China · College of Computer Science and Technology, Zhejiang University, Hangzhou, China · Pen-Tung Sah Institute of Micro-Nano Science and Technology, Xiamen University, Xiamen, China +1
Tighter Regret Bounds for Contextual Action-Set Reinforcement Learning
May 15, 2026Zijun Chen, Zihan ZhangRegret Minimization in RL Reinforcement Learning
Department of Computer Science and Engineering Hong Kong University of Science and Technology
AstraFlow: Dataflow-Oriented Reinforcement Learning for Agentic LLMs
May 15, 2026Haizhong Zheng, Yizhuo Di, Jiahui Wang +7Agentic RL Reinforcement Learning
1Carnegie Mellon University · University of Michigan · 3UC Berkeley +1
Terrain Consistent Reference-Guided RL for Humanoid Navigation Autonomy
May 15, 2026William D. Compton, Zachary Olkin, Aaron D. AmesHumanoid Robot Locomotion Reinforcement Learning
Department of Computing and Mathematical Sciences, California Institute of Technology, Pasadena, CA 91125
parallelcbf: A composable safety-filter and auditability framework for tensor-parallel reinforcement learning
May 15, 2026Yijun Lu, Zilei Yang, Yuyin MaReinforcement Learning Control Barrier Functions
GRLO: Towards Generalizable Reinforcement Learning in Open-Ended Environments from Zero
May 14, 2026Shangjian Yin, Yu Fu, Yue Dong +1Reinforcement Learning RL for Language Model Reasoning
University of California, Riverside
QuantFPFlow: Quantum Amplitude Estimation for Fokker--Planck Policy Optimisation in Continuous Reinforcement Learning
May 14, 2026Abraham Itzhak WeinbergReinforcement Learning Quantum-Inspired ML
AI-WEINBERG, AI Experts, Tel Aviv, Israel
Second-Order Actor-Critic Methods for Discounted MDPs via Policy Hessian Decomposition
May 14, 2026Sanjeev Manivannan, Shuban VReinforcement Learning Policy Gradient Methods
Indian Institute of Technology Madras Chennai, India
Critic-Driven Voronoi-Quantization for Distilling Deep RL Policies to Explainable Models
May 14, 2026Senne Deproost, Denis Steckelmacher, Ann NowéReinforcement Learning Vector Quantization
Vrije Universiteit Brussel, Pleinlaan 2, 1050 Brussels, Belgium
CaMeRL: Collision-Aware and Memory-Enhanced Reinforcement Learning for UAV Navigation in Multi-Scale Obstacle Environments
May 14, 2026Hong Hong, Feiyu Liao, Yongheng Liang +3RL for Robotics Reinforcement Learning
School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou, China, and the Guangdong Key Laboratory of Big Data Analysis and Processing, Guangzhou, China
Peng's Q( $λ$ ) for Conservative Value Estimation in Offline Reinforcement Learning
May 14, 2026Byeongchan Kim, Min-hwan OhReinforcement Learning Value Function Estimation
Seoul National University
DRL-STAF: A Deep Reinforcement Learning Framework for State-Aware Forecasting of Complex Multivariate Hidden Markov Processes
May 14, 2026Manrui Jiang, Jingru Huang, Yong Chen +1Multivariate Time Series Forecasting Reinforcement Learning
Department of Industrial Engineering, Tsinghua University, Beijing 100084, China · Department of Industrial and Systems Engineering, University of Iowa, Iowa City, IA 52242, USA.
Fast Rates for Inverse Reinforcement Learning
May 14, 2026Andreas Schlaginhaufen, Maryam KamgarpourReinforcement Learning Statistical Learning Theory
Sycamore, EPFL
Angel or Demon: Investigating the Plasticity Interventions' Impact on Backdoor Threats in Deep Reinforcement Learning
May 14, 2026Oubo Ma, Ruixiao Lin, Yang Dai +4Reinforcement Learning Backdoor Attacks
1Zhejiang University · 2National University of Defense Technol · 3Xi’an Jiaotong University
Fully Dynamic Rebalancing in Dockless Bike-Sharing Systems via Deep Reinforcement Learning
May 14, 2026Edoardo Scarpel, Alberto Pettena, Matteo Cederle +3RL Control Reinforcement Learning
University of Padua, via Gradenigo 6/B, 35131, Padua, Italy
ROAD: Adaptive Data Mixing for Offline-to-Online Reinforcement Learning via Bi-Level Optimization
May 14, 2026Letian Yang, Xu Liu, Yiqiang Lu +3Reinforcement Learning Offline-To-Online RL
Shanghai Jiao Tong University, Shanghai, China · Ant Group, Shanghai, China
COLLATOR: Compositional Multi-Agent Orchestration with Counterfactual Reinforcement Learning
May 14, 2026Xudong Chen, Yixin Liu, Hua Wei +1Multi-Agent System Optimization Multi-Agent Orchestration
A Unified Knowledge Embedded Reinforcement Learning-based Framework for Generalized Capacitated Vehicle Routing Problems
May 14, 2026Wen Wang, Xiangchen Wu, Liang Wang +2Reinforcement Learning Vehicle Routing
Nanjing University
Learning to Build the Environment: Self-Evolving Reasoning RL via Verifiable Environment Synthesis
May 14, 2026Yucheng Shi, Zhenwen Liang, Kishan Panaganti +3Reinforcement Learning RL for Language Model Reasoning
Tencent HY LLM
Reinforcement Learning with Semantic Rewards Enables Low-Resource Language Expansion without Alignment Tax
May 14, 2026Zeli Su, Ziyin Zhang, Zhou Liu +7Reinforcement Learning Low-Resource MT
Minzu University of China · Ant Group · Shanghai Jiao Tong University +4
Matrix-Space Reinforcement Learning for Reusing Local Transition Geometry
May 14, 2026Zuyuan Zhang, Carlee Joe-Wong, Tian LanReinforcement Learning Trajectory Representation Learning
The George Washington University · Carnegie Mellon University

May 17, 2026, stat.MLJ/K move · Enter open · S save

On Gaussian approximation for entropy-regularized Q-learning with function approximation

Artemy Rubtsov, Rahul Singh, Eric Moulines, Alexey Naumov+1

HSE University, Moscow, Russia · Mohamed Bin Zayed University of AI, UAE · EPITA, France+1

Reinforcement Learning Stochastic Approximation Q-Learning Entropy Regularization

Open paper AskPDF arXiv

In this paper, we derive rates of convergence in the high-dimensional central limit theorem for Polyak--Ruppert averaged iterates generated by entropy-regularized asynchronous Q-learning with linear function approximation and a polynomial stepsize

k^{-ω}

ω\in (1/2,1)

. Assuming that the sequence of observed triples

(s_k,a_k,s_{k+1})_{k \geq 0}

forms a uniformly geometrically ergodic Markov chain, and under suitable regularity conditions for the projected soft Bellman equation, we establish a Gaussian approximation bound in the convex distance with rate of order

n^{-1/4}

, up to polylogarithmic factors in

n

, where

n

is the number of samples used by the algorithm. To obtain this result, we combine a linearization of the soft Bellman recursion with a Gaussian approximation for the leading martingale term. Finally, we derive high-order moment bounds for the algorithm's last iterate, which might be of independent interest.

Momentum

Related topics

Latest papers 1,138