Distributional RL

RL: Reinforcement Learning

Overview

Distributional reinforcement learning studies the probability distribution of future rewards, rather than only their expected value, which can reveal uncertainty and rare high-cost outcomes. Common approaches represent returns with categorical supports, quantiles, particles, or learned flows, and train them using distributional Bellman updates; risk-sensitive methods then use measures such as quantiles or conditional value at risk to guide decisions. The methods are tested in settings including Atari, MuJoCo, D4RL offline control, robotics, and safety-critical navigation, while theory increasingly addresses convergence, sample complexity, and statistical inference. A key open tension is whether learned return distributions reliably capture environmental risk: distributional critics can improve robustness, but their risk claims require careful validation and do not follow automatically from modeling a distribution.

Latest papers

CardsList

53 papers3 papers in the last four weeks, down 40% on the four weeks before. 0.0% of all new papers.

  1. QTOP: Scaling Humanoid Motion Tracking with Quantile Critics

    Nov 16, 2026Markus Peschl, Dana Kianfar, Daniel DijkmanHumanoid Motion TrackingRL for Robotics

  2. Bellman Contraction under MMD: A Unified Framework

    Nov 12, 2026Baptiste Debes, Tinne TuytelaarsRadial Basis KernelsDistributional RL

  3. Value Forcing: Aligning Return Distributions at All Noise Levels

    Nov 1, 2026Chongyi Zheng, Zhiyuan Zhou, Qiyang Li +2Value Function EstimationSample-Efficient RL

  4. Near Minimax Rates for Quantile Distributional Reinforcement Learning

    Oct 21, 2026Zijie Cheng, Zhihua ZhangDistributional RLPolicy Evaluation

  5. Posterior-Averaged Bellman Flow Matching for Distributional Critics

    Oct 13, 2026Zeqiao Li, Yijing Wang, Haoyu Wang +2Distributional RLFlow Matching

  6. Variance-Averse nn-Step Offline Reinforcement Learning for Sparse Long-Horizon Environments

    Oct 6, 2026Guhyeon Kang, Minhae KwonDistributional RLRisk-Sensitive RL

  7. Reinforcement Learning under State and Outcome Uncertainty: A Foundational Distributional Perspective

    Sep 21, 2026Larry Preuett, Qiuyi Zhang, Muhammad Aurangzeb AhmadDistributional RLMarkov Decision Processes

  8. Deep Reinforcement Learning with Buffered Quantile Objectives

    Sep 18, 2026Mohammad Alipour-vaezi, Sajad KhodadadianRisk-Sensitive RLDistributional RL

  9. A Finite-Sample Analysis of Quantile Temporal-Difference Learning

    Aug 27, 2026Zijie Cheng, Xiang Li, Yang Peng +1Distributional RLStochastic Approximation

  10. Learning to Control Coupled-Dynamics Environments with Joint Markov Decision Processes

    Aug 24, 2026Ege C. Kaya, Aliasghar Pourghani, Mahsa Ghasemi +2Semi-Markov Decision ProcessMarkov Decision Processes

  11. Risk-Sensitive Reinforcement Learning with Smoothed Quantile Objectives

    Aug 23, 2026Mohammad Alipour-Vaezi, Huaiyang Zhong, Sajad KhodadadianRisk-Sensitive RLRegret Minimization in RL

  12. Online Inference in Distributional Temporal-Difference Learning

    Aug 14, 2026Yang Peng, Liangyu ZhangDistributional RLTemporal-Difference Learning

  13. Online Inference for Quantile Distributional Reinforcement Learning

    Aug 13, 2026Zijie Cheng, Yang Peng, Zhihua ZhangDistributional RLReinforcement Learning

  14. Distributional Soft Bellman Operator under the Cramér Geometry

    Jul 20, 2026Keru Wang, Yixin Deng, Yao Lyu +2Distributional RLMaximum Entropy RL

  15. Active Beyond-Diagonal RIS Empowered Heterogeneous Edge Computing: A Distributional Reinforcement Learning Approach

    Jul 14, 2026Tianyu Pang, Hongyu LiDistributional RLReconfigurable Intelligent Surfaces

  16. Statistical Efficiency and Inference of Quantile Distributional Reinforcement Learning

    Jul 9, 2026Zijie Cheng, Yang Peng, Zhihua ZhangDistributional RLReinforcement Learning

  17. Learning the Supports for Categorical Critic in Reinforcement Learning

    Jul 2, 2026Jen-Yen Chang, Takayuki Osa, Tatsuya HaradaDistributional RL

  18. FastDSAC: Enhancing Policy Plasticity via Constrained Exploration for Scalable Humanoid Locomotion

    Jun 30, 2026Guanchen Lu, Yajuan Dun, Yi Zhou +4Distributional RLReinforcement Learning

  19. Dual-Flow Reinforcement Learning with State-Aware Exploration

    Jun 29, 2026Qijun Li, Zheng Fu, Qi Song +4Distributional RLReinforcement Learning

  20. DRIVE: Distributional and Retrieval-Augmented Bidding with Value Evaluation

    Jun 12, 2026Miduo Cui, Haochen Wang, Shangqin Mao +6Distributional RLAutomated Bidding

  21. QnRL: Quantum-Native Reinforcement Learning

    Jun 6, 2026Alexander DeRieux, Walid SaadDistributional RLQuantum Generative Modeling

  22. Reinforcement Learning from Rich Feedback with Distributional DAgger

    Jun 3, 2026Rishabh Agrawal, Jacob Fein-Ashley, Paria RashidinejadDistributional RLRL for Language Model Reasoning

  23. Multivariate Distributional Reinforcement Learning Using Sliced Divergences

    May 29, 2026Baptiste Debes, Tinne TuytelaarsDistributional RL

  24. On Distributional Reinforcement Learning in Chaotic Dynamical Systems

    May 28, 2026James Rudd-Jones, Mirco Musolesi, María Pérez-OrtizDistributional RLReinforcement Learning

  25. Reinforcement Learning over Predictive Distributions for LLM Regression

    May 20, 2026Jungsoo Park, Hyungjoo Chae, Ethan Mendes +4Distributional RLRL for Language Models

  26. Quotient-Categorical Representations for Bellman-Compatible Average-Reward Distributional Reinforcement Learning

    May 11, 2026Ege C. Kaya, Aliasghar Pourghani, Vijay Gupta +1Distributional RLReinforcement Learning