Bellman Equation

Ask about this topic

Recent momentum

-56%

4 papers in the last 28 days · 0.1% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Also in Markov Decision Processes

Neighbouring directions

Markov Decision ProcessesOptimal PoliciesPartially Observable Markov Decision ProcessValue FunctionsFinite-Horizon Episodic Markov Decision ProcessesFinite Planning Horizon

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-14

4 new papers

A weekly snapshot of new work published in Bellman Equation.

67 papers

Latest in Bellman Equation

Open your feed →
CardsList

  1. A Bellman Optimality Equation for Plasticity

    Sep 11, 2026Jeremy Lucas, Doina PrecupPlasticityBellman Equation

  2. Support Discovery With Iteratively Reweighted Least Squares for Fixed-Charge Network Flow

    Sep 10, 2026Sindura Saraswathi, Christian KümmerleMixed-Integer Linear ProgrammingLeast Squares

  3. Optimal Value Inference for Reinforcement Learning

    Sep 9, 2026Nan Lu, Ethan Lee, James M. Robins +2Value FunctionsBellman Equation

  4. BRACE: Anchored Bellman-Residual Correction for Stale Critics in Asynchronous RL

    Sep 9, 2026Guanqun Zhao, Zijun Xie, Binbin Zheng +3Safe Reinforcement LearningLarge Language Model Training

  5. CODS: Iterative Bellman-Residual Data Selection for Reusable Offline Reinforcement Learning

    Aug 7, 2026Ibne Farabi Shihab, Sanjeda Akter, Abu Sa-Adat Mohamed Moon-Im Al Ahsan +2Offline Safe Reinforcement LearningLong-Horizon Credit Assignment

  6. Adaptive Finite-Budget Training for CVaR Risk-Aware Q-Learning

    Aug 5, 2026Yifan Wu, Junjie Lei, Wenjie HuangConditional-Value-At-RiskQ-Learning

  7. Revisiting TD Target Aggregation under Uncertainty in Q-Learning

    Aug 4, 2026Lipeng Zu, Xiaonan ZhangDeep Q-NetworksQ-Learning

  8. Hypergradient-based Bilevel Reinforcement Learning with Improved Sample Complexity

    Jul 30, 2026Naman Saxena, Mudit Gaur, Vaneet AggarwalHierarchical Reinforcement LearningBellman Equation

  9. Search as Computation Allocation

    Jul 30, 2026Alexander TuisovOptimal Comparison AllocationComputational Cost

  10. Relative Value Learning

    Jul 23, 2026Marc Höftmann, Jan Robine, Stefan HarmelingValue FunctionsBellman Equation

  11. Long-Term Sequential Decision Making under Risk

    Jul 22, 2026Irmaan, Mirzanejad, Nadjet Bourdache +1Finite-Horizon Episodic Markov Decision ProcessesSequential Decision Making

  12. Generalised Bellman recurrence and three dualities in sequential decision-making

    Jul 20, 2026Fernando E. Rosas, David Hyland, Daniel PolaniBellman EquationValue Functions

  13. Distributional Soft Bellman Operator under the Cramér Geometry

    Jul 20, 2026Keru Wang, Yixin Deng, Yao Lyu +2Bellman EquationKullback-Leibler Regularization

  14. Rationalizing Boltzmann Rationality: An Axiomatic Characterization of Entropy-Regularized Policies

    Jul 19, 2026Silviu PitisBellman EquationKullback-Leibler Regularization

  15. Solving Stochastic Fixed-Point Equations with High Probability

    Jul 10, 2026Jelena DiakonikolasFixed-Point IterationStochastic Approximation

  16. Statistical Efficiency and Inference of Quantile Distributional Reinforcement Learning

    Jul 9, 2026Zijie Cheng, Yang Peng, Zhihua ZhangDistributional Reinforcement LearningQuantile Regression

  17. Fitted Occupancy-Ratio Evaluation without Bellman Completeness

    Jul 6, 2026Lars van der Laan, Nathan KallusBellman EquationMinimax

  18. Non-Convex Sparse Reinforcement Learning via Non-Monotone Inclusions

    Jul 6, 2026Kyohei Suzuki, Konstantinos SlavakisLipschitz ConstantBellman Equation

  19. Tight Lower Bounds for the Multi-Secretary Problem via Bellman Certificates

    Jul 2, 2026Jiawei ZhangLower BoundsBellman Equation

  20. Learning the Supports for Categorical Critic in Reinforcement Learning

    Jul 2, 2026Jen-Yen Chang, Takayuki Osa, Tatsuya HaradaSoft Actor-CriticValue Functions

  21. Regularized Reward-Punishment Reinforcement Learning

    Jun 26, 2026Jiexin Wang, Eiji UchibeDeep Q-NetworksBellman Equation

  22. Mean-Field PhiBE: Continuous-Time Mean-Field Reinforcement Learning from Discrete-Time Data

    Jun 25, 2026Erhan Bayraktar, Martin Hernandez, Qinxin Yan +1Model-Free Reinforcement LearningStochastic Optimal Control

  23. Deterministic Pareto-Optimal Policy Synthesis for Multi-Objective Reinforcement Learning

    Jun 24, 2026Aniruddha Joshi, Niklas Lauffer, Sanjit SeshiaMulti-Objective Reinforcement LearningOptimal Policies

  24. A Transport-Based Geometry of Belief-Cost

    Jun 19, 2026Laurent CaraffaOptimal TransportBelief-Space Planning

  25. Inverting the Bellman Equation: From Q-Values to World Models

    Jun 19, 2026Alistair Letcher, Mattie Fellows, Alexander D. Goldie +3Model-Free Reinforcement LearningGoal-Conditioned Reinforcement Learning

  26. Robust Q-learning for mean-field control under Wasserstein uncertainty in common noise

    Jun 18, 2026Mathieu Laurière, Ariel Neufeld, Kyunghyun ParkQ-LearningStochastic Optimal Control

  27. A Diffusion Approximation for Temporal-Difference Learning with Linear Features under Markovian Noise

    Jun 16, 2026M. Forzo, E. Monzio Compagnoni, A. Russo +1Temporal DifferenceStochastic Differential Equations

  28. Deep Q-Learning on Hölder Spaces

    Jun 15, 2026Qian QiQ-LearningDeep Q-Networks

  29. Maximum Entropy Inverse Reinforcement Learning for Mean-Field Games with Average Reward

    Jun 15, 2026Şevket Kaan Alkır, Naci Saldı, Berkay Anahtarcı +1Mean Field GamesBellman Equation

  30. Bellman-sufficient Information Complexity

    Jun 9, 2026Yunbei XuInformation-Theoretic LimitsOptimal Sample Complexity

  31. Bellman-Taylor Score Decoding for Markov Decision Processes with State-Dependent Feasible Action Sets

    Jun 9, 2026Yi Chen, Rushuai Yang, Qiang Chen +2Markov Decision ProcessesBellman Equation

  32. FLOWREADER: Min-Cost Flow Optimization for Multi-Modal Long Document Q&A

    Jun 5, 2026Ambuj Mehrish, Sebastiano VasconMultimodal QueryTop-K

  33. Prospect-Theory Behavior from Bellman Optimality in MDPs with Catastrophic States

    May 31, 2026Yujiao ChenConditional-Value-At-RiskMarkov Decision Processes

  34. Multivariate Distributional Reinforcement Learning Using Sliced Divergences

    May 29, 2026Baptiste Debes, Tinne TuytelaarsDistributional Reinforcement LearningNon-Exponential Discounting

  35. On Distributional Reinforcement Learning in Chaotic Dynamical Systems

    May 28, 2026James Rudd-Jones, Mirco Musolesi, María Pérez-OrtizDistributional Reinforcement LearningChaotic Dynamical Systems

  36. Reward Transfer from Inverse Reinforcement Learning: A Coupled Minimax Approach

    May 27, 2026Guang-Yuan Hao, Lars van der Laan, Aurélien Bibaut +1Bellman EquationMinimax

  37. Global Convergence of Wasserstein Policy Gradient for Entropy-Regularized Reinforcement Learning

    May 25, 2026Zhaoyu Zhu, Rui Gao, Shuang LiPolicy GradientKullback-Leibler Regularization

  38. A Contractive Feedback Semantics for Reinforcement Learning

    May 23, 2026Zuyuan ZhangSafe Reinforcement LearningBellman Equation

  39. Target-Aligned Bellman Backup for Cross-domain Offline Reinforcement Learning

    May 21, 2026Wei Liu, Ting LongOffline Safe Reinforcement LearningBellman Equation

  40. Beyond the Bellman Recursion: A Pontryagin-Guided Framework for Non-Exponential Discounting

    May 20, 2026Hojin Ko, Jeonggyu HuhNon-Exponential DiscountingRelative Policy Optimization

  41. On Gaussian approximation for entropy-regularized Q-learning with function approximation

    May 17, 2026Artemy Rubtsov, Rahul Singh, Eric Moulines +2Q-LearningLarge Deviations Theory

  42. BAPR: Bayesian amnesic piecewise-robust reinforcement learning for non-stationary continuous control

    May 15, 2026Yifan Zhang, Liang ZhengBellman EquationChange-Point Detection

  43. Adaptive Multi-Round Allocation with Stochastic Arrivals

    May 12, 2026Yuqi Pan, Davin Choo, Haichuan Wang +3Optimal Comparison AllocationQueueing

  44. Stochastic Minimum-Cost Reach-Avoid Reinforcement Learning

    May 12, 2026Jingduo Pan, Taoran Wu, Yiling Xue +1ReachabilitySafe Reinforcement Learning

  45. Offline Policy Evaluation for Manipulation Policies via Discounted Liveness Formulation

    May 12, 2026Hao Wang, Joshua Bowden, Colton Crosby +1Robot PoliciesFinite Planning Horizon

  46. Natural Policy Gradient as Doubly Smoothed Policy Iteration: A Bellman-Operator Framework

    May 11, 2026Phalguni Nanda, Zaiwei ChenPolicy GradientBellman Equation

  47. Quantile-Coupled Flow Matching for Distributional Reinforcement Learning

    May 8, 2026Michael Groom, Victor-Alexandru Darvariu, Lars Kunze +2Distributional Reinforcement LearningDistributional Learning

  48. Central Limit Theorem for Two-Time-Scale Approximate Distributionally Robust RL

    May 8, 2026Shengbo Wang, Zexi ZhangDistributional Reinforcement LearningModel-Free Reinforcement Learning

  49. Reinforcement Learning for Exponential Utility: Algorithms and Convergence in Discounted MDPs

    May 8, 2026Gugan Thoppe, L. A. Prashanth, Ankur Naskar +1Q-LearningNon-Exponential Discounting

  50. Path-Coupled Bellman Flows for Distributional Reinforcement Learning

    May 7, 2026Boyang Xu, Qing Zou, Siqin Yang +1Distributional Reinforcement LearningBellman Equation

  51. Soft Deterministic Policy Gradient with Gaussian Smoothing

    May 7, 2026Hyunjun Na, Donghwan LeePolicy GradientValue Functions

  52. A Measure-Theoretic Finite-Sample Theory for Adaptive-Data Fitted Q-Iteration

    May 7, 2026Manuel Haussmann, Mustafa Mert Çelikok, Melih KandemirQ-LearningModel-Free Reinforcement Learning

  53. Bridging the Gap Between Average and Discounted TD Learning

    May 3, 2026Haoxing Tian, Zaiwei Chen, Ioannis Ch. Paschalidis +1Temporal DifferenceBellman Equation

  54. Regularized Centered Emphatic Temporal Difference Learning

    May 2, 2026Xingguo Chen, Chaohui Wu, Jinguo Ye +5Temporal DifferenceRegularization Methods

  55. Graph Neural Network-Informed Predictive Flows for Faster Ford-Fulkerson and PAC-Learnability

    Apr 23, 2026Eleanor Wiesler, Trace BaxleyGraph Neural NetworksState-Of-The-Art Unsupervised Class-Aware Image Segmentation Methods

  56. Planning in entropy-regularized Markov decision processes and games

    Apr 21, 2026Jean-Bastien Grill, Omar Darwiche Domingues, Pierre Ménard +2Markov Decision ProcessesKullback-Leibler Regularization

  57. Beyond Bellman: High-Order Generator Regression for Continuous-Time Policy Evaluation

    Apr 21, 2026Yaowei Zheng, Richong Zhang, Shenxi Wu +5Value FunctionsBellman Equation

  58. Beyond the Bellman Fixed Point: Geometry and Fast Policy Identification in Value Iteration

    Apr 19, 2026Donghwan LeeBellman EquationValue Functions

  59. End-to-End Efficient RL for Linear Bellman Complete MDPs with Deterministic Transitions

    Mar 24, 2026Zakaria Mhammedi, Alexander Rakhlin, Nneka OkoloMarkov Decision ProcessesBellman Equation

  60. Reward Redistribution for CVaR MDPs using a Bellman Operator on L-infinity

    Feb 3, 2026Aneri Muni, Vincent Taboga, Esther Derman +2Conditional-Value-At-RiskBellman Equation