Overview

They estimate gradients from sampled trajectories using score-function methods such as REINFORCE, actor–critic value baselines, natural gradients, or pathwise differentiation through models. PPO-style clipping and trust regions constrain updates, while variance reduction and finer-grained credit assignment aim to use fewer samples. These methods are studied in bandits, robotics, continuous control, multi-agent and safe decision-making, and language-model post-training, where rewards can be sparse and trajectories long. A central tension is improving sample efficiency and stability without biasing updates or losing exploration; convergence guarantees exist in restricted settings, while high-dimensional and long-horizon problems remain challenging.

Latest papers

CardsList

172 papers8 papers in the last four weeks, down 68% on the four weeks before. 0.1% of all new papers.

  1. Exploration of Reinforcement Learning in Generative Recommendation Models

    Nov 15, 2026Pengfei Zheng, Wuchao Li, Shiyao Wang +11RL for RecommendationPolicy Optimization

  2. A Unified Analysis of Importance-Corrected Momentum Actor-Critic over a Markovian Trajectory

    Oct 24, 2026Yanjie Dong, Zhou Su, Wei Wang +1Reinforcement LearningActor-Critic Methods

  3. Direction-Aware Token Credit Assignment with Reward-Model Gradients

    Oct 23, 2026Yikuan Hu, Jifeng Zhu, Minle Su +6Token-Level Credit AssignmentPolicy Gradient Methods

  4. Effectiveness of Curriculum Learning Depends on Reward Sparsity and Competing Optima

    Oct 22, 2026John J. Vastola, Ann Huang, Satpreet H. Singh +2Curriculum RLReinforcement Learning

  5. On Reparameterizing the Score Function

    Oct 16, 2026Mohammad Hossein Amani, Leonardo Bocchieri, Maxime Peyrard +2Policy GradientPolicy Gradient Methods

  6. Baselines and Score Centering in Policy Gradient Estimation

    Oct 15, 2026Shuo Han, Ziqing HuPolicy GradientPolicy Gradient Methods

  7. MIPS: Mitigating Mode Collapse in Reinforcement Learning for Large Outcome Spaces

    Oct 14, 2026Armaan Sandhu, Abhijeet Sinha, Dianbo LiuMolecule DesignReinforcement Learning

  8. Variance-Reduced Policy Gradient is Nearly Minimax-Optimal

    Oct 9, 2026Leonardo Cesani, Matteo Papini, Marcello RestelliPolicy GradientPolicy Gradient Methods

  9. Randomized Transport Maps for Model-Free Policy-Gradient Mean-Field Control

    Oct 8, 2026Adonis Jamal, Samy Mekkaoui, Yadh Hafsi +1Policy Gradient MethodsModel-Free RL

  10. Temporally Interpretable Differentiable Decision Trees

    Oct 7, 2026Eisuke Hirota, Aarav Sane, Rohan PalejaInterpretable MLInterpretability in RL

  11. A Closed-Loop Non-Asymptotic Convergence Analysis of PPO with Learned Critics and Clipping

    Oct 7, 2026Junwei Su, Mengfan Liu, Yanyong Zhang +1Proximal Policy OptimizationActor-Critic Methods

  12. Convex-Concave Reinforcement Learning

    Oct 6, 2026Shripad V. Deshmukh, Yaswanth Chittepu, Dhawal Gupta +2Reinforcement LearningPolicy Gradient Methods

  13. Variance-Optimal Control Variates for Learning with Black-box Feedback

    Oct 3, 2026Zihao Zhao, Shuhan Zhang, Kai WangVariance ReductionPolicy Gradient Methods

  14. Planning to Learn

    Oct 2, 2026Ian OsbandPolicy Gradient MethodsPolicy Gradient

  15. Sample complexity of variance-reduced policy gradient: weaker assumptions and lower bounds

    Oct 2, 2026Gabor Paczolay, Matteo Papini, Alberto Maria Metelli +2Policy GradientPolicy Gradient Methods

  16. Multi-Fidelity Policy Gradients Stabilize Data-Scarce Reinforcement Learning

    Oct 1, 2026Xinjie Liu, Ruihan Zhao, Anirban Chaudhuri +3Policy Gradient MethodsPolicy Learning

  17. OPTS-TTPO: Enhancing Finite-Sample Policy-Gradient Learning with Tree Search

    Sep 30, 2026Junyu Lu, Shichao Weng, Zhiqiang Wang +10Tree SearchPolicy Gradient Methods

  18. Fine-Tuning on Self-Generated and Reward-Weighted Data: Learning Dynamics, Convergence Rates, and Benefits of Off-Policyness

    Sep 29, 2026Zhiwei Wang, Yanxi Chen, Yaliang Li +1Policy Gradient MethodsOff-Policy RL

  19. Regularized policy gradient with learned mixtures of Gaussians for games with continuous actions

    Sep 29, 2026Ondřej Kubíček, Viliam Lisý, Tuomas SandholmGame-Playing AgentsSelf-Play RL

  20. ORPG: Reconciling Multiple Reward Objectives through Objective-wise Policy Gradients

    Sep 28, 2026Shicheng Fang, Yiwen Zhao, Wenbo Tian +4Multi-Objective Reinforcement LearningGradient Interference

  21. Sufficiency of Zeroth-Order Reward Shaping for Policy Gradient in Stabilization Control

    Sep 28, 2026Yisheng Zhang, Tao Wang, Sicun GaoReward ShapingRobotic RL

  22. OSCC: Certified Observation-Safe Coupling Optimization for Gradient-Noise Control in Imperfect-Information Learning

    Sep 27, 2026Miaobo Hu, Shuhao Hu, Xiaobo Guo +4Partially Observable RLPolicy Gradient Methods

  23. Learning Robot Policies from Sparse Success Signals via STL-Guided Stein Variational Policy Gradient

    Sep 25, 2026Hongrui Zheng, Cristian Ioan Vasile, Antonio Loquercio +1Robot Policy LearningReinforcement Learning