Overview

Policy optimization studies how to update a decision-making rule so it earns higher rewards while meeting constraints such as safety, fairness, or limited data. Common approaches include policy gradients, actor-critic methods, trust regions and mirror descent, as well as policy iteration and newer generative-policy methods. Work spans continuous-control benchmarks such as MuJoCo, offline and multi-agent settings, and language-model training for mathematical reasoning, coding, and tool use, where token-, segment-, or trajectory-level rewards guide updates. A central challenge is balancing effective exploration and sample reuse with stable updates, useful credit assignment, and improvements that carry over from training to deployment.

Latest papers

CardsList

237 papers18 papers in the last four weeks, down 45% on the four weeks before. 0.1% of all new papers.

  1. SRPO: Setwise Relative Policy Optimization for Multi-Agent Systems

    Sep 8, 2026Shengtian Yang, Ziyu Xiong, Yu Li +3Multi-Agent CoordinationPolicy Optimization

  2. Algorithmic Optimality Guarantees for Nonsmooth H∞H_\infty Output-Feedback Policy Search

    Sep 5, 2026Ashkan Soleymani, Patrick Jailletoutput feedback stabilizationPolicy Optimization

  3. Reinforcement Learning for Sequential Solar PV Policy Design under Uncertainty: An Agent-Based Approach

    Sep 4, 2026Iias Faiud, Jonaid Shianifar, Michael Schukat +1Policy OptimizationReinforcement Learning

  4. Group Adaptive Clipping Policy Optimization

    Aug 31, 2026Sheng Jia, Xiao Wang, Shiva Prasad Kasiviswanathan +1Group Relative Policy OptimizationPolicy Optimization

  5. PAVE: Predictive Alignment and Value-Guided Evolution for World-Action Policies

    Aug 31, 2026Botong Zhao, Fang Yu, Tim Yu +3Robot Policy LearningRobot Skill Learning

  6. Categorizer Automata for Discounted-Sum Payoffs

    Aug 27, 2026Nathalie Bertrand, Pranav Ghorpade, Senthil Rajasekaran +2Policy OptimizationMarkov Decision Processes

  7. Where Entropy Is Measured Matters: Policy Geometry in Bounded Continuous-Control PPO

    Aug 25, 2026Yiyang He, Zhichun Zhou, Ziwei Wang +2Policy OptimizationProximal Policy Optimization

  8. SRPO: Self-Reflective Policy Optimization for Long-Horizon Reasoning

    Aug 24, 2026Jialong Liu, Yuling Shi, Ning Yang +2RL for Language Model ReasoningPolicy Optimization

  9. Unregularized Convergence of Single-Loop, Entropy-Regularized Natural Actor-Critic

    Aug 20, 2026Zhiqiang TanPolicy OptimizationActor-Critic Methods

  10. RTPO: Reverse-Turn Policy Optimization for Stabilizing Agentic RL Training

    Aug 19, 2026Yugu Li, Zehong Cao, Jianglin Qiao +1Agentic RLReinforcement Learning

  11. PlanPO: Group Planning-Aware Policy Optimization for Multi-Turn Agentic LLMs

    Aug 18, 2026Dayang Liang, Liyuan He, Xuan Feng +3RL for LLM AgentsPolicy Optimization

  12. HarmTrace: Anchor-Calibrated Decoupled Optimization for Fine-Grained Target Identification in Harmful Memes

    Aug 17, 2026Yujia Li, Yiqun Zhang, Zihan Cheng +7Harmful Meme DetectionMultimodal Meme Classification

  13. LLM-Based Hierarchical Coordinated Control with Continuation-Aware Policy Learning

    Aug 15, 2026Changhong He, Jinda Gao, Xinkuan Liu +3Language Model-Based ControlMulti-Agent Coordination

  14. CVPO: Enhancing LLM Reinforcement Learning Reasoning via Value-Variance Adaptation and Dynamic Curriculum Learning

    Aug 4, 2026Ziqi Jia, Yalu Ouyang, Bo Pang +5Numerical Reasoning in Language ModelsRL for Language Model Reasoning

  15. Robust Counterfactual Policy Optimisation via Nondeterministic Causal Models

    Aug 3, 2026Jessica Lally, Milad Kazemi, Nicola Paoletti +2Markov Decision ProcessesStructural Causal Models

  16. AtumAI: A Principled Framework for Agentic Generation of Datacenter Control-Plane Policies

    Aug 3, 2026Qiushi Lin, Chaojie Zhang, Íñigo Goiri +3Policy OptimizationCloud Computing

  17. Optimizing Minimax Regret in Uncertain MDPs with Small Sets of Policies

    Aug 3, 2026Sterre Lutz, Daniël Vos, Matthijs T. J. Spaan +1Markov Decision ProcessesBranch and Bound

  18. Beyond the Mean: Multi-Moment Policy Optimization for LLM Reasoning

    Aug 3, 2026Yijun Zhang, Yule Xie, Jiaxin Ding +4RL for Language Model ReasoningPolicy Optimization

  19. MonitorVLM-v2: A Deployed Vision-Language Framework for Real-Time Safety Violation Detection

    Aug 2, 2026Jiang Wu, Sichao Wu, Yinsong Ma +2Vision-Language ModelsEfficient VLM Inference

  20. Learning Not to Optimize: Physics-Informed Action-Space Reshaping for Intent-Based Network Control

    Aug 2, 2026Zuyuan Zhang, Vaneet Aggarwal, Tian LanReinforcement LearningPolicy Optimization

  21. X-NavDP: Generalizing Navigation Diffusion Policy to Novel Behavior and Embodiments with Group Q-score Reweighted Matching

    Jul 30, 2026Tianyu Yang, Yiming Zeng, Wenzhe Cai +5Robot NavigationPolicy Optimization

  22. RedFlow: Redirect Failure into Action-level Corrections for Flow-matching VLA Policy

    Jul 30, 2026Zhengyang Yan, Junhao Li, Fangqi Zhu +6Robot Policy LearningPolicy Optimization

  23. Preference Elicitation for Policy Optimization and Application to Aligning Heart Transplantation with Human Values

    Jul 29, 2026Itai Zilberstein, Ioannis Anagnostides, Zachary W Sollie +2Preference ElicitationHuman Preference Modeling

  24. Q-Steer: Action-Value Guidance for Molecular Policy Optimization

    Jul 29, 2026Xinyu Wang, Jinbo Bi, Minghu SongMolecular OptimizationLarge Language Model-Guided Optimization

  25. P3: Probabilistic Policy Propagation for Stable VAE-Based Robot Learning

    Jul 28, 2026Liyun Yan, Jianming Ma, Yang Zhang +5Variational AutoencodersRobot Policy Learning