Policy Optimization

Ask about this topic

Recent momentum

-75%

6 papers in the last 28 days · 0.2% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Also in Policy Optimization

Neighbouring directions

Relative Policy OptimizationPolicy GradientProximal Policy Optimization

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-14

3 new papers

A weekly snapshot of new work published in Policy Optimization.

156 papers

Latest in Policy Optimization

Open your feed →
CardsList

  1. HaWMPO: Hallucination-Aware World Model-based Policy Optimization for Generalist Robot Policy

    Sep 9, 2026Zengjue Chen, Peidong Liu, Jiawei Li +1Robot PoliciesSafe Reinforcement Learning

  2. Entropy-Regularized Rank-Masked Policy Optimization for Test-Time Reinforcement Learning in Code Generation

    Sep 8, 2026Jiacheng Xu, Feng Chen, Xiuneng Xu +1AI Code GenerationSafe Reinforcement Learning

  3. Difficulty-Adaptive Tree-Structured Policy Optimization for Expanding Reasoning Coverage in RLVR

    Sep 8, 2026Youngjun Yu, Sanghwan Jang, Hwanjo YuVerifiable RewardsRelative Policy Optimization

  4. TIGPO: Temporal Instance-Graph Policy Optimization for Long-Horizon LLM Agents

    Sep 3, 2026Jinwei GanPolicy OptimizationLong-Horizon Credit Assignment

  5. Reinforcement learning to choose optimizers

    Sep 1, 2026Martin van der Schelling, Deepesh Toshniwal, Miguel A. BessaPortfolio OptimizationPolicy Optimization

  6. Aligning Multi-Trajectory Supervision with Policy Optimization for VLA Driving

    Aug 31, 2026Tian Zhang, Zhuo Huang, Hongrui Ye +3Vision-Language-Action PoliciesPolicy Optimization

  7. DiDPO: Diff-in-Diff Policy Optimization for Coding Agent Training

    Aug 7, 2026Xucong Wang, Zhe Zhao, Liheng Yu +3Verifiable RewardsAgentic Reinforcement Learning

  8. Retrieval-Constrained Policy Optimization for Attack Technique Extraction from Cyber Threat Intelligence

    Aug 7, 2026Jiayun Zhang, Junshen Xu, Zejun Xie +1Cyber Threat IntelligenceThreat Models

  9. Contextual Information Policy Optimization for Search Agents

    Aug 6, 2026Xingyu Guo, Wei Chen, Linlin Yang +1Policy Optimization

  10. EvoHIL: Self-Evolving Reward and Flow-Matched Policy Optimization for Robust Human-in-the-Loop Reinforcement Learning

    Aug 4, 2026Shuoqin Zhang, Tongtong Cheng, Xiru Gao +7Human-In-The-LoopReinforcement Learning From Human Feedback

  11. Don't Peek at the Answer: Outcome-Masked Group Relative Policy Optimization for Label-Free RLVR

    Aug 4, 2026Yongshi Ye, Liang Zhang, Yidong Chen +2Verifiable RewardsRepair-Based Group-Relative Policy Optimization

  12. Towards More Expressive Spoken LLMs: Fine-Grained Intent Benchmarking and Acoustic-Lexical Decoupled Policy Optimization

    Aug 4, 2026Xiang Lin, Tian-Hao Zhang, Chunfeng Wang +3Paralinguistic CuesSpeech Language Models

  13. Beyond the Mean: Multi-Moment Policy Optimization for LLM Reasoning

    Aug 3, 2026Yijun Zhang, Yule Xie, Jiaxin Ding +4LLM Reasoning MethodsRelative Policy Optimization

  14. Reusing Rollouts under Policy Lag: Prefix-Normalized Policy Optimization for LLM Reinforcement Learning

    Aug 2, 2026Wenhao Zhang, Yibo Xie, Rui Wang +9Reinforcement Learning RolloutsRelative Policy Optimization

  15. BiCAA: Bidirectional Credit Assignment for Search-Augmented Agent

    Aug 2, 2026Yibin Huang, Bin Xu, Hailong Cao +1Process Reward ModelingSearch Agents

  16. DocPO: Advancing Document Policy Optimization via Tailored Step-Aware Rewards

    Aug 1, 2026Yunhao Wang, Binghong Wu, Zhenyu Huang +4External Reward ModelsRelative Policy Optimization

  17. β-OPSD: Deriving with Policy Optimization, Training with Self-Distillation

    Jul 30, 2026Jiawei Xu, Minghui Liu, Juzheng Zhang +2Unsupervised On-Policy Self-DistillationSelf-Distillation

  18. APO: Unsupervised Atomic Policy Optimization for 3D Structure Prediction of Atomic Systems

    Jul 30, 2026Shentong Mo, Yatao BianCrystal Structure PredictionFeature Alignment

  19. TAPO: Transition-Aware Policy Optimization for LLM Agents

    Jul 30, 2026Cong Li, Peixi Peng, Yisen Zhao +4Policy OptimizationLarge Language Model Agents

  20. Q-Steer: Action-Value Guidance for Molecular Policy Optimization

    Jul 29, 2026Xinyu Wang, Jinbo Bi, Minghu SongMolecular OptimizationPolicy Optimization

  21. Towards Robust Reinforcement Learning for Small-Scale Language Model Agents

    Jul 27, 2026Md Rezwanul Haque, Md. Milon Islam, Fakhri KarraySmall Large Language ModelsProximal Policy Optimization

  22. On the Impossibility of Unbiased and Length-Invariant Policy Optimization with Outcome Rewards

    Jul 25, 2026Fei Ding, Yongkang Zhang, Yuhao Liao +2Relative Policy OptimizationPolicy Optimization

  23. QLPO: Quadrant-weighted Sampling for Length-aware Policy Optimization

    Jul 23, 2026Siwei Chen, Siqi Chen, Xupeng Miao +1Relative Policy OptimizationPolicy Optimization

  24. Active Inference as a Convex Markov Decision Process

    Jul 22, 2026Nikola Milosevic, Nicolás Hinrichs, Nico ScherfMarkov Decision ProcessesPolicy Optimization

  25. Co-Evolving LLM Evaluators and Policies via DynamicRubric

    Jul 22, 2026Beining Wang, Weihang Su, Hongtao Tian +8RubricsLarge Language Model Evaluation

  26. Progress-conditioned Group Policy Optimization for Long-Horizon Agentic Tasks

    Jul 22, 2026Kaibing Yang, Guangfeng Cai, Shengtian Yang +6Policy OptimizationLong-Horizon Agents

  27. RRPO: Reference-Relative Policy Optimization with Stratified Conditional Rollouts

    Jul 20, 2026Yuxin Xiong, Xunyi Jiang, Rohan Surana +8Verifiable RewardsPolicy Optimization

  28. OR Else: A Differentiable Trust Region for Policy Optimization

    Jul 20, 2026Chinmay Rane, Kanishka Tyagi, Michael ManryPolicy OptimizationTrust Region

  29. CriPO: Enhancing Rubric-based RL via Self-Distillation

    Jul 20, 2026Mingxuan Xia, Yuhang Yang, Chao Ye +7Rubric-Based Reinforcement LearningUnsupervised On-Policy Self-Distillation

  30. JAGG: Jacobian-Aggregated Group Gradient for Efficient GRPO Training of Diffusion Models

    Jul 20, 2026Ruiyi Ding, Jie Li, He Kang +3Diffusion TransformersDiffusion Models

  31. Group Entropy-Controlled Policy Optimization

    Jul 18, 2026Guangran Cheng, Chengqi Lyu, Songyang Gao +2Repair-Based Group-Relative Policy OptimizationPolicy Optimization

  32. Beyond Entropy: Correctness-Aware Advantage Shaping via Contrastive Policy Optimization

    Jul 16, 2026Weiwen Xu, Jia Liu, Hou Pong Chan +4Verifiable RewardsPolicy Optimization

  33. Branching Policy Optimization: Sandbox-Native Language Agent Reinforcement Learning

    Jul 15, 2026Bowei He, Yankai Chen, Xiaokun Zhang +1Policy OptimizationSafe Reinforcement Learning

  34. From Critic to Confidence: PPO for Language-Based Quantitative Prediction with Confidence Estimation

    Jul 14, 2026Mehak Dhaliwal, Rasta Tadayon, Andong Hua +2Large Language Model UncertaintyPolicy Optimization

  35. Max Out GRPO Signal: Adaptive Trace Prefix Control for Hard Reasoning Problems

    Jul 8, 2026Vladislav BeliaevGrokipediaDirect Advantage Estimation

  36. Information Gain-based Rollout Policy Optimization: An Adaptive Tree-Structured Rollout Approach for Multi-Turn LLM Agents

    Jul 7, 2026Yijun Zhang, Fan Xu, Jiaxin Ding +6Reinforcement Learning RolloutsLong-Horizon Agents

  37. Staleness-Learning Rate Scaling Laws for Asynchronous RLHF

    Jul 1, 2026Jingwei Song, Haofeng Xu, Jie Xiao +8Long RolloutsLearning Rates

  38. Active-GRPO: Adaptive Imitation and Self-Improving Reasoning for Molecular Optimization

    Jul 1, 2026Xuefeng Liu, Mingxuan Cao, Qinan Huang +3Molecular OptimizationGrokipedia

  39. Policy Optimization Achieves Data-Dependent Regret Bounds in MDPs with Unknown Transitions

    Jun 30, 2026Mingyi Li, Taira Tsuchiya, Kenji YamanishiSublinear RegretMarkov Decision Processes

  40. ReGRPO: Reflection-Augmented Policy Optimization for Tool-Using Agents

    Jun 30, 2026Binjie Zhang, Mike Zheng ShouGroup Relative Policy Optimization GradientsAgentic Reinforcement Learning

  41. ACPO: Agent-Chained Policy Optimization for Multi-Agent Reinforcement Learning

    Jun 29, 2026Daiki E. Matsunaga, Junho Na, Tri Wahyu Guntara +4Multi-Agent Reinforcement LearningPolicy Optimization

  42. PS-PPO: Prefix-Sampling PPO for Critic-Free RLHF

    Jun 29, 2026Doo Hwan Hwang, Kee-Eung KimReinforcement Learning From Human FeedbackActor--Critic Training

  43. BiPACE: Bisimulation-Guided Policy Optimization with Action Counterfactual Estimation for LLM Agents

    Jun 24, 2026Hanyang Wang, Weijieying Ren, Yuxiang Zhang +4Reinforcement Learning Base-To-Thinking GapPolicy Optimization

  44. Beyond Trajectory Imitation: Strategy-Guided Policy Optimization for LLM Reasoning

    Jun 23, 2026Tianyuan Shi, Canbin Huang, Bei Li +4LLM Reasoning MethodsPolicy Optimization

  45. Scheduling Thoughts: Learning the Order of Thought in Diffusion Language Models

    Jun 22, 2026Jiawei Xu, Minghui Liu, Aakriti Agrawal +2Diffusion Language ModelsMasked Diffusion Language Models

  46. GraphPO: Graph-based Policy Optimization for Reasoning Models

    Jun 17, 2026Yuliang Zhan, Xinyu Tang, Jian Li +7Reasoning PathsVerifiable Rewards

  47. Scalar-Stepsize Nonuniform Monte Carlo Optimistic Policy Iteration: A Certified Counterexample

    Jun 14, 2026Yuanlong ChenStochastic ApproximationMonte Carlo

  48. BALTO: Balanced Token-Level Policy Optimization for Hallucination Mitigation

    Jun 14, 2026Ning Li, Zixuan Guo, Yan Xu +7Large Language Model HallucinationLarge Language Model Reliability

  49. AP-GRPO: Anchor-Gated Phonetic Alignment with Policy Optimization for Pathological Speech Reconstruction

    Jun 14, 2026Pengfei Zhang, Hoang H Nguyen, Yutong Song +6Dysarthric SpeechSpeech-To-Text Alignment

  50. Learning Coordinated Preference for Multi-Objective Multi-Agent Reinforcement Learning

    Jun 12, 2026Pengxin Wang, Lihao Guo, Yi Xie +3Multi-Agent Reinforcement LearningPolicy Optimization

  51. Utility-Constrained Policy Optimization

    Jun 12, 2026Mehrdad Moghimi, Bernardo Avila PiresSafety ConstraintsMarkov Decision Processes

  52. IAPO: Input Attribution-Aware Policy Optimization for Tool Use in Small Multimodal Agents

    Jun 10, 2026Yifan Yang, Zhen Zhang, Jiayi Tian +2Multimodal AgentsLarge Multimodal Models

  53. Test-Time Gradient Guidance of Flow Policies in Reinforcement Learning

    Jun 9, 2026Zhiyuan Zhou, Andy Peng, Charles Xu +4Diffusion PoliciesImitation Learning

  54. Flow-DPPO: Divergence Proximal Policy Optimization for Flow Matching Models

    Jun 9, 2026Bowen Ping, Xiangxin Zhou, Penghui Qi +3Proximal Policy OptimizationTraining-Inference Mismatch

  55. On-sky demonstration of reinforcement learning for adaptive optics control

    Jun 9, 2026Jalo Nousiainen, Vincent Chambouleyron, Benoit Neichel +7Robust ControlPolicy Optimization

  56. N-GRPO: Embedding-Level Neighbor Mixing for Enhanced Policy Optimization

    Jun 9, 2026Xukun Zhu, Hang Yu, Peng Di +1Mathematical Reasoning BenchmarksGrokipedia

  57. Convergence of Monte Carlo Optimistic Policy Iteration: Beyond Uniform State-Action Updates

    Jun 9, 2026Octave Oliviers, Glenn VinnicombeOptimal PoliciesPolicy Optimization

  58. Discovering Interpretable Multi-Parameter Control Policies for Evolutionary Algorithms Using Deep Reinforcement Learning

    Jun 8, 2026Tai Nguyen, Phong Le, Carola Doerr +1Deep Q-NetworksEvolutionary Algorithms

  59. 3SPO: State-Score-Supervised Policy Optimization for LLM Agents

    Jun 8, 2026Yu Han, Kailing Li, Yang Jiao +4Safe Reinforcement LearningPolicy Optimization

  60. Co-Evolving Skill Generation and Policy Optimization

    Jun 7, 2026Zhiwei Zhang, Yudi Lin, Nikki Lijing Kuang +4Agent Skill LibrariesAgentic Reinforcement Learning