Group Relative Policy Optimization

Follow this field Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

14 new papers

A weekly snapshot of new work published in Group Relative Policy Optimization.

Period ending 2026-09-14

6 new papers

A weekly snapshot of new work published in Group Relative Policy Optimization.

Period ending 2026-09-07

21 new papers

A weekly snapshot of new work published in Group Relative Policy Optimization.

Inside this field

Focused directions

Focused topic

Group Relative Policy Optimization

Within Group Relative Policy Optimization

287 papersExplore

Focused topic

Multi-Objective Policy Optimization

Within Group Relative Policy Optimization

122 papersExplore

Focused topic

Policy Gradient

Within Group Relative Policy Optimization

64 papersExplore

Focused topic

Proximal Policy Optimization

Within Group Relative Policy Optimization

60 papersExplore

Focused topic

Flow-Grpo

Within Group Relative Policy Optimization

42 papersExplore

532 papers

Latest in Group Relative Policy Optimization

Browse all topics →

Signal Reshaping for GRPO in Weak-Feedback Agentic Code Repair
May 8, 2026Jia Li, Yuxin Su, Ting Peng +3Potential-Based Reward Shaping Agentic Reinforcement-Learning Framework
Structured Role-Aware Policy Optimization for Multimodal Reasoning
May 8, 2026Bingqing Jiang, Difan ZouMultimodal Reasoning Latent Visual Reasoning
Experience Sharing in Mutual Reinforcement Learning for Heterogeneous Language Models
May 8, 2026Xiaoze Liu, Dhananjay Ram, Yuting Zhang +3Reinforcement Learning Post-Training Group Relative Policy Optimization
PISTO: Proximal Inference for Stochastic Trajectory Optimization
May 8, 2026Hongzhe Yu, Zinuo Chang, Yongxin ChenTrajectory Optimization Proximal Policy Optimization
Where to Spend Rollouts: Hit-Utility Optimal Rollout Allocation for Group-Based RLVR
May 8, 2026Tao Wang, Shuo Li, Yan Sun +2Group Relative Policy Optimization Reinforcement Learning With Verifiable Reward
DACA-GRPO: Denoising-Aware Credit Assignment for Reinforcement Learning in Diffusion Language Models
May 8, 2026Amin Karimi Monsefi, Dominic Culver, Nikhil Bhendawade +4Diffusion Language Models Credit Assignment
PACEvolve++: Improving Test-time Learning for Evolutionary Search Agents
May 7, 2026Minghao Yan, Bo Peng, Benjamin Coleman +11Evolutionary Search Multi-Objective Policy Optimization
Beyond Negative Rollouts: Positive-Only Policy Optimization with Implicit Negative Gradients
May 7, 2026Mingwei Xu, Hao FangReinforcement Learning With Verifiable Reward Verifiable Rewards
SNAPO: Smooth Neural Adjoint Policy Optimization for Optimal Control via Differentiable Simulation
May 7, 2026Dmitri Goloubentsev, Natalija KarpichinaMulti-Objective Policy Optimization Adjoint Matching
Gradient Extrapolation-Based Policy Optimization
May 7, 2026Ismam Nur Swapnil, Aranya Saha, Tanvir Ahmed Khan +2Group Relative Policy Optimization Multi-Objective Policy Optimization
Asymmetric On-Policy Distillation: Bridging Exploitation and Imitation at the Token Level
May 7, 2026Nan Jia, Haojin Yang, Xing Ma +6On-Policy Distillation Policy Gradient
A Unified Pair-GRPO Family: From Implicit to Explicit Preference Constraints for Stable and General RL Alignment
May 7, 2026Hao YuTraining-Free Reward Alignment Group Relative Policy Optimization
Listwise Policy Optimization: Group-based RLVR as Target-Projection on the LLM Response Simplex
May 7, 2026Yun Qu, Qi Wang, Yixiu Mao +11Group Relative Policy Optimization Reinforcement Learning With Verifiable Reward
Beyond Uniform Credit Assignment: Selective Eligibility Traces for RLVR
May 7, 2026Chaoli Mou, Zhan Zhuang, Xinning Chen +1Reinforcement Learning With Verifiable Reward Group Relative Policy Optimization
AGPO: Asymmetric Group Policy Optimization for Verifiable Reasoning and Search Ads Relevance at JD
May 7, 2026Yang Xu, Kun Yao, Yiming Deng +3Reinforcement Learning With Verifiable Reward Group Relative Policy Optimization
Selective Rollout: Mid-Trajectory Termination for Multi-Sample Agent RL
May 7, 2026Zhiyuan Zhai, Xin WangGroup Relative Policy Optimization Long Rollouts
MotionGRPO: Overcoming Low Intra-Group Diversity in GRPO-Based Egocentric Motion Recovery
May 7, 2026Nanjie Yao, Junlong Ren, Wenhao Shen +1Avatar Reconstruction Ego-Motion
Nonsense Helps: Prompt Space Perturbation Broadens Reasoning Exploration
May 7, 2026Langlin Huang, Chengsong Huang, Jinyuan Li +3Large Language Model Reasoning Reinforcement Learning With Verifiable Reward
Approximate Next Policy Sampling: Replacing Conservative Target Policy Updates in Deep RL
May 6, 2026Dillon Sandhu, Ronald ParrMulti-Objective Policy Optimization Deep Reinforcement Learning
Rollout Pass-Rate Control: Steering Binary-Reward RL Toward Its Most Informative Regime
May 6, 2026Tianshu Zhu, Wenyu Zhang, Xiaoying Zuo +8Rollout Group Relative Policy Optimization
EP-GRPO: Entropy-Progress Aligned Group Relative Policy Optimization with Implicit Process Guidance
May 6, 2026Song Yu, Li Li, Wenwen Zhao +1Group Relative Policy Optimization Reinforcement Learning With Verifiable Reward
Maximizing Rollout Informativeness under a Fixed Budget: A Submodular View of Tree Search for Tool-Use Agentic Reinforcement Learning
May 6, 2026Yuelin Hu, Zhenbo Yu, Zhengxue Cheng +2Rollout Agentic Reinforcement-Learning Framework
Explaining and Preventing Alignment Collapse in Iterative RLHF
May 5, 2026Etienne Gauthier, Francis Bach, Michael I. JordanReinforcement Learning From Human Feedback Multi-Objective Policy Optimization
Vanishing L2 regularization for the softmax Multi Armed Bandit
May 5, 2026Stefana-Lucia Anita, Gabriel TuriniciMulti-Armed Bandits Policy Gradient
GRPO-TTA: Test-Time Visual Tuning for Vision-Language Models via GRPO-Driven Reinforcement Learning
May 5, 2026Yujun Li, Hongyuan Zhang, Yuan YuanVision-Language Model Adaptation Group Relative Policy Optimization
DGPO: Distribution Guided Policy Optimization for Fine Grained Credit Assignment
May 5, 2026Hongbo Jin, Rongpeng Zhu, Zhongjing Du +4Multi-Objective Policy Optimization Credit Assignment
Orchestrating Spatial Semantics via a Zone-Graph Paradigm for Intricate Indoor Scene Generation
May 4, 2026Meisheng Zhang, Shizhao Sun, Yang Zhao +3Indoor Scene Generation Group Relative Policy Optimization
ANO: Robust Policy Optimization via Bounded, Redescending Gain Fields
May 4, 2026Yiheng Zhang, Yiming Wang, Kaiyan Zhao +3Proximal Policy Optimization Multi-Objective Policy Optimization
T $^2$ PO: Uncertainty-Guided Exploration Control for Stable Multi-Turn Agentic Reinforcement Learning
May 4, 2026Haixin Wang, Hejie Cui, Chenwei Zhang +7Multi-Objective Policy Optimization Efficient Exploration
Enhanced LLM Reasoning by Optimizing Reward Functions with Search-Driven Reinforcement Learning
May 3, 2026Arash Ahmadi, Sarah Sharif, Yaser +1Large Language Model Reasoning External Reward Models
Grounding Multi-Hop Reasoning in Structural Causal Models via Group Relative Policy Optimization
May 2, 2026Yunhan Bu, Quan Zhang, Huaping Zhang +9Multi-Hop Reasoning Structural Causal Model
Beyond Perceptual Shortcuts: Causal-Inspired Debiasing Optimization for Generalizable Video Reasoning in Lightweight MLLMs
May 2, 2026Jingze Wu, Quan Zhang, Hongfei Suo +2Video Understanding Visual Reasoning
PPO guided Agentic Pipeline for Adaptive Prompt Selection and Test Case Generation
May 1, 2026Gourisetty Venkata Sai Koushik, Dama Aditya, Mahankali Harish Sai +3Test Generation Workflow Generation
Global Optimality for Constrained Exploration via Penalty Regularization
Apr 30, 2026Florian Wolf, Ilyas Fatkhullin, Niao HePolicy Gradient Efficient Exploration
Cost-Aware Learning
Apr 30, 2026Clara Mohri, Amir Globerson, Haim Kaplan +2Group Relative Policy Optimization Stochastic Gradient Descent
Kernelized Advantage Estimation: From Nonparametric Statistics to LLM Reasoning
Apr 30, 2026Shijin Gong, Kai Ye, Jin Zhu +3Large Language Model Reasoning Policy Gradient
Latent-GRPO: Group Relative Policy Optimization for Latent Reasoning
Apr 30, 2026Jingcheng Deng, Zihao Wei, Liang Pang +4Efficient Latent Reasoning Group Relative Policy Optimization
Bayesian policy gradient and actor-critic algorithms
Apr 30, 2026Mohammad Ghavamzadeh, Yaakov Engel, Michal ValkoPolicy Gradient Soft Actor-Critic
Skills-Coach: A Self-Evolving Skill Optimizer via Training-Free GRPO
Apr 30, 2026Yu Tian, Jiawei Chen, Lifan Zheng +5Skill Evolution Group Relative Policy Optimization
Distributional Alignment Games for Answer-Level Fine-Tuning
Apr 29, 2026Mehryar Mohri, Jon Schneider, Yifan WuLarge Language Model Alignment Finetuning
When Errors Can Be Beneficial: A Categorization of Imperfect Rewards for Policy Gradient
Apr 28, 2026Shuning Shang, Hubert Strauss, Stanley Wei +2Policy Gradient Training Language Models
Sample-efficient Neuro-symbolic Proximal Policy Optimization
Apr 28, 2026Simone Murari, Celeste Veronese, Daniele MeliProximal Policy Optimization Neuro-Symbolic Framework
DGLight: DQN-Guided GRPO Fine-Tuning of Large Language Models for Traffic Signal Control
Apr 28, 2026Chenbo YuIterative Reinforcement Learning Group Relative Policy Optimization
Frictive Policy Optimization for LLMs: Epistemic Intervention, Risk-Sensitive Control, and Reflective Alignment
Apr 28, 2026James Pustejovsky, Nikhil KrishnaswamyEpistemic Actions Epistemic Stance
V-GRPO: Online Reinforcement Learning for Denoising Generative Models Is Easier than You Think
Apr 25, 2026Bingda Tang, Yuhui Zhang, Xiaohan Wang +3Group Relative Policy Optimization Generative Models
Hidden States Know Where Reasoning Diverges: Credit Assignment via Span-Level Wasserstein Distance
Apr 25, 2026Xinzhu Chen, Wei He, Huichuan Fan +7Credit Assignment Group Relative Policy Optimization
K-Score: Kalman Filter as a Principled Alternative to Reward Normalization in Reinforcement Learning
Apr 24, 2026Zixuan Xia, Quanxi LiPolicy Gradient Extended Kalman Filter
Towards Temporal Compositional Reasoning in Long-Form Sports Videos
Apr 24, 2026Siyu Cao, Lu Zhang, Ruizhe Zeng +1Video Temporal Grounding Dense Temporal Annotation
Tempered Sequential Monte Carlo for Trajectory and Policy Optimization with Differentiable Dynamics
Apr 23, 2026Heng YangHamiltonian Monte Carlo Monte Carlo
Near-Future Policy Optimization
Apr 22, 2026Chuanyu Qin, Chenxu Yang, Qingyi Si +6Multi-Objective Policy Optimization Off-Policy Evaluation
GRPO-VPS: Enhancing Group Relative Policy Optimization with Verifiable Process Supervision for Effective Reasoning
Apr 22, 2026Jingyi Wang, Lei Zhu, Tengjin Weng +8Reinforcement Learning With Verifiable Reward Group Relative Policy Optimization
Efficient Reinforcement Learning using Linear Koopman Dynamics for Nonlinear Robotic Systems
Apr 21, 2026Wenjian Hao, Yuxuan Fang, Zehui Lu +1Koopman Operator Deep Reinforcement Learning
EVPO: Explained Variance Policy Optimization for Adaptive Critic Utilization in LLM Post-Training
Apr 21, 2026Chengjun Pan, Shichun Liu, Jiahang Lin +10Multi-Objective Policy Optimization Sparse Rewards
M $^{2}$ GRPO: Mamba-based Multi-Agent Group Relative Policy Optimization for Biomimetic Underwater Robots Pursuit
Apr 21, 2026Yukai Feng, Zhiheng Wu, Zhengxing Wu +2Underwater Robots Multi-Agent Reinforcement Learning
Learning to Credit the Right Steps: Objective-aware Process Optimization for Visual Generation
Apr 21, 2026Rui Li, Ke Hao, Yuanzhi Liang +4Denoising Trajectory Visual Generation
Reinforcement Learning Improves LLM Accuracy and Reasoning in Disease Classification from Radiology Reports
Apr 21, 2026Yishu Wei, Yi Lin, Adam Flanders +2Radiology Report Generation Disease Detection
Intentional Updates for Streaming Reinforcement Learning
Apr 21, 2026Arsalan Sharifnassab, Mohamed Elsayed, Kris De Asis +2Policy Gradient Deep Reinforcement Learning
Policy Gradient Primal-Dual Method for Safe Reinforcement Learning from Human Feedback
Apr 21, 2026Qiang Liu, Adrienne Kline, Ermin WeiReinforcement Learning From Human Feedback Deep Reinforcement Learning
Accelerating trajectory optimization with Sobolev-trained diffusion policies
Apr 21, 2026Théotime Le Hellard, Franki Nguimatsia Tiofack, Quentin Le Lidec +1Trajectory Optimization Diffusion Policies
Bounded Ratio Reinforcement Learning
Apr 20, 2026Yunke Ao, Le Chen, Bruce D. Lee +5Proximal Policy Optimization Deep Reinforcement Learning

May 8, 2026 · cs.AIJ/K move · Enter open · S save

Signal Reshaping for GRPO in Weak-Feedback Agentic Code Repair

Jia Li, Yuxin Su, Ting Peng, Hailiang Huang+2

The Chinese University of Hong Kong · Sun Yat-sen University · Tencent

Code-agent RL often receives weak feedback: rollout-time signals are reliable and executable, but capture only necessary or surface conditions for task success rather than the target semantic predicate. Using agentic compile-fix as the setting, we study signal reshaping for standard GRPO under such feedback. Our central claim is that GRPO's within-group comparison is meaningful only after three kinds of signals are reshaped: outcome rewards recover semantic ranking, process signals localize intra-trajectory credit, and rollouts from the same prompt remain execution-comparable. We operationalize these conditions with a minimal signal-reshaping construction that leaves GRPO's group-normalized advantage construction unchanged: compile-and-semantic layered rewards reshape trajectory ranking, step-level process scores outside group reward normalization reshape within-trajectory update strength, and failure-cause-aware rollout governance reshapes within-group comparability. Experiments show a clear end-to-end gain: full signal-reshaped GRPO improves strict compile-and-semantic accuracy from the base model's zero-shot

0.385

0.535

. Controlled comparisons further explain the source of this gain: binary rewards remove the compile-only middle tier and degrade trajectory control; on top of layered rewards, process-score weighting further improves accuracy from

0.48

0.53

and reduces average evaluation steps from

23.50

17.02

. As a boundary comparison, privileged-prompt token-level distillation mainly optimizes local distributional alignment; in long tool-use trajectories, this signal is diluted by non-critical tokens and cannot replace outcome semantics, process credit, or within-group comparability.

Potential-Based Reward Shaping Agentic Reinforcement-Learning Framework Group Relative Policy Optimization Coding Agents Long Rollouts Feedback Learning Agentic Tool Use

Open paper Ask about it PDF