Dense Reward RL

RL: Reinforcement Learning

Overview

Dense reward reinforcement learning studies how to give agents useful feedback during a task, rather than only scoring the final outcome, to improve learning and credit assignment. Approaches include progress and stage-based rewards, models learned from demonstrations or videos, language- and vision-based signals, and trajectory, graph, or token-level feedback. These methods are used in robotic manipulation, long-horizon language-model agents, coding, and mathematical reasoning, often alongside sparse outcome rewards. A central challenge is making intermediate signals accurate and generalizable without encouraging reward hacking or destabilizing training; in some settings, noisy or poorly delivered dense rewards can perform worse than sparse feedback.

Latest papers

CardsList

34 papers5 papers in the last four weeks, level with the four weeks before. 0.0% of all new papers.

  1. Are Dense Rewards Worth Their Tokens in GRPO?

    Nov 10, 2026Vikash Singh, Weicong Chen, Debargha Ganguly +16RL for Language ModelsDense Reward RL

  2. TwinBridge: Digital Twin-Driven Policy and Reward Transfer for Real-World Reinforcement Learning in Laboratory Robotics

    Nov 4, 2026Shu'ang Sun, Yibo Qiu, Haoliang Ye +5Robotic RLSim-to-Real Transfer

  3. Online Dense Reinforcement Learning with Planning-Grounding Agent for UI Navigation on Live IOS Apps

    Oct 29, 2026Peitong Duan, Khashayar Gatmiry, Jeffrey Nichols +2RL for GUI AgentsDense Reward RL

  4. Event2Reward: Learning Robotic Rewards from Progress Relations

    Oct 29, 2026Junnan Nie, Zitian Fan, Jiachen Zhang +14Robotic RLReward Design for RL

  5. Expert-Guided Rubrics as Dense Reward Signals for Reinforcement Learning in Non-Verifiable Domains

    Oct 17, 2026Ashish Bansal, Hossam Amer, Keerat Kaur Guliani +3RL for LLM AgentsReward Design for RL

  6. Tev: Scaling Long-Horizon Agentic Environments with Dense Progress Rewards

    Oct 13, 2026Wenbo Hu, Shraman Pramanick, Krishna Kumar Singh +3LLM Agent TrainingLong-Horizon LLM Agents

  7. Disentangling Task-Relevant Latent Dynamics for Reward Modeling

    Oct 9, 2026Dayou Li, Jionghao Wang, Peihao Wang +9Dense Reward RLMultimodal Reward Modeling

  8. Before the Rollout Ends: Early Terminal Reward Prediction for Long-horizon Coding Agents

    Sep 25, 2026Jihan Yao, Sihan Zeng, Shangbin Feng +3Long-Horizon Agent EvaluationReward Modeling

  9. HiRE: Hindsight Reward Editing for Policy Finetuning

    Sep 22, 2026Haoyi Niu, Zhengtao Han, Yufeng Ji +2Reward Design for RLRobot Policy Learning

  10. From Connectivity to Rewards: Dense Reward Learning with Directed State Graphs

    Sep 9, 2026Shuyuan Zhang, Zihan Wang, Xiao-Wen Chang +1Reinforcement LearningHierarchical RL

  11. Long-Horizon Language Model Reinforcement Learning via Progressive Point Matching

    Sep 7, 2026Preston Fu, Kevin Frans, Oleh Rybkin +2Dense Reward RLReward Shaping

  12. Dense Process Supervision for Search Agents via Fact Utility Estimation

    Sep 1, 2026Rongzhi Zhu, Xiangyu Liu, Yi Liu +7Reinforcement LearningCredit Assignment in RL

  13. Dream2Reward: Transition-Alignment Reward Models from Positive Demonstrations for Robotic Manipulation

    Aug 19, 2026Haoyu Zhang, Zecui Zeng, Bin Wang +3Reward Design for RLDense Reward RL

  14. TRACE: Turn-level Reward Assignment via Credit Estimation for Long-Horizon Agents

    Jul 15, 2026Leitian Tao, Baolin Peng, Wenlin Yao +5Credit Assignment in RLStep-Level Credit Assignment in RL

  15. Stage-Transition Dense Reward Modeling for Reinforcement Learning

    Jun 30, 2026Yang Yang, Bingjie Chen, Zihan Wang +4RL for RoboticsLong-Horizon Robotic Manipulation

  16. RARM: Confidence-Gated Progress Reward Modeling for RL in Manipulation

    Jun 20, 2026Pengzhi Yang, Xinyu Wang, Pengyu Jing +7Process Reward ModelsLong-Horizon Robotic Manipulation

  17. Momentum for Reasoning: Dense Intrinsic Signals in Policy Optimization

    Jun 7, 2026Hao Chen, Zhanming Shen, Liyao Li +8Intrinsic Reward MethodsReinforcement Learning

  18. Domain-Adaptable Reinforcement Learning for Code Generation with Dense Rewards

    May 20, 2026Erfan Aghadavoodi Jolfaei, Daniel Maninger, Abhinav Anand +2RL for Code GenerationReinforcement Learning

  19. PokeRL: Reinforcement Learning for Pokemon Red

    Apr 12, 2026Dheeraj Mudireddy, Sai PatibandlaRL for Game AIReinforcement Learning

  20. Skip-Connected Policy Optimization for Implicit Advantage

    Apr 9, 2026Fengwei Teng, Jinyi Bai, Xinhao Yao +3RL for Language Model ReasoningReinforcement Learning with Verifiable Rewards

  21. ARM: Advantage Reward Modeling for Long-Horizon Manipulation

    Apr 3, 2026Yiming Mao, Zixi Yu, Weixin Mao +5Reward ModelingLong-Horizon Robotic Manipulation

  22. Generalizable Dense Reward for Long-Horizon Robotic Tasks

    Mar 31, 2026Silong Yong, Stephen Sheng, Carl Qi +6Reinforcement LearningLong-Horizon Robotic Manipulation

  23. RewardFlow: Can Action-Level Reward Be Estimated from State-Graph Topology in Agentic RL?

    Mar 19, 2026Xiao Feng, Bo Han, Zhanke Zhou +5RL for LLM AgentsReward Design for RL

  24. Rewarding DINO: Predicting Dense Rewards with Vision Foundation Models

    Mar 17, 2026Pierre Krack, Tobias Jülg, Wolfram Burgard +1Reward ModelingReward Design for RL

  25. SQL-ASTRA: Alleviating Sparse Feedback in Agentic SQL via Column-Set Matching and Trajectory Aggregation

    Mar 17, 2026Long Li, Zhijian Zhou, Jiangxuan Long +5Text-to-SQLStep-Level Credit Assignment in RL