Overview

Reward shaping studies how to turn sparse or delayed task outcomes into learning signals that help an agent identify useful actions and make progress. Common approaches add potential-based progress estimates, subgoal or process rewards, and signals learned from demonstrations, language models, visual feedback, or model uncertainty; they are used in robotics, tool-using language agents, reasoning, and control. A central challenge is providing dense, reliable credit without changing the intended objective or encouraging reward hacking, verbosity, or unsafe shortcuts. Current work increasingly tests not just whether rewards improve benchmark performance, but also whether they preserve optimal policies, remain stable during optimization, and generalize beyond training settings.

Latest papers

CardsList

150 papers10 papers in the last four weeks, down 52% on the four weeks before. 0.1% of all new papers.

  1. MaxIM: Maximally Informative Incremental Summarization via Reinforcement Learning

    Nov 9, 2026Jihwan Jeong, Guy Tennenholtz, Yinlam Chow +2Text SummarizationMemory-Augmented RL

  2. AttnSR: Attention Step Reward for Long-Horizon Agentic RL

    Nov 5, 2026Mengsong Wu, Tianchen Zhou, Zhaochen Su +3Agentic RLStep-Level Credit Assignment in RL

  3. PhySA: Decoupling Aesthetic and Physical Rewards for Humanoid Locomotion

    Nov 5, 2026Yunwan Fu, Sicheng He, Jiageng Mao +1Humanoid Robot LocomotionRobot Locomotion

  4. Behavior-Discriminative Reward Shaping for Reward-Robust Reinforcement Learning

    Nov 2, 2026Zixuan Liu, Fangzheng Wu, Brian Summa +1Robust RLReward Shaping

  5. Enhancing Deep Reinforcement Learning for Robotic Motion Planning via Task Decomposition

    Oct 26, 2026Yuanzhi He, Victor Romero-Cano, Jiayu Xu +2Reinforcement LearningRobotic RL

  6. MPBRS: Multi-Potential-Based Reward Shaping for Unified Reward Configuration in Humanoid Locomotion

    Oct 21, 2026Van Chung Nguyen, Hung Manh LaReward ShapingReward Design for RL

  7. The Predictive--Optimization Gap in GuanDan Self-Play

    Oct 21, 2026Qicheng Zou, Biao Yuan, Siyu Song +2Predict-Then-OptimizeSelf-Play RL

  8. Mitigating Reward Hacking in Preference Reward Models with Evolving Penalties

    Oct 19, 2026Afonso Baldo, António Farinhas, Marcos Treviso +2Reward HackingRL for Language Models

  9. Progress Reward Model for Reinforcement Learning via Large Language Models

    Oct 15, 2026Xiuhui Zhang, Ning Gao, Xingyu Jiang +4Reward Design for RLLLM-Guided RL

  10. GRID-Planner: Graph-Structured Relational Reward Shaping for Diffusion Planning

    Oct 15, 2026Zhao Yang, Zezhong Qian, Yinan Shi +2Autonomous Driving PlanningDiffusion-Based Planning

  11. Diagnosing and Correcting Reward Hacking in Verifiable Instruction Following

    Oct 14, 2026Sangyeon Yoon, Wooseok Seo, Hamish Ivison +5Reward HackingInstruction Following

  12. Tev: Scaling Long-Horizon Agentic Environments with Dense Progress Rewards

    Oct 13, 2026Wenbo Hu, Shraman Pramanick, Krishna Kumar Singh +3LLM Agent TrainingLong-Horizon LLM Agents

  13. Training LLMs for Multi-Agent Collaboration with Verifiable Information Rewards

    Oct 13, 2026Keru Chen, Sen Lin, Yingbin Liang +2LLM Agent TrainingMulti-Agent Collaboration

  14. CodeLift: Your Test Suite Is Secretly a Dense SWE Curriculum

    Oct 12, 2026Junjielong Xu, Huachao Zhu, Alyssa Wu +2RL for Code GenerationSoftware Engineering Agents

  15. ADAPT: Audio-Depth Action Planning with Transition-Aware Rewards for Lights-Out Industrial Navigation

    Oct 11, 2026Wenjun Huang, Shenghao Fu, Yian Jin +12Robot NavigationRobotic RL

  16. Self-Evolving Visual Agent via Margin Reward

    Oct 10, 2026Wenxi Yang, Yuzhong Zhao, Baochang Zhang +2Tool-Using Vision-Language AgentsRL for Tool Use

  17. Ask the Expert: LLM-Guided Reinforcement Learning for Autonomous Cyber Defense

    Oct 7, 2026Fernando Martinez, Abhishek Satyam, Tao Li +3Autonomous Cyber DefenseLLM-Guided RL

  18. Task-Space Imitation Guidance for Efficient Reinforcement Learning

    Oct 5, 2026Salar Asayesh, Hossein Darani, Todd Cao +2Reward ShapingImitation Learning

  19. Dependency-Aware Reward Shaping for Agentic Reinforcement Learning

    Oct 1, 2026Ziyi Chen, Yan Zhang, Jianhui Wei +2RL for Language ModelsAgentic RL

  20. T2SPO: Trajectory-to-Step Policy Optimization for Agentic Reinforcement Learning

    Sep 30, 2026Bo-Wen Zhang, Junwei He, Maoqi Liu +6Agentic RLReward Shaping

  21. ReF-HIL: Shaping the Critic around Human Action Neighborhoods for Efficient Human-in-the-Loop Reinforcement Learning

    Sep 29, 2026Shaoyin Luo, Song Wang, Shibo Xia +5RL for RoboticsReward Shaping

  22. StructRL: Online Structured Reinforcement Learning for Long-Horizon Vision-Language-Action Tasks

    Sep 28, 2026Ziyi Yin, Sangmin Woo, Kang Zhou +4Reward ShapingLong-Horizon Robotic Manipulation

  23. Quality Determines Direction, Length Shapes Magnitude: Length Control for Open-Ended Reinforcement Learning

    Sep 28, 2026Zijun Weng, Zhongan Bi, Xuanang Gao +5Open-Ended GenerationRL for Language Models

  24. Sufficiency of Zeroth-Order Reward Shaping for Policy Gradient in Stabilization Control

    Sep 28, 2026Yisheng Zhang, Tao Wang, Sicun GaoReward ShapingRobotic RL

  25. SWE-MILE: Asynchronous Potential-Induced Milestone Credit Assignment for Long-Horizon Software Engineering Agents

    Sep 26, 2026Chaoqun Cui, Hao Zhou, Meiqi Chen +2Software Engineering AgentsStep-Level Credit Assignment in RL