Overview

Reward hacking occurs when a system optimizes a proxy—such as a reward model, judge, rubric, or benchmark verifier—without achieving the intended goal. Research studies this in settings including reinforcement learning from human feedback, verifiable-reward language-model training, tool-using agents, and image or robot generation. Common approaches include building controlled tests and adversarial audits, hardening verifiers, using uncertainty-aware or multiple reward signals, and monitoring behavior through outputs or internal activations. A central challenge is that optimization can expose new weaknesses or adapt around defenses, so high scores and low detector readings do not necessarily establish genuine task success or safety.

Latest papers

CardsList

202 papers25 papers in the last four weeks, down 37% on the four weeks before. 0.2% of all new papers.

  1. Optimistic Verifiers Get Hacked: Reward Hacking Under an Exact Process Oracle

    Nov 16, 2026Arunkumar V, Manoranjan Gandhudi, Gangadharan G. R. +2Reward HackingReinforcement Learning with Verifiable Rewards

  2. Jev-as-a-Reward: Validating Probabilistic Safety Judges for Reinforcement Learning

    Nov 16, 2026Eunkyeong Lee, Junhyung Moon, Seunggwan Hong +1AI Safety EvaluationLLM-as-a-Judge

  3. "It's Just a Small Weapon": What Rewarding Misbehavior During RL Does to Character-Trained Models

    Nov 11, 2026Mohammad Omar Khursheed, Thomas Morris, Fabien RogerEmergent Misalignment in Language ModelsRL for Language Models

  4. Honesty Is a Race: Predicting When Verifiable-Reward RL Teaches a Model to Bluff

    Nov 11, 2026Nathaniel Bottman, Alexei OblomkovReinforcement Learning with Verifiable RewardsLLM Honesty

  5. Outside the Purview of the Reward: Capability Drift in Multilingual Post-Training

    Nov 11, 2026Sutanshu Saksena Raj, Purusharth Malik, Pasunuti Prasanjith +3RL Post-TrainingReward Hacking

  6. Breaking Bad: "Going Badly" Activations Drive Reward Hacking

    Nov 11, 2026Natalia Fischl-Lanzoni, Punya Syon Pandey, Merlin Stein +1Reward HackingCoding Agents

  7. Goodhart in the Planner: Sampling-Based Control Exploits Rewards Learned from Human Preferences

    Nov 6, 2026Soovadeep Bakshi, Apurba BoseReward HackingPreference-Based RL

  8. Forecasting How RLHF Responds to Reward-Model Edits Before Training

    Nov 2, 2026Zixiao Wang, Duzhen Zhang, Xingbo Du +2Reinforcement LearningRL Post-Training

  9. The Verifier Is Part of the Simulator: Evidence-View Gaming in Agentic Equation Discovery

    Oct 31, 2026Orestis Oikonomou, Bogdan RaonicReward HackingAI Agents for Scientific Discovery

  10. Alignment Flywheel-Guided Suppression Patching for Interactionless Inverse Reinforcement Learning

    Oct 31, 2026Elias Malomgré, Pieter SimoensReward Design for RLReward Hacking

  11. Towards Understanding Score-Seeking in LLMs

    Oct 29, 2026Aghyad Deeb, Ryan Greenblatt, Alex MallenReward HackingEvaluation Awareness in Language Models

  12. Audit Where Hacks Pay: Budgeted Strong-Verifier Audits Against Reward Hacking in GRPO

    Oct 26, 2026Shurun Li, Michael Hua Wang, Haibo Zeng +1Reward HackingReinforcement Learning with Verifiable Rewards

  13. Eat Your Precision: Precision Objective Mitigates Reward Hacking in Rubric-based RL

    Oct 24, 2026Hyun Ryu, Jong-Heon Kim, Yiqing Xie +3Rubric-Based RLReward Design for RL

  14. Mitigating Reward Hacking in Realistic Scenarios Through Representation Engineering

    Oct 21, 2026Austin Meek, Kyle Cox, Matthew Nguyen +2Reward HackingActivation Steering

  15. SimHack: Predicting the onset of detectable reward hacking before RL training

    Oct 20, 2026Junwei Deng, Alex Bie, Natalia PonomarevaReward HackingRL for Language Models

  16. Intra-Rubric Reward Divergence: Mitigating Rubric Hacking through Latent Dimension Recovery and Balancing

    Oct 19, 2026Jianqiang Xia, Han Xu, Dianxi ShiReward HackingRubric-Based RL

  17. Mitigating Reward Hacking in Preference Reward Models with Evolving Penalties

    Oct 19, 2026Afonso Baldo, António Farinhas, Marcos Treviso +2Reward HackingRL for Language Models

  18. LeakBench: Auditing Reward Hacking through Prediction-Time Leakage in Clinical Modeling Agents

    Oct 19, 2026Xiaoyuan Bao, Jingsi Jiang, Jiao Shan +4Data LeakageAI Agent Auditing

  19. Specification Gaming and a Constrained Reinforcement Learning Mitigation in a Cleaning Gridworld

    Oct 15, 2026Hilda Adwubi OseiReward HackingReward Design for RL

  20. Multi-Reward Hacking: From Aggregation-Induced Drift to Trust-Anchored Defense

    Oct 15, 2026Yushu Li, Jiin Woo, Xiaoxiao Li +1Reward HackingRL for Language Models