Reward Hacking

Ask about this topic

Momentum

20 papers in the last four weeks, up 100% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 112

All topics
CardsList

  1. Uncertainty-Aware Reward Discounting for Mitigating Reward Hacking

    Apr 29, 2026Disha SinghaReward HackingReinforcement Learning

  2. Distill-Belief: Closed-Loop Inverse Source Localization and Characterization in Physical Fields

    Apr 28, 2026Yiwei Shi, Zixing Song, Mengyue Yang +2Belief-Space PlanningReward Hacking

    SEMT, University of Bristol, Bristol, UK · LUCAS, Loughborough University, Loughborough, UK

  3. Do Prompt-Elicited Trajectories Reflect Training-Time Reward Hacking? A Systematic Study on Monitoring Trainig-Time Reward Hacking in Code Generation

    Apr 26, 2026Lichen Li, Hengguang Zhou, Yijun Liang +2RL for Code GenerationReward Hacking

    Peking University · University of California, Los Angeles · University of Maryland +2

  4. Emergent Strategic Reasoning Risks in AI: A Taxonomy-Driven Evaluation Framework

    Apr 23, 2026Tharindu Kumarage, Lisa Bauer, Yao Ma +7Reward HackingLanguage Model Safety Evaluation

    Amazon Nova Responsible AI

  5. Terminal Wrench: A Dataset of 331 Reward-Hackable Environments and 3,632 Exploit Trajectories

    Apr 19, 2026Ivan Bercovich, Ivgeni Segal, Kexun Zhang +3Reward HackingAI Agent Security Benchmarks

    1Fewshot Corp · *Independent Researcher · 2Carnegie Mellon University

  6. Beyond Static Snapshots: A Grounded Evaluation Framework for Language Models at the Agentic Frontier

    Apr 19, 2026Jazmia HenryReward HackingRL for Language Models

    University of Oxford

  7. Debate as Reward: A Multi-Agent Reward System for Scientific Ideation via RL Post-Training

    Apr 17, 2026Moein Salimi, Babak Hosseini Mohtasham, Amin Aghakasiri +6Reward HackingRL for Language Models

    Sharif University of Technology · University of Tehran · Sharif University of Technology[cs.AI]

  8. Detecting and Suppressing Reward Hacking with Gradient Fingerprints

    Apr 17, 2026Songtao Wang, Quang Hieu Pham, Fangcong Yin +4Reward HackingReinforcement Learning with Verifiable Rewards

    AUniversity of Alberta · N New York University · LLMU Munich +1

  9. LLMs Gaming Verifiers: RLVR can Lead to Reward Hacking

    Apr 16, 2026Lukas Helff, Quentin Delfosse, David Steinmann +6Reward HackingLogical Reasoning

    TU Darmstadt · DFKI · Intrinsic +4

  10. Safety Training Modulates Harmful Misalignment Under On-Policy RL, But Direction Depends on Environment Design

    Apr 14, 2026Leon Eshuijs, Shihan Wang, Antske FokkensReward HackingRL for Language Models

    Vrije Universiteit Amsterdam · Utrecht University

  11. Gradient Regularization Mitigates Reward Hacking in Reinforcement Learning from Human Feedback and Verifiable Rewards

    Feb 20, 2026Johannes Ackermann, Michael Noukhovitch, Takashi Ishida +1Reward HackingReinforcement Learning with Verifiable Rewards

    The University of Tokyo · Mila · RIKEN AIP

  12. Reward Modeling for Reinforcement Learning-Based LLM Reasoning: Design, Challenges, and Evaluation

    Feb 10, 2026Pei-Chi Pan, Yingbin Liang, Sen LinReward ModelingReward Hacking

    Department of Computer Science University of Houston · The Ohio State University · University of Houston

  13. Adversarial Reward Auditing for Active Detection and Mitigation of Reward Hacking

    Feb 2, 2026Mohammad Beigi, Ming Jin, Junshan Zhang +2Adversarial TrainingReward Hacking

    Department of Computer Science, University of California, Davis, USA · Virginia Tech, Blacksburg, USA · Meta AI Research.

  14. Spurious Rewards Paradox: Mechanistically Understanding How RLVR Activates Memorization Shortcuts in LLMs

    Jan 16, 2026Lecheng Yan, Ruizhe Li, Guanhua Chen +5Reward HackingMemorization in Language Models

    Southern University of Science and Technology · University of Science and Technology of China · University of Aberdeen +5

  15. Understanding Reward Hacking in Text-to-Image Reinforcement Learning

    Jan 6, 2026Yunqi Hong, Kuei-Chun Kao, Hengguang Zhou +1Reward HackingMultimodal Reward Modeling

    Department of Computer Science, University of California, Los Angeles

  16. Training Language Models to Use Prolog as a Tool

    Dec 8, 2025Niklas Mellgren, Peter Schneider-Kamp, Lukas Galke PoechReward HackingLogical Reasoning

    University of Southern Denmark

  17. Test-Time Alignment of Text-to-Image Diffusion Models via Null-Text Embedding Optimisation

    Nov 25, 2025Taehoon Kim, Henry Gouk, Timothy HospedalesDiffusion Model AlignmentReward Hacking

    School of Informatics, University of Edinburgh · 2Samsung AI Center, Cambridge

  18. Rethinking Reward Signals in Video GRPO: When Scores Become Targets

    Nov 24, 2025Rui Li, Yuanzhi Liang, Ziqi Ni +3Reward HackingRL for Video Generation

    University of Science and Technology of China, Hefei, China · Institute of Artificial Intelligence (TeleAI), China Telecom, Shanghai, China · Southeast University, Nanjing, China

  19. Truthful or Fabricated? Using Causal Attribution to Mitigate Reward Hacking in Explanations

    Apr 7, 2025Pedro Ferreira, Wilker Aziz, Ivan TitovCoT FaithfulnessReward Hacking

    Institute for Logic, Language and Computation (ILLC), University of Amsterdam · Institute for Language, Cognition and Computation (ILCC), University of Edinburgh

  20. Countdown-Code: A Testbed for Studying The Emergence and Generalization of Reward Hacking in RLVR

    Date pendingMuhammad Khalifa, Zohaib Khan, Omer Tafveez +2RL BenchmarksReward Hacking

    NVIDIA · University of Michigan · University of Illinois Urbana-Champaign

  21. SpecBench: Measuring Reward Hacking in Long-Horizon Coding Agents

    Date pendingBingchen Zhao, Dhruv Srikanth, Yuxiang Wu +1Reward HackingAI Coding Agents

    Weco AI

  22. A False Average: Pooled CoT-Monitor Accuracy Conceals a Reasoning-Dependent Fragility

    Date pendingShikhar Shiromani, Leo RichterReward HackingAdversarial Attacks on LLMs

    Pivotal Research · University College London