RL for Code Generation

RL: Reinforcement Learning

Overview

This field trains language models to write, repair, and optimize programs by using execution environments, unit tests, compilers, formal verifiers, or renderers as feedback. Common approaches include reinforcement learning with verifiable rewards, often using GRPO or PPO, alongside synthetic tasks, curricula, and multi-turn tool-using agents. Newer methods add dense or token-level credit, reward models, self-correction, and search, with evaluation spanning HumanEval, MBPP, APPS, LiveCodeBench, SWE-bench, hardware kernels, and visual-to-code tasks. A central challenge is making feedback reliable and informative without reward hacking or excessive rollout costs, while ensuring gains transfer beyond the training tasks and execution harnesses.

Latest papers

CardsList

161 papers12 papers in the last four weeks, down 57% on the four weeks before. 0.1% of all new papers.

  1. Let Execution Do the Teaching

    Nov 15, 2026Abhishek Mishra, Sandeep Srinivasa, Arko Chattopadhyay +2Execution-Guided Code GenerationRL for Code Generation

  2. Policy Optimization With Multiple Verifiers via Pareto Rankings

    Nov 14, 2026Kai Yamashita, Shohei Taniguchi, Hiroki Furuta +2RL for Language Model ReasoningReinforcement Learning with Verifiable Rewards

  3. CoReMem: Cost-Internalizing Memory for Successive Coding Tasks with Prospective Valuation

    Nov 12, 2026Peiwen Li, Harshit Verma, Sophia Zhou +6Agent MemoryMemory Management for LLM Agents

  4. AutoC2V: Synthesis-Guided LLM Training for QoR-Optimized C++-to-Verilog Generation

    Nov 7, 2026Guanqi Lyu, Fei Zhao, Zhaojun Lu +2Electronic Design AutomationLLM-Based Program Synthesis

  5. Enhancing Repository-Level Code Completion with Reinforcement Learning in Real-World Scenarios

    Nov 5, 2026Zhenlong Dai, Zhuoluo Zhao, Xiu Tang +4Repository-Level Code GenerationCode Language Models

  6. Catalyzing Interactive HTML Generation Capabilities via High-Fidelity Reinforcement Learning

    Nov 3, 2026Xujia Wang, Yixuan Liu, Shaohan Huang +4RL for Code GenerationReinforcement Learning

  7. Guided-RLVR: Guided Exploration in Reinforcement Learning with Verifiable Rewards

    Oct 27, 2026Bo Yang, Zishuai Zhang, Weihua Li +3RL for Language Model ReasoningReinforcement Learning with Verifiable Rewards

  8. RIPPLE: Recovery Internalization through Process-Level Policy Learning and Effect-Aware Credit for Long-Horizon Agentic Coding

    Oct 22, 2026Jingxuan Xu, Zihang Xu, Yuechen Luo +9Code GenerationRL for LLM Agents

  9. SimHack: Predicting the onset of detectable reward hacking before RL training

    Oct 20, 2026Junwei Deng, Alex Bie, Natalia PonomarevaReward HackingRL for Language Models

  10. Co-Evolving Policy and Reward for Code Generation: A Mechanistic Study of Single-Adapter Drift

    Oct 19, 2026Amarsaikhan Batjargal, Noriko TomuroRL for Code GenerationReinforcement Learning

  11. Over-Defense in Coding Agents Begins at Silent Forks

    Oct 18, 2026Hanjun Luo, Xuecheng Liu, Xiucheng Zhang +5AI Coding AgentsRL for Code Generation

  12. Self-Evolving Coding Agents via Harness-Policy Optimization

    Oct 16, 2026Zhepei Wei, Wenlin Yao, Baolin Peng +5AI Coding AgentsAgent Harness Optimization

  13. Verifier-Grounded Agentic RL for Provably Correct Code

    Oct 13, 2026George Ma, Yuhao Zhang, Bing He +5RL for Code GenerationVerified Code Generation

  14. AesCode: Aesthetic Code Generation with Decoupled Cross-Modal Rewards

    Oct 13, 2026Xin Gao, Yifan Yang, Xin Li +13Code GenerationRL for Code Generation

  15. PreciseCoder: Faithful and Generalizable Debugging Beyond Unit-Test Rewards

    Oct 13, 2026Yunkai Zhan, Miaosen Chai, Shangshang Wang +5Automated Program RepairRL Post-Training

  16. CodeLift: Your Test Suite Is Secretly a Dense SWE Curriculum

    Oct 12, 2026Junjielong Xu, Huachao Zhu, Alyssa Wu +2RL for Code GenerationSoftware Engineering Agents

  17. ANTE: Anticipate, Then Execute -- Learning Internal World Models for Coding Agents from Verified Beliefs

    Oct 11, 2026Yi Ge, Kangrui Ruan, Jifan Chen +6Code World ModelsSoftware Engineering Agents

  18. Learning after Execution with Action-Specific Credit

    Oct 10, 2026Yufeng Tian, Jiahao Tang, Minghao WuReinforcement LearningCredit Assignment

  19. SPROUT: Scaling Agentic Reinforcement Learning for Long-Horizon Software Engineering

    Oct 9, 2026Mengyang Liu, Weiming Wang, Haixin Nan +6Agentic RLRL for Code Generation

  20. Reward Hacking as a Transmissible Strategy in Multi-Agent Coding Systems

    Oct 9, 2026Yuepeng Hu, Pegah Ghahremani, Reza Aghajani +2Reward HackingMulti-Agent Systems

  21. AGAR: a reinforcement learning substrate for LLM program evolution

    Oct 6, 2026Haoran Li, Zengle Ge, Xiaomin Yuan +11LLM-Based Program SynthesisRL for Code Generation

  22. CodeForge-MA: Execution-Verified Multi-Agent Learning with Language-Conditioned LoRA for Multilingual Code Generation

    Oct 4, 2026Zhizhou Gu, Xianting Wu, Siyu Gu +2RL for Code GenerationSynthetic Data Generation for Language Models

  23. Pareto-Dominant Clarification: Post-Training Coding LLMs via PPO-Lagrangian Budget Constraints

    Oct 2, 2026Abhinav Rajput, Acey VogelsteinLLM Post-TrainingRL for Code Generation