Execution-Guided Code Generation

Ask about this topic

Overview

Execution-guided code generation uses evidence from running programs—such as test results, compiler errors, runtime traces, and rendered outputs—to help language models produce and repair code. Common approaches iteratively revise a candidate, generate or refine tests, select among candidates by comparing behavior, or train models with execution-based rewards and step-level feedback. These methods are evaluated on settings ranging from programming benchmarks such as HumanEval, MBPP, and LiveCodeBench to repository tasks, database queries, and generated interfaces. A key tension is that execution feedback can catch syntax and runtime failures but may be noisy, costly, or misleading when tests are incomplete or the model and verifier share a mistaken assumption.

Latest papers

CardsList

67 papers8 papers in the last four weeks, up 100% on the four weeks before. 0.0% of all new papers.

  1. Self-Execution Simulation Improves Coding Models

    Mar 11, 2026Gallil Maimon, Ori Yoran, Felix Kreuk +4Execution-Guided Code GenerationLLM Self-Correction

    FAIR team, Meta · Hebrew University of Jerusalem · Inria

  2. 1D-Bench: A Benchmark for Iterative UI Code Generation with Visual Feedback in Real-World

    Feb 20, 2026Qiao Xu, Yipeng Yu, Chengxiao Feng +1Benchmark DesignExecution-Guided Code Generation

    Taobao & Tmall Group of Alibaba

  3. SPARC: Scenario Planning and Reasoning for Automated C Unit Test Generation

    Feb 18, 2026Jaid Monwar Chowdhury, Chi-An Fu, Reyhaneh JabbarvandAutomated Test GenerationExecution-Guided Code Generation

    Bangladesh University of Engineering and Technology, Dhaka, Bangladesh · National Taiwan University, Taipei, Taiwan · University of Illinois at Urbana-Champaign, Champaign, IL, USA

  4. A Theoretical Analysis of Test-Driven Code Generation

    Feb 5, 2026Nicolas Menet, Michael Hersche, Andreas Krause +1Execution-Guided Code GenerationCode Generation

  5. Re4: Scientific Computing Agent with Rewriting, Resolution, Review and Revision

    Aug 28, 2025Ao Cheng, Lei Zhang, Guowei HeScientific Code GenerationExecution-Guided Code Generation

    The State Key Laboratory of Nonlinear Mechanics, Institute of Mechanics, Chinese Academy of Sciences, Beijing 100190, China · School of Engineering Science, University of Chinese Academy of Sciences, Beijing 100049, China

  6. Code Reasoning for Software Engineering Tasks: A Survey and A Call to Action

    Jun 16, 2025Saurabh Pujar, Ira Ceka, Irene Manotas +3Software Engineering AgentsExecution-Guided Code Generation

    IBM · Columbia University

  7. Toward Secure Code Generation: Bridging Correctness and Security via Task-Adaptive Vulnerability Modeling and Execution-Based Benchmarking

    Jul 2, 2024Jiexin Wang, Liuwen Cao, Xitong Luo +6Execution-Guided Code GenerationAgentic Code Generation

    South China University of Technology, Guangzhou, China · University of Innsbruck, Innsbruck, Austria