LLM-Based Program Synthesis

Overview

This field studies how language models can turn descriptions, examples, or formal specifications into programs, algorithms, and executable workflows. Common approaches combine prompting or specialized intermediate languages with retrieval, multi-agent decomposition, evolutionary search, and feedback from execution, solvers, compilers, or formal verifiers. These methods are used for tasks ranging from benchmark coding and Dafny or Verilog generation to optimization, GPU kernels, robotics, and CAD; evaluation often tests execution and correctness on suites such as LiveCodeBench, KernelBench, and VerilogEval. Systems can produce useful domain-specific code, but passing tests or compiling does not ensure semantic correctness, safety, performance, or generalization to unseen cases.

Latest papers

CardsList

311 papers36 papers in the last four weeks, up 24% on the four weeks before. 0.2% of all new papers.

  1. Spec-Harness: Assessing and Guiding LLM-Synthesized Formal Specifications Beyond Verifiability

    Mar 31, 2026Md Rakib Hossain Misu, Cristina V. Lopes, Iris Ma +2Software Engineering AgentsLLM-Based Program Synthesis

  2. WybeCoder: Verified Imperative Code Generation

    Mar 31, 2026Fabian Gloeckle, Mantas Baksys, Darius Feher +5Verified Code GenerationFormal Verification

  3. SAGAI-MID: A Generative AI-Driven Middleware for Dynamic Runtime Interoperability

    Mar 30, 2026Oliver Aleksander Larsen, Mahyar T. MoghaddamLLM-Based Program Synthesis

  4. SEVerA: Verified Synthesis of Self-Evolving Agents

    Mar 26, 2026Debangshu Banerjee, Changming Xu, Eugene Ie +5Agentic Code GenerationSelf-Evolving Agents

  5. Likelihood Hacking in Probabilistic Program Synthesis

    Mar 25, 2026Jacek Karwowski, Younesse Kaddar, Zihuiwen Ye +2Probabilistic ProgrammingLLM-Based Program Synthesis

  6. Language Models as Higher-Order Planning Formalizers

    Mar 25, 2026Owen Jiang, Cassie Huang, Ashish Sabharwal +1LLM PlanningLLM-Based Program Synthesis

  7. From Language Models to Control Policies: Search, Selection, and Verification

    Mar 20, 2026Nima H. Siboni, Seyedreza Kiamousavi, Vahid Rostami +1Automated Heuristic DesignLLM-Based Program Synthesis

  8. Procedural Refinement by LLM-driven Algorithmic Debugging for ARC-AGI-2

    Mar 20, 2026Yu-Ning Qiu, Lin-Feng Zou, Jiong-Da Wang +2ARC-AGINeuro-Symbolic Reasoning

  9. HyEvo: Self-Evolving Hybrid Agentic Workflows for Efficient Reasoning

    Mar 20, 2026Beibei Xu, Yutong Ye, Chuyun Shen +3Agentic WorkflowsLLM Agent Workflow Optimization

  10. AutORAN: LLM-driven Natural Language Programming for Agile xApp Development

    Mar 19, 2026Xin Li, Shiming Yu, Leming Shen +3Code GenerationOpen Radio Access Network

  11. Bootstrapping Coding Agents: The Specification Is the Program

    Mar 18, 2026Martin MonperrusAI Coding AgentsLLM-Based Program Synthesis

  12. Not All Invariants Are Equal: Curating Training Data to Accelerate Program Verification with SLMs

    Mar 16, 2026Ido Pinto, Yizhak Yisrael Elboher, Haoze Wu +2Fine-TuningTraining Data Curation

  13. AeroGen: Structured Prompting for Low-Code Drone-as-a-Service Mission Composition

    Mar 15, 2026Kautuk Astu, Yogesh SimmhanLLM-Based Program SynthesisLLM Code Generation

  14. KernelFoundry: Hardware-aware evolutionary GPU kernel optimization

    Mar 12, 2026Nina Wiedemann, Quentin Leboutet, Michael Paulitsch +2GPU Kernel OptimizationGPU Acceleration

  15. GenePlan: Evolving Better Generalized PDDL Plans using Large Language Models

    Mar 10, 2026Andrew Murray, Danial Dervovic, Alberto Pozanco +1Symbolic PlanningLLM-Based Program Synthesis

  16. Learning From Design Procedure To Generate CAD Programs for Data Augmentation

    Mar 6, 2026Yan-Ying Chen, Dule Shu, Matthew Hong +3Synthetic Data AugmentationLLM-Based Program Synthesis

  17. Symmetry-Constrained Language-Guided Program Synthesis for Discovering Governing Equations from Noisy and Partial Observations

    Mar 6, 2026Mirza Samad Ahmed Baig, Syeda Anshrah GillaniODE DiscoveryAutonomous Scientific Discovery

  18. IMR-LLM: Industrial Multi-Robot Task Planning and Program Generation using Large Language Models

    Mar 3, 2026Xiangyu Su, Juzhan Xu, Oliver van Kaick +2Robot Task PlanningLarge Language Model-Based Robot Planning

  19. ParEVO: Synthesizing Code for Irregular Data: High-Performance Parallelism through Agentic Evolution

    Mar 3, 2026Liu Yang, Zeyu Nie, Andrew Liu +4High-Performance ComputingCode Generation

  20. NERFIFY: A Multi-Agent Framework for Turning NeRF Papers into Code

    Feb 28, 2026Seemandhar Jain, Keshav Gupta, Kunal Gupta +1Agentic Code GenerationLLM-Based Program Synthesis

  21. AdaEvolve: Adaptive LLM Driven Zeroth-Order Optimization

    Feb 23, 2026Mert Cemri, Shubham Agrawal, Akshat Gupta +9Large Language Model-Guided OptimizationLLMs for Evolutionary Optimization

  22. Feedback-based Automated Verification in Vibe Coding of CAS Adaptation Built on Constraint Logic

    Feb 20, 2026Michal Töpfer, František Plášil, Tomáš Bureš +1Temporal LogicLLM-Based Program Synthesis

  23. AutoNumerics: An Autonomous, PDE-Agnostic Multi-Agent Pipeline for Scientific Computing

    Feb 19, 2026Jianda Du, Youran Sun, Haizhao YangPDE SolvingAutomated Algorithm Discovery

  24. Heuristic Search as Language-Guided Program Optimization

    Feb 17, 2026Mingxin Yu, Ruixiao Yang, Chuchu FanAutomated Heuristic DesignLarge Language Model-Guided Optimization

  25. ReLoop: Structured Modeling and Behavioral Verification for Reliable LLM-Based Optimization

    Feb 17, 2026Junbo Jacob Lian, Yujun Sun, Huiling Chen +3LLM-Based Program SynthesisLLM Reliability