LLM-Based Program Synthesis

Overview

This field studies how language models can turn descriptions, examples, or formal specifications into programs, algorithms, and executable workflows. Common approaches combine prompting or specialized intermediate languages with retrieval, multi-agent decomposition, evolutionary search, and feedback from execution, solvers, compilers, or formal verifiers. These methods are used for tasks ranging from benchmark coding and Dafny or Verilog generation to optimization, GPU kernels, robotics, and CAD; evaluation often tests execution and correctness on suites such as LiveCodeBench, KernelBench, and VerilogEval. Systems can produce useful domain-specific code, but passing tests or compiling does not ensure semantic correctness, safety, performance, or generalization to unseen cases.

Latest papers

CardsList

339 papers31 papers in the last four weeks, down 28% on the four weeks before. 0.2% of all new papers.

  1. Weights & Caches: LLMs Can Program Tabular Foundation Models

    Nov 15, 2026Shi Bin Hoo, Magnus Buehler, Omar Swelam +2LLM-Based Program SynthesisTabular Foundation Models

  2. Discovering Programmatic Policies from Reinforcement Learning-Based Traffic Signal Controllers

    Nov 15, 2026Lindong Xie, Yang Zhang, Beiyu Song +3Traffic Signal ControlPolicy Distillation

  3. Learning from Mutants: Teaching Small Language Models to Synthesise Loop Invariants

    Nov 14, 2026Daragh King, Vasileios KoutavasLLM-Based Program SynthesisProgram Synthesis

  4. Program Distillation: Transferring LLM Capability from System 2 to System 0

    Nov 14, 2026Pujun Zheng, Wanying Ren, Guoxiu HePolicy DistillationKnowledge Distillation

  5. Can Agentic LLMs Write Task-Based Parallel Code? A Study of OpenMP Tasking, HPX, StarPU and TTG

    Nov 14, 2026Linus Bantel, Anna-Lena Roth, Tim Thüring +2Code GenerationLLM-Based Program Synthesis

  6. Agentic AI for Discovering Fault-Tolerant Quantum Circuits

    Nov 13, 2026Aritra Lahiri, Florian MarquardtQuantum Circuit SynthesisQuantum Error Correction

  7. Interactive Program Induction with Language Model Priors

    Nov 13, 2026Robin Shing Moon Chan, Ryan CotterellInductive InferenceActive Learning

  8. Where Autonomy Belongs: A Separation of Powers for Agentic Program Evolution

    Nov 11, 2026Zhengyang Ai, Tong Liu, Jingxian Tang +6LLMs for Evolutionary OptimizationAgent Harness Self-Evolution

  9. GOPR-CAD: Graph-of-Operations Progressive Reasoning for CAD Generation

    Nov 8, 2026Yitian Pang, Yifan Li, Xiaowei Yue +1Text-to-CAD GenerationParametric CAD Modeling

  10. Semantic Synthesis over Brute-Force Search: LLM-Guided Transformation Design for Efficient Learning

    Nov 7, 2026Usha Shrestha, Radu Timofte, Dmitry IgnatovData AugmentationLarge Language Model-Based Data Augmentation

  11. AutoC2V: Synthesis-Guided LLM Training for QoR-Optimized C++-to-Verilog Generation

    Nov 7, 2026Guanqi Lyu, Fei Zhao, Zhaojun Lu +2Electronic Design AutomationLLM-Based Program Synthesis

  12. RTLREX: LLM-Guided Framework for Exact High-Level RTL Recovery

    Nov 7, 2026Wuqian Tang, Fangzhou Liu, Ruijie Wang +3RTL Code GenerationLLM-Based Program Synthesis

  13. Discovering formally verified quantum programs with AI

    Nov 6, 2026Sergey Shirobokov, Ben Jaderberg, Katerina Hristova +22Automated Algorithm DiscoveryProgram Synthesis

  14. CHATDIFY: Automating End-to-End Dify Workflow Synthesis from Natural Language via Multi-Agent Collaboration

    Nov 1, 2026Tao Fan, Guoqiang MaLLM Agent OrchestrationLLM-Based Program Synthesis

  15. A Self-Exploring and Self-Evolving Paradigm for Adaptive Edge AI Development

    Nov 1, 2026Leming Shen, Qiang Yang, Xinyu Huang +3AI Coding AgentsSelf-Evolving Agents

  16. Agent4FreeFem: A Verification-Guided Framework for Autonomous Topology Optimization

    Oct 31, 2026Zhipu Cui, Helin Gong, Shengfeng ZhuTopology OptimizationNatural Language to Optimization Modeling

  17. Robustness Starts with the Objective: Designing and Certifying Robust LLM-Generated Heuristics

    Oct 31, 2026Pantea Karimi, Roozbeh Bostandoost, Dany Rouhana +5Automated Heuristic DesignLarge Language Model-Guided Optimization

  18. Compile Away Uncertainty: Self-Evolving Agent Skills via Programmatic Compilation

    Oct 29, 2026Chengyu Yang, Yunxiang Zheng, Zongzheng Li +6LLM Agent Skill LearningSelf-Evolving Agents

  19. The Code Behind the Layout: AI Agents for Analog Layout Generators

    Oct 28, 2026Minxing Chu, Anhang Li, Martins Atilla +2Electronic Design AutomationAgentic Code Generation

  20. Ranking Function Generation with LLMs for Termination

    Oct 26, 2026Rongkang Li, Jiaxin Hu, Taolue Chen +3Program SynthesisLLM-Based Program Synthesis

  21. FlashScript: Compiling Recurring Agent Workflows into Reusable Neuro-Symbolic Programs

    Oct 24, 2026Sadra Sabouri, Hosein Hasanbeig, Adam Sage +6LLM Agent Workflow OptimizationLLM-Based Program Synthesis

  22. AgenticEvolve: Evolutionary Program Search with Persistent Language Model Agents that Design and Run Experiments

    Oct 22, 2026Ze-Yu Peng, Qing-Yu Lan, Zhan-He Wang +2LLMs for Evolutionary OptimizationLLM-Based Program Synthesis

  23. SpecEvo: Speculative Evolution with Large Language Models for Cost-Efficient Scientific Discovery

    Oct 20, 2026Ha Minh Hieu, Tongyao Zhu, Do Xuan Long +1Large Language Model-Guided Scientific DiscoveryLLMs for Evolutionary Optimization