LLM Code Generation

LLM: Large Language Model

Overview

This field studies how large language models generate, edit, translate, and test programs from natural-language instructions, examples, or existing code. Common approaches include prompting and retrieval, fine-tuning and reinforcement learning, constrained decoding, and agentic loops that use execution, tests, or static analysis to refine outputs. Evaluations range from HumanEval, MBPP, and LiveCodeBench to repository-level and domain-specific tasks, increasingly measuring security, efficiency, and adherence to requirements alongside whether code runs. Models have improved on standard benchmarks, but reliability on unfamiliar APIs, complex projects, specialized languages, and implicit requirements remains a challenge, as do trade-offs among correctness, safety, cost, and maintainability.

Latest papers

CardsList

335 papers16 papers in the last four weeks, down 45% on the four weeks before. 0.1% of all new papers.

  1. Leveraging Metamemory Agent for Enhanced Data-Free Code Generation in Large Language Models

    Jan 14, 2025Shengsheng Zhou, Shuai Wang, Liang Ding +5Code GenerationAgentic Code Generation

  2. BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions

    Jun 22, 2024Terry Yue Zhuo, Minh Chien Vu, Jenny Chim +30Code Generation BenchmarksCode Generation

  3. Grammar-Aligned Decoding

    May 31, 2024Kanghee Park, Jiayu Wang, Taylor Berg-Kirkpatrick +2Constrained Generative ModelingConstrained Decoding