Large Language Model-Guided Optimization

Overview

This field studies how language models can use learned patterns and natural-language understanding to help search for better algorithms, programs, designs, prompts, and agent workflows. Common approaches combine model-generated proposals with evolutionary search, Bayesian optimization, reinforcement learning, or classical solvers, then use execution, simulator, or benchmark feedback to select and repair candidates. Applications range from combinatorial and scientific optimization to GPU kernels, compiler code, engineering design, and tuning language-model systems. A central open tension is that language models can suggest useful structures but may be unreliable, costly, or prone to overfitting, so robust evaluation, constraint checks, and comparisons with numerical methods remain essential.

Latest papers

CardsList

660 papers58 papers in the last four weeks, down 45% on the four weeks before. 0.4% of all new papers.

  1. AI agents can redesign engineering parts with more than a thousand CAD parameters and nonlinear simulations

    Nov 19, 2026Alexandra Starostina, Alexander Hermann, Mahish Guru +3Engineering Design OptimizationLarge Language Model-Guided Optimization

  2. HapBO: Harnessed αα-ππ Bayesian Optimization via Expert Natural Language Priors

    Nov 18, 2026Jean-Sébastien Giroux, Rose Guay Hottin, Marco BonizzatoBayesian OptimizationHyperparameter Optimization

  3. LLM-Assisted Multi-Fidelity Bayesian Optimization: Fusing Expert Knowledge with Numerical Data

    Nov 18, 2026Dongjun Han, Mingyu Lee, Ikjin LeeMulti-Fidelity OptimizationBayesian Optimization

  4. In Situ Training of Optical Neural Networks by Coding Agents

    Nov 18, 2026Ilker Oguz, Colin Christian, Christophe Moser +2On-Device TrainingLarge Language Model-Guided Optimization

  5. Simplicity Goes Far: Auditing Prompt Optimizers with Demonstration-Conditioned Prompt Search

    Nov 17, 2026Bohe ChenAutomatic Prompt OptimizationLarge Language Model-Guided Optimization

  6. PVTSizing 2.0: A Fast and Reliable Analog Circuit Sizing Operator for Agentic EDA Workflows

    Nov 17, 2026Zichen Kong, Minghuan Song, Xiyuan Tang +3Analog Circuit SizingElectronic Design Automation

  7. Agent-Guided Configuration Tuning for SMT Solvers

    Nov 16, 2026Cong Wang, Qiaoyi Zheng, Zhaoguo Wang +1Satisfiability Modulo TheoriesLarge Language Model-Guided Optimization

  8. Large Language Model-based Optimization for Wireless Communication: A Survey

    Nov 15, 2026Muhammad Sohaib, Taehyung Kim, Hyeri Heo +4Large Language Model-Guided OptimizationWireless Communications

  9. STaSBO: LLM-Guided Strategy Planning and Configuration Selection for Bayesian Optimization

    Nov 14, 2026Youngseok Yoon, Peng LiBayesian OptimizationLarge Language Model-Guided Optimization

  10. Large Language Models for AI Infrastructure

    Nov 14, 2026Bolin Shen, Shaoyi Huang, Yushun DongLarge Language Model-Guided Optimization

  11. Programming Quantum Circuit Parameters with Large Language Models

    Nov 12, 2026Tiago de Souza Farias, Caio Moraes Porto, Matheus da Silva Fonseca +3Large Language Model-Guided OptimizationQuantum Circuit Optimization

  12. Gradient-Aware AI Agents for Autonomous Turbulence Model Discovery via Differentiable CFD

    Nov 11, 2026Yi Liu, Xiantao Fan, Mingqi Xu +1Turbulence ModelingComputational Fluid Dynamics

  13. KernelMosaic: An Open Dataset and Agentic Framework for CUDA Kernel Generation

    Nov 10, 2026Ningyuan Xi, Yuhang Lai, Ning MiaoGPU Kernel GenerationGPU Kernel Optimization

  14. TAPCO-G: LLM-Guided Design-Adaptive Timing and Power Co-Optimization with Graph-Based Physical Priors

    Nov 10, 2026Wuqian Tang, Zixiao Wang, Che-Chien Lin +5Large Language Model-Guided Optimization

  15. Large Language Models as a Universal Searcher for Open-World Automated Machine Learning

    Nov 9, 2026Yuxuan Hu, Jihao Liu, Weikang Shi +6Automated Machine LearningLarge Language Model-Guided Optimization

  16. Correct First, Fast Second: What a Local 7B Code Model Can and Cannot Do for GPU Kernel Optimization

    Nov 9, 2026Jui-Chien Tsou, Po-Yi WuGPU Kernel GenerationLarge Language Model-Guided Optimization

  17. COMPASS: Composable Policy-Amortized Structured Search for LLM-Based Optimization Modeling

    Nov 9, 2026Nguyen Le Minh Hoang, Van Duc Cuong, Bui Trong Duc +1Large Language Model-Guided OptimizationNatural Language to Optimization Modeling

  18. AutoQS: Automated Quantization Strategy Design with Large Language Models

    Nov 9, 2026Zhen Liu, Zhiqin Yang, Yonggang Zhang +3LLM QuantizationQuantization

  19. GradReason: LLMs as Meta-Learners that Replace Training Epochs with Training-Data-Free Weight Updates

    Nov 7, 2026Ali Mohammadi Ruzbahani, Abbas Yazdinejad, Hadis KarimipourLarge Language Model-Guided OptimizationData-Efficient Learning

  20. AutoC2V: Synthesis-Guided LLM Training for QoR-Optimized C++-to-Verilog Generation

    Nov 7, 2026Guanqi Lyu, Fei Zhao, Zhaojun Lu +2Electronic Design AutomationLLM-Based Program Synthesis

  21. KDASO: Knowledge-Data Dual-Driven Automated Skill Optimization for Liability Adjudication Tasks

    Nov 4, 2026Zi-Jian Cheng, Weiming Wu, Jie Meng +5LLM Agent Skill LearningLarge Language Model-Guided Optimization