Large Language Model-Guided Optimization

Follow this topic Ask about this topic

Momentum

67 papers in the last four weeks, up 219% on the four weeks before. 0.7% of all new papers.

Jul 13Week of Sep 28

Latest papers 404

All topics

AutoSG: LLM-Driven Solver Generation Solely from Task Prompts for Expensive Optimization
May 25, 2026Haoran Gu, Handing Wang, Yi Mei +1Large Language Model-Guided Optimization LLM-Based Program Synthesis
Xidian University · Victoria University of Wellington
FrontierOR: Benchmarking LLMs' Capacity for Efficient Algorithm Design in Large-Scale Optimization
May 24, 2026Minwei Kong, Chonghe Jiang, Ao Qu +24LLM Evaluation Large Language Model-Guided Optimization
Singapore-MIT Alliance for Research and Technology · Massachusetts Institute of Technology · Northeastern University +10
VeriSimpl: Robust Optimization Modeling from Natural Language using Simplification-based Verification
May 24, 2026Sumaya Abdul Rahman, Seckhen Ariel Andrade Cuellar, Ghani Raissov +1Large Language Model-Guided Optimization Formal Verification
Texas A&M University at Qatar, Doha, Qatar · Carnegie Mellon University in Qatar, Doha, Qatar · Qatar Computing Research Institute, Doha, Qatar
SkillOpt: Executive Strategy for Self-Evolving Agent Skills
May 22, 2026Yifan Yang, Ziyang Gong, Weiquan Huang +12Large Language Model-Guided Optimization LLM Agent Self-Improvement
Microsoft · Shanghai Jiao Tong University · Tongji University +1
FastKernels: Benchmarking GPU Kernel Generation in Production
May 22, 2026Gabriele Oliaro, Yichao Fu, May Jiang +5GPU Kernel Optimization GPU Acceleration
1Snowflake AI Research · 2CMU · 3UCSD +1
Steered Generation via Gradient-Based Optimization on Sparse Query Features
May 21, 2026Sumanta Bhattacharyya, Pedram RooshenasConstrained Motion Planning Language Model Steering
Department of Computer Science University of Illinois Chicago
MadEvolve: Evolutionary Optimization of Trading Systems with Large Language Models
May 21, 2026Yurii Kvasiuk, Tianyi Li, Owen Colegrove +1Quantitative Finance Evolutionary Optimization
Department of Physics, University of Wisconsin–Madison · Event Horizon Labs
Molecular Lead Optimization via Agentic Tool Planning
May 21, 2026Lingxiao Li, Haobo Zhang, Ruohao Fan +2Molecular Optimization Large Language Model-Guided Optimization
University of Michigan Ann Arbor, Michigan, USA · Department of Biochemistry and Molecular Medicine University of California, Davis Davis, California, USA · Department of Pharmacology and Toxicology Michigan State University East Lansing, Michigan, USA
Evolutionary Multi-Task Optimization for LLM-Guided Program Discovery
May 21, 2026Halil Alperen Gozeten, Xuechen Zhang, Emrullah Ildiz +3Evolutionary Optimization Large Language Model-Guided Optimization
University of Michigan - Ann Arbor · University of California San Diego
LABO: LLM-Accelerated Bayesian Optimization through Broad Exploration and Selective Experimentation
May 21, 2026Zhuo Chen, Xinzhe Yuan, Jianshu Zhang +8AI for Science Bayesian Optimization
equal contribution · Shanghai Artificial Intelligence Laboratory, Shanghai, China · School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China +7
TextReg: Mitigating Prompt Distributional Overfitting via Regularized Text-Space Optimization
May 20, 2026Lucheng Fu, Ye Yu, Yiyang Wang +4Neural Network Generalization Large Language Model-Guided Optimization
Georgia Institute of Technology · University of Illinois Urbana-Champaign
A Case for Agentic Tuning: From Documentation to Action in PostgreSQL
May 19, 2026Hongyu Lin, Mingyu Li, Weichen Zhang +4Large Language Model-Guided Optimization LLM Agent Skill Learning
Institute of Software, Chinese Academy of Sciences · University of Chinese Academy of Sciences · Key Laboratory of System Software (Chinese Academy of Sciences) +3
Prior Knowledge or Search? A Study of LLM Agents in Hardware-Aware Code Optimization
May 19, 2026Dmitry Redko, Albert Fazlyev, Konstantin Sozykin +3GPU Kernel Optimization Large Language Model-Guided Optimization
Applied AI Institute · AI Talent Hub, ITMO University · YSDA +1
optimize_anything: A Universal API for Optimizing any Text Parameter
May 19, 2026Lakshya A Agrawal, Donghyun Lee, Shangyin Tan +11Black-Box Optimization Large Language Model-Guided Optimization
UC Berkeley USA · MIT USA
Structuring Open-Ended NAS: Semi-Automated Design Knowledge Structuring with LLMs for Efficient Neural Architecture Search
May 19, 2026Yuiko Sakuma, Masakazu Yoshimura, Marcel Gröpl +4Large Language Model-Guided NAS Large Language Model-Guided Optimization
Sony Group Corporation, Tokyo, Japan · ETH Zurich, Switzerland
Embedding by Elicitation: Dynamic Representations for Bayesian Optimization of System Prompts
May 18, 2026Zhiyuan Jerry Lin, Benjamin Letham, Samuel Dooley +2Bayesian Optimization Large Language Model-Guided Optimization
Meta
Democratizing Large-Scale Re-Optimization with LLM-Guided Model Patches
May 18, 2026Tinghan Ye, Arnaud Deza, Ved Mohan +2Large Language Model-Guided Optimization Natural Language to Optimization Modeling
H. Milton Stewart School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, USA · Department of Operations and Decision Systems, Université Laval, Québec, Canada
Automated Kernel Discovery Towards Understanding High-dimensional Bayesian Optimization
May 18, 2026Taeyoung Yun, Woocheol Shin, Inhyuck Song +2Bayesian Optimization Large Language Model-Guided Optimization
1Korea Advanced Institute of Science and Technology (KAIST)
AutoVecCoder: Teaching LLMs to Generate Explicitly Vectorized Code
May 18, 2026Shangzhan Li, Xinyu Yin, Xuanyu Jin +8Large Language Model-Guided Optimization Code Generation
Harbin Institute of Technology, Harbin, China · Xiamen University, Xiamen, China · Tsinghua University, Beijing, China
Unleashing LLMs in Bayesian Optimization: Preference-Guided Framework for Scientific Discovery
May 18, 2026Xinzhe Yuan, Zhuo Chen, Jianshu Zhang +4Bayesian Optimization Large Language Model-Guided Optimization
Shanghai Artificial Intelligence Laboratory, Shanghai, China · Shanghai Jiao Tong University, Shanghai, China · Harbin Institute of Technology, Harbin, China
Lean Refactor: Multi-Objective Controllable Proof Optimization via Agentic Strategy Search
May 18, 2026Jialin Lu, Soonho Kong, Rodrigo Stehling +4Large Language Model-Guided Optimization Lean Theorem Proving
Simon Fraser University · Amazon Web Services · MiroMind +1
Memory-Guided Tree Search with Cross-Branch Knowledge Transfer for LLM Solver Synthesis
May 17, 2026Fatemeh Haji, Javier Delarosa Quiros, Peyman NajafiradTree Search Large Language Model-Guided Optimization
Secure AI and Autonomy Lab · The University of Texas at San Antonio
Latent Heuristic Search: Continuous Optimization for Automated Algorithm Design
May 16, 2026Cheikh Ahmed, Mahdi Mostajabdaveh, Zirui ZhouSurrogate-Assisted Optimization Automated Algorithm Discovery
Huawei Technologies Canada, Burnaby, Canada
Prospective multi-pathogen disease forecasting using autonomous LLM-guided tree search
May 15, 2026Sarah Martinson, Michael P. Brenner, Martyna Plomecka +3Epidemic Forecasting Large Language Model-Guided Optimization
Google Research · School of Engineering and Applied Sciences, Harvard University · Google Deepmind +1
Optimized Three-Dimensional Photovoltaic Structures with LLM guided Tree Search
May 15, 2026Michael P. Brenner, Lizzie Dorfman, John C. PlattLarge Language Model-Guided Optimization Large Language Model-Guided Scientific Discovery
Google Research · School of Engineering and Applied Sciences, Harvard University
Optimization-as-a-Service via Multi-Agent Large Language Model for Radio Access Networks
May 15, 2026Chaoqun You, Yueyue Dai, Xingqiu He +3Multi-Agent System Optimization Large Language Model-Guided Optimization
Fudan University · Huazhong University of Science and Technology · University of Surrey +1
Agentic Discovery of Neural Architectures: AIRA-Compose and AIRA-Design
May 15, 2026Alberto Pepe, Chien-Yu Lin, Despoina Magka +6Large Language Model-Guided NAS Large Language Model-Guided Optimization
FAIR at Meta
From Feedback Loops to Policy Updates: Reinforcement Fine-Tuning for LLM-Based Alpha Factor Discovery
May 14, 2026Lingzhe Zhang, Tong Jia, Yunpeng Zhai +5RL for Language Models Large Language Model-Guided Optimization
Peking University, Beijing, China · Alibaba Group, China · Nanjing University, Nanjing, China +1
TuxBot: Semantic-Aware Online OS Tuning with Large Language Models
May 14, 2026Georgios Liargkovas, Mihir Nitin Joshi, Hubertus Franke +1Language Model-Based Control Large Language Model-Guided Optimization
Columbia University · IBM Research
Distribution-Aware Programming: Learning Specialized Solvers from Experience
May 13, 2026Saharsh Koganti, Priyadarsi Mishra, Pierfrancesco Beneventano +1Large Language Model-Guided Optimization LLM-Based Program Synthesis
Texas A&M University · Massachusetts Institute of Technology

May 25, 2026, cs.CLJ/K move · Enter open · S save

AutoSG: LLM-Driven Solver Generation Solely from Task Prompts for Expensive Optimization

Haoran Gu, Handing Wang, Yi Mei, Mengjie Zhang

Xidian University · Victoria University of Wellington

Large Language Model-Guided Optimization LLM-Based Program Synthesis

Open paper AskPDF arXiv

Expensive optimization tasks are ubiquitous in real-world applications, demanding highly specialized solvers. While LLM-driven automated solver generation shows promise, current paradigms face three critical issues when tackling expensive optimization: factual hallucinations due to deficient domain knowledge, the frequent dismantling of previously established locally optimal structures during refinement, and the prohibitive evaluation costs alongside restricted generalization caused by executing on training instances. To address these issues, we introduce AutoSG, a fully automated workflow directly translating natural language prompts into executable customized solvers. AutoSG features three core innovations: a retrieval-augmented solver generation module strictly grounding code in verified literature; a one-step self-refinement operator introducing task-specific improvements while preserving critical structural components; and an instance-free Elo-based LLM-as-a-Judge evaluation mechanism rapidly establishing global rankings. Extensive evaluations across diverse expensive optimization tasks confirm AutoSG significantly outperforms human-designed state-of-the-art frameworks and existing LLM-generated solvers.

Momentum

Related topics

Latest papers 404