cs.LGMay 20, 2025

LLINBO: Trustworthy LLM-in-the-Loop Bayesian Optimization

Authors: Chih-Yu Chang, Milad Azvar, Chinedum Okwudire, Raed Al Kontar

Organizations: University of Michigan, Ann Arbor

Abstract

Bayesian optimization (BO) is a sequential decision-making tool widely used for optimizing expensive black-box functions. Recently, Large Language Models (LLMs) have shown remarkable adaptability in low-data regimes, making them promising tools for black-box optimization by leveraging contextual knowledge to propose high-quality query points. However, LLMs lack explicit surrogate modeling and calibrated uncertainty, and their internal mechanisms remain opaque. This structural opacity can result in unnecessary experiments, which are costly in BO and may prevent the search from approaching the optimum. To address this, we propose LLINBO: LLM-in-the-Loop BO, a general framework that wraps existing LLM-based BO approaches, deciding when and how to act on their suggestions and when to revert to classical BO. We introduce three mechanisms for this interaction, each accompanied by a no-harm theoretical guarantee that ensures sublinear cumulative regret for common kernels while requiring no performance assumptions on the LLM. Beyond these theoretical guarantees, we show through simulation studies that LLINBO makes existing LLM-based BO more reliable while still exploiting the LLM's few-shot learning ability to outperform classical BO. We further demonstrate its practical use on a real-world, expensive 3D printing experiment. Code is available at https://github.com/UMDataScienceLab/LLM-in-the-Loop-BO.

Figures & tables

Appendix figures & tables15 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. LABO: LLM-Accelerated Bayesian Optimization through Broad Exploration and Selective Experimentation

    May 21, 2026Zhuo Chen, Xinzhe Yuan, Jianshu Zhang +8AI for ScienceBayesian Optimization

  2. BoLT: A Benchmark to Democratize Black-box Optimization Research for Expensive LLM Tasks

    May 16, 2026Ruth Wan Theng Chew, Zhiliang Chen, Apivich Hemachandra +1Bayesian OptimizationBenchmark Design

  3. Bayesian Optimization with Rich Auxiliary Information via LLMs

    Sep 16, 2026Efe Mert Karagözlü, Rohit Sonker, Tejus Gupta +2Bayesian OptimizationLarge Language Model-Guided Optimization