cs.AINov 14, 2026

STaSBO: LLM-Guided Strategy Planning and Configuration Selection for Bayesian Optimization

Authors: Youngseok Yoon, Peng Li

Organizations: Department of Electrical and Computer Engineering, University of California, Santa Barbara, California, United States.

Abstract

Bayesian optimization (BO) enables sample-efficient search for expensive black-box problems, but its performance depends strongly on surrogate-acquisition configurations whose suitability varies across problems and optimization states. We take a significant step toward LLM-driven strategic management of BO with STaSBO, a task-agnostic meta-controller that plans search behavior and jointly selects surrogate-acquisition configurations, while numerical BO retains responsibility for probabilistic modeling and candidate generation. STaSBO comprises two coordinated stages: strategy planning and strategy-guided configuration selection. A structured memory system connects prior plans, configuration selections, and candidate behaviors to optimization states, allowing the controller to revise its trajectory summary and behavioral plans during planning. To navigate the large joint configuration space, the selection stage shortlists configurations using surrogate fit evidence. Prospective BO-action diagnostics then expose the candidate behaviors, supporting final joint selection against the behavioral plans. Across 12 synthetic mathematical and 10 scientific and engineering application tasks, STaSBO achieves the best average rank against 11 baselines: 2.17 and 2.60, compared with 4.08 and 4.10 for the strongest baseline in each suite, respectively.

Figures & tables

Appendix figures & tables19 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. LLINBO: Trustworthy LLM-in-the-Loop Bayesian Optimization

    May 20, 2025Chih-Yu Chang, Milad Azvar, Chinedum Okwudire +1Bayesian OptimizationBlack-Box Optimization

  2. Agentic Bayesian Optimization through Surrogate-Augmented Autoresearch

    Jul 31, 2026Paul Brunzema, Louis Tiao, Nhat Le +3Surrogate-Assisted OptimizationBayesian Optimization

  3. LABO: LLM-Accelerated Bayesian Optimization through Broad Exploration and Selective Experimentation

    May 21, 2026Zhuo Chen, Xinzhe Yuan, Jianshu Zhang +8AI for ScienceBayesian Optimization