cs.LGNov 11, 2026

Efficient Knowledge Transfer in Federated Bayesian Optimization through Neural Network Surrogates

Authors: Alexander Gräfe, Max van Gemmeren, Paul Brunzema, Sebastian Trimpe

Organizations: Institute for Data Science in Mechanical Engineering, RWTH Aachen University, Aachen, Germany

Abstract

Federated Bayesian Optimization (FedBO) has emerged as a powerful paradigm for enhancing Bayesian Optimization (BO) in distributed, privacy-sensitive settings, enabling agents to accelerate the optimization of their local objectives by sharing knowledge about their similarities without exposing raw data. However, existing methods rely on restrictive assumptions, such as near-identical objective functions or shared Gaussian process hyperparameters that are often violated in heterogeneous real-world applications. We present GLOBAFED, a novel framework that enables efficient knowledge transfer across different but related objectives without compromising privacy. At its core is a probabilistic neural network surrogate with a shared feature-extracting backbone and agent-specific heads equipped with varia- tional Bayesian last layers to provide uncertainty estimates. During optimization, agents use federated learning on the shared backbone to collaboratively build a common latent feature representation, while agent-specific heads adapt to their individual objectives. Our empirical results demonstrate that GLOBAFED significantly accelerates convergence and reaches better final performance compared to state-of-the-art FedBO baselines, and enables agents to warm-start their optimization from previously learned global features.

Figures & tables

Appendix figures & tables8 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. GUIDE-FBO: Guidance via Uncertainty Intervention and Distributional Exchange for Federated Bayesian Optimization

    Sep 28, 2026Jintao Wei, Chenxi Li, Songhao WangBayesian OptimizationGaussian Processes

  2. Federated Agent Optimization

    Oct 1, 2026Qiang Yang, Zhiqiang Kou, Xueyi Zhang +6Privacy-Preserving Federated LearningLLM Agent Training

  3. A Momentum-Based Variance-Reduced Algorithm for Federated Multiobjective Optimization

    Aug 24, 2026Yong Zhao, Chunlin You, Minh N. Dao +1Multi-Objective OptimizationFederated Learning