cs.LGNov 11, 2025

Multi-objective Hyperparameter Optimization with Expert Priors

Authors: Soham Basu, Nastaran Alipour, Frank Hutter, Danny Stoll

Organizations: University of Freiburg · Prior Labs · ELLIS Institute Tübingen

Abstract

While Deep Learning (DL) experts often have prior knowledge about which hyperparameter settings yield strong performance, only few Hyperparameter Optimization (HPO) algorithms can leverage such prior knowledge and none incorporate priors over multiple objectives. As DL practitioners often need to optimize not just one but many objectives, this is a blind spot in the algorithmic landscape of HPO. To address this shortcoming, we propose the novel problem setting of multi-objective HPO with expert priors and introduce PriMO, the first HPO algorithm that can integrate user beliefs over multiple objectives. We show PriMO achieves state-of-the-art performance across 8 DL benchmarks in the multi-objective and single-objective setting. Further, we demonstrate that PriMO remains state-of-the-art at large scales by optimizing a vision-language model over three objectives.

Figures & tables

Appendix figures & tables21 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Provably Reduced Sample Cost in Prior-Guided Hyperparameter Optimization

    Jun 3, 2026Leona Hennig, Jasmin Brandt, Lukas Fehring +3Multi-Fidelity OptimizationMulti-Armed Bandits

  2. Evidence-Gated LLM Priors for Multi-Objective Bayesian Optimization

    Jun 1, 2026Jiangyu Chen, Ban YiBayesian OptimizationLarge Language Model-Guided Optimization

  3. Importance-Aware Scheduling for High-Dimensional Hyperparameter Optimization

    Jun 8, 2026Ruinan Wang, Ian Nabney, Mohammad GolbabaeeBayesian OptimizationHyperparameter Optimization