RaMMOBO: Random Max-Margin Multi-Objective Bayesian Optimization
Organizations: Institute of Machine Learning and Neural Computation, TU Graz, Austria · Graz Center for Machine Learning (GraML), Austria
Abstract
Multi-objective Bayesian optimization (MOBO) maximizes expensive black-box objectives with the goal of approximating the Pareto set, whose objective vectors cannot be improved in one component without sacrificing another. A common quality measure is hypervolume, the volume in objective space dominated by these vectors relative to a reference point. Expected hypervolume improvement (EHVI) directly targets this metric and is one-step Bayes-optimal, but its standard computation scales exponentially with , making it prohibitively expensive for many-objective problems. We introduce random max-margin multi-objective Bayesian optimization (RaMMOBO), whose acquisition function lower-bounds EHVI while requiring only linear cost in to evaluate. RaMMOBO measures the volume of a max-margin box contained in a candidate's hypervolume-improvement region and averages over random reweightings of the objective space, yielding a utility that is strictly Pareto-monotone on hypervolume-improving outcomes. It naturally handles noisy observations and different probabilistic surrogates and supports efficient gradient-based optimization. Across synthetic and real-world benchmarks, RaMMOBO matches or outperforms state-of-the-art methods, with largest gains at higher , with acquisition optimization up to two orders of magnitude faster than qLogNEHVI. Our implementation is available at https://anonymous.4open.science/r/rammobo.
Figures & tables
Appendix figures & tables8 assets
Supplementary material from the paper’s appendix.
Appendix
| Problem | reference point | noise | ||||
|---|---|---|---|---|---|---|
| Branin–Currin | 2 | 2 | 20 | 30 | ||
| DTLZ3 | 10 | 2 | 100 | 600 | ||
| DTLZ7 | 5 | 2 | 50 | 50 | ||
| Vehicle design | 5 | 3 | 50 | 90 | ||
| Car side-impact | 7 | 4 | 70 | 130 | ||
| RE91 | 7 | 9 | 22 | 50 |
Bayesian Optimization
Bayesian optimization uses probabilistic models and sequential experiments to find strong solutions when evaluating a black-box objective is costly.
See all 268 papers