cs.LGNov 4, 2026

Adaptive Multi Mode: Budget-Aware Routing of Optimizers By Online Landscape Probes

Authors: Benjamin Jacob Bodner

Abstract

The best classical optimizer for a continuous black-box problem depends on its budget and landscape. Existing routers decide from the dimension and budget, past improvement or features fitted to one benchmark, and few test an optimizer's implicit assumptions online. AMM (Adaptive Multi Mode) routes a known budget among quasi-Newton, trust-region, coordinate, multistart and evolution-strategy optimization engines with online probes of curvature, plateaus, separability, kinks, basins and fractal structure. Each probe has a default, a dimension-by-budget validity range and a cost charged to the budget. In its pre-registered development loop on bbob, 32 of 36 predictions held over the last 16 confirmations. AMM was then tested once on held-out bbob instances 101-110 (D=2-40, 10D-1000D) against up to seven competitors. It has the highest target share in 382 of 600 function-dimension-budget cells (236 outright, 146 tied) and, by a descriptive posterior rule, is credibly behind in 35, mostly at 10D and 30D. At every budget it also leads the controls built from its own engines (the best engine alone, the best engine per dimension and budget, and a greedy schedule), narrowly at 10D and 30D, and nevergrad's NgIohTuned. In pre-registered runs its lead over IPOP-CMA-ES holds under affine and box transformations, on box-constrained bbob and, pooled, on rotated f2-f4, but rotating the separable f3 and f4 removes most of the lead there. On held-out MA-BBOB its final share at 2000*D is level with IPOP-CMA-ES's and its anytime area lower. We published AMM as an open-source Python package (pip install amm-optimizer; https://github.com/BjBodner/amm-optimizer).

Explore similar work

CardsList
  1. A Large-Scale Empirical Evaluation of MMAO Under Fair-Budget Continuous and Discrete Benchmarks

    Jun 30, 2026Jinliang Xu, Liping MaMulti-Agent System OptimizationMetaheuristic Optimization

  2. RaMMOBO: Random Max-Margin Multi-Objective Bayesian Optimization

    Oct 30, 2026Thomas Wedenig, Paul Plantosar, Robert PeharzBayesian OptimizationMulti-Objective Optimization

  3. Minimal MMAO: A Resource-Closed-Loop Framework for Adaptive Metaheuristic Search

    Jun 29, 2026Jinliang Xu, Liping MaMulti-Agent System OptimizationMetaheuristic Optimization