cs.NEJun 14, 2026

MSC-CMA-ES: Structure-Aware Restarts for CMA-ES via Cyclic Nearest-Better Basin Discovery

Authors: Dimitar Nedanovski, Svetoslav Nenov, Dimitar Pilev

Abstract

CMA-ES is, per run, a local optimizer; multimodal search relies on restart strategies such as IPOP and BIPOP, which draw every restart uniformly and reuse no information from previous evaluations. Multi-Start Clustering CMA-ES (MSC-CMA-ES) makes restarts structure-aware: in alternating cycles, a Sobol pre-sample is partitioned into approximate basins of attraction by nearest-better clustering, restarts are seeded basin by basin with locally scaled step sizes and population sizes, redundant basin visits are detected and excluded, and the remaining budget is spent on an unbounded local refinement of the best-so-far solution. We evaluate the method on four CEC suites (CEC2014, CEC2017, CEC2020, CEC2022) at their official budgets, across ten (suite, dimension) cells with dimensions 5-30, 51 runs per function, against BIPOP-CMA-ES and five differential-evolution algorithms (ARRDE, jSO, j2020, NL-SHADE-RSP, LSRTDE). Read per function class, MSC-CMA-ES leads on one class, is mixed on a second, and trails on the third. On composition functions, MSC-CMA-ES attains the best value on all four aggregate measures, with 2.7x the fixed-budget target coverage of BIPOP-CMA-ES - the highest composition coverage of any algorithm evaluated. On basic functions, it achieves the best (lowest) median error but exhibits a lower deep-target coverage - the measured price of spending budget on landscape discovery. On hybrid functions both CMA variants trail the leading DE algorithms; the deficit belongs to the CMA family, not to the restart mechanism. All results and scripts are publicly available.

Explore similar work

CardsList
Apr 29, 2026cs.NE

RCMAES: A Robust CMA-ES Variant for CEC2026 Competition

This paper proposes RCMAES, a novel variant of the Covariance Matrix Adaptation Evolution Strategy (CMA-ES) for CEC benchmark optimization. RCMAES integrates a dimension-dependent nonlinear population-size reduction strategy with an adaptive restart mechanism within a pure CMA-ES framework. RCMAES is evaluated on three benchmark suites (CEC2017, CEC2020, and CEC2022) and compared with state-of-the-art DE algorithms as well as its closely related counterpart, BIPOP-aCMAES. Experimental results show that RCMAES achieves competitive and robust performance across all benchmarks.
Khoirul Faiq Muzakka, Sören Möller, Martin Finsterbusch
Covariance EstimationPopulation DynamicsBenchmark Suite
AskPDF
Jun 8, 2026cs.NE

Quantitative Performance Analysis of Stopping Criteria for CMA-ES

Covariance matrix adaptation evolution strategy (CMA-ES) is a state-of-the-art black-box optimization algorithm. In general, CMA-ES uses a portfolio of multiple stopping criteria to automatically determine when to stop the search. This mechanism aims to avoid unnecessary consumption of the function evaluation budget during stagnation. Stopping criteria play an important role in CMA-ES, particularly when restart strategies are employed. However, the effectiveness of stopping criteria in CMA-ES remains poorly understood. To address this issue, this paper investigates how the 11 stopping criteria in CMA-ES behave on the noiseless BBOB function set. The performance of the stopping criteria is quantitatively evaluated based on the optimal stopping point in terms of the number of function evaluations in a single run of CMA-ES. Our results show that, although which stopping criterion is triggered first depends significantly on the sample size λλ and the dimension nn, \texttt{tolflatfitness} and \texttt{tolfun} are frequently the first criteria to be triggered among the portfolio of 11 stopping criteria. We also demonstrate that \texttt{tolfunhist} and the portfolio achieve the highest stopping accuracy in most cases. In addition, our results show that the \texttt{tolfun} and \texttt{tolfunhist} criteria are frequently triggered before CMA-ES reaches complete stagnation.
Ryoji Tanabe
Black-Box OptimizationCovariance EstimationRetrying
AskPDF
Jul 15, 2026cs.NE

S-CARD-CMSA: A Score-Aware Candidate Archive with Density-Filtered Reporting for Multimodal Optimization

Multimodal optimization aims to locate multiple globally optimal or near-optimal solutions in a single run. This paper presents \emph{S-CARD-CMSA}, a score-aware candidate-archive and density-filtered reporting framework built on the covariance matrix self-adaptation evolution strategy with repelling subpopulations (RS-CMSA-ESII). The method is developed for the IEEE CEC 2026 Competition on Benchmarking Niching Methods for Multimodal Optimization. Rather than modifying the core search dynamics of RS-CMSA-ESII, S-CARD-CMSA preserves its sampling, covariance adaptation, taboo-region update, restart, and termination mechanisms. Two conservative extensions are introduced. First, a passive secondary candidate archive records the restart-level best candidates without influencing the search trajectory. Second, a score-aware density-filtered reporting rule constructs the final solution set by balancing robust peak ratio and precision-driven F1-score. Development experiments show that the density-filtered rule preserves the peak coverage obtained by a medium score-aware rule while reducing redundant reports. On a broader validation subset, it maintains the same mean RPR while improving mean precision, F1-score, and the official-score-oriented average. The method does not use true global-minimum locations during optimization; such information is used only for offline development analysis and post-run scoring. The source code of S-CARD-CMSA is available at https://github.com/ChauhanDikshit.
Dikshit Chauhan
Joint OptimizationCovariance Estimation
AskPDF