REMBGO for Evaluation-Limited Optimization: CEC2022 Benchmarking and EAF-STATCOM Generalization
Authors: Vikram Chekuri, Narapareddy Ramarao, Prashanth N A
Organizations: Department of Electrical and Electronics Engineering, BMS Institute of Technology and Management, Bengaluru, Karnataka, India · Affiliated to Visvesvaraya Technological University, Belagavi, Karnataka, India
Metaheuristic comparisons are often reported at evaluation budgets far larger than an expensive engineering simulation can afford. This paper presents REMBGO, an evaluation-budget-aware refinement of EMBGO. Its contribution is not any single operator: it is the integration of population preservation, scale-normalized exploration and recovery mechanisms whose parent-relative benefit is concentrated under restricted function-evaluation budgets. REMBGO is evaluated on CEC2022 at a primary, application-aligned budget of 1040 function evaluations, with a surrounding budget ladder reported descriptively to characterise budget dependence rather than as a family of controlled hypotheses. A component-removal study finds no individual mechanism whose removal survives multiplicity correction, consistent with an integrated rather than a single-operator contribution. The algorithm is then applied to EAF--STATCOM controller tuning, and the resulting frozen gain vectors are transferred without retuning to twenty pre-specified unseen stochastic arc realizations (210 fixed-gain simulations, all feasible). The selected gain-vector main effect accounts for only 3.6--5.8% of the crossed validation variation, against approximately 61.4% for interaction plus residual, and the matched REMBGO--EMBGO paired differences are controller-dependent in sign and not statistically significant. REMBGO is therefore presented as a resource-aware refinement whose benefit must be stated together with the evaluation budget, not as a universally superior optimizer.
Figures & tables
Parameter
Symbol
Value
Elite count
Ke
3
Radius scale
δ
U(0.8,1.2)
Radius decay
ρ(τ)
1.5→0.8
Step gain
λ
0.02→0.003
Lévy exponent
βL
1.5
Opposition probability
po
0.10
Table 1: Default REMBGO control parameters. The Cauchy and triple-leader probabilities, elite count and restart fraction are varied only in the sensitivity analysis of Supplementary Material S2.
Figure 1: Friedman mean rank of the five optimizers against the evaluation budget, for D=10 (left) and D=20 (right); lower mean rank is better. The dashed vertical marker identifies the exact 1040 -evaluation application budget.
D
FEs
PSO
GWO
FP-SHADE
EMBGO
REMBGO
Best
Friedman p
W/T/L
10
200
1.917
1.917
4.083
4.417
2.667
PSO/GWO
1.93e-05
10/2/0
10
1040
2.750
2.833
4.000
3.167
2.250
REMBGO
0.0892
4/6/2
10
200000
2.542
4.917
1.625
2.625
3.292
FP-SHADE
1.07e-06
0/9/3
20
125
2.250
1.250
4.583
4.333
2.583
GWO
7.66e-08
10/2/0
20
1040
2.500
2.250
3.833
3.833
2.583
GWO
0.0224
9/1/2
20
1000000
2.542
4.917
1.542
2.875
3.125
FP-SHADE
3.82e-06
0/8/4
Table 2: Representative benchmark rungs across the three budget regimes; lower mean rank is better and Best names the optimizer with the lowest observed mean rank. W/T/L reports REMBGO better / no significant difference / EMBGO better over the twelve functions after within-budget Holm correction; the full ladder is in Supplementary Material S1.
Figure 2: Holm-corrected paired function-level comparison between REMBGO and EMBGO across evaluation budgets. Green, grey and red mark functions significantly favouring REMBGO, with no significant difference, and favouring EMBGO, respectively; correction is applied across the twelve functions at each budget.
Removed component
Rank D=10
Rank D=20
Δlog10D=10
Δlog10D=20
Holm pD=10
Holm pD=20
Elitism
3.583
4.833
−0.0411
−0.0064
0.617
1.000
Weighted centroid
5.167
5.083
−0.0058
−0.0015
1.000
1.000
Normalized/decaying radius
6.667
6.500
+0.0043
+0.0053
1.000
1.000
Opposition
3.917
2.583
−0.0380
−0.0527
0.617
0.098
Cauchy mutation
7.583
8.167
+0.0181
+0.0520
1.000
1.000
Triple leader
7.833
8.000
+0.0092
+0.0423
1.000
0.068
Table 3: Component-removal results at the exact 1040 -evaluation budget; the removed elements include both retained and refined parts of REMBGO. Positive median Δlog10 error indicates degradation after removal, negative a descriptive improvement. No removal is significant after the suite-level Holm correction across the ten planned contrasts.
Figure 3: Component-removal penalties for REMBGO at the exact 1040 -evaluation budget ( D=10 left, D=20 right). Positive values indicate degradation after removal, negative a descriptive improvement; no removal is significant after the suite-level Holm correction across the ten planned contrasts.
Figure 4: Fixed-gain generalization across twenty unseen stochastic EAF arc realizations for the five selected gain vectors of each controller. The first two panels show the validation objective distributions for the DQ-PI and Lyapunov controllers over the twenty pre-specified corrected arc realizations; the final panel partitions the crossed variation into arc-realization, gain-vector and interaction-plus-residual components. The corrected base- 42 reference case is excluded. No re-optimization is performed and no optimizer ranking is implied.
Appendix figures & tables7 assets
Supplementary material from the paper’s appendix.
Appendix
D
FEs
PSO
GWO
FP-SHADE
EMBGO
REMBGO
Best
Friedman p
W/T/L
10
200
1.917
1.917
4.083
4.417
2.667
PSO/GWO
1.93e-05
10/2/0
10
316
2.417
1.750
4.167
4.083
2.583
GWO
1.89e-04
8/4/0
10
502
2.583
2.083
4.000
3.917
2.417
GWO
4.06e-03
6/5/1
10
796
2.417
2.333
4.000
3.500
2.750
GWO
0.0393
3/7/2
10
840
2.583
2.500
4.083
3.417
2.417
REMBGO
0.0382
3/7/2
10
1040
2.750
2.833
4.000
3.167
2.250
REMBGO
0.0892
4/6/2
Appendix
Table S1 : Complete five-optimizer CEC2022 evaluation-budget ladder. Mean Friedman ranks, lowest-mean-rank optimizer, per-rung omnibus Friedman p , and Holm-corrected REMBGO-vs-EMBGO win/tie/loss over the twelve functions. Source: archived CEC2022 budget-ladder result set.
Parameter
Value
Rank D=10
Δlog10D=10
Rank D=20
Δlog10D=20
Cauchy probability
0.1
2.167
−0.0348
2.833
+0.0139
0.2∗
2.833
+0.0000
3.000
+0.0000
0.3
3.000
−0.0009
2.167
−0.0329
0.4
2.000
−0.0107
2.000
−0.0337
Elite count
1
2.500
−0.0309
2.500
−0.0130
2
2.667
−0.0018
1.667
−0.0230
Appendix
Table S2 : REMBGO sensitivity at the exact 1040 -evaluation budget. Within each swept factor the ranks are computed across that factor’s settings; the default value (marked ∗ ) defines the zero of Δlog10 . Source: archived 1040 -evaluation sensitivity result set.
Figure S1 : REMBGO one-factor-at-a-time sensitivity at the exact 1040 -evaluation budget for D=10 and D=20 . The selected default of each factor is marked; nearby settings are descriptively better or worse without a consistent improvement across both dimensions.
Table S3 : Selected minimum- Jtot gain vectors replayed in the fixed-gain transfer study, one per optimizer and controller. For DQ-PI the reactive integral gain follows Ki,Q=Kp,Q/Ti,Q and is not listed separately. Values are the archived stochastic-tuning champions; each reproduces the tabulated Jtrain of Table S4 on replay.
Controller
Optimizer
Jtrain
Val. mean
Val. SD
Val. median
Mean shift
Corr. base-42
DQ-PI
PSO
0.406577
0.416711
0.023752
0.409602
+0.010133
0.402806
GWO
0.402520
0.419252
0.025181
0.411996
+0.016732
0.419992
FP-SHADE
0.413838
0.407128
0.021850
0.410386
−0.006710
0.388682
EMBGO
0.412499
0.413542
0.017652
0.408077
+0.001044
0.426294
REMBGO
0.411379
0.419498
0.030625
0.413860
+0.008119
0.399341
Lyapunov
PSO
0.310776
0.343695
0.016917
0.345919
+0.032919
0.353066
Appendix
Table S4 : Fixed-gain replay of the ten selected minimum- Jtot vectors. Jtrain is the tuning-arc score; validation columns summarise Jtot over the twenty pre-registered corrected unseen arcs; mean shift is validation mean minus Jtrain , where Jtrain is the STO-SR tuning-arc score recorded during the original campaign. The final column is the corrected base- 42 realization, reported as a reference case only and excluded from every validation statistic; it is not a reproduction of the STO-SR tuning trajectory. Source: the corrected-generator campaign dataset, 200 unseen rows.
Controller
Mean
Median
95% CI
Signed-rank p
Signs
DQ-PI
+0.005956
+0.001871
[−0.005184,+0.007000]
0.4980
8/0/12
Lyapunov
−0.008843
−0.006007
[−0.019601,+0.004355]
0.1650
12/0/8
Appendix
Table S5 : Matched REMBGO − EMBGO fixed-gain paired difference across the twenty unseen arcs (positive means the REMBGO vector has the larger, worse Jtot ). CI is a 10,000 -resample percentile bootstrap; p is the two-sided exact signed-rank test; signs are REMBGO better / ties / REMBGO worse. Source: the corrected-generator campaign dataset.
Controller
Arc realization
Gain vector
Interaction + residual
Fixed-vector Friedman p
Kendall W
DQ-PI
34.98%
3.64%
61.38%
0.641
0.031
Lyapunov
32.79%
5.75%
61.46%
0.585
0.036
Appendix
Table S6 : Crossed-variation decomposition of the fixed-gain validation objective over the twenty unseen arcs and five selected vectors. Percentages are shares of the total sum of squares; the fixed-vector Friedman test and Kendall’s W are descriptive checks over post-selected champions. Source: the corrected-generator campaign dataset.
Expensive black-box optimization is ubiquitous in science and engineering, where function evaluations are costly and the evaluation budget is limited. Traditional evolutionary algorithms and Meta-BlackBox Optimization (MetaBBO) approaches typically consume most evaluations on candidate selection, often wasting precious budget on inferior solutions. Although surrogate-assisted evolution and Bayesian optimization aim to reduce evaluations through surrogate models, constructing an accurate global model from limited data remains challenging, and model bias can easily trap the search in local optima. To overcome these limitations, we propose NeurGO, a generative MetaBBO framework that directly synthesizes elite candidates from historical population states. Specifically, we employ an attention-based encoder to capture the population-level search trend and condition a decoder on this representation to generate high-quality candidates, avoiding the expensive evaluation of large offspring pools. We then design a quality-diversity loss to maintain solution quality and population diversity throughout the search. Through extensive benchmarking on CEC 2008 and the COCO BBOB test suites, our method achieves better optimization performance under the same evaluation budget and exhibits faster convergence.
This paper evaluates the Metabolic Multi-Agent Optimizer (MMAO) under a stricter empirical protocol rather than reintroducing the framework itself. The study asks whether MMAO's closed-loop resource-allocation principle remains credible under broader, more standard, and more explicitly budget-controlled continuous and discrete benchmarks. The main completed matrix covers eight CEC2017 functions at 10D and 30D with 20 seeds each, and five TSPLIB instances with 20 seeds each, together with stronger reproducible baselines including PSO-lite, ES-lite, and an iterated-greedy 2-opt route baseline. We further add trajectory-level diagnostics for communal budget, success rate, role evolution, and population turnover, plus an auxiliary OR-Library multiple-knapsack slice to extend the discrete evidence beyond routing. Under this protocol, MMAO clearly outperforms the external baseline set on the continuous side and on the TSPLIB side, while the ablation variants remain much closer to the full method than the external baselines are. We therefore position MMAO as a benchmark-backed cross-domain adaptive framework whose most clearly validated value is endogenous resource redistribution under evidence pressure, while also noting that the strongest remaining gap is not basic workability but sharper mechanism isolation and broader competition-grade comparison.
Jinliang Xu, Liping Ma
Jinliang Xu is with the current study team · Department of Disease Control and Prevention, The Seventh Medical Center of Chinese PLA General Hospital, Beijing, China
This paper formalizes threshold-based selection as an evaluation-gating architecture in which each incumbent is tested before variation and a replacement is generated and evaluated only when contextual pressure exceeds intrinsic strength. The mechanism is instantiated as Leaf Abscission Optimization (LAO), using rank-based strength, a phenological seasonal signal, diversity modulation, environmental pressure, and a base regrowth kernel. A blocked two-to-the-fourth-power factorial analysis at dimension 10 on the CEC 2017 suite reduces the original multi-layer design to a parsimonious core: drift is harmful, while the other three auxiliary layers show no robust independent evidence of benefit. The resulting LAO-Core attains the third-best mean Friedman rank among nine optimizers at dimensions 10, 30, and 50 under the equal evaluation budget. A four-budget sweep shows budget-dependent relative performance, with adaptive differential-evolution baselines gaining relative advantage at larger budgets; the nine-cell dimension-budget analysis establishes neither an evaluation-budget-per-dimension-only law nor a statistically significant dimension-budget interaction. A paired intervention shows that diversity modulation changes late-run replacement behaviour without a detectable effect on final error at the tested budget. The evidence supports LAO as a parsimonious evaluation-gating mechanism with regime-qualified competitiveness, rather than as a generally superior optimizer.
Nasser Khalili
Graduate School of Management and Economics, Sharif University of Technology, Tehran, Iran.