cs.NEDec 20, 2025

Large-scale benchmarking of multi-objective soft-computing metaheuristics for redundancy allocation in repairable k-out-of-n systems

Authors: Mateusz Oszczypała, David Ibehej, Jakub Kudela

Abstract

This paper presents a large-scale budget-aware benchmark of multi-objective soft-computing metaheuristics for a bi-objective redundancy allocation problem in repairable k-out-of-n systems. The problem combines cost minimization and steady-state availability maximization under weight constraints, with binary subsystem-level decisions determining both the number of redundant components and the redundancy strategy. Four strategies are considered: cold standby, warm standby, hot standby, and a mixed active-warm standby strategy. Subsystem availability is evaluated using continuous-time Markov chains, while the optimization task is treated as a constrained mixed-integer multi-objective problem. The study compares 65 metaheuristic algorithms from multiple algorithmic families under two initialization settings, with and without Scaled Binomial Initialization (SBI), across six case studies of increasing structural and dimensional complexity and four weight limits per case. Performance is assessed using hypervolume, budget-dependent convergence profiles, and non-parametric statistical comparisons. The results show that algorithm rankings are strongly budget-dependent, indicating that a single final-budget ranking can be misleading. SBI provides a substantial early advantage and can change the relative performance of competing methods, especially for larger instances. The best-performing algorithms vary across budget regimes: NNIA-SBI and CMOPSO-SBI are competitive under tight budgets, whereas NSGA-II+ARSBX-SBI performs robustly for medium and large budgets. From a system design perspective, Pareto-optimal solutions are dominated by hot standby and mixed redundancy strategies, while cold and warm standby rarely appear. The benchmark highlights the importance of initialization, computational budget, and problem complexity when selecting soft-computing optimizers for practical redundancy allocation.

Explore similar work

CardsList
Jun 9, 2026stat.ML

Annealed Entropic Allocation for Ranking and Selection

We propose annealed entropic allocation, an adaptive sampling policy based on an annealed, weighted soft-min formulation of static budget allocation. We replace the maximin large-deviation rate objective with a weighted log-sum-exp surrogate that blends challenger-specific pairwise scores through soft-min weights, avoiding hard switching when several challengers are nearly active. To capture tail behavior beyond the leading exponent, the surrogate incorporates saddlepoint prefactors from refined pairwise tail asymptotics. Because these corrections are subexponential, decreasing the annealing temperature with the budget preserves the same first-order target allocation. For the static problem, we prove uniform convergence to the hard minimum, concentration of soft-min weights on active challengers, and continuity of the induced target-allocation map under fixed weights. Experiments show that the proposed methods are consistently competitive: the no-saddlepoint ablation performs best in symmetric Gaussian and exponential slippage settings, while saddlepoint weighting can help in heterogeneous or asymmetric cases.
Xin Fei, Juergen Branke
Gradient-Free Rank AllocatorCosine AnnealingToken BudgetsRankingScoring
AskPDF
Aug 13, 2026cs.LG

Sampling Luck Masquerades as Allocation Gain: Auditing Test-Time Budget Allocation for Neural Combinatorial Optimization

Neural combinatorial optimization (NCO) solvers report the best of many sampled solutions per instance, and the sample count is, by convention, identical for every instance. Whether a non-uniform allocation of a fixed total budget would buy anything has not been measured. We measure it, and we audit the measurement itself. First, on in-distribution workloads the allocation headroom is not detectable. Across three pretrained solvers (POMO, AM, SymNCO) on uniform TSP-100, an oracle allocation computed and evaluated on the same stored samples reports a 2.2-2.6% gain with intervals excluding zero; measured out of sample the same gain is indistinguishable from zero (0.457, 0.015, -0.512 percent). Following the customary in-sample procedure, all three solvers would have supported a published 2%-level gain that does not exist. We calibrate this bias against an instance-wise null in which the true gain is zero by construction; over the ranges we test it does not shrink with more samples or more instances. Second, the same correction that removes the phantom gains preserves a real one. Under distribution shift (a workload mixing uniform and clustered instances), a pre-registered confirmatory experiment finds that allocation guided by held-out sample statistics improves best-of-k by 11.5% (AM, primary endpoint; 95% CI [7.4, 19.7]) and 12.0% (SymNCO, replication) at equal evaluation budget, with the signal-acquisition cost not charged; a pre-registered negative control (POMO, an order of magnitude more robust to shift) shows -0.3% [-0.7, 0.24]. The gain exceeds a frozen distribution-label baseline by 4.2 points [1.9, 7.7]. An exploratory policy charging a 20-sample probe against the same budget retains 3.4% (AM) and 4.6% (SymNCO). We give a correction procedure and a reporting checklist, and release all data, code, and the pre-registration record.
Jinhyung Bae
Combinatorial OptimizationToken Budgets
AskPDF
Jun 30, 2026cs.NE

A Large-Scale Empirical Evaluation of MMAO Under Fair-Budget Continuous and Discrete Benchmarks

This paper evaluates the Metabolic Multi-Agent Optimizer (MMAO) under a stricter empirical protocol rather than reintroducing the framework itself. The study asks whether MMAO's closed-loop resource-allocation principle remains credible under broader, more standard, and more explicitly budget-controlled continuous and discrete benchmarks. The main completed matrix covers eight CEC2017 functions at 10D and 30D with 20 seeds each, and five TSPLIB instances with 20 seeds each, together with stronger reproducible baselines including PSO-lite, ES-lite, and an iterated-greedy 2-opt route baseline. We further add trajectory-level diagnostics for communal budget, success rate, role evolution, and population turnover, plus an auxiliary OR-Library multiple-knapsack slice to extend the discrete evidence beyond routing. Under this protocol, MMAO clearly outperforms the external baseline set on the continuous side and on the TSPLIB side, while the ablation variants remain much closer to the full method than the external baselines are. We therefore position MMAO as a benchmark-backed cross-domain adaptive framework whose most clearly validated value is endogenous resource redistribution under evidence pressure, while also noting that the strongest remaining gap is not basic workability but sharper mechanism isolation and broader competition-grade comparison.
Jinliang Xu, Liping Ma
MetabolicToken Budgets
AskPDF