cs.NEFeb 5, 2026

Variable Search Stepsize for Randomized Local Search in Multi-Objective Combinatorial Optimization

Authors: Xuepeng RenMaocai WangGuangming DaiZimin LiangQianrong LiuShengxiang YangMiqing Li

Abstract

Over the past two decades, research in evolutionary multi-objective optimization has predominantly focused on continuous domains, with comparatively limited attention given to multi-objective combinatorial optimization problems (MOCOPs). Combinatorial problems differ significantly from continuous ones in terms of problem structure and landscape. Recent studies have shown that on MOCOPs multi-objective evolutionary algorithms (MOEAs) can even be outperformed by simple randomised local search. Starting with a randomly sampled solution in search space, randomised local search iteratively draws a random solution (from an archive) to perform local variation within its neighbourhood. However, in most existing methods, the local variation relies on a fixed neighbourhood, which limits exploration and makes the search easy to get trapped in local optima. In this paper, we present a simple yet effective local search method, called variable stepsize randomized local search (VS-RLS), which adjusts the stepsize during the search. VS-RLS transitions gradually from a broad, exploratory search in the early phases to a more focused, fine-grained search as the search progresses. We demonstrate the effectiveness and generalizability of VS-RLS through extensive evaluations against local search and MOEAs methods on diverse MOCOPs.

Explore similar work

Apr 20, 2026cs.NE

On Scalability of Multi-Objective Evolutionary Algorithms on Combinatorial Optimisation Problems

Scalability of evolutionary algorithms refers to assessing how their performance changes as problem size increases. In the area of multi-objective optimisation, research on the scalability of multi-objective evolutionary algorithms (MOEAs) has predominantly focussed on continuous problems. However, multi-objective combinatorial optimisation problems (MOCOPs) differ from continuous ones. Their discrete and rigid structure often brings rugged landscape, numerous local optimal solutions and disjoint global optimal regions. This leads to different behaviour of MOEAs. For example, SEMO, a simple MOEA without mating selection and diversity maintenance mechanisms, has been shown to be highly competitive, and in many cases to outperform more sophisticated MOEAs on MOCOPs. Yet, it remains unclear whether such findings hold for large-scale cases. In this paper, we conduct an empirical investigation into the scalability of MOEAs on combinatorial problems, with problem size from 50 to 5,000. Our results show that SEMO experiences a decline in convergence speed as dimensionality increases, compared to other MOEAs such as NSGA-II, SMS-EMOA and MOEA/D. We further demonstrate that the absence of crossover is a major contributor to SEMO's underperformance in large-scale problems, and that incorporating crossover into SEMO can substantially accelerate convergence in general, despite being detrimental in spreading solutions over the Pareto front.
Menghao Tang, Zimin Liang, Miqing Li
Jul 6, 2026cs.NE

A Large-Scale Sparse Multiobjective Optimization Algorithm Based on Optimal Performance Scores

Large-scale sparse multiobjective optimization problems (LSSMOPs) involve a large number of decision variables and Pareto optimal solutions with only a few nonzero variables. However, as the number of decision variables grows, it becomes increasingly challenging to accurately identify the nonzero variables, and optimization performance is adversely affected. To address these issues, this paper proposes an evolutionary algorithm for LSSMOPs. Specifically, we propose a new initialization method capable of generating scores that accurately reflect the importance of variables, and an initial mask vector template that can locate nonzero variables. This leads to the generation of a high-quality initial population. Additionally, this paper introduces a new strategy to calculate the mutation probability for each variable and a novel optimization for real variables based on the Pareto-guided normal distribution, enabling the population to avoid being trapped in local optima and quickly converge to the global optimum. Experimental results from eight benchmark problems and three real-world applications demonstrate that the proposed algorithm achieves superior performance compared with state-of-the-art algorithms.
Jia-Lin Mai, Min-Rong Chen, Guo-Qiang Zeng +2
Jul 18, 2026cs.NE

Decision Variable Analysis-Guided Differentiated Fuzzy Search for Large-Scale Multi-Objective Optimization

Large-scale multi-objective optimization problems (LSMOPs) are challenging due to their high-dimensional decision spaces. Fuzzy search is an effective technique for improving search efficiency, while decision variable analysis can reveal the distinct roles of variables in promoting convergence and maintaining diversity. However, existing fuzzy search methods generally employ a uniform search granularity for all variables, overlooking the heterogeneous search requirements implied by variable roles. To address this limitation, this paper proposes a Decision variable analysis-guided Differentiated Fuzzy Search method, termed DDFS. The proposed method establishes an explicit mapping between decision-variable roles and fuzzy search granularities. Decision variable analysis is employed to identify variable roles and search sensitivities, enabling different variable groups to adopt differentiated fuzzy search behaviors during offspring generation. Furthermore, a Dual-Indicator Stage Transition Mechanism is developed to dynamically adjust fuzzy-updating intensity throughout the evolutionary process, balancing early-stage search-space compression and late-stage convergence refinement. Extensive experiments on the LSMOP and UF benchmark suites with up to 1000 decision variables show that DDFS generally achieves competitive performance against several representative large-scale multi-objective evolutionary algorithms. The results suggest that explicitly incorporating decision-variable roles into fuzzy search can help improve optimization performance in high-dimensional decision spaces.
Boxi Xiao, Hui Bai, Jinhua Zheng +2