Multi-Objective Evolutionary Optimization of Chance-Constrained Multiple-Choice Knapsack Problems with Implicit Probability Distributions
Organizations: Guangdong Provincial Key Laboratory of Brain-Inspired Intelligent Computation, Department of Computer Science and Engineering, Southern University of Science and Technology, Shenzhen 518055, China · School of Information Management, Central China Normal University, Wuhan 430079, China · Centre for Frontier AI Research, Institute of High Performance Computing, Agency for Science Technology and Research, Singapore 138632 · College of Computing and Data Science, Nanyang Technological University, Singapore 639798
Abstract
The multiple-choice knapsack problem (MCKP) is a classic combinatorial optimization with wide practical applications. This paper investigates a significant yet underexplored extension of MCKP: the multi-objective chance-constrained MCKP (MO-CCMCKP) under implicit probability distributions. The goal of the problem is to simultaneously minimize the total cost and maximize the confidence level of satisfying the capacity constraint, capturing essential trade-offs in domains like 5G network configuration. To address the computational challenge of evaluating chance constraints under implicit distributions, we first propose an order-preserving efficient resource allocation Monte Carlo (OPERA-MC) method. This approach adaptively allocates sampling resources to preserve dominance relationships while reducing evaluation time significantly. Further, we develop NHILS, a hybrid evolutionary algorithm that integrates specialized initialization and local search into NSGA-II to navigate sparse feasible regions. Experiments on synthetic benchmarks and real-world 5G network configuration benchmarks demonstrate that NHILS consistently outperforms several state-of-the-art multi-objective optimizers in convergence, diversity, and feasibility. The benchmark instances and source code will be made publicly available to facilitate research in this area.
Figures & tables
| Instance | |||||
| 10 | 10 | 500 | 20 | 35 | |
| 10 | 20 | 500 | 14 | 15 | |
| 20 | 10 | 500 | 30 | 41 | |
| 30 | 10 | 500 | 45 | 60 | |
| 40 | 10 | 500 | 58 | 87 | |
| 50 | 10 | 500 | 68 | 97 |
| ST | Absolute Error for Different Values | ||||
| 13.2 | 14.7 | 15.9 | 16.9 | 17.9 | |
| 0.013997 | 0.007000 | 0.001702 | 8.74E-05 | 7.10E-06 | |
| 0.008203 | 0.003251 | 0.000349 | 8.74E-05 | 7.10E-06 | |
| 0.009426 | 0.003095 | 0.000448 | 4.76E-05 | 1.57E-05 | |
| 0.008073 | 0.000737 | 6.59E-05 | 2.00E-05 | 1.43E-05 | |
| 0.007041 | 0.000975 | 0.000427 | 3.85E-05 | 2.90E-06 | |
| ST | Absolute Error for Different Values | ||||
| 13.2 | 14.6 | 15.8 | 16.8 | 17.8 | |
| 0.025311 | 0.008009 | 0.000953 | 9.58E-05 | 7.90E-06 | |
| 0.006966 | 0.002918 | 0.000700 | 9.58E-05 | 7.90E-06 | |
| 0.017886 | 0.003295 | 0.000262 | 7.34E-05 | 7.90E-06 | |
| 0.004049 | 0.001846 | 0.000439 | 3.02E-05 | 8.68E-06 | |
| 0.000992 | 0.000829 | 0.000248 | 3.73E-05 | 3.52E-06 | |
| HV | IGD | Runtime(s) | |
| 0.02 | 5.73 0.15 | 0.55 0.08 | 268.9 24.3 |
| 0.05 | 5.79 0.12 | 0.40 0.07 | 490.1 32.7 |
| 0.10 | 5.83 0.09 | 0.29 0.05 | 859.3 45.8 |
| 0.20 | 5.84 0.08 | 0.28 0.04 | 1664.7 68.9 |
| 0.30 | 5.85 0.07 | 0.25 0.03 | 2440.7 92.1 |
| Test Case | Indicators | NHILS | NSGA-II | SPEA-II | ANSGA-II | MOEA/D(ws) | MOEA/D(pbi) | MOEA/D(tche) |
| LAB-ls1 | HV | |||||||
| IGD | ||||||||
| IGD+ | ||||||||
| FSR | ||||||||
| #Gens | ||||||||
| LAB-ls2 | HV |
| Test Case | Indicators | NHILS | NSGA-II | SPEA-II | ANSGA-II | MOEA/D(ws) | MOEA/D(pbi) | MOEA/D(tche) |
| APP-ls1 | HV | |||||||
| IGD | ||||||||
| IGD+ | ||||||||
| FSR | ||||||||
| #Gens | ||||||||
| APP-ls2 | HV |
| Variant | HV | IGD | Time (s) |
| Complete | 859.32 873.96 | ||
| No Local Search | 5.30 2.44 | 1.93 2.07 | 107.32 100.06 |
| No HybridInit | 4.26 1.75 | 2.18 4.97 | 334.24 191.82 |
| NSGA-II | 3.31 1.20 | 2.82 3.09 |
Appendix figures & tables2 assets
Supplementary material from the paper’s appendix.
Appendix
| Estimation error( ) | 5 | 0.5 | 0.05 | 0.005 |
| Hoeffding’s bound | 139 | 13863 | 1386295 | 138629437 |
| Chernoff’s bound [ 46 ] | 278 | 27726 | 2772589 | 277258873 |
| Alamo’s bound [ 47 ] | 1573 | 15723 | 157227 | 1572269 |
Chance-Constrained Optimization
Chance-constrained optimization chooses decisions that optimize performance while limiting the probability of violating uncertain constraints.
See all 29 papers