cs.NEMar 8, 2026

CDEoH: Category-Driven Automatic Algorithm Design With Large Language Models

Authors: Yu-Nian Wang, Shen-Huan Lyu, Ning Chen, Jia-Le Xu, Baoliu Ye, Qingfu Zhang

Organizations: Key Laboratory of Water Big Data Technology of Ministry of Water Resources, College of Computer Science and Software Engineering, Hohai University, Nanjing, China · Department of Computer Science, City University of Hong Kong, Hong Kong, China · State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China

Abstract

With the rapid advancement of large language models (LLMs), LLM-based heuristic search methods have demonstrated strong capabilities in automated algorithm generation. However, their evolutionary processes often suffer from instability and premature convergence. Existing approaches mainly address this issue through prompt engineering or by jointly evolving thought and code, while largely overlooking the critical role of algorithmic category diversity in maintaining evolutionary stability. To this end, we propose Category Driven Automatic Algorithm Design with Large Language Models (CDEoH), which explicitly models algorithm categories and jointly balances performance and category diversity in population management, enabling parallel exploration across multiple algorithmic paradigms. Extensive experiments on representative combinatorial optimization problems across multiple scales demonstrate that CDEoH effectively mitigates convergence toward a single evolutionary direction, significantly enhancing evolutionary stability and achieving consistently superior average performance across tasks and scales.

Figures & tables

Explore similar work

CardsList
  1. A2DEPT: Large Language Model-Driven Automated Algorithm Design via Evolutionary Program Trees

    Apr 27, 2026Bin Chen, Shouliang Zhu, Beidan Liu +4Automated Algorithm DiscoveryAutomated Heuristic Design

  2. QDEvo: A Multi-Objective Quality-Diversity Framework for Automated Heuristic Design

    Jul 6, 2026Nam Do Khanh, Nhat Nguyen Tran Minh, Dat Pham Vu Tuan +2Automated Algorithm DiscoveryAutomated Heuristic Design

  3. MeEvo: Metacognitive Evolution Combined with Natural Evolution for Automatic Heuristic Design

    Jun 12, 2026Zishang Qiu, Xinan Chen, Rong Qu +1Automated Heuristic DesignEvolutionary Optimization