From Recursion to Convolution: Parallel Self-Improvement for Multi-Agent Systems
Organizations: Huawei Technologies Co., Ltd.
Abstract
Multi-agent self-improvement enables agents to improve through interaction and feedback. However, sequential dependencies across agents and refinement rounds can propagate errors, increase computational costs, and limit parallelism. Moreover, refining individual features or agents in isolation can overlook their dependencies and restrict collective coordination. To address these challenges, we propose ConvRSI, a framework for parallelizing multi-agent self-improvement through convolution. ConvRSI couples intra-agent convolution, which jointly refines related agent features, with inter-agent graph convolution, which aggregates messages according to the collaboration topology. Both stages operate in latent space, enabling parallel updates without repeatedly decoding and re-encoding intermediate messages. Experiments on MATH-500 show that ConvRSI achieves 5.04% performance improvement while reducing 17.27% inference cost, and 45.11% latency compared with RecursiveMAS. It also supports diverse collaboration patterns by representing their topologies as adjacency matrices. These results demonstrate the potential of convolutional co-evolution for efficient multi-agent self-improvement. Our code and datasets are provided in https://github.com/LYA2333/ConvRSI.
Figures & tables
| Style | Adjacency construction | Degree after adding self-loops |
| Sequential | , | ; for |
| Mixture | , | ; for |
| Distillation | Asymmetric influence: on selected pairs | |
| Deliberation | Reciprocal exchange: on interacting pairs |
| Collaboration Pattern | Role | Model Size & Version |
| Sequential Style (Light) | Planner | Qwen3-1.7B [ Yang et al., 2025a ] |
| Critic | Llama-3.2-1B-Instruct [ Grattafiori et al., 2024 ] | |
| Solver | Qwen2.5-Math-1.5B-Instruct [ Yang et al., 2025b ] | |
| Mixture Style | Code Specialist | Qwen2.5-Coder-3B-Instruct [ Hui et al., 2024 ] |
| Science Specialist | BioMistral-7B [ Labrak et al., 2024 ] | |
| Math Specialist | DeepSeek-R1-Distill-Qwen-1.5B [ Yang et al., 2025b ] |
| Method | Solver or agent configuration | MATH-500 accuracy (%) | MBPP+ pass@1 (%) |
| Modular harness optimization | |||
| ModularRSI | Qwen3.5-4B | 67.1 | 32.1 |
| Persistent memory and skills | |||
| Hermes+ | Sequential-Light solver | 64.6 | 28.6 |
| Hermes+ | Qwen3.5-4B | 67.2 | 27.3 |
| Multi-agent workflow optimization and self-training | |||
Self-Improving Agents
Self-improving agents use experience and feedback to update their models, memories, skills, or workflows for better future task performance.
See all 198 papers