Efficient Failure Management for Multi-Agent Systems with Reasoning Trace Representation
Authors: Lingzhe Zhang, Tong Jia, Mingyu Wang, Weijie Hong, Chiming Duan, Minghua He, Rongqian Wang, Xi Peng, Meiling Wang, Gong Zhang, Renhai Chen, Ying Li
Organizations: Peking University Beijing, China · Huawei Technologies Co., Ltd. Beijing, China · Huawei Technologies Co., Ltd. Hong Kong SAR, China · Huawei Technologies Co., Ltd. Shenzhen, China
Large Language Models (LLM)-based Multi-Agent Systems (MASs) have emerged as a new paradigm in software system design, increasingly demonstrating strong reasoning and collaboration capabilities. As these systems become more complex and autonomous, effective failure management is essential to ensure reliability and availability. However, existing approaches often rely on per-trace reasoning, which leads to low efficiency, and neglect historical failure patterns, limiting diagnostic accuracy. In this paper, we conduct a preliminary empirical study to demonstrate the necessity, potential, and challenges of leveraging historical failure patterns to enhance failure management in MASs. Building on this insight, we propose EAGER, an efficient failure management framework for multi-agent systems based on reasoning trace representation. EAGER employs unsupervised reasoning-scoped contrastive learning to encode both intra-agent reasoning and inter-agent coordination, enabling real-time step-wise failure detection, diagnosis, and reflexive mitigation guided by historical failure knowledge. Preliminary evaluations on three open-source MASs demonstrate the effectiveness of EAGER and highlight promising directions for future research in reliable multi-agent system operations.
Figures & tables
Figure 1. Workflow of EAGER. The left panel shows the overall framework, while the right illustrates an example.
Failure Type
AutoGen-Code
RCLAgent
SWE-Agent
Decomposition Error
34.48%
0.00%
0.00%
Incorrect Code
48.28%
0.00%
46.15%
Round Limitation
17.24%
5.26%
0.00%
Critical Trace Miss
0.00%
52.63%
0.00%
Metrics Query Error
0.00%
42.11%
0.00%
Editing Error
0.00%
0.00%
25.64%
Table 1. Failure Type Analysis across Three MAS
Model
Recall@10
NDCG@10
MRR@10
Qwen3-0.6B-Embedding
13.3%
8.7%
6.2%
BGE-M3-Embedding
22.2%
14.5%
10.8%
Table 2. Similar Reasoning Trace Retrieval Experiment
Figure 2. Training Pipeline of Reasoning Scoped Contrsative Learning
Institute of Software, Chinese Academy of Sciences, Beijing, China · State Key Laboratory of Complex System Modeling and Simulation Technology, Beijing, China · Science & Technology on Integrated Information System Laboratory, Beijing, China +2