cs.SEMar 23, 2026

Efficient Failure Management for Multi-Agent Systems with Reasoning Trace Representation

Authors: Lingzhe Zhang, Tong Jia, Mingyu Wang, Weijie Hong, Chiming Duan, Minghua He, Rongqian Wang, Xi Peng, 

Organizations: Peking University Beijing, China · Huawei Technologies Co., Ltd. Beijing, China · Huawei Technologies Co., Ltd. Hong Kong SAR, China · Huawei Technologies Co., Ltd. Shenzhen, China

Abstract

Large Language Models (LLM)-based Multi-Agent Systems (MASs) have emerged as a new paradigm in software system design, increasingly demonstrating strong reasoning and collaboration capabilities. As these systems become more complex and autonomous, effective failure management is essential to ensure reliability and availability. However, existing approaches often rely on per-trace reasoning, which leads to low efficiency, and neglect historical failure patterns, limiting diagnostic accuracy. In this paper, we conduct a preliminary empirical study to demonstrate the necessity, potential, and challenges of leveraging historical failure patterns to enhance failure management in MASs. Building on this insight, we propose EAGER, an efficient failure management framework for multi-agent systems based on reasoning trace representation. EAGER employs unsupervised reasoning-scoped contrastive learning to encode both intra-agent reasoning and inter-agent coordination, enabling real-time step-wise failure detection, diagnosis, and reflexive mitigation guided by historical failure knowledge. Preliminary evaluations on three open-source MASs demonstrate the effectiveness of EAGER and highlight promising directions for future research in reliable multi-agent system operations.

Figures & tables

Explore similar work

CardsList
  1. From Flat Logs to Causal Graphs: Hierarchical Failure Attribution for LLM-based Multi-Agent Systems

    Feb 27, 2026Yawen Wang, Wenjie Wu, Junjie Wang +1Agent Failure AnalysisMulti-Agent LLM Systems

  2. VerifyMAS: Hypothesis Verification for Failure Attribution in LLM-based Multi-Agent Systems

    May 17, 2026Hezhe Qiao, Hanghang Tong, Ee-Peng Lim +2Agent Failure AnalysisMulti-Agent LLM Systems

  3. MAS-FIRE: Fault Injection and Reliability Evaluation for LLM-Based Multi-Agent Systems

    Feb 23, 2026Jin Jia, Zhiling Deng, Zhuangbin Chen +2Multi-Agent LLM SystemsLLM Agent Reliability