cs.CLApr 20, 2026

MASS-RAG: Multi-Agent Synthesis Retrieval-Augmented Generation

Authors: Xingchen XiaoHeyan HuangRunheng LiuJincheng Xie

Organizations: School of Computer Science and Technology, Beijing Institute of Technology · Department of Mathematical Sciences, Tsinghua University

Abstract

Large language models (LLMs) are widely used in retrieval-augmented generation (RAG) to incorporate external knowledge at inference time. However, when retrieved contexts are noisy, incomplete, or heterogeneous, a single generation process often struggles to reconcile evidence effectively. We propose \textbf{MASS-RAG}, a multi-agent synthesis approach to retrieval-augmented generation that structures evidence processing into multiple role-specialized agents. MASS-RAG applies distinct agents for evidence summarization, evidence extraction, and reasoning over retrieved documents, and combines their outputs through a dedicated synthesis stage to produce the final answer. This design exposes multiple intermediate evidence views, allowing the model to compare and integrate complementary information before answer generation. Experiments on four benchmarks show that MASS-RAG consistently improves performance over strong RAG baselines, particularly in settings where relevant evidence is distributed across retrieved contexts.

Explore similar work

CardsList
  1. Uncertainty-Aware Hybrid Retrieval for Long-Document RAG

    Jun 11, 2026Hoin Jung, Xiaoqian Wang