cs.CLMar 9, 2026

SPD-RAG: Sub-Agent Per Document Retrieval-Augmented Generation

Authors: Yagiz Can Akay, Muhammed Yusuf Kartal, Esra Alparslan, Faruk Ortakoyluoglu, Arda Akpinar

Organizations: TOBB University of Economics and Technology · OSTIM Technical University

Abstract

Answering complex, real-world queries often requires synthesizing facts scattered across vast document corpora. In these settings, standard retrieval-augmented generation (RAG) pipelines suffer from incomplete evidence coverage, while long-context large language models (LLMs) struggle to reason reliably over massive inputs. We introduce SPD-RAG, a hierarchical multi-agent framework for exhaustive cross-document question answering that decomposes the problem along the document axis. Each document is processed by a dedicated document-level agent operating only on its own content, enabling focused retrieval, while a coordinator dispatches tasks to relevant agents and aggregates their partial answers. Agent outputs are synthesized by merging partial answers through a token-bounded synthesis layer (which supports recursive map-reduce for massive corpora). This document-level specialization with centralized fusion improves scalability and answer quality in heterogeneous multidocument settings while yielding a modular, extensible retrieval pipeline. On the LOONG benchmark (EMNLP 2024) for long-context multi-document QA, SPD-RAG achieves an Avg Score of 58.1 (GPT-5 evaluation), outperforming Normal RAG (33.0) and Agentic RAG (32.8) while using only 38% of the API cost of a full-context baseline (68.0).

Figures & tables

Explore similar work

CardsList
  1. EnSI-RAG: Entity-Structure-Indexed Retrieval-Augmented Generation for Long-Document Question Answering

    Aug 21, 2026Xuanyu Meng, Jiashuo Sun, Jash Rajesh Parekh +1Document QARetrieval-Augmented Generation

  2. MASS-RAG: Multi-Agent Synthesis Retrieval-Augmented Generation

    Apr 20, 2026Xingchen Xiao, Heyan Huang, Runheng Liu +1Retrieval-Augmented GenerationMulti-Agent LLM Systems

  3. Hierarchical Abstract Tree for Cross-Document Retrieval-Augmented Generation

    May 1, 2026Ziwen Zhao, Menglin YangMulti-Hop QARetrieval-Augmented Generation