cs.CLNov 17, 2026

StitchRAG: Constructing Compact and Evidence-Preserving Contexts for RAG with Diffusion-Based Stitching

Authors: Minsang Kim, Junpyo Lim, Heeje Cho, Seungjun Baek

Organizations: Korea University · SK Telecom

Abstract

Retrieval-augmented generation (RAG) improves factuality by grounding large language models (LLMs) in external evidence. However, long retrieved contexts incur computational overhead and can even hurt performance due to noisy or irrelevant content. We propose StitchRAG, a framework for constructing compact context in RAG. StitchRAG builds a faithful, information-dense context while dynamically compressing the retrieved passages. We adapt the size reduction ratio to each passage by formulating a utility maximization trading-off the retained information and computation costs. We then extract answer candidates and query-related keywords from passages as anchors and collect passage sentences containing anchors under the derived size constraint. Finally, we connect or stitch the collected sentences together using text diffusion to form a coherent and natural context. Experiments on five open-domain QA benchmarks show that StitchRAG consistently outperforms diverse multi-step and compression baselines. Extensive ablations show the effectiveness of dynamic size allocation, anchor preservation, and diffusion-based stitching.

Figures & tables

Appendix figures & tables3 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Compression Beyond the Uncompressed: A Two-Stage Training Recipe for Soft Context Compression in RAG

    Sep 4, 2026Shuyu Guo, Shuo Zhang, Zhaochun RenRL for RAGLLM Inference Acceleration

  2. SpectRAG: Weighted Chunk Graphs for Token-Budgeted Context Selection in Multi-Hop Retrieval-Augmented Generation

    Oct 27, 2026Zafer Sahinoglu, Abdulazeez Mohammed, Buse Yaren Kazangirler +1Multi-Hop RAGGraph Retrieval-Augmented Generation