cs.IROct 27, 2026

QESChunker: A Single Objective Unifies Overlapping and Non-Overlapping Chunking for RAG

Authors: Yifan Zhao, Qianyang Zhao, Xinyu Guan, kai wei, Yuming Deng

Organizations: Alibaba Group (alibaba-inc.com) · Taobao (China) Software Co., Ltd. (taobao.com)

Abstract

Chunking is a fundamental preprocessing step in retrieval-augmented generation (RAG), yet most existing chunkers rely primarily on heuristics. We introduce the Question--Evidence-Supervised Chunker (QESChunker), to our knowledge the first method for constructing static chunk indices from question--evidence supervision. QESChunker constructs document-specific chunk indices by optimizing over human-annotated or LLM-generated question--evidence pairs, without access to held-out test queries. We formulate non-overlapping and overlapping index construction through a unified question--evidence utility-maximization objective, turning chunking into a supervised combinatorial optimization problem. Under the non-overlap constraint, the objective decomposes over chunks and can be optimized exactly in polynomial time by dynamic programming. When overlap is allowed, the objective becomes monotone submodular; exact optimization is NP-hard, but our greedy achieves a (1−1/e)(1-1/\sqrt{e})-approximation. Across two self-constructed and three public datasets, both variants outperform existing chunking methods in complete-evidence recall in nearly all evaluated settings, under the same overlap regime and a fixed hybrid retriever. These results recast chunking as supervised, budget-aware index construction for evidence retrieval.

Figures & tables

Appendix figures & tables4 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Adaptive Chunking: Optimizing Chunking-Method Selection for RAG

    Mar 26, 2026Paulo Roberto de Moura Júnior, Jean Lelong, Annabelle BlangeroDocument ChunkingRetrieval-Augmented Generation

  2. QChunker: Learning Question-Aware Text Chunking for Domain RAG via Multi-Agent Debate

    Mar 12, 2026Jihao Zhao, Daixuan Li, Pengfei Li +3Document ChunkingRetrieval-Augmented Generation