cs.CLOct 22, 2026

Chunk Recomputation under Real Document Revisions: Measuring Update Cost and Retrieval Quality of Fixed, Recursive, and Content-Defined Chunking

Authors: Yuning Bian, Lele Xu, Yifan Yuan, Xinyu Yin, Chengyan Zhan

Organizations: School of Computer Science and Technology, Anhui University of Technology, Ma’anshan, China

Abstract

Chunking strategies for retrieval-augmented generation are almost always evaluated on a static snapshot, yet the documents underlying a knowledge base continue to change. Because chunks are embedded independently, a boundary that moves after an edit forces unchanged text to be re-embedded. We measure this update cost on 120 pairs of adjacent Chinese and English Wikipedia revisions for three stateless chunkers (non-overlapping fixed-size, recursive paragraph-first, and content-defined chunking) under a strict byte-identical reuse rule and a frozen dense encoder. On the 116-article common-success pool, with frozen, length-calibrated parameters, fixed-size chunking recomputes 57-68% of its full new-version embedding-input workload, recursive chunking 38-56%, and content-defined chunking 43-54% (it failed on 4 of 62 Chinese articles), while at these parameters mean evidence recall under a fixed 2048-token retrieval budget differs by less than two percentage points within either language. A cost-only parameter grid shows that the ranking of the two content-aware chunkers changes with chunk-length settings, whereas non-overlapping fixed-size chunking has the highest recomputation cost in every length-matched condition. Controlled edits and a verbatim-presence diagnostic support boundary drift as one contributor to recomputation of text already present in the previous version. Update cost is therefore a substantial, parameter-sensitive dimension that static retrieval evaluations do not expose and that should be reported alongside retrieval quality.

Figures & tables

Explore similar work

CardsList
  1. A Systematic Investigation of Document Chunking Strategies and Embedding Sensitivity

    Mar 7, 2026Muhammad Arslan Shaukat, Muntasir Adnan, Carlos C. N. KuhnDocument ChunkingDense Retrieval

  2. Evaluating Chunking Strategies for Retrieval-Augmented Generation on Academic Texts

    Jul 2, 2026Valentin J. J. Kreileder, Johannes Reisinger, Andreas FischerDocument ChunkingRetrieval-Augmented Generation