cs.CLOct 14, 2026

Structure-Preserving Document-Level Data Augmentation via Discourse Parsing

Authors: Ruilin Shang, Shilong Hou, Zi Long, Xianghua Fu

Organizations: Shenzhen University, China · Shenzhen Technology University, China

Abstract

Data augmentation (DA) plays a vital role in improving model performance in low-resource or limited-supervision scenarios within Natural Language Processing (NLP). Existing DA methods, such as synonym replacement and back-translation, have demonstrated effectiveness on the word or sentence level; however, they frequently neglect discourse-level coherence and logical flow, which are essential for complex tasks dependent on inter-sentential relationships. In this paper, we propose a structure-preserving document-level data augmentation framework based on large language models (LLMs) and document-level discourse structure parsing. Our approach identifies rhetorical relations between sentence pairs and extracts key phrases, which are then replaced with semantically coherent but topically shifted content while preserving the original discourse structure. Experimental results on text summarization and question answering show that the proposed augmented data provides complementary supervision and improves combined-data training across the evaluated tasks. Comparisons with a standard RST parser and controlled ablations further support the proposed discourse representation.

Figures & tables

Appendix figures & tables1 asset

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Mix and Match: Context Pairing for Scalable Topic-Controlled Educational Summarisation

    Apr 20, 2026Nathikan Yodthapa, Thanapong Intharah, Sahan BulathwelaData AugmentationText Summarization

  2. Towards Real-World Document Parsing via Realistic Scene Synthesis and Document-Aware Training

    Mar 25, 2026Gengluo Li, Pengyuan Lyu, Chengquan Zhang +7Document ParsingMultimodal Large Language Models

  3. REER-PT: Reverse-Engineered Reasoning for Perplexity-Guided Pre-training Data Augmentation

    Aug 31, 2026Haoran Que, Jiajun Shi, Ting Huang +7Language Model PretrainingSynthetic Data Pretraining