EarlySciRev: A Dataset of Early-Stage Scientific Revisions Extracted from LaTeX Writing Traces
Organizations: Nantes Université, École Centrale Nantes, CNRS, LS2N, UMR 6004, F-44000 Nantes, France · Inria, LS2N, Nantes Université, France
Abstract
Scientific writing is an iterative process that generates rich revision traces, yet publicly available resources typically expose only final or near-final versions of papers. This limits empirical study of revision behaviour and evaluation of large language models (LLMs) for scientific writing. We introduce EarlySciRev, a dataset of early-stage scientific text revisions automatically extracted from arXiv LaTeX source files. Our key observation is that commented-out text in LaTeX often preserves discarded or alternative formulations written by the authors themselves. By aligning commented segments with nearby final text, we extract paragraph-level candidate revision pairs and apply LLM-based filtering to retain genuine revisions. Starting from 1.28M candidate pairs, our pipeline yields 578k validated revision pairs, grounded in authentic early drafting traces. We additionally provide a human-annotated benchmark for revision detection. EarlySciRev complements existing resources focused on late-stage revisions or synthetic rewrites and supports research on scientific writing dynamics, revision modelling, and LLM-assisted editing.
Figures & tables
| Model | Acc. | P. | R. | time | |
| *-PLUIE | Qwen3 (4B) (thr=0) | 0.77 | 0.77 | 0.76 | 22h |
| Qwen3 (4B) (thr=-4.75) | 0.78 | 0.75 | 0.81 | ||
| Olmo-3 (7B) (thr=0) | 0.74 | 0.73 | 0.76 | 35h | |
| Olmo-3 (7B) (thr=0.60) | 0.74 | 0.78 | 0.67 | ||
| Llama-3.1 (8B) (thr=0) | 0.70 | 0.65 | 0.85 | 35h | |
| Llama-3.1 (8B) (thr=0.85) | 0.73 | 0.75 | 0.67 | ||
| #rev | #paper | #rev/§ | #words/§ | % words diff |
| 578,440 | 104,023 | 1.10 | 82.42 | 56.85 |
Scientific Communication
Scientific communication studies how research is written, shared, translated, visualized, and understood by specialist and public audiences.
See all 50 papers