CSRP: Chain-of-Thought Reasoning for Chinese Text Correction via Reinforcement Learning with Efficiency-Aware Rewards
Authors: Wei Tian, Yuhao Zhou, Man Lan
Organizations: School of Computer Science and Technology, East China Normal University · Shanghai Institute of Artificial Intelligence for Education, East China Normal University
Large Language Model (LLM) based Chinese Grammatical Error Correction (CGEC) systems face two critical challenges: general-purpose models lack specialized linguistic priors for subtle grammatical distinctions, and Supervised Fine-Tuning (SFT) with Maximum Likelihood Estimation fails to optimize for precision-focused metrics, leading to systematic over-correction. We propose CSRP, a three-stage framework that progressively builds correction capability through Continual Pre-training (CPT) on 5.9M balanced samples to internalize domain knowledge, Chain-of-Thought SFT with explicit error reasoning for diagnostic transparency, and Group Relative Policy Optimization with a novel Efficiency-Aware Reward that explicitly penalizes unnecessary edits. On the NACGEC benchmark, CSRP achieves state-of-the-art performance with 50.99 F0.5 and 57.17 precision, substantially outperforming previous best results while effectively mitigating the over-correction bias inherent in MLE-trained models. Our method also advances CSCD spelling correction to 59.61 F1, surpassing GPT-4 by 5.20 points. Comprehensive ablation studies demonstrate that the RL alignment stage contributes a 8% relative gain over the SFT baseline, and that this gain is orthogonal to the contribution of large-scale CPT, validating that explicit optimization for edit efficiency is essential for high-quality grammatical error correction. Our code is available at https://github.com/TW-NLP/ChineseErrorCorrector.
Figure 2: Overview of the proposed CSRP (CPT-SFT-RL) framework.
Figure 3: CPT Data Processing Process.
Figure 4: Cot Processing Process.
Phase
Source
Count
CPT
Wiki-zh, CCI2
4.7M
Lang8, HSK
1.2M
SFT
CSCD-train, NACGEC
37.5K
FCGEC, CGED
55K
WK271
251K
(80% split)
269K
Table 1: Data statistics for the three-stage training curriculum and evaluation sets. The SFT and RL phases use an 80:20 split of the correction data (total 336K samples after filtering). Note that the actual sample count (336K) is lower than the sum of individual subsets, as a portion of sentences containing sensitive content were rejected by the cloud-based teacher model’s safety policy during CoT distillation.
Model
P
R
F0.5
BART Lewis et al. (2020)
34.67
41.88
35.91
HW-CGEC Su et al. (2023)
50.95
32.29
45.26
ScholarGEC (14B) Kong et al. (2025)
45.08
59.33
47.35
CEC3 (4B) Tian and others (2025)
54.20
34.75
48.74
CSRP (4B)
57.17
35.60
50.99
Table 2: Main results on the NACGEC benchmark.
Model
F1
BERT Tan et al. (2020)
25.49
SoftMask Zhang et al. (2020)
44.48
SMBERT Li et al. (2021)
44.67
MDCSpell+ARM Liu et al. (2024)
48.93
PGT (BERT) Wei et al. (2024)
48.57
GPT-4 Achiam et al. (2023)
54.41
Table 3: Chinese spelling check performance on the CSCD dataset.
Configuration
NACGEC
NACGEC
CSCD
P
R
F0.5
F1
SFT only (merged data)
42.13
34.02
40.21
49.71
SFT + GRPO (w/o CPT)
50.54
33.75
45.97
52.96
CPT + SFT (no CoT)
44.90
35.50
42.64
52.01
CPT + SFT
48.73
35.80
45.45
56.28
CPT + SFT (w/ RL data)
52.20
36.00
47.21
57.92
Table 4: Progressive ablation study. “SFT only (merged data)” combines all data without CPT. “SFT + GRPO (w/o CPT)” applies GRPO directly to the base model to isolate the RL contribution. “CPT + SFT (no CoT)” excludes chain-of-thought reasoning. “CPT + SFT (w/ RL data)” uses all data for SFT as a controlled baseline.
NACGEC
Configuration
P
R
F0.5
CPT + SFT
48.73
35.80
45.45
CPT + SFT + GRPO
57.17
35.60
50.99
Change
+8.44
-0.20
+5.54
Table 5: Impact of GRPO on precision-recall trade-off. The RL stage significantly improves precision while maintaining comparable recall, demonstrating effective learning of conservative editing behavior.
Appendix figures & tables3 assets
Supplementary material from the paper’s appendix.
Appendix
Dataset
Train
Test
Type
CSCD-NS
30,000
5,000
CSC
WK271+SIGHAN15
251,835
1,100
CSC
CGED
20,449
-
CGEC
NACGEC
7,568
5,869
CGEC
FCGEC
35,355
-
CGEC
Subtotal
345,207
11,969
-
Appendix
Table 6: Data composition for Stage II (SFT) and Stage III (RL).
Data Source
Raw Count
After Dedup & Filter
Wiki-zh-25
1,442,291
1,417,899
Wiki-zh-23
254,547
0
CCI2
4,021,572
3,306,931
Lang8+HSK
1,568,885
1,176,870
Total
7,287,295
5,901,700
General:Correction = 8:2 (4,707,480:1,176,870)
Appendix
Table 7: Data processing statistics for the CPT phase.
Metric
Score
Semantic Agreement
95.2%
Average Pairwise κ
0.81
Appendix
Table 8: Human evaluation metrics on 1,000 sampled CoT rationales. Semantic Agreement denotes the proportion of samples reaching a majority consensus ( ≥ 2/3 labeled as Faithful). The Average Pairwise Cohen’s κ of 0.81 indicates almost perfect inter-annotator agreement.
School of Information Science and Technology, Guangdong University of Foreign Studies · Guangdong Engineering Research Center of Data Security Governance and Privacy Computing · College of Computer Science and Technology, National University of Defense Technology