Syn2DRE: Synergistic Dual Teacher-Student Framework for Document-level Relation Extraction
Organizations: School of Electrical Engineering and Computer Science The University of Queensland, Australia
Abstract
Document-level Relation Extraction (DocRE) aims to identify relations between entities across a document but typically relies on costly large-scale annotations. While pseudo-labelling enables the use of low-quality data, existing methods often suffer from inefficiency and confirmation bias. To address these challenges, we propose Syn2DRE, a semi-supervised framework that combines self-supervised learning with cross-supervision in a lightweight teacher-student architecture to produce more reliable pseudo-labels. Additionally, we introduce a unified end-to-end training strategy to further improve efficiency of the framework. Experiments on multiple benchmarks show that Syn2DRE consistently outperforms prior state-of-the-art semi-supervised DocRE methods.
Figures & tables
| Model | DocRED | Re-DocRED | ||||||
|---|---|---|---|---|---|---|---|---|
| Dev | Test | Dev | Test | |||||
| Ign | Ign | Ign | Ign | |||||
| ATLOP ( Zhou et al., 2021 ) | 63.42 | 61.57 | 63.48 | 61.43 | 74.34 | 73.62 | 74.23 | 73.53 |
| DocuNet ( Zhang et al., 2021a ) | 64.35 | 62.66 | 64.00 | 61.93 | 76.22 | 75.50 | 75.35 | 74.61 |
| NCRL ( Zhou and Lee, 2022 ) | 63.87 | 61.65 | 63.45 | 60.98 | 75.85 | 74.91 | 75.90 | 75.00 |
| CAST* ( Tan et al., 2023 ) | - | - | - | - | - | - | 74.67 | 73.32 |
| Model | Test F1 |
|---|---|
| SSAN Xu et al. (2021a) | 61.00 |
| LSR Nan et al. (2020) | 68.41 |
| GAIN Zeng et al. (2020) | 76.09 |
| ATLOP Zhou et al. (2021) | 77.63 |
| KD-DocRE Tan et al. (2022a) | 78.75 |
| DAATF+ATL Wei et al. (2025) | 79.03 |
| Model | Test F1 | |
|---|---|---|
| CDR | GDA | |
| SSAN Xu et al. (2021a) | 68.7 | 83.7 |
| ATLOP Zhou et al. (2021) | 69.4 | 83.9 |
| DGI Wang et al. (2023) | 70.1 | 84.1 |
| SE-REPI Liu et al. (2025) | 73.3 | 84.8 |
| DAATF Wei et al. (2025) | 71.62 | 85.04 |
| Model | Freq | LT |
|---|---|---|
| ATLOP ( Zhou et al., 2021 ) | 75.92 | 67.46 |
| SSR-PU ( Wang et al., 2022 ) | 78.41 | 68.32 |
| CREST ( Wei et al., 2021 ) | 77.93 | 68.68 |
| CAST ( Tan et al., 2023 ) | 78.53 | 69.34 |
| VaeDiff-DocRE ( Tran et al., 2025 ) | 79.18 | 71.12 |
| DuRE ( Feng and Lakshmanan, 2024 ) | 79.81 | 72.88 |
| Model | Dev | Test | ||
|---|---|---|---|---|
| Ign | Ign | |||
| Syn2DRE | 79.93 | 78.74 | 79.50 | 78.35 |
| - w/o Cross-sup | 79.79 | 78.64 | 79.48 | 78.31 |
| - w/o ST | 79.52 | 78.45 | 79.28 | 78.21 |
| UGDRE | 78.28 | 77.32 | 78.14 | 77.24 |
| KD-DocRE | 76.47 | 75.30 | 76.14 | 74.97 |
| Model | Training Time | # of Unlabelled Documents |
|---|---|---|
| UGDRE | 55 hours | 101,873 |
| Syn2DRE (ours) | 26 hours | 30,480 |
| # of Labelled Docs | 100 | 200 | 300 | 400 | 600 |
|---|---|---|---|---|---|
| Dev F1 | 69.5 | 71.64 | 74.3 | 74.97 | 75.71 |
| Models | Component | Dev F1 | Test F1 |
|---|---|---|---|
| ATLOP | 74.34 | 74.23 | |
| DocuNet | 76.22 | 75.35 | |
| Syn2DRE (ATLOP + DocuNet) | ATLOP | 75.41 | 75.12 |
| DocuNet | 78.20 | 77.62 | |
| Syn2DRE (ATLOP + KD-DocRE) | ATLOP | 76.18 | 75.99 |
| Syn2DRE (ATLOP + UGDRE) | ATLOP | 76.34 | 76.04 |
Appendix figures & tables4 assets
Supplementary material from the paper’s appendix.
Appendix
| Hyper-parameters | Value |
|---|---|
| Train batch size | 8 |
| Test batch size | 8 |
| Dropout rate | 0.25 |
| Warmup ratiors | 6% |
| Train epochs | 10 |
| Encoder learning rate |
| Hyper-parameters | Value |
| Train batch size | 8 |
| Test batch size | 8 |
| in AFL loss function | 0.5 |
| Warmup ratiors | 6% |
| Train epochs | 5 |
| Encoder learning rate |
| Datasets | # Documents |
|---|---|
| DocRED-Train | 3,053 |
| DocRED-Dev | 1,000 |
| DocRED-Test | 1,000 |
| DocRED Distantly Supervised | 101,873 |
| Re-DocRED-Train | 3,053 |
| Re-DocRED-Dev | 500 |
| Package | Version |
|---|---|
| axial_attention | 0.6.1 |
| ema_pytorch | 0.5.2 |
| numpy | 1.26.2 |
| opt_einsum | 3.3.0 |
| PyTorch | 2.1.2 |
| tqdm | 4.66.1 |
Relation Extraction
Relation extraction identifies and classifies relationships between entities or events in text and multimodal data.
See all 87 papers