Agent-Guided Evidence Acquisition for Emotion-Cause Pair Extraction
Organizations: Universiti Malaya, Malaysia · Suzhou University of Technology, China · VinUniversity, Vietnam
Abstract
Emotion-Cause Pair Extraction (ECPE) requires identifying the causes associated with emotions expressed in a conversation. Accurate extraction can depend on evidence that is not initially available, making it important to decide when further information is worth acquiring. We study agent-guided evidence acquisition for ECPE, where a student agent selectively accesses expert judgments for borderline relations on both sides of its validation-selected F1 decision boundary and revises only queried predictions. Through controlled comparisons under different information-access conditions, we examine how delegation granularity, query selection, and response integration affect prediction quality. At a nominal 10% query rate, selective fusion improves mean pair F1 by 2.64-3.88 points over the student in our main experiments, reaching 65.14 on ECF and 49.74 on MEC4 across model families. Our analysis suggests that greater access does not always translate into better cause identification. These findings motivate acquisition strategies that consider both the relevance of newly available evidence and its effect on prediction revision, providing an empirical basis for more effective and efficient evidence acquisition in ECPE.
Figures & tables
| (a) Candidate coverage | |||
|---|---|---|---|
| Dataset | Candidates | Coverage (%) | |
| ECF | 16,016 | 1,843/1,873 | 98.40 |
| MEC 4 | 40,462 | 2,084/2,112 | 98.67 |
| Dataset | Model | Actual query % | Student ( 4B) | Random F | Selective F | Random R | Selective R | Expert ( 27B) |
|---|---|---|---|---|---|---|---|---|
| ECF | Qwen | 9.31 | ||||||
| ECF | Gemma | 9.08 | ||||||
| MEC 4 | Qwen | 9.65 | 49.79 | |||||
| MEC 4 | Gemma | 9.65 |
| Method | Input | ECF | MEC 4 |
|---|---|---|---|
| MECPE-2steps ( Wang et al., 2023 ) | T | 52.71 | 25.31 |
| HiLo ( Li et al., 2025 ) | T | 53.09 | 34.22 |
| M3F ( Wu et al., 2025 ) | T | 56.52 | 43.21 |
| SCALE ( Ma et al., 2026 ) | T | 57.70 | – |
| BridgeProt-SFT ( Xia et al., 2026a ) | T | 53.51 | 40.53 |
| Jud-Local ( Feng et al., 2026 ) | T | 62.14 | – |
| (a) Query ranking: pair F1 and paired difference | ||||||
|---|---|---|---|---|---|---|
| Dataset | Model | Learned | Boundary | vs. Learned [95% CI] | ||
| ECF | Qwen | |||||
| ECF | Gemma | |||||
| MEC 4 | Qwen | |||||
| MEC 4 | Gemma | |||||
| (a) Pair F1 | ||||
|---|---|---|---|---|
| Dataset | Model | Relation | Target | Dialogue |
| ECF | Qwen | |||
| ECF | Gemma | |||
| MEC 4 | Qwen | |||
| MEC 4 | Gemma | |||
| (b) Complete multi-cause sets (%) | ||||
| Model | Student | Expert | Full fusion | Selective |
|---|---|---|---|---|
| Qwen | ||||
| Gemma |
| Dataset | Model | 0–5% | 5–10% | 10–20% | 20–100% |
|---|---|---|---|---|---|
| ECF | Qwen | ||||
| ECF | Gemma | ||||
| MEC 4 | Qwen | ||||
| MEC 4 | Gemma |
| (a) Two ordinary SFT passes (seed 42) | ||||
| Dataset | Model | Student | Random | Selective |
| ECF | Qwen | 62.66 | 63.06 | |
| ECF | Gemma | 62.59 | 63.00 | |
| MEC 4 | Qwen | 47.73 | 47.95 | |
| MEC 4 | Gemma | 46.88 | 47.30 | |
| (b) One SFT pass plus one KD pass (three seeds) | ||||
Appendix figures & tables39 assets
Supplementary material from the paper’s appendix.
Appendix
| Dataset | Split | D | U | N | G | O |
|---|---|---|---|---|---|---|
| ECF | Train | 1,001 | 9,966 | 62,604 | 7,055 | 122 |
| ECF | Validation | 112 | 1,087 | 6,760 | 866 | 17 |
| ECF | Test | 261 | 2,566 | 16,016 | 1,873 | 30 |
| MEC 4 | Train | 1,277 | 17,513 | 117,158 | 5,777 | 62 |
| MEC 4 | Validation | 404 | 5,541 | 37,085 | 1,847 | 23 |
| MEC 4 | Test | 443 | 6,051 | 40,462 | 2,112 | 28 |
| Dataset | Model | Seed | Val F1 | Test F1 | Test P | Test R |
|---|---|---|---|---|---|---|
| ECF | Qwen | 42 | 67.42 | 66.60 | 62.06 | 71.86 |
| ECF | Gemma | 42 | 67.45 | 66.70 | 64.80 | 68.71 |
| MEC 4 | Qwen | 42 | 48.74 | 49.79 | 42.37 | 60.37 |
| MEC 4 | Gemma | 42 | 48.80 | 50.27 | 47.98 | 52.79 |
| Endpoint | yes | no | pad | Revision |
|---|---|---|---|---|
| Qwen 4B | 9405 | 2083 | 248044 | 851bf6e806ef |
| Qwen 27B | 9405 | 2083 | 248044 | fc05daec18b0 |
| Gemma E4B | 4443 | 1904 | 0 | ee0ef6023621 |
| Gemma 31B | 4443 | 1904 | 0 | 842da3794eaa |
| Dataset | Model | Seed | ||||||
|---|---|---|---|---|---|---|---|---|
| ECF | Qwen | 42 | -0.50 | -0.80 | -0.70 | 0.2943 | 0.5988 | 1.2278 |
| ECF | Qwen | 43 | -0.95 | -0.80 | -0.75 | 0.2553 | 0.5546 | 1.0652 |
| ECF | Qwen | 44 | -1.00 | -0.80 | -0.85 | 0.2417 | 0.5689 | 1.1142 |
| ECF | Gemma | 42 | -0.75 | -0.70 | -0.60 | 0.3254 | 0.5372 | 1.1881 |
| ECF | Gemma | 43 | -0.60 | -0.70 | -0.70 | 0.2121 | 0.5166 | 1.2271 |
| ECF | Gemma | 44 | -0.55 | -0.70 | -0.70 | 0.3025 | 0.6413 | 1.2059 |
| Dataset | Model | Seed | Accepted | Rejected | Accepted (%) | ||
|---|---|---|---|---|---|---|---|
| ECF | Qwen | 42 | 0.3775 | 1,544 | 675 | 869 | 43.72 |
| ECF | Qwen | 43 | 0.2789 | 1,447 | 662 | 785 | 45.75 |
| ECF | Qwen | 44 | 0.2689 | 1,480 | 689 | 791 | 46.55 |
| ECF | Gemma | 42 | 0.3208 | 1,428 | 661 | 767 | 46.29 |
| ECF | Gemma | 43 | 0.3543 | 1,395 | 709 | 686 | 50.82 |
| ECF | Gemma | 44 | 0.3659 | 1,539 | 600 | 939 | 38.99 |
| Dataset | Model | Seed | Val student | Val selective F | Test student | Test random F | Test selective F | Test selective R |
|---|---|---|---|---|---|---|---|---|
| ECF | Qwen | 42 | 63.05 | 65.32 | 61.28 | 61.60 | 64.00 | 64.75 |
| ECF | Qwen | 43 | 63.12 | 65.31 | 62.04 | 62.46 | 65.11 | 65.41 |
| ECF | Qwen | 44 | 63.82 | 65.52 | 62.82 | 63.18 | 65.55 | 66.03 |
| ECF | Gemma | 42 | 61.78 | 64.52 | 61.35 | 61.84 | 64.88 | 65.18 |
| ECF | Gemma | 43 | 62.25 | 66.08 | 61.87 | 62.35 | 65.46 | 65.27 |
| ECF | Gemma | 44 | 61.63 | 65.76 | 60.56 | 61.16 | 65.09 | 65.16 |
| Dataset | Model | Seed | student | 95% interval | random F | 95% interval |
|---|---|---|---|---|---|---|
| ECF | Qwen | 42 | +2.72 | [1.61, 3.84] | +2.41 | [1.40, 3.40] |
| ECF | Qwen | 43 | +3.06 | [2.14, 3.97] | +2.65 | [1.85, 3.46] |
| ECF | Qwen | 44 | +2.73 | [1.84, 3.57] | +2.37 | [1.58, 3.08] |
| ECF | Gemma | 42 | +3.53 | [2.59, 4.45] | +3.04 | [2.19, 3.87] |
| ECF | Gemma | 43 | +3.59 | [2.64, 4.59] | +3.11 | [2.25, 4.00] |
| ECF | Gemma | 44 | +4.53 | [3.33, 5.75] | +3.93 | [2.89, 4.99] |
| Dataset | Model | System | Emotion | Cause |
|---|---|---|---|---|
| ECF | Qwen | Student | ||
| Fusion | ||||
| Replacement | ||||
| ECF | Gemma | Student | ||
| Fusion | ||||
| Replacement |
| Emotion endpoint F1 | Cause endpoint F1 | |||||||
|---|---|---|---|---|---|---|---|---|
| Dataset | Model | Seed | Student | F | R | Student | F | R |
| ECF | Qwen | 42 | 78.39 | 79.96 | 80.68 | 74.98 | 76.64 | 77.20 |
| ECF | Qwen | 43 | 79.30 | 81.01 | 80.96 | 75.25 | 76.83 | 77.44 |
| ECF | Qwen | 44 | 79.53 | 81.19 | 81.35 | 76.33 | 77.26 | 77.65 |
| ECF | Gemma | 42 | 78.92 | 80.88 | 80.86 | 74.49 | 77.00 | 77.18 |
| ECF | Gemma | 43 | 78.06 | 79.71 | 80.15 | 75.11 | 77.79 | 77.85 |
| Dataset | Model | Slice | Gold | Student | Selective F | Selective R |
|---|---|---|---|---|---|---|
| ECF | Qwen | self | 957 | |||
| ECF | Qwen | external | 916 | |||
| ECF | Qwen | previous turn | 534 | |||
| ECF | Qwen | earlier by at least two | 302 | |||
| ECF | Qwen | future | 80 | |||
| ECF | Gemma | self | 957 |
| Dataset | Model | (%) | Group | Group F1 | Relation F1 | [95% CI] | |
|---|---|---|---|---|---|---|---|
| ECF | Qwen | 5 | Target | 800.0 | +1.41 [+1.00, +1.79] | ||
| ECF | Qwen | 5 | Dialogue | 799.3 | +1.66 [+1.12, +2.16] | ||
| ECF | Qwen | 10 | Target | 1601.0 | +1.88 [+1.37, +2.36] | ||
| ECF | Qwen | 10 | Dialogue | 1599.7 | +2.25 [+1.59, +2.89] | ||
| ECF | Qwen | 20 | Target | 3203.0 | +1.90 [+1.36, +2.42] | ||
| ECF | Qwen | 20 | Dialogue | 3200.3 | +2.24 [+1.58, +2.90] |
| Dataset | Model | Gold target subset | Relation | Target | Dialogue | |
|---|---|---|---|---|---|---|
| ECF | Qwen | At least one cause | 1344 | |||
| ECF | Qwen | At least two causes | 417 | |||
| ECF | Gemma | At least one cause | 1344 | |||
| ECF | Gemma | At least two causes | 417 | |||
| MEC 4 | Qwen | At least one cause | 1849 | |||
| MEC 4 | Qwen | At least two causes | 218 |
| No. | Feature | Definition |
|---|---|---|
| 1 | Student score | Calibrated logit . |
| 2 | Boundary distance | . |
| 3 | Student class | . |
| 4 | Signed distance | . Positive values denote later candidate utterances. |
| 5 | Speaker match | Equality of target and candidate speaker strings. |
| 6 | Candidate length | Character count of candidate utterance text. |
| Dataset | Model | Seed | F-M | F-G | R-M | R-G |
|---|---|---|---|---|---|---|
| ECF | Qwen | 42 | C/C/C | C/C/C | L/C/L | L/C/L |
| ECF | Qwen | 43 | C/C/C | C/C/C | C/C/C | C/C/L |
| ECF | Qwen | 44 | C/C/C | C/C/C | C/C/C | C/C/C |
| ECF | Gemma | 42 | C/C/L | C/C/C | C/C/C | C/C/C |
| ECF | Gemma | 43 | C/C/C | C/C/C | C/C/C | C/C/C |
| ECF | Gemma | 44 | C/C/C | C/C/C | C/C/C | C/C/C |
| Dataset | Model | (%) | Learned | Boundary | [95% CI] | |||
|---|---|---|---|---|---|---|---|---|
| ECF | Qwen | 5 | 661.3 | +0.06 [-0.28, +0.40] | ||||
| ECF | Qwen | 10 | 1490.3 | +0.42 [+0.04, +0.77] | ||||
| ECF | Qwen | 20 | 3108.3 | +0.55 [+0.20, +0.89] | ||||
| ECF | Gemma | 5 | 714.0 | +0.36 [+0.00, +0.73] | ||||
| ECF | Gemma | 10 | 1454.0 | +0.47 [+0.14, +0.81] | ||||
| ECF | Gemma | 20 | 3094.0 | +0.98 [+0.57, +1.40] |
| Dataset | Model | (%) | Learned | Boundary | [95% CI] | |||
|---|---|---|---|---|---|---|---|---|
| ECF | Qwen | 5 | 800.0 | +0.21 [-0.17, +0.57] | ||||
| ECF | Qwen | 10 | 1601.0 | +0.44 [+0.04, +0.80] | ||||
| ECF | Qwen | 20 | 3203.0 | +0.56 [+0.20, +0.90] | ||||
| ECF | Gemma | 5 | 800.0 | +0.28 [-0.13, +0.72] | ||||
| ECF | Gemma | 10 | 1601.0 | +0.31 [-0.03, +0.67] | ||||
| ECF | Gemma | 20 | 3203.0 | +0.79 [+0.38, +1.22] |
| Dataset | Model | (%) | Learned | Boundary | [95% CI] | |||
|---|---|---|---|---|---|---|---|---|
| ECF | Qwen | 5 | 661.3 | +0.22 [-0.24, +0.66] | ||||
| ECF | Qwen | 10 | 1490.3 | +0.71 [+0.29, +1.11] | ||||
| ECF | Qwen | 20 | 3108.3 | +1.21 [+0.60, +1.77] | ||||
| ECF | Gemma | 5 | 714.0 | +0.35 [-0.08, +0.79] | ||||
| ECF | Gemma | 10 | 1454.0 | +0.40 [-0.13, +0.93] | ||||
| ECF | Gemma | 20 | 3094.0 | +0.75 [+0.26, +1.26] |
| Dataset | Model | (%) | Learned | Boundary | [95% CI] | |||
|---|---|---|---|---|---|---|---|---|
| ECF | Qwen | 5 | 800.0 | +0.59 [+0.08, +1.12] | ||||
| ECF | Qwen | 10 | 1601.0 | +0.58 [+0.14, +1.01] | ||||
| ECF | Qwen | 20 | 3203.0 | +1.11 [+0.48, +1.69] | ||||
| ECF | Gemma | 5 | 800.0 | +0.17 [-0.29, +0.67] | ||||
| ECF | Gemma | 10 | 1601.0 | +0.29 [-0.25, +0.84] | ||||
| ECF | Gemma | 20 | 3203.0 | +0.81 [+0.35, +1.32] |
| Dataset | Model | Selector | Restricted | Bilateral | [95% CI] | |
|---|---|---|---|---|---|---|
| ECF | Qwen | Negative only | 1490.3 | +1.21 [+0.76, +1.61] | ||
| ECF | Qwen | Positive only | 1402.3 | +1.09 [+0.54, +1.62] | ||
| ECF | Qwen | One rejected/target | 1464.3 | +1.24 [+0.79, +1.66] | ||
| ECF | Gemma | Negative only | 1453.3 | +1.10 [+0.50, +1.72] | ||
| ECF | Gemma | Positive only | 1351.7 | +2.03 [+1.36, +2.66] | ||
| ECF | Gemma | One rejected/target | 1427.7 | +1.69 [+1.07, +2.30] |
| Dataset | Model | Selector | Restricted | Bilateral | [95% CI] | |
|---|---|---|---|---|---|---|
| ECF | Qwen | Negative only | 661.3 | +0.48 [+0.13, +0.82] | ||
| ECF | Qwen | Positive only | 653.3 | +0.28 [-0.15, +0.74] | ||
| ECF | Qwen | One rejected/target | 660.0 | +0.42 [+0.07, +0.75] | ||
| ECF | Gemma | Negative only | 713.3 | +0.71 [+0.26, +1.17] | ||
| ECF | Gemma | Positive only | 701.3 | +1.26 [+0.78, +1.72] | ||
| ECF | Gemma | One rejected/target | 712.3 | +0.90 [+0.43, +1.35] |
| Dataset | Model | Selector | Restricted | Bilateral | [95% CI] | |
|---|---|---|---|---|---|---|
| ECF | Qwen | Negative only | 3107.7 | +1.75 [+1.29, +2.15] | ||
| ECF | Qwen | Positive only | 2088.0 | +1.34 [+0.73, +1.91] | ||
| ECF | Qwen | One rejected/target | 2373.7 | +1.63 [+1.20, +2.06] | ||
| ECF | Gemma | Negative only | 3092.0 | +1.78 [+1.19, +2.38] | ||
| ECF | Gemma | Positive only | 1912.0 | +2.36 [+1.68, +3.04] | ||
| ECF | Gemma | One rejected/target | 2365.3 | +2.38 [+1.75, +3.02] |
| Dataset | Model | Nominal query % | Random policy | Actual query % | Fusion | Replacement |
|---|---|---|---|---|---|---|
| ECF | Qwen | 5 | uniform matched total | 4.13 | ||
| ECF | Qwen | 5 | uniform nominal | 5.00 | ||
| ECF | Qwen | 5 | per-dialogue matched | 4.13 | ||
| ECF | Qwen | 10 | uniform matched total | 9.31 | ||
| ECF | Qwen | 10 | uniform nominal | 10.00 | ||
| ECF | Qwen | 10 | per-dialogue matched | 9.31 |
| Dataset | Model | Seed | Boundary | Stratified | [95% CI] | |
|---|---|---|---|---|---|---|
| ECF | Qwen | 42 | 1544 | 64.00 | 62.35 | +1.65 [+0.88, +2.37] |
| ECF | Qwen | 43 | 1447 | 65.11 | 63.12 | +1.98 [+1.39, +2.57] |
| ECF | Qwen | 44 | 1480 | 65.55 | 64.10 | +1.44 [+0.87, +2.02] |
| ECF | Gemma | 42 | 1428 | 64.88 | 62.93 | +1.95 [+1.36, +2.56] |
| ECF | Gemma | 43 | 1395 | 65.46 | 63.72 | +1.74 [+1.09, +2.37] |
| ECF | Gemma | 44 | 1539 | 65.09 | 62.72 | +2.37 [+1.49, +3.22] |
| Dataset | Model | F | Local F | R | Expert |
|---|---|---|---|---|---|
| ECF | Qwen | ||||
| ECF | Gemma | ||||
| MEC 4 | Qwen | ||||
| MEC 4 | Gemma |
| Dataset | Model | Seed | F | Local F | ||
|---|---|---|---|---|---|---|
| ECF | Qwen | 42 | 0.75 | -0.65 | 64.59 | 66.02 |
| ECF | Qwen | 43 | 0.75 | -0.75 | 65.87 | 66.50 |
| ECF | Qwen | 44 | 0.50 | -0.85 | 66.05 | 66.40 |
| ECF | Gemma | 42 | 0.75 | -0.65 | 65.69 | 66.28 |
| ECF | Gemma | 43 | 0.75 | -0.55 | 66.38 | 66.61 |
| ECF | Gemma | 44 | 0.75 | -0.70 | 65.89 | 66.84 |
| Policy | (%) | Time (s) | Tok. (k) | Pairs/s | |
| Qwen | |||||
| Student | 0.00 | 0.0 | 181.5 | 118.7 | |
| Expert | 100.00 | 32.0 | 168.5 | 30.0 | |
| Full fusion | 100.00 | 32.0 | 350.0 | 24.0 | |
| Sel. 5% | 3.95 | 25.0 | 195.6 | 77.9 | |
| Sel. 10% | 9.42 | 30.0 | 206.6 | 66.9 | |
| Model | Policy | Allocated | Reserved | Diff |
|---|---|---|---|---|
| Qwen | Student | 10.66 | 16.61 | 0 |
| Qwen | Expert | 52.05 | 53.36 | 0 |
| Qwen | Full fusion | 60.83 | 67.48 | 0 |
| Qwen | Selective 5% | 60.83 | 67.48 | 2 |
| Qwen | Selective 10% | 60.83 | 67.48 | 3 |
| Qwen | Selective 20% | 60.83 | 67.48 | 2 |
| Dataset | Model | Bin (%) | F repair | F damage | R repair | R damage | |
|---|---|---|---|---|---|---|---|
| ECF | Qwen | 0–5 | 661.3 | 23.59 | 13.16 | 26.61 | 15.02 |
| ECF | Qwen | 5–10 | 829.0 | 12.83 | 5.91 | 20.59 | 11.06 |
| ECF | Qwen | 10–20 | 1618.0 | 2.58 | 1.26 | 8.47 | 6.26 |
| ECF | Qwen | 20–100 | 12907.7 | 0.02 | 0.01 | 0.47 | 0.50 |
| ECF | Gemma | 0–5 | 714.0 | 27.78 | 11.53 | 30.44 | 14.19 |
| ECF | Gemma | 5–10 | 740.0 | 12.57 | 6.17 | 19.41 | 12.25 |
| Dataset | Model | Student | Random F | Selective F | Selective R | [95% CI] | ||
|---|---|---|---|---|---|---|---|---|
| ECF | Qwen | 5 | 723 | 62.66 | 62.89 | 64.78 | 64.69 | +1.89 [+1.21, +2.58] |
| ECF | Qwen | 10 | 1,458 | 62.66 | 63.06 | 65.89 | 65.77 | +2.83 [+2.00, +3.66] |
| ECF | Qwen | 20 | 3,211 | 62.66 | 63.51 | 66.40 | 66.73 | +2.89 [+2.10, +3.67] |
| ECF | Gemma | 5 | 765 | 62.59 | 62.80 | 64.54 | 64.39 | +1.74 [+1.01, +2.47] |
| ECF | Gemma | 10 | 1,516 | 62.59 | 63.00 | 65.77 | 65.71 | +2.77 [+1.97, +3.63] |
| ECF | Gemma | 20 | 3,089 | 62.59 | 63.34 | 66.45 | 66.74 | +3.12 [+2.31, +3.93] |
| (a) Test | |||||||
| Dataset | Model | Student | Learned | Boundary | |||
| ECF | Qwen | 1,601 | 62.66 | 64.40 | 64.15 | 65.16 | |
| ECF | Gemma | 1,601 | 62.59 | 65.00 | 65.02 | 64.81 | |
| MEC 4 | Qwen | 4,046 | 47.73 | 49.49 | 49.39 | 49.15 | |
| MEC 4 | Gemma | 4,046 | 46.88 | 50.08 | 50.06 | 49.30 | |
| (b) Validation | |||||||
| Dataset | Model | Boundary | Boundary | Boundary Learned |
|---|---|---|---|---|
| ECF | Qwen | +1.58 [+0.84, +2.35] | +1.83 [+1.07, +2.61] | +0.82 [+0.31, +1.35] |
| ECF | Gemma | +0.74 [+0.21, +1.29] | +0.72 [+0.18, +1.25] | +0.93 [+0.35, +1.52] |
| MEC 4 | Qwen | +0.20 [-0.20, +0.61] | +0.30 [-0.14, +0.75] | +0.54 [+0.04, +1.06] |
| MEC 4 | Gemma | +0.07 [-0.29, +0.46] | +0.09 [-0.31, +0.49] | +0.85 [+0.40, +1.32] |
| Dataset | Model | Seed | Val student | Test student | Random F | Selective F | [95% CI] |
|---|---|---|---|---|---|---|---|
| ECF | Qwen | 42 | 66.06 | 65.04 | 65.17 | 66.73 | +1.56 [+0.76, +2.37] |
| ECF | Qwen | 43 | 65.45 | 64.86 | 65.02 | 66.23 | +1.21 [+0.38, +2.03] |
| ECF | Qwen | 44 | 65.91 | 64.95 | 65.14 | 66.49 | +1.35 [+0.55, +2.18] |
| ECF | Gemma | 42 | 64.40 | 63.25 | 63.52 | 64.75 | +1.23 [+0.37, +2.17] |
| ECF | Gemma | 43 | 64.76 | 64.01 | 64.30 | 66.34 | +2.04 [+1.18, +2.93] |
| ECF | Gemma | 44 | 64.25 | 64.12 | 64.60 | 66.97 | +2.37 [+1.55, +3.20] |
| Dataset | Student | (%) | Same F | Cross F | Cross R | [95% CI] |
|---|---|---|---|---|---|---|
| ECF | Qwen | 5 | +0.35 [+0.02, +0.70] | |||
| ECF | Qwen | 10 | +0.56 [+0.02, +1.14] | |||
| ECF | Qwen | 20 | +0.66 [+0.03, +1.32] | |||
| ECF | Gemma | 5 | -0.46 [-0.86, -0.07] | |||
| ECF | Gemma | 10 | -0.61 [-1.18, -0.05] | |||
| ECF | Gemma | 20 | -0.82 [-1.54, -0.07] |
| Dataset | Model | Seed | Mean | 2.5–97.5% | Minimum | Positive (%) | Query range (%) |
|---|---|---|---|---|---|---|---|
| ECF | Qwen | 42 | +2.62 | [+2.20, +3.27] | +1.95 | 100 | [8.62, 10.72] |
| ECF | Qwen | 43 | +3.01 | [+2.37, +3.58] | +1.86 | 100 | [8.24, 10.21] |
| ECF | Qwen | 44 | +2.82 | [+2.12, +3.74] | +2.07 | 100 | [8.59, 10.48] |
| ECF | Gemma | 42 | +3.87 | [+3.19, +4.38] | +2.86 | 100 | [8.19, 10.38] |
| ECF | Gemma | 43 | +3.67 | [+2.89, +4.48] | +2.59 | 100 | [8.14, 10.22] |
| ECF | Gemma | 44 | +3.64 | [+2.29, +4.53] | +1.70 | 100 | [8.44, 10.73] |
Evidence Selection
Evidence selection chooses the documents, passages, claims, or observations that best support an answer or decision.
See all 60 papers