TrialJev: Open-Weight Single Pass Eligibility Scoring for Patient Trial Screening
Organizations: AI Hub, University Health Network (UHN), Toronto, ON · AI Hub, University Health Network (UHN), Toronto, ON, Canada · Department of Medical Biophysics, University of Toronto, Toronto, ON, Canada · Vector Institute for Artificial Intelligence, Toronto, ON, Canada ·
Abstract
Clinical trial screening requires assessing large numbers of patient-trial pairs to prioritize candidates for detailed eligibility review, often under restrictions on sharing patient records. We introduce TrialJev, an open-weight eligibility scorer that uses LoRA-adapted Qwen models and a pointer head to score natural-language answer options in a single forward pass, without autoregressive decoding. Trained on TREC Clinical Trials 2021 and evaluated on 6,975 eligible-or-excluded pairs from 50 unseen TREC 2022 synthetic patients, TrialJev achieves 80.97% (Qwen3.5-27B) and 81.84% (Qwen3.8-27B) accuracy, compared with 79.87% and 79.93% for LLMs fine-tuned on the same data to generate verdicts. In matched batch-1 measurements, verdict generation takes 2.45-2.70 times as long as the one-pass inference of TrialJev at 9B-27B. Under a common development-fitted decision correction, the two 27B TrialJev models reach 80.99% and 81.88% accuracy, compared with 81.28% for the proprietary hosted Jev API; paired confidence intervals include zero. TrialJev runs locally on a single GPU, requiring approximately 178 ms per pair at 27B, without transmitting patient text to an external model API. An A/B-logit ablation shows that avoiding decoding, rather than the pointer head alone, accounts for the measured efficiency advantage. TrialJev is intended for first-pass prioritization of candidate trials, complementing rather than replacing explanatory models and clinical review. Evaluation is limited to synthetic patients and implementation-specific timing, and clinical use has not been validated. Adapters, pointer heads, and model cards are released on Hugging Face.
Figures & tables
| Split | Source | Pairs | Patients | Eligible / Excluded | Pairs per patient (median / max) |
|---|---|---|---|---|---|
| Train | TREC 2021 | 9,302 | 60 | 4,348 / 4,954 | — |
| Development | TREC 2021 | 2,233 | 15 | 1,168 / 1,065 | — |
| Test | TREC 2022 | 6,975 | 50 | 3,939 / 3,036 | 116 / 398 |
| Model | System | Accuracy [95% CI] | Macro-F1 | AUROC | Brier | ECE |
|---|---|---|---|---|---|---|
| Always “eligible” | — | 56.47% | — | 0.500 | — | — |
| 0.8B, fresh | TrialJev (3 seeds) | 54.27 0.95 [51.75, 57.11] | 51.2% | 0.582 | 0.254 | 0.077 |
| 0.8B, fresh | control | 52.85 [47.91, 57.99] | 52.5% | 0.567 | 0.252 | 0.070 |
| 0.8B, MedJev init | TrialJev (3 seeds) | 70.71 2.64 [68.12, 73.36] | 70.4% | 0.786 | 0.196 | 0.044 |
| 9B | TrialJev (3 seeds) | 78.27 0.55 [75.80, 80.75] | 78.1% | 0.862 | 0.158 | 0.063 |
| 9B | control (3 seeds) | 78.23 2.74 [75.43, 80.92] | 77.9% | 0.861 | 0.155 | 0.024 |
| Backbone | TrialJev accuracy | Fine-tuned LLM accuracy | TrialJev one-pass median ms | LLM / TrialJev latency |
|---|---|---|---|---|
| Qwen3.5-0.8B | 70.71 2.64% | 74.05% | 54.0 | 1.85 |
| Qwen3.5-9B | 78.27 0.55% | 78.34 2.31% | 106.2 | 2.45 |
| Qwen3.5-27B | 80.97% | 79.87% | 177.6 | 2.62 |
| Qwen3.8-27B | 81.84% | 79.93% | 178.2 | 2.70 |
| System | 0.8B | 9B | 27B | Qwen3.8-27B |
|---|---|---|---|---|
| Always “eligible” | 56.47% | 56.47% | 56.47% | 56.47% |
| Prompted LLM, one word: accuracy | 56.01% | 77.35% | 72.89% | 61.66% |
| Prompted LLM, one word: median ms (ratio) | 79.2 (1.47) | 243.9 (2.30) | 347.1 (1.96) | 339.1 (1.90) |
| Un-adapted, letter scoring | 55.70% | 43.68% | 64.00% | not run |
| MedJev as released, no TREC training | 56.59% | – | – | – |
| TrialJev (Table 3) | 70.71% | 78.27% | 80.97% | 81.84% |
| System | Raw native score decision | Development-corrected | Corrected minus corrected Jev [95% CI] |
|---|---|---|---|
| TrialJev 0.8B, MedJev init (3 seeds) | 70.71 2.64 | 70.81 2.32 | 10.47 [ 13.22, 7.71] |
| TrialJev 9B (3 seeds) | 78.27 0.55 | 78.94 1.21 | 2.34 [ 3.60, 0.95] |
| TrialJev Qwen3.5-27B | 80.97 | 80.99 | 0.29 [ 1.16, +0.62] |
| TrialJev Qwen3.8-27B | 81.84 | 81.88 | +0.60 [ 0.30, +1.49] |
| Fine-tuned LLM score 0.8B (fresh) | 74.05 | 72.89 | 8.39 [ 10.86, 5.73] |
| Fine-tuned LLM score 9B (3 seeds) | 78.41 1.51 | 78.06 0.65 | 3.22 [ 4.51, 1.91] |
Appendix figures & tables25 assets
Supplementary material from the paper’s appendix.
Appendix
| Model | Readout | Accuracy [95% CI] | Macro-F1 | AUROC | Brier | ECE |
|---|---|---|---|---|---|---|
| Always “eligible” | — | 56.47% | — | 0.500 | — | — |
| 0.8B, fresh | pointer (3 seeds) | 54.27 0.95 [51.75, 57.11] | 51.2% | 0.582 | 0.254 | 0.077 |
| 0.8B, fresh | A/B-logit LoRA | 52.85 [47.91, 57.99] | 52.5% | 0.567 | 0.252 | 0.070 |
| 0.8B, MedJev init | pointer (3 seeds) | 70.71 2.64 [68.12, 73.36] | 70.4% | 0.786 | 0.196 | 0.044 |
| 9B | pointer (3 seeds) | 78.27 0.55 [75.80, 80.75] | 78.1% | 0.862 | 0.158 | 0.063 |
| 9B | A/B-logit LoRA (3 seeds) | 78.23 2.74 [75.43, 80.92] | 77.9% | 0.861 | 0.155 | 0.024 |
| Comparison (A B) | Accuracy, points [95% CI] | p | ECE [95% CI] | AUROC [95% CI] |
|---|---|---|---|---|
| 9B, 3 seeds: A/B-logit LoRA pointer | 0.05 [ 1.34, +1.16] | 0.95 | 0.039 [ 0.045, 0.019] | 0.001 [ 0.009, +0.006] |
| 27B: A/B-logit LoRA pointer | +0.27 [ 0.35, +0.87] | 0.39 | 0.061 [ 0.077, 0.036] | 0.001 [ 0.005, +0.002] |
| Qwen3.8-27B: A/B-logit LoRA pointer | 3.58 [ 5.32, 1.97] | <0.001 | 0.070 [ 0.083, 0.040] | 0.001 [ 0.008, +0.005] |
| 9B, seed 0 only: A/B-logit LoRA pointer | +1.98 [ 0.45, +4.43] | 0.12 | 0.055 [ 0.074, 0.027] | +0.007 [ 0.002, +0.015] |
| 9B, seed 0: A/B-logit LoRA (swapped) pointer | +2.02 [+0.17, +3.92] | 0.031 | 0.022 [ 0.040, 0.002] | +0.008 [ 0.001, +0.016] |
| 27B: A/B-logit LoRA (swapped) pointer | +0.85 [+0.09, +1.61] | 0.029 | 0.068 [ 0.084, 0.030] | +0.000 [ 0.004, +0.004] |
| Run | Checkpoint | Accuracy [95% CI] | Macro-F1 | Brier | ECE |
|---|---|---|---|---|---|
| 9B A/B-logit LoRA, seed 2 | step 200 (selected) | 75.18% [71.36, 78.56] | 75.17% | 0.1715 | 0.0262 |
| 9B A/B-logit LoRA, seed 2 | step 400 (post hoc) | 75.48% [72.44, 78.34] | 75.48% | 0.1855 | 0.0793 |
| Qwen3.8-27B A/B-logit LoRA | step 200 (selected) | 78.25% [74.89, 81.34] | 78.24% | 0.1462 | 0.0280 |
| Qwen3.8-27B A/B-logit LoRA | step 400 (post hoc) | 78.11% [74.96, 81.07] | 78.09% | 0.1492 | 0.0388 |
| Qwen3.8-27B A/B-logit LoRA, letters swapped | step 200 (selected) | 80.06% [76.90, 82.92] | 79.96% | 0.1425 | 0.0220 |
| Qwen3.8-27B A/B-logit LoRA, letters swapped | step 400 (post hoc) | 80.29% [77.29, 82.97] | 80.13% | 0.1392 | 0.0248 |
| Condition | Model | Accuracy [95% CI] | Macro-F1 | Invalid answers | Other order: accuracy [95% CI] |
|---|---|---|---|---|---|
| Zero-shot chat, writes the word | Qwen3.5-9B (instruct) | 77.35% [74.41, 80.31] | 77.3% | 0 | 74.71% [70.92, 78.58] |
| Zero-shot chat, writes the word | Qwen3.5-27B | 72.89% [66.77, 77.83] | 72.8% | 0 | 71.54% [65.24, 76.66] |
| Zero-shot chat, writes the word | Qwen3.8-27B | 61.66% [54.78, 68.37] | 59.6% | 1 | 58.61% [51.56, 65.60] |
| Zero-shot plain, writes the word | Qwen3.5-9B-Base | 44.24% [37.31, 51.35] | 39.9% | 1,149 (16.5%) | not run |
| Zero-shot letters, matched prompt, scored | Qwen3.5-0.8B-Base | 55.70% [48.26, 62.94] | 38.5% | 0 | 46.72% [44.05, 49.49] |
| Zero-shot letters, matched prompt, scored | Qwen3.5-9B-Base | 43.68% [35.89, 51.73] | 30.7% | 0 | 56.89% [48.93, 64.71] |
| Condition | New tokens | 0.8B ms | 0.8B ratio | 9B ms | 9B ratio | 27B ms | 27B ratio |
|---|---|---|---|---|---|---|---|
| A/B-logit LoRA, reads the logits (one pass) | 0 | 62.4 | 1.00 | 114.9 | 1.00 | 209.0 | 1.00 |
| A/B-logit LoRA, emits its label token | 1 | 62.8 (54% empty) | 1.01 | 113.6 | 0.99 | 209.7 | 1.00 |
| Pointer head, two-pass path (A) | — | 66.2 | 1.06 | 176.7 | 1.54 | 312.3 | 1.49 |
| Pointer head, one-pass path (B) | — | 51.3 | 0.82 | 104.0 | 0.90 | 172.0 | 0.82 |
| Zero-shot chat, writes the word | 5.5 (9B), 3.4 (27B) | — | — | 244.4 | 2.13 | 340.1 | 1.63 |
| Zero-shot plain (Base), writes the word | 3.8 | — | — | 181.5 | 1.58 | — | — |
| Backbone | Accuracy, path A | Accuracy, path B | Pairs with different prediction | Largest probability difference | Median ms, A | Median ms, B | A / B (median of pairwise ratios) |
|---|---|---|---|---|---|---|---|
| Qwen3.5-9B-Base | 78.52% | 78.49% | 20 (0.29%) | 0.023 | 177.1 | 64.9 | 2.69 |
| Qwen3.5-27B | 80.97% | 81.00% | 12 (0.17%) | 0.045 | 327.8 | 170.6 | 1.93 |
| Qwen3.8-27B | 81.84% | 81.75% | 12 (0.17%) | 0.020 | 328.7 | 167.9 | 1.95 |
| Run | Step | Accuracy | Macro-F1 | Brier | ECE |
|---|---|---|---|---|---|
| 0.8B pointer, fresh, seed 0 | 1000 | 54.27% | 53.87% | 0.2511 | 0.0881 |
| 0.8B pointer, fresh, seed 1 | 100 | 55.23% | 47.77% | 0.2454 | 0.0151 |
| 0.8B pointer, fresh, seed 2 | 500 | 53.32% | 51.88% | 0.2662 | 0.1276 |
| 0.8B pointer, MedJev init, seed 0 | 400 | 73.48% | 72.97% | 0.1897 | 0.0852 |
| 0.8B pointer, MedJev init, seed 1 | 500 | 68.22% | 68.21% | 0.2065 | 0.0340 |
| 0.8B pointer, MedJev init, seed 2 | 500 | 70.44% | 70.13% | 0.1903 | 0.0124 |
| Model | Prompt | Accuracy |
|---|---|---|
| Qwen3.5-9B-Base | plain | 43.66% |
| Qwen3.5-9B (instruct) | chat | 68.66% |
| Qwen3.5-27B | chat | 63.90% |
| Qwen3.8-27B | chat | 57.63% |
| System | P@10 | nDCG@10 | MRR | MAP |
|---|---|---|---|---|
| TrialJev 9B (3 seeds) | 0.921 [0.887, 0.950] | 0.930 [0.899, 0.957] | 0.980 [0.957, 0.997] | 0.882 [0.847, 0.912] |
| Control 9B (3 seeds) | 0.924 [0.893, 0.951] | 0.934 [0.905, 0.959] | 0.983 [0.963, 0.997] | 0.884 [0.850, 0.914] |
| TrialJev 27B | 0.940 [0.908, 0.966] | 0.945 [0.914, 0.970] | 0.970 [0.930, 1.000] | 0.894 [0.857, 0.926] |
| Control 27B | 0.936 [0.904, 0.964] | 0.945 [0.919, 0.969] | 0.990 [0.970, 1.000] | 0.897 [0.864, 0.926] |
| TrialJev Qwen3.8-27B | 0.936 [0.902, 0.964] | 0.941 [0.909, 0.968] | 0.960 [0.920, 0.990] | 0.897 [0.862, 0.928] |
| Control Qwen3.8-27B | 0.944 [0.910, 0.972] | 0.954 [0.926, 0.978] | 1.000 [1.000, 1.000] | 0.901 [0.870, 0.930] |
| Run | Accuracy | Macro-F1 | Eligible recall | Excluded recall | Predicted eligible | AUROC (first token) | Written differs from score |
|---|---|---|---|---|---|---|---|
| 0.8B, fresh, seed 0 | 74.05% | 73.0% | 83.0% | 62.4% | 63.3% | 0.802 | 0 |
| 9B, seed 0 | 79.50% | 78.5% | 89.7% | 66.3% | 65.3% | 0.864 | 146 |
| 9B, seed 1 | 79.84% | 79.0% | 88.4% | 68.7% | 63.5% | 0.862 | 149 |
| 9B, seed 2 | 75.68% | 75.7% | 67.0% | 86.9% | 43.6% | 0.860 | 211 |
| 27B, seed 0 | 79.87% | 79.8% | 76.7% | 84.0% | 50.3% | 0.879 | 139 |
| Qwen3.8-27B, seed 0 | 79.93% | 79.9% | 75.7% | 85.4% | 49.1% | 0.888 | 144 |
| System | 9B accuracy | 9B ratio | 27B accuracy | 27B ratio | 27B AUROC |
|---|---|---|---|---|---|
| TrialJev, one-pass | 78.49% | 0.90 | 81.00% | 0.82 | 0.885 |
| TrialJev, two-pass | 78.52% | 1.54 | 80.97% | 1.49 | 0.885 |
| A/B-logit control | 80.50% | 1.00 | 81.25% | 1.00 | 0.884 |
| Zero-shot letters, matched prompt | 43.68% | — | 64.00% | — | 0.860 |
| Zero-shot chat, writes the word | 77.35% | 2.13 | 72.89% | 1.63 | — |
| TrialJev model | Raw TrialJev accuracy | AUROC | Both raw: TrialJev minus Jev (63.89%) | Both corrected: TrialJev minus Jev (81.28%) | AUROC minus Jev (0.882) |
|---|---|---|---|---|---|
| 0.8B, fresh (3 seeds) | 54.27 0.95% | 0.582 | 9.62 [ 14.16, 4.66] | 27.38 [ 31.28, 23.39] | 0.300 |
| 0.8B, MedJev init (3 seeds) | 70.71 2.64% | 0.786 | +6.82 [+1.33, +12.74] | 10.47 [ 13.22, 7.71] | 0.095 |
| 9B (3 seeds) | 78.27 0.55% | 0.862 | +14.39 [+8.98, +20.19] | 2.34 [ 3.60, 0.95] | 0.020 |
| 27B | 80.97% | 0.885 | +17.09 [+10.88, +23.66] | 0.29 [ 1.16, +0.62] | +0.003 |
| Qwen3.8-27B | 81.84% | 0.888 | +17.95 [+12.08, +24.60] | +0.60 [ 0.30, +1.49] | +0.006 |
| Size | System | Full-test accuracy | Full-test AUROC | Accuracy, n = 992 | Median ms | Ratio |
|---|---|---|---|---|---|---|
| 0.8B | TrialJev, one-pass | 70.71 2.64 (seed 0: 73.48) | 0.786 | 74.80% | 54.0 | 1.00 |
| 0.8B | TrialJev, two-pass | same | same | 74.80% | 69.2 | 1.28 |
| 0.8B | Fine-tuned LLM | 74.05% | 0.802 | 72.68% | 99.9 | 1.85 |
| 9B | TrialJev, one-pass | 78.27 0.55 (seed 0: 78.52) | 0.862 | 80.85% | 106.2 | 1.00 |
| 9B | TrialJev, two-pass | same | same | 80.34% | 183.2 | 1.73 |
| 9B | Fine-tuned LLM | 78.34 2.31 (seed 0: 79.50) | 0.862 | 80.65% | 259.9 | 2.45 |
| Size | Explanation | Valid only (n) | Invalid / 200 | TrialJev | Fine-tuned LLM | Gap [95% CI] |
|---|---|---|---|---|---|---|
| 9B | 65.5% | 72.8% (n = 180) | 20 | 83.0% | 81.0% | +17.5 [+11.5, +24.0] |
| 27B | 61.5% | 71.1% (n = 173) | 27 | 79.5% | 83.0% | +18.0 [+10.0, +26.0] |
| Qwen3.8-27B | 52.5% | 75.5% (n = 139) | 61 | 82.0% | 81.0% | +29.5 [+22.0, +37.5] |
| Size | Mean new tokens | Explanation, median s per pair | Ratio to TrialJev one-pass |
|---|---|---|---|
| 9B | 270 | 7.3 | 68 |
| 27B | 312 | 19.2 | 104 |
| Qwen3.8-27B | 383 | 25.4 | 139 |
| Backbone | Params | Type | Revision | Readouts trained |
|---|---|---|---|---|
| Qwen3.5-0.8B-Base | 0.8B | pretraining-only | not recorded | pointer (3 seeds fresh, 3 seeds MedJev-init), A/B-logit LoRA (1 seed), fine-tuned LLM (1 seed), zero-shot plain and zero-shot letters |
| Qwen3.5-9B-Base | 9B | pretraining-only | 68c46c4b…f404 ‡ | pointer (3 seeds), A/B-logit LoRA (3 seeds), fine-tuned LLM (3 seeds), zero-shot plain and zero-shot letters |
| Qwen3.5-9B | 9B | post-trained (instruct) | c2022362…7b9a | zero-shot chat and zero-shot explanation baselines only |
| Qwen3.5-27B | 27B | post-trained backbone | fc05daec…f654 ‡ | pointer, A/B-logit LoRA, fine-tuned LLM, zero-shot chat, zero-shot explanation and zero-shot letters |
| Qwen3.8-27B | 27B | post-trained backbone | 1d4bf0f2…0c0 | pointer, A/B-logit LoRA, fine-tuned LLM, zero-shot chat and zero-shot explanation |
| Setting | 0.8B runs | 9B / 27B / Qwen3.8-27B runs |
|---|---|---|
| LoRA rank / / dropout | 16 / 32 / 0.05 | 16 / 32 / 0.05 |
| Pointer-head dimension (pointer only) | 256 | 256 |
| Learning rate / schedule | 1e-4, one-cycle (5% warm-up) | same |
| Weight decay / optimizer | 0.01, AdamW | same |
| Gradient clipping | 1.0 | 1.0 |
| Epochs / optimizer steps | 3 / 1,746 | 3 / 1,746 |
| Run | Selected step | Dev loss | Dev accuracy | Train wall time | Peak memory |
|---|---|---|---|---|---|
| 0.8B pointer, fresh, seed 0 | 1000 | 0.6747 | 59.11% | 2.36 h | 7.2 GB |
| 0.8B pointer, fresh, seed 1 | 100 | 0.6883 | 53.83% | 2.30 h | 7.2 GB |
| 0.8B pointer, fresh, seed 2 | 500 | 0.7224 | 54.86% | 2.32 h | 7.2 GB |
| 0.8B pointer, MedJev init, seed 0 | 400 | 0.5727 | 70.22% | 2.31 h | 7.2 GB |
| 0.8B pointer, MedJev init, seed 1 | 500 | 0.5828 | 69.55% | 2.32 h | 7.2 GB |
| 0.8B pointer, MedJev init, seed 2 | 500 | 0.5831 | 70.31% | 2.30 h | 7.2 GB |
| Run | Selected step | Dev loss | Dev first-token accuracy | Train wall time | Peak memory |
|---|---|---|---|---|---|
| 0.8B fine-tuned LLM, fresh, seed 0 | 800 | 0.2196 | 69.91% | 1.79 h | 7.2 GB |
| 9B fine-tuned LLM, seed 0 | 400 | 0.1750 | 73.94% | 2.79 h | 23.1 GB |
| 9B fine-tuned LLM, seed 1 | 400 | 0.1700 | 74.79% | 2.81 h | 23.1 GB |
| 9B fine-tuned LLM, seed 2 | 200 | 0.1675 | 76.67% | 2.85 h | 23.1 GB |
| 27B fine-tuned LLM | 200 | 0.1779 | 76.58% | 8.15 h | 61.9 GB |
| Qwen3.8-27B fine-tuned LLM | 200 | 0.1720 | 76.80% | 8.18 h | 61.9 GB |
| Property | Generative, criterion-level (e.g. TrialGPT) | Fine-tuned classifier (e.g. LLM-Match) | Formal / symbolic (VERDICT) | TrialJev pointer-head scorer |
|---|---|---|---|---|
| Output | text rationale + label | class score | verdict + formal decision trace | probability over two options |
| Autoregressive generation | yes, per criterion | no | LLM formalizer + solver | no |
| Per-criterion explanation | yes | not reported | yes (trace) | no |
| Output must be parsed | yes | no | yes | no |
| Probability usable for thresholding | indirect | yes | not reported | yes |
| Task-specific training | no (prompting) | yes | distilled formalizer | yes (LoRA) |
| System | What it does | Evaluation | Reported | Comparable to ours? |
|---|---|---|---|---|
| TrialJev | non-generative pointer-head pair scorer | TREC 2022, 6,975 eligible/excluded pairs, 50 patients | 80.97% accuracy, AUROC 0.885 (Qwen3.5-27B); 81.84%, AUROC 0.888 (Qwen3.8-27B); 70.71%, AUROC 0.786 (0.8B, MedJev init, 3 seeds) | — |
| VERDICT [ 13 ] | LLM formalization + solver, with decision traces | 363 selected TREC 2021 pairs, near-balanced | F1 0.828 (GPT-5-mini), 0.829 (distilled 7B) | same binary task family; different year, sample, balance, metric |
| LLM-Match [ 14 ] | fine-tuned Llama-3-8B-Instruct + RAG + classification head | TREC 2022 (also SIGIR, TREC 2021); binary label merges excluded and eligible against irrelevant | AUROC 0.8102 on TREC 2022; 0.8010 average | no, a relevance task and not eligible vs excluded |
| TrialGPT [ 1 ] | LLM retrieval, criterion-level matching, ranking | manual review of patient–criterion pairs; trial ranking | 87.3% criterion-level accuracy on 1,015 reviewed pairs | different granularity; not pair-level |
| TrialMatchAI [ 9 ] | end-to-end retrieval + criterion reasoning | oncology patients; criterion-level classification | relevant trial in top 20 for 92% of patients; >90% criterion-level accuracy | different tasks and metrics |
| Controlled LLM reasoning [ 10 ] | retrieval + LLM reasoning | TREC 2022 ranking | best nDCG@10 0.693 (coarse); best P@10 0.730 (hybrid), different variants | full-collection ranking metrics |
Medical LLMs
Medical large language models are AI systems adapted to clinical and biomedical data for health reasoning, information extraction, and communication.
See all 428 papers