How Reliable Is Individualized Functional-Network Attribution in Resting-State fMRI Cognitive Prediction in ADNI?
Organizations: Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Martensstr. 3, 91058 Erlangen, Germany · Siemens Healthineers, Henkestr. 127, 91052 Erlangen, Germany
Abstract
Individualized attribution estimates which functional networks drive a model prediction for a given subject and is often proposed as an interpretable resting-state fMRI (rs-fMRI) biomarker, but its test-retest reliability is rarely quantified. We evaluate per-subject network-ablation attribution for a frozen resting-state functional connectivity (FC) predictor (Schaefer-200 FC predicting MMSE/ADAS-Cog13) trained on N=875 subjects from the Alzheimer's Disease Neuroimaging Initiative (ADNI), using, and (iii) a subject-level permutation null. Split-half reliability is near-ceiling (Spearman p=0.948/0.950) but drops on scan-rescan (p=0.609/0.616). Under the mismatched-subject null, correlations remain substantial (p0.46-0.47), indicating strong population-shared structure, yet matched pairs exceed this null (z6.6-6.9, p<=10-4). Thus, in ADNI, individualized network attribution contains a modest but non-zero person-specific component atop a strong population-shared pattern. We recommend reporting scan-rescan reliability together with a permutation-null control, rather than within-session proxies alone, to avoid overstating individual specificity.
Figures & tables
| Split-half | Scan–rescan | |||
| Statistic | MMSE | ADAS-Cog13 | MMSE | ADAS-Cog13 |
| Mean | 0.948 | 0.950 | 0.609 | 0.616 |
| 95 % CI | 0.929–0.964 | 0.934–0.964 | 0.553–0.663 | 0.571–0.660 |
| Median | 0.988 | 0.988 | 0.625 | 0.661 |
| Std | 0.101 | 0.085 | 0.242 | 0.198 |
| 10–90% | 0.87–1.00 | 0.85–1.00 | 0.34–0.90 | 0.33–0.85 |
Feature Attribution
Feature attribution estimates which input features or internal components contribute to a model’s predictions.
See all 234 papers