Organizations: Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong, China · PET/CT Center, The First Affiliated Hospital of Xi’an Jiaotong University, No. 277 Yanta West Road, Xi’an 710061, China
Alzheimer's disease (AD) diagnosis may benefit from gut metabolic information associated with brain-gut interactions, yet existing models largely analyze cerebral glucose metabolism alone. Although whole-body fluorodeoxyglucose positron emission tomography (FDG-PET) can provide paired brain-gut observations, routine brain examinations rarely include gut imaging, limiting direct use of this information for diagnosis. In this paper, we present BRIDGE (Brain and Gut Representation Integration via Distribution-Guided Enhancement), a two-stage framework for transferring brain-gut metabolic knowledge to brain-only diagnosis. Specifically, BRIDGE integrates a conditional brain-to-gut latent transport module and a disease-evidence-guided cerebral pathway to capture subject-specific cross-organ correspondence and disease-relevant cerebral representations. For the cerebral pathway, a large language model (LLM) helps organize literature-derived descriptors into human-approved semantic anchors that guide feature learning. Additionally, we introduce a counterfactual-guided residual fusion mechanism, which uses matched and non-matched virtual-gut evidence to supervise a confidence gate and dynamically regulate the contribution of transported cross-organ information. At inference, BRIDGE exploits complementary gut-related context using brain PET alone, without measured gut PET. Extensive experiments across public and private cohorts demonstrate that BRIDGE outperforms brain-only and cross-organ baselines, achieving AUC gains of 6.0% and 5.2% over its brain-only counterpart for CN/MCI and CN/AD diagnosis, respectively. Notably, its ability to transfer complementary brain-gut metabolic context while preserving brain PET as the sole inference input highlights its potential for clinically practical diagnosis. Our code is available at https://github.com/CUHK-AIM-Group/BRIDGE.
Figures & tables
Fig. 1: Conceptual illustration and performance of BRIDGE. (a) Brain–gut representation learning and virtual-gut transfer for brain-only inference. (b) AUC comparison between the brain-only and +gut models for AD and MCI diagnosis on the public and private cohorts, respectively.
Fig. 2: Overview of BRIDGE framework. Stage 1 uses paired whole-body PET to learn subject-specific brain-to-gut latent transport through organ-specific encoders and endpoint constraints. Stage 2 uses labeled brain PET to train a cerebral pathway guided by literature-derived, human-approved semantic anchors and a virtual-gut residual pathway. An offline LLM assists in organizing the anchors, while matched and nonmatched gains supervise the confidence gate. At inference, a brain-only PET drives both pathways, and the gate regulates the virtual-gut contribution.
Cohort
Modality
Labels
N
Role
AutoPET [ 44 ]
BG
Unlabeled
188
Transport pretrain
PETWB [ 45 ]
BG
Unlabeled
484
Transport pretrain
QUADRA [ 46 ]
BG
Unlabeled
96
Transport pretrain
ENHANCE [ 47 ]
BG
Unlabeled
12
Transport pretrain
ADNI [ 48 ]
B
CN/MCI/AD
1,004
Source training validation
Private cohort
BG
CN/MCI
278
Primary evaluation
TABLE I: Cohort composition and experimental roles. BG and B denote paired brain–gut PET and brain PET, respectively. N denotes the number of examinations.
Method
Category
AUC ↑
ACC ↑
BACC ↑
SEN ↑
SPE ↑
Macro-F1 ↑
Brain-only baselines
ConvNeXt [ 18 ]
B/B
0.837 ± 0.050
0.728 ± 0.040 ∗
0.727 ± 0.039 ∗
0.816 ± 0.149
0.638 ± 0.101 ∗
0.726 ± 0.041 ∗
3D ViT [ 19 ]
B/B
0.684 ± 0.070 ∗
0.626 ± 0.068 ∗
0.626 ± 0.068 ∗
0.629 ± 0.090 ∗
0.624 ± 0.091 ∗
0.625 ± 0.069 ∗
Swin-T [ 20 ]
B/B
0.837 ± 0.060
0.756 ± 0.060
0.756 ± 0.060
0.743 ± 0.092
0.769 ± 0.071
0.755 ± 0.060
MiSePyNet [ 5 ]
B/B
0.736 ± 0.055 ∗
0.651 ± 0.075 ∗
0.653 ± 0.075 ∗
0.493 ± 0.203 ∗
0.812 ± 0.132
0.632 ± 0.095 ∗
Privileged-training comparators
TABLE II: Private-cohort CN/MCI classification performance (mean ± SD over five folds). B and BG denote brain and brain–gut PET. ∗ indicates significance by two-sided paired t -test with Holm correction ( p<0.05 ). Best and second-best results are shown in bold and underlined, respectively.
Method
Category
AUC ↑
ACC ↑
BACC ↑
SEN ↑
SPE ↑
Macro-F1 ↑
Brain-only baselines
ConvNeXt [ 18 ]
B/B
0.740 ± 0.039 ∗
0.661 ± 0.051 ∗
0.660 ± 0.049 ∗
0.631 ± 0.102 ∗
0.690 ± 0.165 ∗
0.656 ± 0.050 ∗
3D ViT [ 19 ]
B/B
0.691 ± 0.063 ∗
0.599 ± 0.061 ∗
0.596 ± 0.064 ∗
0.443 ± 0.267 ∗
0.750 ± 0.155 ∗
0.561 ± 0.130 ∗
Swin-T [ 20 ]
B/B
0.693 ± 0.072 ∗
0.619 ± 0.077 ∗
0.618 ± 0.080 ∗
0.551 ± 0.251 ∗
0.684 ± 0.168 ∗
0.601 ± 0.102 ∗
MiSePyNet [ 5 ]
B/B
0.935 ± 0.011
0.869 ± 0.021
0.869 ± 0.020
0.883 ± 0.069
0.855 ± 0.069
0.869 ± 0.021
Privileged-training comparators
TABLE III: ADNI CN/AD classification performance (mean ± SD over five folds). B and BG denote brain and brain–gut PET. ∗ indicates significance by two-sided paired t -test with Holm correction ( p<0.05 ). Best and second-best results are shown in bold and underlined, respectively.
Fig. 3: Private-cohort operating-point analysis. (a) Sensitivity and specificity across methods. Markers show five-fold means, error bars show SD, and marker size denotes AUC. The diagonal indicates equal sensitivity and specificity. (b) Expected error cost per 100 scans from five-fold mean sensitivity and specificity and cohort proportions, plotted against the missed-MCI penalty relative to false alarms. Red denotes BRIDGE, gray the comparators, and the navy dashed curve their lowest cost. Both axes are logarithmic, with lower error costs indicating better performance and the dotted line at 1 marking equal penalties.
Variant
AUC ↑
ACC ↑
BACC ↑
SEN ↑
SPE ↑
Macro-F1 ↑
Full BRIDGE
0.881 ± 0.050
0.818 ± 0.028
0.819 ± 0.027
0.821 ± 0.067
0.816 ± 0.029
0.815 ± 0.027
Component-level ablations
Brain-only
0.831 ± 0.030
0.766 ± 0.032
0.767 ± 0.032
0.764 ± 0.086
0.769 ± 0.069
0.766 ± 0.031
Without evidence anchors
0.875 ± 0.043
0.802 ± 0.028
0.802 ± 0.028
0.814 ± 0.073
0.790 ± 0.057
0.802 ± 0.027
Without latent transport
0.845 ± 0.054
0.774 ± 0.031
0.774 ± 0.031
0.757 ± 0.030
0.790 ± 0.044
0.774 ± 0.031
Fixed residual admission ( α=1 )
0.876 ± 0.027
0.791 ± 0.008
0.791 ± 0.008
0.800 ± 0.041
0.783 ± 0.037
0.791 ± 0.008
TABLE IV: Ablation study on private-cohort CN/MCI classification. Results are mean ± SD over five held-out folds. Component-level variants modify individual modules, whereas objective-level variants modify individual loss terms.
Fig. 4: Cross-organ transport alignment and task-specific feature geometry. (a) Cosine similarities of cerebral and transported virtual-gut latents to matched measured-gut latents ( n=278 ). The dashed line marks equality. (b) Paired gains after transport, with the point and bar indicating the mean and stratified-bootstrap 95% CI, respectively. (c) ADNI CN/AD fold-1 training features (182 CN, 174 AD). (d) Private-cohort CN/MCI fold-1 training features (96 CN, 98 MCI).
Fig. 5: Out-of-fold regional attribution on the private cohort. Circular bars show the ten AAL3 regions with the highest mean normalized positive integrated-gradient attribution to the final MCI logit, with scores rescaled to the top-ranked region. Surrounding surfaces localize the corresponding atlas parcels. Results aggregate all 278 examinations and reflect model-attributed diagnostic evidence rather than causal anatomy or imaging biomarkers.
Fig. 6: Illustrative brain–gut Grad-CAM maps. (a) ADNI AD brain PET, with attribution to the AD-class diagnostic logit. (b) Private-cohort MCI brain PET, with attribution to the MCI-class diagnostic logit. (c) Matched measured-gut PET from the same private examination, probed post hoc through the trained virtual-gut residual head. Columns show axial, sagittal, and coronal views.
Alzheimer's disease (AD) is an irreversible neurodegenerative disorder and a leading cause of death worldwide. Early diagnosis plays an important part especially at the Mild Cognitive Impairment stage, where timely intervention can help slow its progression before it advances to AD. Neuroimaging data, like Magnetic Resonance Imaging (MRI) and Positron Emission Tomography (PET) scans, can help detect brain changes early by providing structural and functional brain changes related to the disease. Yet, many multimodal models still fuse MRI and PET with static concatenation and apply identical computation to all subjects, which limits robustness to patient/site heterogeneity and can waste computation. To address these limitations, we present the first study of combining 3D convolutional feature extractors with three fusion strategies - concatenation, Gated Multimodal Unit (GMU), and gated self-attention - and a sparsely gated Mixture-of-Experts (MoE) classifier that performs input-adaptive routing, activating only the most informative experts per case. Finally, we utilize Grad-CAM to visualize disease-related regions, ensuring model interpretability. Experiments are performed across three binary classification tasks (NC vs. MCI, MCI vs. AD, and NC vs. AD). Results show that GMU achieves accuracies of 80.46 % (NC vs. MCI) and 95.47 % (NC vs. AD), while gated self-attention attains 82.08 % on MCI vs. AD. Ablations show that removing the MoE consistently degrades accuracy across all tasks. These findings underscore the value of input-adaptive, multimodal modeling for AD diagnosis by leveraging the complementary nature of MRI and PET.
Deep learning models for Alzheimer disease (AD) classification routinely report near-perfect discrimination, yet few are shown to rest on AD-relevant neurobiology rather than on dataset artifacts, subject-level leakage, or non-brain image content. We present a fusion network combining T1 MRI and FDG PET across axial, coronal, and sagittal planes, trained on ADNI consists of 554 paired subjects. The fusion model reaches AUC 0.962, accuracy 0.909, and F1 0.891, competitive with recent 3D CNN and multimodal transformer systems at substantially lower cost. We first quantify how much modality, plane and slice geometry matter. A validation-only search over slice centres and neighbour spacings moves AUC by 0.180 for MRI and 0.078 for PET, selecting narrow spacing for MRI and wide spacing for PET, with the chosen coronal centres falling on the hippocampal body and on the posterior cingulate respectively. The contribution, however, is the evidence layer built around that number. Shortcut controls collapse the model to AUC 0.622 (silhouette), 0.608 (exterior), and 0.500 (blank), and a label-permutation null yields 0.456. Forward region-of-interest (ROI) ablation shows that masking medial temporal cortex in MRI and the posterior default-mode network (DMN) in PET produces the largest shift in the AD logit, while area-matched controls remain indistinguishable from that null. Reverse ROI ablation shows that the medial temporal lobe alone retains 89.2% of above-chance discrimination in MRI and the posterior DMN alone retains 79.0% in PET. A quantitative comparison of attribution methods shows occlusion sensitivity reaching 3.5-5.0* enrichment inside a priori AD regions against 0.10-0.43* in controls. Ablation and attribution independently establish a biologically correct double dissociation: hippocampal evidence is carried by MRI, posterior cingulate evidence by PET.
Saeid Firouzi Daghigh, Saeed Ayat
Department of Computer Engineering and Information Technology, Payame Noor University, Tehran, Iran
Reliable Alzheimer's disease (AD) diagnosis increasingly relies on multimodal assessments combining structural Magnetic Resonance Imaging (MRI) and Electronic Health Records (EHR). However, deploying these models is bottlenecked by modality missingness, as MRI scans are expensive and frequently unavailable in many patient cohorts. Furthermore, synthesizing de novo 3D anatomical scans from sparse, high-dimensional tabular records is technically challenging and poses severe clinical risks. To address this, we introduce MIRAGE, a novel framework that reframes the missing-MRI problem as an anatomy-guided cross-modal latent distillation task. First, MIRAGE leverages a Biomedical Knowledge Graph (KG) and Graph Attention Networks to map heterogeneous EHR variables into a unified embedding space that can be propagated from cohorts with real MRIs to cohorts without them. To bridge the semantic gap and enforce physical spatial awareness, we employ a frozen pre-trained 3D U-Net decoder strictly as an auxiliary regularization engine. Supported by a novel cohort-aggregated skip feature compensation strategy, this decoder acts as a rigorous structural penalty, forcing 1D latent representations to encode biologically plausible, macro-level pathological semantics. By exclusively utilizing this distilled "diagnostic-surrogate" representation during inference, MIRAGE completely bypasses computationally expensive 3D voxel reconstruction. Experiments demonstrate that our framework successfully bridges the missing-modality gap, improving the AD classification rate by 13% compared to unimodal baselines in cohorts without real MRIs.
Guanchen Wu, Zhe Huang, Yuzhang Xie +6
Emory University, Atlanta, USA · Cornell University, New York, USA