SFL-Net: Source-Factorized Latent Representation Learning for Multi-Contrast MRI to Tau-PET Synthesis

Structural MRI-to-amyloid PET synthesis has been proposed as a non-invasive alternative for amyloid assessment in Alzheimer's disease (AD). However, reported performance of identical models varies widely across studies, and increasingly complex architectures have not led to consistent gains. This inconsistency is thought to be caused by a fundamental biological ambiguity: MRI captures neurodegeneration, while PET measures amyloid pathology - two processes that are often temporally decoupled in AD. As a result, similar MRI patterns may correspond to different amyloid states, creating ambiguous one-to-many mappings. MRI-to-amyloid PET synthesis may therefore be intrinsically ill-posed; however, this idea has yet to be tested scientifically. The aim of this work is to test this hypothesis through two controlled experiments. We first control the training distribution by stratifying paired MRI-PET data by amyloid and neurodegeneration status. Using two standard synthesis models under a controlled design, we show that biologically unambiguous mappings are learnable in isolation, but performance collapses when data ambiguity is introduced. This demonstrates that ambiguity in the data distribution, rather than architectural capacity, constrains performance. Second, we show that introducing orthogonal biological information in the form of plasma biomarkers resolves this ambiguity. When multimodal inputs are incorporated, performance improves and stability is restored. Together, these findings suggest that limited and inconsistent performance in MRI-to-amyloid PET synthesis is explained by intrinsic biological ambiguity, and that stable, meaningful progress requires multimodal integration rather than architectural complexity.

Tau positron emission tomography (PET) is widely used for the in vivo characterization of disease stage and progression in Alzheimer's disease (AD). With the adoption of multiple tau PET tracers including AV-1451, PI-2620, MK-6240 with different binding behaviors in various large-scale studies, there is a great need of effective harmonization methods to enable the cross-tracer integration of tau PET datasets. While previous methods such as CenTauR were proposed to standardize scalar tau PET measures, they are limited in accounting for the heterogeneity of tau pathology. In this work, we propose Feynman-Kac Reweighted Schrödinger Bridge Matching (FKRSBM), a surface-based framework for cross-tracer tau PET harmonization. FKRSBM learns a direct stochastic transport between tracer domains using Schrödinger Bridge matching, avoiding the Gaussian-prior routing used in diffusion-based translation. To promote biologically consistent transport, FKRSBM introduces an endpoint penalty favoring bridge pairings with matched tau-pathology status and implements it through a Feynman-Kac reweighted endpoint proposal. To preserve cortical organization, FKRSBM uses a spherical convolutional network for vertex-level harmonization on cortical surface meshes. In our experiments, we demonstrate our method by harmonizing Tau PET images acquired with the AV-1451 (n=1480) and PI-2620 (n=2458) tracers from two large-scale datasets. Compared to previous methods including ComBat, CycleGAN, Diffusion Model(DF), and unregularized Schrödinger Bridge Model(DSBM), the proposed FKRSBM method outperforms these baselines in subgroup-level alignment, tau-positivity consistency, and diagnostic classification while preserving subject-specific cortical topography of tau pathology. The code is available at: https://github.com/jianweizhang17/FKRSBM.

Deep networks trained on structural MRI for Alzheimer's disease (AD) staging often reach reasonable accuracy while attending to anatomically irrelevant regions, and multimodal models that add clinical tables frequently rely on variables that were used to assign the diagnostic label in the first place. We study both issues with a deliberately lightweight slice-based encoder (ResNet18 with a one-layer Transformer over slices) on 1,075 baseline T1-weighted scans from ADNI-1. First, we use FastSurfer segmentations as an anatomical reference: YOLOv8 models trained on segmentation-derived labels localize Alzheimer-relevant structures with mAP_50 above 0.96, and a Grad-CAM comparison shows that the image-only classifier frequently attends to the skull, orbits and background. Second, we adapt a CLIP-style image - tabular contrastive framework and organize ADNIMERGE variables along a label-leakage spectrum. Fusion with cognitive scores yields 87.3% three-way accuracy, which we treat as a leakage-driven upper bound rather than an imaging result; fusion with regional volumes yields 73.0%. We observe that the choice of contrastive target changes what the image encoder learns: on MCI vs. CN, the image-only head reaches 52.4% when the encoder is aligned to cognitive scores and 73.8% when aligned to volumes, although no tabular input is used at inference. Third, restricting the input to a per-subject crop of the medial temporal lobe raises image-only three-way accuracy from 58.7% to 65.1%. All results come from single runs on a small balanced test set, and we report confidence intervals and the protocol differences that prevent direct comparison with published numbers.