Organizations: Department of Electrical Engineering, Indian Institute of Technology Madras, Chennai, India · Sudha Gopalakrishnan Brain Centre, Indian Institute of Technology Madras, Chennai, India
Generative AI framework-based modeling and prediction of longitudinal human brain images offer an efficient mechanism to track neurodegenerative progression, essential for the assessment of diseases like Alzheimer's. Among the existing generative approaches, recent diffusion-based models have emerged as an effective alternative to generate disease progression images. Incorporating multi-modal and non-imaging attributes as conditional information into diffusion frameworks has been shown to improve controllability during such generations. However, existing methods do not explicitly ensure that information from non-imaging conditioning modalities is meaningfully aligned with image features to introduce desirable changes in the generated images, such as modulation of progression-specific regions. Further, more precise control over the generation process can be achieved by introducing progression-relevant structure into the internal representations of the model, lacking in the existing approaches. To address these limitations, we propose a diffusion autoencoder-based framework for disease progression modeling that explicitly enforces alignment between different modalities. The alignment is enforced by introducing an explicit objective function that enables the model to focus on the regions exhibiting progression-related changes. Further, we devise a mechanism to better structure the latent representational space of the diffusion auto-encoding framework. Specifically, we assign separate latent subspaces for integrating progression-related conditions and retaining subject-specific identity information, allowing better-controlled image generation. These results demonstrate that enforcing alignment and better structuring of the latent representational space of diffusion auto-encoding framework leads to more anatomically precise modeling of Alzheimer's disease progression.
Figures & tables
Fig. 1: Flow diagram indicating the desirable information to be modeled in the latent representational space of our approach.
Fig. 2: Left to right: The condition encoder ( C ) integrates progression information with the latent representation of baseline image ( xb ) produced by the encoding component ( E ), guiding the denoising decoder ( D ) to generate follow-up image ( x^f ). Cross-attention ( Al ) is computed between the conditioning vector and decoder layers, and the objective functions enforce alignment of Al with the progression-specific mask ( M ).
Methods
PSNR (dB) ( ↑ )
SSIM ( ↑ )
MSE ( ↓ )
CN/ MCI & AD
CN/ MCI & AD
CN/ MCI & AD
Naive Baseline
27.25 ± 2.12/ 26.75 ± 2.07
0.93 ± 0.021/ 0.92 ± 0.021
0.0021 ± 0.001/ 0.0024 ± 0.001
IPGAN [ 24 ]
25.86 ± 2.12/ 25.31 ± 2.13
0.92 ± 0.032/ 0.91 ± 0.034
0.0030 ± 0.001/ 0.0034 ± 0.002
BrLP [ 17 ]
26.71 ± 1.02/ 26.20 ± 1.14
0.79 ± 0.022/ 0.79 ± 0.025
0.0029 ± 0.001/ 0.0030 ± 0.001
DE-CVAE [ 4 ]
27.32 ± 2.98/ 26.99 ± 2.83
0.65 ± 0.090/ 0.63 ± 0.082
0.0023 ± 0.001/ 0.0024 ± 0.001
SITGAN [ 23 ]
28.73 ± 3.25/ 28.09 ± 3.23
0.94 ± 0.033/ 0.93 ± 0.034
0.0019 ± 0.001/ 0.0022 ± 0.001
TABLE I: Quantitative evaluations of Align-cDAE with the baseline methods in terms of image-level metrics (PSNR, SSIM, MSE). Statistical significance ( p<0.01 ) is marked with ( ∗ ).
Fig. 3: Left to right: In sub-figures (A) and (B), the columns (a)-(f) present a method-wise comparison of predicted follow-up images ( x^f ) along with their error maps computed with respect to the ground-truth follow-up ( ∣x^f−xf∣ ) and ground truth baseline ( ∣xb−x^f∣ ), respectively. Column (g) in sub-figure (A) shows the ground-truth follow-up ( xf ), while in sub-figure (B) it also shows the ground-truth follow-up and baseline difference ( ∣xb−xf∣ ). Top to bottom: For both sub-figures, the upper and lower two rows correspond to subjects aged 83.3 and 84.3 years, respectively, from the AD disease category. In sub-figure (A), the green box highlights that Align-cDAE better predicts progression-related changes.
Methods
MAE ( ↓ )
Hippocampus
Amygdala
Lateral Ventricles
IPGAN [ 24 ]
0.3348 ± 0.0338
0.3283 ± 0.0260
0.5445 ± 0.5240
BrLP [ 17 ]
0.1960 ± 0.0552
0.1731 ± 0.0529
0.3702 ± 0.1012
DE - CVAE [ 4 ]
0.1871 ± 0.0727
0.1183 ± 0.1117
0.1747 ± 0.1470
SITGAN [ 23 ]
0.1161 ± 0.0288
0.0211 ± 0.0201
0.1436 ± 0.1053
cDAE
0.0550 ± 0.0500
0.0200 ± 0.0400
0.1250 ± 0.1200
TABLE II: Volumetric assessment of Align-cDAE with baseline methods in terms of MAE in different anatomical regions. Statistical significance ( p<0.01 ) is marked with ( ∗ ).
Fig. 4: Left to right: (a) Ground truth, (b) cDAE, and (c) Align-cDAE. Top to bottom: (i) Ground-truth and predicted follow-up images, (ii) (a) Ground truth baseline and (b)-(c) model attention maps overlaid on images, and (iii) Difference between ground-truth/ predicted follow-up and ground-truth baseline images.
Data Mixture
Accuracy (%)
100% RD +0% GD
81.92
75% RD +25% GD
82.02
50% RD +50% GD
82.15
25% RD +75% GD
82.00
0% RD +100% GD
81.93
TABLE III: Cognitive state classification accuracy under different mixtures of real baseline data (RD) and generated follow-up data (GD).
Methods
PSNR( ↑ ) (dB)
SSIM( ↑ )
FID( ↓ )
Accuracy( ↑ ) (%)
CN/ MCI & AD
Classify CN vs. AD
Align-cDAE (w/o L_attn_imax)
28.58/ 28.54
0.945/ 0.938
7.56/ 7.88
80.99
Align-cDAE
29.82/ 29.52
0.950/ 0.944
6.85/ 6.93
81.93
TABLE IV: Ablation study comparing the image similarity and diversity metrics, along with downstream classification performance.
Department of Electrical Engineering, Indian Institute of Technology Madras (IITM), Chennai 600036, India · Sudha Gopalakrishnan Brain Centre (SGBC), IITM, Chennai 600036, India
Department of Artificial Intelligence Convergence, Chonnam National University, South Korea · Department of Nuclear Medicine, Chonnam National University, South Korea · University of South Australia, Australia +2