Unrolled variational networks achieve state-of-the-art performance for accelerated MRI reconstruction, but standard end-to-end training becomes prohibitively memory intensive as the number and width of cascades increase. We propose a memory-efficient training framework that updates a randomly sampled cascade while retaining supervision from the final reconstruction loss. The error signal is propagated from the end of the chain to the sampled cascade using an activation-light backward pass that avoids storing full chain activations, thereby decoupling training memory from chain length. A time-conditioned network shared across cascades further keeps the parameter count independent of chain length. The backward pass is approximate only through frozen normalization statistics, and a trained exact gradient control shows the approximation leaves reconstruction quality unchanged. The framework remains trainable at chain lengths and cascade widths where standard end-to-end backpropagation exhausts GPU memory. On fastMRI single-coil knee and multi-coil brain reconstruction, our method consistently outperforms other local training approaches. On high-SNR knee slices, our method surpasses E2E-VarNet at 8× and matches it at 4×, while on the complete brain validation set it surpasses E2E-VarNet at 8× and achieves comparable performance at 4×, with fewer parameters, lower peak memory, and faster per-iteration training. Code is available at https://github.com/emehillaj/scalable-unrolled-mri.
Figures & tables
Training scheme
PSNR ↑
Mem (GB) ↓
Time (ms)
E2E-VarNet (distinct, full BP)
29.54
5.9
215
Shared-TE, full BP
29.68 ± 0.02
6.7
224
Shared-TE, sampled, exact suffix
29.57 ± 0.02
6.7
136
Shared-TE, sampled, activation-light (ours)
29.58 ± 0.02
1.1
134
Table 1: Isolating the training scheme. Single-coil knee 8× , T=8 , C=32 ; each row changes one design decision. PSNR on the complete high-SNR cohort ( n=2514 ). ± is seed noise from three separately trained replicates.
4×
8×
Params (M)
Method ( C )
High-SNR proxy > 35
Low-SNR proxy ≤ 35
High-SNR proxy > 35
Low-SNR proxy ≤ 35
E2E-VarNet (32)
0.0094/32.41/0.790 (0.0068/2.71/0.081)
0.0574/26.83/0.538 (0.0448/3.08/0.132)
0.0160/29.90/0.716 (0.0091/2.34/0.093)
0.0691/25.79/0.450 (0.0470/2.88/0.138)
116.4
E2E + ckpt. (64)
0.0093 /32.42/ 0.791 (0.0066/2.72/0.081)
0.0578/26.82/0.538 (0.0459/3.09/0.132)
0.0154/30.07/0.716 (0.0090/2.39/0.095)
0.0699/25.74/0.446 (0.0474/2.88/0.138)
465.4
E2E + ckpt. (96)
0.0093 / 32.46 / 0.791 (0.0066/2.73/0.081)
0.0572/26.84/0.539 (0.0447/3.08/0.132)
0.0153/30.13/0.717 (0.0090/2.40/0.096)
0.0699/25.75/0.444 (0.0480/2.89/0.138)
1047.1
GLEAM (32)
0.0103/31.94/0.777 (0.0068/2.60/0.082)
0.0597/26.64/0.521 (0.0466/3.05/0.137)
0.0181/29.33/0.700 (0.0094/2.27/0.094)
0.0730/25.51/0.435 (0.0484/2.84/0.138)
116.4
FLAT-style (32)
0.0208/28.62/0.688 (0.0092/2.16/0.073)
0.0928/24.88/0.487 (0.0838/3.02/0.109)
0.0424/25.50/0.576 (0.0165/2.18/0.085)
0.1320/23.11/0.361 (0.1073/2.82/0.108)
116.4
Table 2: Main comparison on single-coil knee data at T=15 . Results are reported as NMSE/PSNR/SSIM, with per slice standard deviations below, for high-SNR ( n=2514 ) and low-SNR ( n=4621 ) validation cohorts defined using the k-space SNR proxy. Columns > 35 / ≤ 35 are the high-/low-SNR-proxy cohorts. Best per cohort in bold ; C = base channel width, last column = trainable parameters. For Ours (96), the second line is the fraction of slices beating E2E-VarNet (32); stars are results of one-sided paired Wilcoxon tests comparing the two, Holm-Bonferroni corrected over the 18 tests reported in Tabs. 2 and 3 . At these cohort sizes a starred low-SNR cell can differ from the reference by less than the displayed precision, so the win fraction and the effect size, not the star, carry the practical claim. Slice-level tests treat slices as independent and therefore ignore within-volume correlation; the volume-level analysis in the supplementary confirms the PSNR and NMSE conclusions at the volume unit ( ∗p<0.05 , ∗∗p<0.01 , ∗∗∗p<0.001 );
Method ( C )
4×
8×
Params (M)
E2E-VarNet (32)
0.0058/37.42/0.915 (0.0067/2.96/0.096)
0.0106/34.38/0.890 (0.0075/2.64/0.102)
116.8
GLEAM (32)
0.0081/35.76/0.895 (0.0081/2.72/0.098)
0.0180/32.11/0.863 (0.0178/2.71/0.102)
116.8
FLAT-style (32) †
0.0514/27.62/0.750 (0.0358/2.81/0.080)
0.1100/24.07/0.631 (0.0565/2.58/0.084)
116.8
K-space Cold Diff. (64)
0.0173/32.57/0.851 (0.0242/3.05/0.102)
0.0284/29.90/0.799 (0.0285/2.85/0.109)
32.3
Ours (32)
0.0063/37.03/0.912 (0.0072/2.93/0.099)
0.0112/34.16/0.887 (0.0081/2.64/0.103)
8.6
Ours (64)
0.0056 /37.64/0.917 (0.0067/3.01/0.097)
0.0105/34.49/0.891 (0.0087/2.72/0.104)
32.8
Table 3: Main comparison on multi-coil brain data at T=15 . per slice NMSE/PSNR/SSIM are reported over the full validation set ( n=21,842 ), with standard deviations below. Best results per metric are in bold . Win fractions, stars, and conventions as in Tab. 2 (same 18-test Holm family). † FLAT-style did not optimize on brain: its outputs stay within 0.5% of the zero-filled input and its loss decreased by <0.02% over two days of training. We report the row rather than omitting it; the same implementation trains normally on knee.
Figure 1: Qualitative comparison at 8× acceleration. One validation slice per anatomy, each rendered as three rows: full FOV (ROI in red, PSNR inset), ROI zoom, and error ∣x^−xref∣ ( ×10 ). Columns: fully sampled reference, zero-filled (ZF) input, E2E-VarNet (E2E-VN) (32), GLEAM, FLAT-style, K-space Cold Diffusion (KCold), and Ours (96).
Method
T / C
NMSE ↓
PSNR ↑
SSIM ↑
Mem (GB) ↓
Time (ms)
Params (M)
Depth scaling ( C=32 , sweep T )
E2E-VarNet
8
0.0173
29.54
0.708
5.9
215
62.05
E2E-VarNet
15
0.0160
29.90
0.716
11.0
403
116.35
E2E + ckpt.
8
0.0173
29.54
0.708
1.3
293
62.05
E2E + ckpt.
15
0.0160
29.90
0.716
1.7
551
116.35
E2E + ckpt.
25
0.0156
30.02
0.715
2.3
901
193.9
Table 4: Capacity scaling , single-coil knee 8× , high-SNR cohort (SNR >35 dB): depth at fixed C=32 (top) and width at fixed T=8 (bottom). Quality on the complete high-SNR cohort ( n=2514 ); Mem/Time on one A6000 at batch 1 .
4×
8×
Method
high-SNR
low-SNR
high-SNR
low-SNR
E2E-VarNet (32)
32.41
26.83
29.90
25.79
GLEAM (32)
31.94 0% wins
26.64 0% wins
29.33 4% wins
25.51 1% wins
FLAT-style (32)
28.62 0% wins
24.88 0% wins
25.50 0% wins
23.11 0% wins
K-space Cold Diff. (64)
31.91 22% wins
27.21 85% wins
29.46 25% wins
25.89 67% wins
Ours (32)
32.32 4% wins
26.78 4% wins
29.70 21% wins
25.53 2% wins
Table 5: Slice-level win fractions, single-coil knee. Same slices and protocol as the knee block of Tab. 2 , whose cohort means the table reproduces. Each cell gives the mean PSNR (dB) and, beneath it, the fraction of slices on which the method beats the reference row (E2E-VarNet, C=32 ). Best value per acceleration is indicated in bold .
Method
PSNR ↑
SSIM ↑
NMSE ↓
E2E-VarNet (32)
36.75
0.9350
0.0093
GLEAM (32)
34.31 0% wins
0.9122 0% wins
0.0160 0% wins
FLAT-style (32)
25.91 0% wins
0.6852 0% wins
0.1074 0% wins
K-space Cold Diff. (64)
30.78 4% wins
0.8313 2% wins
0.0351 2% wins
Ours (32)
36.44 2% wins
0.9320 0% wins
0.0099 2% wins
Ours (64)
36.92 81% wins
0.9365 84% wins
0.0089 81% wins
Table 6: Volumewise evaluation, multi-coil brain 8× . All V=1,378 validation volumes, no subsampling. Each cell reports the metric averaged over volumes and, beneath it, the fraction of volumes on which the method beats the reference row (E2E-VarNet (32)). Best value per metric is indicated in bold .
Method
PSNR ↑
SSIM ↑
NMSE ↓
E2E-VarNet (32)
40.02
0.9546
0.0044
GLEAM (32)
38.24 0% wins
0.9397 0% wins
0.0065 0% wins
FLAT-style (32)
29.47 0% wins
0.7974 0% wins
0.0477 0% wins
K-space Cold Diff. (64)
32.92 2% wins
0.8731 2% wins
0.0221 2% wins
Ours (32)
39.50 0% wins
0.9520 0% wins
0.0049 0% wins
Ours (64)
40.26 99% wins
0.9557 99% wins
0.0042 99% wins
Table 7: Volumewise evaluation, multi-coil brain 4× . All V=1,378 volumes, with the conventions of Tab. 6 .
Method
PSNR ↑
SSIM ↑
NMSE ↓
E2E-VarNet (32)
31.09
0.6770
0.0409
E2E + ckpt. (64)
31.17
0.6758
0.0408
E2E + ckpt. (96)
31.18
0.6759
0.0408
GLEAM (32)
30.68 0% wins
0.6651 0% wins
0.0440 0% wins
FLAT-style (32)
27.75 0% wins
0.5578 0% wins
0.0771 0% wins
K-space Cold Diff. (64)
29.45 21% wins
0.6653 39% wins
0.0498 8% wins
Table 8: Volumewise evaluation, single-coil knee 8× . All V=199 volumes, with the conventions of Tab. 6 .
Method
PSNR ↑
SSIM ↑
NMSE ↓
E2E-VarNet (32)
32.75
0.7387
0.0310
E2E + ckpt. (64)
32.78
0.7396
0.0309
E2E + ckpt. (96)
32.78
0.7397
0.0309
GLEAM (32)
32.45 0% wins
0.7283 0% wins
0.0324 0% wins
FLAT-style (32)
30.09 0% wins
0.6632 0% wins
0.0490 0% wins
K-space Cold Diff. (64)
30.51 14% wins
0.7340 40% wins
0.0367 15% wins
Table 9: Volumewise evaluation, single-coil knee 4× . All V=199 volumes, with the conventions of Tab. 6 .
Configuration
PSNR ↑
SSIM ↑
NMSE ↓
Depth ( C=32 )
Ours, T=8
30.77
0.6629
0.0439
Ours, T=15
30.87
0.6656
0.0430
Ours, T=25
30.96
0.6677
0.0427
Ours, T=50
31.07
0.6698
0.0419
Width ( T=8 )
Table 10: Ablations under volumewise, unstratified evaluation. Single-coil knee 8× , all V=199 validation volumes, no SNR selection, aggregated as in Sec. 5.2 . The training scheme rows carry the training budget caveat of Tab. 1 and are the mean over 3 seeds.
Method ( C )
Native 4×
8×→4×
Δ
E2E-VarNet (32)
32.41
31.96
−0.45
GLEAM (32)
31.94
31.42
−0.52
FLAT-style (32)
28.62
28.21
−0.41
K-space Cold Diff. (64)
31.91
31.74
−0.17
Ours (32)
32.32
31.55
−0.77
Ours (64)
32.28
31.91
−0.37
Table 11: Cross-acceleration generalization , single-coil knee, high-SNR cohort (SNR >35 dB, complete cohort, n=2514 ). All values are PSNR (dB), Δ is the transfer gap, and the best value per column is in bold .
Method ( C )
Knee 4×
Knee 8×
Params (M)
E2E-VarNet (32)
0.0405/28.79/0.627 (0.0429/3.98/0.168)
0.0504/27.24/0.543 (0.0458/3.34/0.178)
116.4
GLEAM (32)
0.0423/28.51/0.612 (0.0445/3.85/0.172)
0.0537/26.86/0.528 (0.0473/3.22/0.177)
116.4
FLAT-style (32)
0.0674/26.20/0.558 (0.0759/3.28/0.137)
0.1004/23.95/0.437 (0.0969/2.85/0.144)
116.4
K-space Cold Diff. (64)
0.0362 / 28.87 / 0.673 (0.0338/3.59/0.116)
0.0489 /27.14/ 0.567 (0.0401/3.13/0.145)
32.3
Ours (32)
0.0409/28.74/0.623 (0.0434/3.96/0.169)
0.0536/27.00/0.529 (0.0497/3.35/0.178)
8.1
Ours (64)
0.0420/28.67/0.622 (0.0462/3.97/0.169)
0.0523/27.23/0.534 (0.0505/3.47/0.182)
32.3
Table 12: Pooled validation (no SNR stratification), single-coil knee. NMSE ↓ /PSNR ↑ /SSIM ↑ on the complete validation set, pooled across all SNRs ( n=7135 ), at 4× and 8× . Per slice standard deviation in parentheses, best value per metric and acceleration in bold .
Figure 2: Reconstruction quality across the SNR range, single-coil knee 8× . Rows are validation slices ordered by the SNR of the fully sampled reference, from 45 dB (top) to −6.7 dB (bottom), with the PSNR (dB) of each method inset. Columns follow Fig. 1 .
Figure 3: SNR threshold sensitivity, single-coil knee 8× . Shaded bands are 95% bootstrap intervals of the cohort mean and the dashed line marks the 35 dB cutoff of the main paper. The rankings are stable over the full sweep.
Figure 4: SNR threshold sensitivity, single-coil knee 4× . Conventions as in Fig. 3 .
Figure 5: SNR threshold sensitivity, multi-coil brain 8× . Conventions as in Fig. 3 .
Figure 6: SNR threshold sensitivity, multi-coil brain 4× . Conventions as in Fig. 3 .
Proxy band
Brain ρ
Knee ρ
<25 dB
+0.56
+0.60
25 – 30
+0.34
+0.04
30 – 35
−0.08
+0.10
35 – 40
+0.12
+0.37
>40
−0.38
+0.35
overall
+0.17
+0.75
Table 13: Where the SNR proxy is informative. Spearman correlation between the proxy and the PSNR achieved by a fixed model (Ours, C=96 , 8× ), within bands of the proxy (knee n=7135 , brain n=21,842 ).
Figure 7: Noise sensitivity, single-coil knee 8× . Mean PSNR per fully sampled k-space SNR cohort, with reference examples above the curve. Fig. 9 gives the brain counterpart.
Figure 8: Noise sensitivity, single-coil knee 4× . As Fig. 7 , at 4× acceleration. The methods lie closer together than at 8× and the ordering is preserved over the whole range. K-space Cold Diffusion again leads only in the noisiest bin.
Figure 9: Noise sensitivity, multi-coil brain 8× . Mean PSNR per fully sampled k-space SNR cohort over the complete validation set ( n=21,842 slices, identical for every method, 1075 to 5158 per bin), with reference examples above the curve. Tab. 13 shows that the flatness above 30 dB is a property of the proxy on brain rather than of the reconstructions.
Figure 10: Noise sensitivity, multi-coil brain 4× . As Fig. 9 , at 4× acceleration ( n=21,842 slices, identical slices for every method). The curves are flatter still than at 8× : with the inverse problem better constrained, acquisition quality separates the methods less.
Central
Edge
Slices
3,503
3,632
Median proxy (dB)
33.5
32.6
Below 30 dB
25.8%
39.9%
Below 25 dB
4.4%
20.9%
Minimum (dB)
13.5
−6.7
Table 14: SNR proxy by slice position, single-coil knee. All 7,135 validation slices, split by position within the volume: central is the middle half, edge the outer quarter at each end.
Suffix backward component
Peak (GB) ↓
Time (ms)
Gradients
L0 standard autograd
6.61
154
exact
L1 + conv/linear adjoint
4.93
134
exact
L2 + LeakyReLU sign masks
3.10
137
exact
L3 + frozen-statistics norm
1.14
134
approx.
Table 15: Componentwise ablation of the activation-light backward. Single-coil knee 8× , T=8 , C=32 , single A6000, batch 1 . Levels are cumulative. Peak memory is the maximum over the sampled cascade index and step time the mean over it.
Figure 11: Gradient fidelity distribution, single-coil knee 8× , C=32 . The quantity compared is the gradient the suffix returns to the output of the sampled cascade, computed with the compact backward and with exact autograd. Left: CDF of their cosine similarity over n=200 slices and every sampled cascade position, with dotted vertical lines at the 1 st percentile of each model. Eight of the 5,000 measurements at T=50 exceed memory in the exact reference and are excluded. Right: box plot per suffix length for the shared time-embedded model at T=8 .
Scheme
Peak (GB) ↓
weights + grads
activations
Time (ms)
T=8
full backprop.
5.94
0.46
5.48
215
ckpt. per cascade
1.26
0.46
0.80
293
ckpt. nested
0.96
0.46
0.50
385
Ours
1.10
0.06
1.04
134
T=25
Table 16: Checkpointing schemes , single-coil knee, C=32 , one A6000 at batch 1 . Per cascade checkpointing stores the input of each cascade and is the setting used everywhere else in the paper; nested adds a second level inside the U-Net blocks. Peak memory is split into the weights and gradients, which stay resident throughout, and the activations, which are the remainder.
Figure 12: Peak training memory , batch 1 on one A6000. Crosses mark configurations that exceed the 48 GB budget.
Figure 13: Additional single-coil knee reconstructions. Rows are validation slices, columns the compared methods and the fully sampled reference. The two accelerations show the same slices.
Figure 15: Additional multi-coil brain reconstructions. Rows are validation slices across contrasts, columns as in Fig. 13(a) . The two accelerations show the same slices.
Accelerated MRI reconstruction recovers diagnostic images from undersampled k-space data to reduce scan time while preserving anatomical and quantitative information.
Department of Electrical and Electronic Engineering, Bangladesh University of Engineering and Technology, Dhaka, Bangladesh · This paper was produced by the IEEE Publication Technology Group. They are in Piscataway, NJ.
NYU Center for Data Science, NY, USA · Center for Advanced Imaging Innovation and Research (CAI²R), Department of Radiology, NYU Grossman School of Medicine, NY, USA · Courant Institute of Mathematical Sciences, NY, USA +1