DGCM-SSFA: Dual-Granularity Cross-Modulation and Sparse Strip Frequency Attention for Efficient 3T-to-7T MRI Synthesis
Organizations: School of Computer Science and Engineering, Huizhou University, Huizhou, China
Abstract
Synthesizing high-fidelity 7T MRI from routinely acquired 3T scans offers a practical pathway to enhanced neuroimaging without the prohibitive cost of ultra-high-field scanners. While existing deep learning approaches have achieved promising results, state-of-the-art methods typically rely on either large-scale architectures exceeding 45 million parameters or computationally intensive ensemble strategies, limiting their practicality in resource-constrained clinical environments. In this work, we propose a compact multi-domain attention framework, termed DGCM-SSFA, that achieves competitive synthesis quality with only 11M parameters. The proposed architecture integrates two complementary modules into a U-Net Transformer backbone. First, a Dual-Granularity Cross-Modulated Feature Modulator (DGCM) is embedded at multiple hierarchical levels to enhance local edge and texture details through Sobel-guided spatial attention and depthwise frequency-aware channel attention with cross-branch gating. Second, a Sparse Strip Frequency Attention (SSFA) module at the bottleneck captures global spatial context via strip-pooled attention with near-linear complexity, while simultaneously performing FFT-based spectral modulation in the frequency domain. These two modules operate synergistically with the backbone's native channel attention, forming a triple-granularity feature refinement pipeline. Extensive experiments on the UNC and BNU 3T-to-7T MRI datasets across T1w and T2w modalities demonstrate that DGCM-SSFA achieves strong structural fidelity, attaining an SSIM of 0.8431 on BNU T2w---approaching the best benchmark value of 0.8624---and 0.8100 on BNU T1w, while using substantially fewer parameters than Transformer-based alternatives such as ResViT (123.4M) and FS-RWKV (45.4M).
Figures & tables
| Method | UNC T1w | UNC T2w | BNU T1w | BNU T2w | Params (M) | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PSNR | SSIM | RMSE | PSNR | SSIM | RMSE | PSNR | SSIM | RMSE | PSNR | SSIM | RMSE | ||
| CycleGAN | 19.98 | 0.6789 | 0.1008 | 24.88 | 0.7538 | 0.0586 | 21.93 | 0.7881 | 0.0807 | 26.30 | 0.8053 | 0.0493 | 28.29 |
| pix2pix | 19.96 | 0.6847 | 0.1015 | 24.74 | 0.7550 | 0.0591 | 22.74 | 0.8102 | 0.0739 | 26.47 | 0.8182 | 0.0481 | 57.18 |
| DDCNN | 20.75 | 0.6412 | 0.0924 | 24.21 | 0.7286 | 0.0640 | 23.02 | 0.7732 | 0.0717 | 26.88 | 0.8229 | 0.0463 | 0.29 |
| WATNet | 20.17 | 0.6753 | 0.0990 | 23.07 | 0.6698 | 0.0719 | 21.13 | 0.7319 | 0.0886 | 26.13 | 0.7625 | 0.0503 | 1.35 |
| RegGAN | 19.46 | 0.6423 | 0.1073 | 23.97 | 0.6994 | 0.0654 | 22.10 | 0.7897 | 0.0793 | 25.61 | 0.7703 | 0.0531 | 2.76 |
| Variant | PSNR | SSIM |
|---|---|---|
| Full DGCM-SSFA | 26.27 | 0.8431 |
| w/o DGCM | 25.88 | 0.8206 |
| w/o SSFA | 26.02 | 0.8270 |
| w/o Both | 25.66 | 0.8048 |
Medical Image Synthesis
Medical image synthesis creates, translates, reconstructs, and edits clinical images to fill missing data and support analysis.
See all 312 papers