cs.CVMar 10, 2026

TriFusion-SR: Joint Tri-Modal Medical Image Fusion and SR

Authors: Fayaz Ali Dharejo, Sharif S. M. A., Aiman Khalil, Nachiket Chaudhary, Rizwan Ali Naqvi, Radu Timofte

Organizations: University of Würzburg, Germany · Independent Researcher · Mehran UET, Pakistan · Sejong University, Republic of Korea

Abstract

Multimodal medical image fusion facilitates comprehensive diagnosis by aggregating complementary structural and functional information, but its effectiveness is limited by resolution degradation and modality discrepancies. Existing approaches typically perform image fusion and super-resolution (SR) in separate stages, leading to artifacts and degraded perceptual quality. These limitations are further amplified in tri-modal settings that combine anatomical modalities (e.g., MRI, CT) with functional scans (e.g., PET, SPECT) due to pronounced frequency domain imbalances. We propose TriFusionSR, a wavelet-guided conditional diffusion framework for joint tri-modal fusion and SR. The framework explicitly decomposes multimodal features into frequency bands using the 2D Discrete Wavelet Transform, enabling frequency-aware crossmodal interaction. We further introduce a Rectified Wavelet Features (RWF) strategy for latent coefficient calibration, followed by an Adaptive Spatial-Frequency Fusion (ASFF) module with gated channel-spatial attention to enable structure-driven multimodal refinement. Extensive experiments demonstrate state-of-the-art performance, achieving 4.8-12.4% PSNR improvement and substantial reductions in RMSE and LPIPS across multiple upsampling scales.

Figures & tables

Explore similar work

CardsList
  1. Adaptive Context Matters: Towards Provable Multi-Modality Guidance for Super-Resolution

    May 11, 2026Jinyi Luo, Minghao Liu, Yifan Li +2Mixture of ExpertsMultimodal Fusion

  2. MedSR-Vision: Deep Learning Framework for Multi-Domain Medical Image Super-Resolution

    May 5, 2026Subhash Gurappa, Trivikram Satharasi, Yashas Hariprasad +1Medical Image Super-ResolutionMedical Image Benchmarks

  3. AD-SRF: Attack-Defense Semantic Reinforcement for Multi-Modal Image Fusion

    Oct 9, 2026Hao Zhang, Zhiqian Zheng, Linfeng Tang +2Multi-Source Image Fusion