Single-Subject Multi-View MRI Super-Resolution via Implicit Neural Representations
Authors: Heejong Kim, Abhishek Thanki, Roel van Herten, Daniel Margolis, Mert R Sabuncu
Organizations: Department of Radiology, Weill Cornell Medicine, New York, USA · Weill Cornell Graduate School of Medical Sciences, New York, USA · School of Electrical and Computer Engineering, Cornell University and Cornell Tech, New York, USA
Clinical MRI frequently acquires anisotropic volumes with high in-plane resolution and low through-plane resolution to reduce acquisition time. Multiple orientations are therefore acquired to provide complementary anatomical information. Conventional integration of these views relies on registration followed by interpolation, which can degrade fine structural details. Recent deep learning-based super-resolution (SR) approaches have demonstrated strong performance in enhancing single-view images. However, their clinical reliability is often limited by the need for large-scale training datasets, resulting in increased dependence on cohort-level priors. Self-supervised strategies offer an alternative by learning directly from the target scans. Prior work either neglects the existence of multi-view information or assumes that in-plane information can supervise through-plane reconstruction under the assumption of pre-alignment between images. However, this assumption is rarely satisfied in clinical settings. In this work, we introduce Single-Subject Implicit Multi-View Super-Resolution for MRI (SIMS-MRI), a framework that operates solely on anisotropic multi-view scans from a single patient without requiring pre- or post-processing. Our method combines a multi-resolution hash-encoded implicit representation with learned inter-view alignment to generate a spatially consistent isotropic reconstruction. We validate the SIMS-MRI pipeline on both simulated brain and clinical prostate MRI datasets. Code will be made publicly available for reproducibility: https://github.com/abhshkt/SIMS-MRI
Figures & tables
Figure 1: Overview of the proposed three-phase coordinate-based multi-view MRI fusion framework. Phase 1: A continuous implicit image representation model with multi-resolution hash encoding, fθ , is trained on a reference (axial) view to map 3D world coordinates to voxel intensities. Phase 2: A SIREN-based registration network [ 30 ] gϕ learns a dense displacement field that aligns the second (coronal) view to the reference coordinate space while keeping fθ fixed. Phase 3: The implicit image representation is fine-tuned using both the reference and registered views for information fusion. Inference : The learned continuous representation is queried on an isotropic 3D grid to generate a super-resolved volume, enabling reconstruction of unseen slice orientations.
Figure 2: Qualitative results for the unseen view in simulated two-view brain MRI. The first row presents a comparison across methods, and the second row shows a zoomed-in view of the highlighted region. Yellow and green arrows indicate areas where SIMS-MRI achieves superior structural detail reconstruction.
Method
MAE ↓
SSIM ↑
PSNR ↑
LPIPS ↓
DISTS ↓
MONAI ↓
Interpolation (B-spline)
0.0551
0.6723
18.8914
0.2842
0.1960
6.17\times10−4
Interpolation (Linear)
0.0541
0.6779
19.0907
0.2865
0.1991
7.13\times10−4
ECLARE-axial
0.0435
0.7616
20.5620
0.2687
0.2040
3.60\times10−4
ECLARE-fused
0.0412
0.7786
21.2464
0.2464
0.1802
2.91\times10−4
SMORE-axial
0.0431
0.7633
20.5709
0.2700
0.2037
3.57\times10−4
SMORE-fused
0.0409
0.7816
21.2720
0.2445
0.1787
3.10\times10−4
Table 1: Quantitative comparison on simulated two-view brain MRI (unseen view evaluation). ’-axial’ denotes reconstruction using the axial view only, while ’-fused’ indicates co-registered and averaged axial/coronal volumes. ( ↑ : higher is better and ↓ : lower is better. Best in bold and second-best in underline .)
Method
MAE ↓
SSIM ↑
PSNR ↑
LPIPS ↓
DISTS ↓
MONAI ↓
SIMS-MRI
0.0247
0.8877
24.6369
0.2362
0.1845
2.18\times10−4
w/o FreeNeRF & w/ HE
0.0281
0.8461
23.6493
0.2254
0.1744
1.64\times10−4
w/o FreeNeRF & w/ FM
0.0327
0.8077
23.3116
0.3577
0.2345
5.31\times10−4
Table 2: Ablation study on simulated two-view brain MRI. HE: Hash Encoding; FM: Fourier Mapping. Bold and underlined values indicate the best and second-best results.
Figure 3: Results for prostate MRI. The violin plots show the MONAI metric (MONAI: Medical Open Network for Artificial Intelligence model-based perceptual metric). Each row corresponds to a representative subject, selected from slices near the median of the distribution shown in the violin plots (color-coded and marked in the plots).
Psychiatry Neuroimaging Laboratory Brigham and Women’s Hospital Harvard Medical School Boston, MA, USA · School of Computation, Information and Technology Technical University of Munich Munich, Germany · Department of Statistics University of South Carolina Columbia, SC, USA
Department of Bioengineering and I-X, Imperial College London, London SW7 2AZ, United Kingdom · Cardiovascular Research Centre, Royal Brompton Hospital, London, United Kingdom · Bioengineering Department and Imperial-X, Imperial College London, London W12 7SL, U.K. +3