Image registration is a fundamental task that aligns anatomical structures between images. While CNNs perform well, they lack rotation equivariance - a rotated input does not produce a correspondingly rotated output. This hinders performance by failing to exploit the rotational symmetries inherent in anatomical structures, particularly in brain MRI. In this work, we integrate rotation-equivariant convolutions into deformable brain MRI registration networks. We evaluate this approach by replacing standard encoders with equivariant ones in three baseline architectures, testing on multiple public brain MRI datasets. Our experiments demonstrate that equivariant encoders have three key advantages: 1) They achieve higher registration accuracy while reducing network parameters, confirming the benefit of this anatomical inductive bias. 2) They outperform baselines on rotated input pairs, demonstrating robustness to orientation variations common in clinical practice. 3) They show improved performance with less training data, indicating greater sample efficiency. Our results demonstrate that incorporating geometric priors is a critical step toward building more robust, accurate, and efficient registration models.
Figures & tables
Figure 1: Parameter comparison (log scale) between baselines and equivariant counterparts. Red values show parameter reduction. Equivariant models significantly reduce parameters.
Figure 2: Qualitative results of MindBoggle dataset on different baselines and their equivariant version.
Model
Avg
Std
Min
Max
Dual PR ++
0.554
0.107
0.416
0.684
Equi Dual PR ++
0.563
0.106
0.426
0.690
RDP
0.611
0.107
0.470
0.727
Equi RDP
0.628
0.098
0.491
0.729
Table 2: Dice scores for rotated inputs. Equivariant models achieve higher average scores and lower standard deviation.
Figure 3: Dice scores for rotation of moving image only.
Model config
irrep-0
irrep-1
irrep-2
Total channels
Equi irreps 0
16
0
0
16×1=16
Equi irreps 1
0
5
0
5×3=15
Equi irreps 2
0
0
3
3×5=15
Equi irreps 01 (4:4)
4
4
0
4×1+4×3=16
Equi irreps 01 (7:3)
7
3
0
7×1+3×3=16
Equi irreps 012 (5:2:1)
5
2
1
5×1+2×3+1×5=16
Table 3: Equivariant channel configurations.
Figure 4: Comparison of performance of Equivarint models with different choices of irreps.
PR ++
Equi PR ++
Training Portion
DSC
ASSD
DSC
ASSD
LPBA (full)
0.684 ± 0.024
1.864 ± 0.195
0.690 ± 0.023
1.834 ± 0.193
LPBA (1/2)
0.675 ± 0.025
1.911 ± 0.199
0.680 ± 0.024
1.883 ± 0.193
LPBA (1/4)
0.665 ± 0.027
1.962 ± 0.210
0.673 ± 0.025
1.916 ± 0.191
LPBA (1/8)
0.653 ± 0.031
2.032 ± 0.233
0.660 ± 0.028
1.987 ± 0.209
Table 4: Evaluation results on the LPBA test set using different portions of the LPBA training set.
Deformable image registration plays a fundamental role in medical image analysis by enabling spatial alignment of anatomical structures across subjects. While recent deep learning-based approaches have significantly improved computational efficiency, many existing methods remain limited in capturing long-range anatomical correspondence and maintaining deformation consistency. In this work, we present a cycle inverse-consistent transformer-based framework for deformable brain MRI registration. The model integrates a Swin-UNet architecture with bidirectional consistency constraints, enabling the joint estimation of forward and backward deformation fields. This design allows the framework to capture both local anatomical details and global spatial relationships while improving deformation stability. We conduct a comprehensive evaluation of the proposed framework on a large multi-center dataset consisting of 2851 T1-weighted brain MRI scans aggregated from 13 public datasets. Experimental results demonstrate that the proposed framework achieves strong and balanced performance across multiple quantitative evaluation metrics while maintaining stable and physically plausible deformation fields. Detailed quantitative comparisons with baseline methods, including ANTs, ICNet, and VoxelMorph, are provided in the appendix. Experimental results demonstrate that CICTM achieves consistently strong performance across multiple evaluation criteria while maintaining stable and physically plausible deformation fields. These properties make the proposed framework suitable for large-scale neuroimaging datasets where both accuracy and deformation stability are critical.
Deep learning registration methods routinely stack two kinds of enhancement on a base network: architectural additions such as affine pre-alignment stages, and training-objective additions such as regularization losses. Papers tend to adopt both at once, so it is unclear which is doing the work. I ran a controlled ablation to separate them. Using the OASIS brain MRI dataset (394 training subjects, 20 test subjects), I trained four variants of the same registration pipeline: a baseline 3D U-Net with basic similarity losses, the same U-Net with a full regularization suite, an affine-plus-deformable architecture with basic losses, and the affine architecture with the full suite. I evaluated registration accuracy (MSE, NCC, SSIM), deformation quality (Jacobian determinant preservation, displacement statistics, an anatomical plausibility score), and computational cost. Regularization alone accounted for most of the gain: a 21.3% relative gain on the MSE-improvement metric (1.78% to 2.16%, P<.001) and a 21.8% relative gain in NCC improvement, while cutting maximum deformation from 53.1 to 0.51 units, a 99.0% reduction, at essentially no computational cost (-0.06% inference time). The combined model produced the largest accuracy gain, 25.8% (1.78% to 2.24%), and raised anatomical plausibility from 0.596 to 0.930, at a moderate +9.8% inference-time cost. Gradient correlation rose from 0.742 at baseline to 0.980 for the fully enhanced model. All enhanced variants reached sub-voxel accuracy under plausible deformation constraints. Regularization losses are the primary driver in this setting, delivering the accuracy gains and almost all of the deformation control for free at inference time, while the affine architecture adds a smaller complementary benefit at acceptable cost. The 99% reduction in unrealistic deformations addresses a known barrier to clinical deployment.
Nabira Rashid
Carnegie Mellon University · Harvard Medical School
Medical image registration benefits significantly from deep learning, yet existing approaches often lack physical explainability and fine-grained deformation control. Motivated by Demons algorithms, we propose a novel DrivenMorph framework that bridges attention mechanisms with variational image registration by incorporating difference modeling as a physically inspired inductive bias. The resulting driving force, computed from local differences in the latent feature space, provides explicit semantic guidance throughout the registration process. It directly drives the registration process through a neural Demons layer that simulates force-displacement interactions to generate smooth and anatomically consistent deformation. Unlike previous methods, our approach not only integrates traditional registration principles with popular deep networks, providing an explainable and efficient solution for learning-based medical image registration, but also separates difference modeling from deformation, improving modularity and explainability. Extensive experiments on multiple 3D brain MRI datasets demonstrate superior performance over state of-the-art learning-based and optimization-based methods. Furthermore, visualizations and statistical analyses confirm that the learned driving force aligns closely with actual deformation patterns, supporting its explanatory value.
Mingke Li, Jianping Zhang, Jinqiu Deng
School of Mathematics and Computational Science, Hunan Key Laboratory for Computation and Simulation in Science and Engineering, Xiangtan University, Xiangtan, Hunan 411105, P. R. China