cs.CVNov 6, 2026

RegNC-Mamba3: Shared Structural Feature Learning Using Non-Causal State Space Principles for Multi-Modal Image Registration

Authors: Zhikang Li, Yan Wu, Xin Hu, Yi Dai, Ming Li

Organizations: Remote Sensing Image Processing and Fusion Group, School of Electronic Engineering, Xidian University, Xi’an, 710071, China · National Key Laboratory of Radar Signal Processing, Xidian University, Xi’an, 710071, China

Abstract

The main challenge of multi-modal image registration is shared structural feature extraction with higher accuracy and lower computational complexity. Compared with a State Space Model (SSM), the State Space Principles (SSP) formulation of Mamba-3 uses a more accurate discretization with lower truncation error while maintaining linear complexity. However, vanilla SSP is designed for natural language processing (NLP) and is not directly suitable for images. To address this issue, we propose a novel non-causal SSP (NC-SSP) with shared structure awareness and develop a coarse-to-fine registration method named RegNC-Mamba3. First, NC-SSP is designed to eliminate the dependence of the integral computation on the scanning path. By combining relative-weight normalization with aggregation over all circular scan paths, NC-SSP constructs a globally hidden state without long-range decay, which provides a wider receptive field and higher efficiency than the original Mamba-3. Second, NC-SSP is modified to strengthen the extraction of cross-modal structural features. When computing hidden states and feature interactions, we construct complex-valued sequences in NC-SSP by applying learnable Log-Gabor kernels, with different orientations to each head for frequency-domain modulation. This improves the perception of shared structural information across modalities and increases both registration accuracy and quality. Experiments on VIS-SAR and VIS-IR demonstrate that RegNC-Mamba3 outperforms the compared detector-based and semi-dense multi-modal registration methods.

Figures & tables

Explore similar work

CardsList
  1. Cross-Modality Feature Fusion Based on Structured State Space Duality for Multimodal Image Registration Network

    Jun 2, 2026Zhikang Li, Yan Wu, Xin Hu +2Multi-Scale Feature FusionCross-Modal Feature Matching

  2. Disentangle-then-Align: Non-Iterative Hybrid Multimodal Image Registration via Cross-Scale Feature Disentanglement

    Mar 20, 2026Chunlei Zhang, Jiahao Xia, Yun Xiao +2Cross-Modal Image RegistrationDeformable Image Registration

  3. Search-MIND: Training-Free Multi-Modal Medical Image Registration

    Apr 10, 2026Boya Wang, Ruizhe Li, Chao Chen +1Medical Image RegistrationCross-Modal Image Registration