Cross-Modal Image Registration

Ask about this topic

Overview

Cross-modal image registration estimates how images from different sources—such as MRI and CT, infrared and visible light, or cameras and point clouds—overlap in space. Methods range from mutual-information and anatomical-feature matching to learned shared representations, coarse-to-fine correspondence networks, and geometry- or uncertainty-aware optimization; they may estimate rigid poses, local deformations, or both. The goal is to transfer information reliably across modalities for tasks such as image fusion, navigation, and measurement, including when appearance, viewpoint, or tissue shape differs. A central challenge is that stronger overlap scores do not always mean anatomically or geometrically correct alignment, so generalization and task-specific evaluation remain important.

Latest papers

CardsList

70 papers9 papers in the last four weeks, down 25% on the four weeks before. 0.1% of all new papers.

  1. Warping Earth Observations for better ice labeling in the Marginal Marginal Ice Zone

    Aug 12, 2026Tom Kelly, Martin S. J. RogersRemote Sensing Image SegmentationCross-Modal Alignment

    British Antarctic Survey, Cambridge

  2. Bridging Severe Cross-Modal Misalignment: End-to-End Visible-Infrared Object Detection via Explicit Feature-Domain Affine Registration

    Aug 11, 2026Qi Ming, Yuyang Wang, Mingjing Zhao +7Multispectral Object DetectionCross-Modal Alignment

    Beijing University of Technology, China · Central South University, China · Beijing Electronics Science & Technology Institute +4

  3. APCReg: Anatomical-Prior-Guided Coarse-to-Fine CBCT--IOS Registration via Multi-View Projection and Reliability-Controlled Residual Correction

    Aug 7, 2026Xincan Zheng, Yaqi Wang, Zhi Li +4Cone-Beam CTMedical Image Registration

    School of Cyberspace Security, Hangzhou Dianzi University, Hangzhou, China · Innovation Center for Electronic Design Automation Technology, Hangzhou Dianzi University, Hangzhou, China · Department of Craniomaxillofacial Surgery, Shanghai Ninth People’s Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China +2

  4. Coarse-to-Fine Registration of Jawbone CT and Intraoral Scan Data Using GeDi and ICP with Pseudo-IOS Ground Truth

    Aug 3, 2026Sho Mitarai, Hikaru Kayo, Hisashi Ozaki +2Medical Image RegistrationPoint Cloud Registration

    School of Human Health Sciences, Graduate School of Medicine, Kyoto University, Kyoto, Japan. · Department of Oral and Maxillofacial Surgery, Rakuwakai Otowa Hospital, Kyoto, Japan.

  5. Cross-Coordinate Correspondence Pruning for Image-to-Point Cloud Registration

    Jul 19, 2026Xin Liu, Rong Qin, Huipeng Lin +5Point Cloud RegistrationCross-Modal Feature Matching

    VCIP & TMCC & DISSec, College of Computer Science, Nankai University, Tianjin, China. · AutoCity (Shenzhen) Autonomous Driving Co., Ltd, Shenzhen, China. · School of Intelligent Science and Technology, University of Science and Technology Beijing, Beijing, China. +4

  6. Image-to-Point Cloud Registration Made Easy with Rectified Flow-based LiDAR Upsampling

    Jul 16, 2026Reon Tabata, Kenji Koide, Shuji Oishi +4Camera-LiDAR FusionPoint Cloud Registration

    Department of Computer Science and Engineering, Toyohashi University of Technology, Toyohashi, Aichi, Japan · National Institute of Advanced Industrial Science and Technology, Tsukuba, Ibaraki, Japan

  7. Reliability-Aware CT-MRI Registration: A Quality Engineering Framework with Stability Analysis and Risk Classification

    Jul 1, 2026Nisreen AlbzourMedical Image RegistrationCross-Modal Image Registration

    School of Systems Science and Industrial Engineering, Binghamton University, Binghamton, NY, USA

  8. RBE-Flow: Recurrent Bayesian Estimation on Feature Manifolds for Cross-Modal Registration

    Jun 29, 2026Mengzhu Ding, Xin Song, Xiaoke Ding +2Optical FlowBayesian Inference

    Northeastern University, China

  9. Projection-based coupling of infrared thermography and stereocorrelation-based digital image correlation

    Jun 27, 2026Jendrik-Alexander Tröger, Lutz Müller-Lohse, Stefan HartmannThermal ImagingCross-Modal Image Registration

    Institute of Applied Mechanics, Clausthal University of Technology, Adolph-Roemer-Straße 2a, 38678 Clausthal-Zellerfeld, Germany

  10. LayersReg: A Layer-by-Layer Progressive Regressor for Reliable Intraoperative 3D/2D Registration

    Jun 25, 2026Xiyuan Wang, Zhenchao Wang, Xinran Chen +3Medical Image RegistrationCross-Modal Image Registration

    School of Biological Science and Medical Engineering Southeast University Nanjing · School of Engineering, College of Engineering and Physical Sciences University of Birmingham Birmingham · State Key Laboratory of Digital Medical Engineering Southeast University Nanjing

  11. Cross-Modality Feature Fusion Based on Structured State Space Duality for Multimodal Image Registration Network

    Jun 2, 2026Zhikang Li, Yan Wu, Xin Hu +2Multi-Scale Feature FusionCross-Modal Feature Matching

    Remote Sensing Image Processing and Fusion Group, School of Electronic Engineering, Xidian University, Xi’an 710071, China · National Key Laboratory of Radar Signal Processing, Xidian University, Xi’an 710071, China

  12. VoxCor: Training-Free Volumetric Features for Multimodal Voxel Correspondence

    May 13, 2026Guney Tombak, Ertunc Erdil, Ender KonukogluMedical Imaging Foundation ModelsCross-Modal Representation Learning

    Biomedical Image Computing Group, ETH Zurich, Zurich, Switzerland · The LOOP Zurich – Medical Research Center, Zurich, Switzerland

  13. Uncertainty-aware Spatial-Frequency Registration and Fusion for Infrared and Visible Images

    May 13, 2026Xingyuan Li, Haoyuan Xu, Xingyue Zhu +4Multi-Source Image FusionInfrared-Visible Image Fusion

    Dalian University of Technology · Northwestern Polytechnical University · Dalian Maritime University

  14. TAR: Text Semantic Assisted Cross-modal Image Registration Framework for Optical and SAR Images

    May 12, 2026Zhuoyu Cai, Dou Quan, Ning Huyan +3Remote SensingSynthetic Aperture Radar

    Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education of China, School of Artificial Intelligence, Xidian University, Xi’an 710071, China

  15. FS-I2P:A Hierarchical Focus-Sweep Registration Network with Dynamically Allocated Depth

    May 8, 2026Zhixin Cheng, Yujia Chen, Xujing Tao +4Cross-Modal AttentionPoint Cloud Registration

    School of Information Science and Technology, University of Science and Technology of China · School of Computer Science and Information Engineering, Hefei University of Technology · National Key Laboratory of Deep Space Exploration, Deep Space Exploration Laboratory +1

  16. Angle-I2P: Angle-Consistent-Aware Hierarchical Attention for Cross-Modality Outlier Rejection

    May 6, 2026Muyao Peng, Shun Zou, Pei An +2Point Cloud RegistrationCross-Modal Feature Matching

    School of Electronic Information and Communications, Huazhong University of Science and Technology

  17. Warm-Started Reinforcement Learning for Iterative 3D/2D Liver Registration

    Apr 11, 2026Hanyuan Zhang, Lucas He, Zijie Cheng +5Medical Image RegistrationCross-Modal Image Registration

    UCL Hawkes Institute, University College London, London, UK · Medtronic plc., London, UK

  18. Are Pretrained Image Matchers Good Enough for SAR-Optical Satellite Registration?

    Apr 11, 2026Isaac Corley, Alex Stoken, Gabriele BertonCross-Modal Image RegistrationCross-Modal Feature Matching

    Taylor Geospatial · Independent Researcher

  19. Particle Diffusion Matching: Random Walk Correspondence Search for the Alignment of Standard and Ultra-Widefield Fundus Images

    Apr 11, 2026Kanggeon Lee, Soochahn Lee, Kyoung Mu LeeMedical Image RegistrationCross-Modal Image Registration

    ASRI, Dept. of ECE, Seoul National University, Korea · School of Electrical Engineering, Kookmin University, Korea

  20. Active Diffusion Matching: Score-based Iterative Alignment of Cross-Modal Retinal Images

    Apr 11, 2026Kanggeon Lee, Su Jeong Song, Soochahn Lee +1Medical Image RegistrationCross-Modal Image Registration

    ASRI, Dept. of ECE, Seoul National University, Korea · Dept. of Ophthalmology, Kangbuk Samsung Hospital, Sungkyunkwan University, Korea · School of Electrical Engineering, Kookmin University, Korea

  21. Search-MIND: Training-Free Multi-Modal Medical Image Registration

    Apr 10, 2026Boya Wang, Ruizhe Li, Chao Chen +1Medical Image RegistrationCross-Modal Image Registration

    Intelligent Modelling & Analysis Group (IMA), School of Computer Science, University of Nottingham, UK · Lab for Uncertainty in Data and Decision Making (LUCID), Nottingham Biomedical Research Centre (BRC), School of Medicine, University of Nottingham, UK

  22. Automatic dental superimposition of 3D intraorals and 2D photographs for human identification

    Apr 7, 2026Antonio D. Villegas-Yeguas, Xavier Abreau-Freire, Guillermo R-García +52D-3D Image RegistrationBiometric Identification

    Department of Computer Science and Artificial Intelligence of the University of Granada (DECSAI), Spain · Panacea Cooperative Research S. Coop., Ponferrada, Spain · Associate Laboratory i4HB - Institute for Health and Bioeconomy, University Institute of Health Sciences (IUCS), CESPU, 4585-116 Gandra, Portugal +7

  23. CRFT: Consistent-Recurrent Feature Flow Transformer for Cross-Modal Image Registration

    Apr 7, 2026Xuecong Liu, Mengzhu Ding, Zixuan Sun +2Cross-Modal Image RegistrationCross-Modal Feature Matching

    Northeastern University, China · National University of Defense Technology, China

  24. SCC-Loc: A Unified Semantic Cascade Consensus Framework for UAV Thermal Geo-Localization

    Apr 3, 2026Xiaoran Zhang, Yu Liu, Jinyu Liang +3Cross-View Geo-LocalizationGNSS-Denied Localization

    College of Systems Engineering, National University of Defense Technology, Changsha 410073, China

  25. Hg-I2P: Bridging Modalities for Generalizable Image-to-Point-Cloud Registration via Heterogeneous Graphs

    Mar 30, 2026Pei An, Junfeng Ding, Jiaqi Yang +32D-3D Image RegistrationPoint Cloud Registration

    Huazhong University of Science and Technology, China · Northwestern Polytechnical University, China · Huazhong Agricultural University, China +1

  26. Adapting Frozen Mono-modal Backbones for Multi-modal Registration via Contrast-Agnostic Instance Optimization

    Mar 27, 2026Yi Zhang, Yidong Zhao, Qian TaoDeformable Image RegistrationCross-Modal Image Registration

    Department of Imaging Physics, Delft University of Technology, The Netherlands

  27. GLASS: Geometry-aware Local Alignment and Structure Synchronization Network for 2D-3D Registration

    Mar 27, 2026Zhixin Cheng, Jiacheng Deng, Xinjun Li +52D-3D Image RegistrationPoint Cloud Registration

    School of Information Science and Technology, University of Science and Technology of China, Hefei 230027, China · Meituan Inc, Beijing 100000, China · Institute of Advanced Technology, University of Science and Technology of China, Hefei 230027, China

  28. Disentangle-then-Align: Non-Iterative Hybrid Multimodal Image Registration via Cross-Scale Feature Disentanglement

    Mar 20, 2026Chunlei Zhang, Jiahao Xia, Yun Xiao +2Cross-Modal Image RegistrationDeformable Image Registration

    Faculty of Engineering and IT, University of Technology Sydney, Australia · School of Artificial Intelligence, Anhui University, Hefei, China · School of Computer Science and Technology, Anhui University, Hefei, China

  29. SegFly: A Dataset and 2D-3D-2D Paradigm for Aerial RGB-Thermal Semantic Segmentation at Scale

    Mar 18, 2026Markus Gross, Sai Bharadhwaj Matha, Rui Song +4Remote Sensing Image SegmentationCross-Modal Image Registration

    Fraunhofer Institute IVI · TU Munich · MCML +2

  30. Effective Feature Learning for 3D Medical Registration via Domain-Specialized DINO Pretraining

    Mar 14, 2026Eytan Kats, Mattias P. HeinrichMedical Image RegistrationDeformable Image Registration

    Institute of Medical Informatics, University of Lübeck, Germany