Cross-Modal Image Registration

Ask about this topic

Overview

Cross-modal image registration estimates how images from different sources—such as MRI and CT, infrared and visible light, or cameras and point clouds—overlap in space. Methods range from mutual-information and anatomical-feature matching to learned shared representations, coarse-to-fine correspondence networks, and geometry- or uncertainty-aware optimization; they may estimate rigid poses, local deformations, or both. The goal is to transfer information reliably across modalities for tasks such as image fusion, navigation, and measurement, including when appearance, viewpoint, or tissue shape differs. A central challenge is that stronger overlap scores do not always mean anatomically or geometrically correct alignment, so generalization and task-specific evaluation remain important.

Latest papers

CardsList

70 papers9 papers in the last four weeks, down 25% on the four weeks before. 0.1% of all new papers.

  1. TriDifNet: A Unified Three-Task Diffusion Network for End-to-End RGB-T Perception

    Oct 27, 2026Qianchao He, Jing Liu, Yunhao Li +1Object DetectionInfrared-Visible Image Fusion

    School of Automation Science and Engineering, Faculty of Electronic and Information Engineering, Xi’an Jiaotong University, Xi’an 710049, China · School of Electrical and Control Engineering, Xi’an University of Science and Technology, Xi’an 710054, China

  2. SeeRF: Learning to See Beyond Fields of View via Generative Image Registration and Fusion

    Oct 26, 2026Xunpeng Yi, Yibing Zhang, Qinglong Yan +3Multi-Source Image FusionCross-Modal Image Registration

    Electronic Information School, Wuhan University, Wuhan 430072, China · School of Automation, Southeast University, Nanjing 210096, China · Electronic Information School and the School of Robotics, Wuhan University, Wuhan, 430072

  3. FlexiMIND: Combined Pretrained Vision Features and Local Structure for Training-Free Deformable Medical Image Registration

    Oct 25, 2026Mojtaba Safari, Mingzhe Hu, Shansong Wang +6Medical Image RegistrationDeformable Image Registration

    Department of Radiation and Cellular Oncology, The University of Chicago, Chicago, IL, United States. · Department of Computer Science and Informatics, Emory University, Atlanta, GA, United States. · Department of Radiology, The University of Chicago, Chicago, IL, United States.

  4. SAR2Net: Learning Spatially Anchored Representations for Retrieval-Guided Cross-Stain Alignment

    Oct 19, 2026Tianle Shen, Fang Yan, Xiaofan ZhangMedical Image RegistrationWhole-Slide Image Analysis

    Shanghai Jiao Tong University · Shanghai Artificial Intelligence Laboratory

  5. X-Splat: Unified Gaussian Splatting for Joint RGB and X-ray 3D Reconstruction

    Oct 16, 2026Wangze Xu, Chu Zhou, Mae Yamaguchi +43D Reconstruction3D Gaussian Splatting

    The University of Tokyo, Japan · National Institute of Informatics, Japan · Shibaura Institute of Technology, Japan

  6. PET Quantification-Preserving Registration for Longitudinal Whole-Body PSMA PET/CT

    Oct 15, 2026Fryderyk Kögl, Anna Reithmeir, Daniel M. Lang +3Medical Image RegistrationDeformable Image Registration

    Helmholtz Munich · Technical University of Munich · Munich Center for Machine Learning +2

  7. A3^3PreCore: Robust Rigid Registration for Native FLAIR-Space Brain-Mask Transfer

    Oct 14, 2026Elmira Mirzabeigi, Zahra Khalilzad, Taylor Snowden-Richardson +4Medical Image Quality AssessmentMedical Image Registration

    Faubert Laboratory, School of Optometry, Université de Montréal, 3744 Jean-Brillant, Montréal, Québec H3T 1P1, Canada · Department of Psychology, University of Victoria, 3800 Finnerty Road, Victoria, British Columbia V8P 5C2, Canada · Division of Medical Sciences, University of Victoria, 3800 Finnerty Road, Victoria, British Columbia V8P 5C2, Canada

  8. Multimodal Remote Sensing Image Registration: A Comprehensive Review, Challenges and Prospects

    Oct 8, 2026Zhiqiang Han, Yuanxin Ye, Qiuyun Wu +3Cross-Modal Image RegistrationRemote Sensing

    Faculty of Geosciences and Engineering, Southwest Jiaotong University. Chengdu, 611756, China. · Yunnan Key Laboratory of Quantitative Remote Sensing / Yunnan International Joint Laboratory for Integrated Sky-Ground Intelligent Monitoring of Mountain Hazards, Faculty of Land Resources Engineering, Kunming University of Science and Technology. Kunming, 650093, China. · School of Software Engineering, Beijing Jiaotong University. Beijing, 100044, China.

  9. Deformable CT-US Registration via Anatomy-Aware Implicit Neural Representations

    Oct 6, 2026Agnieszka Lach, Magdalena Wysocki, Feng Li +7Medical Image RegistrationUltrasound Imaging

    medPhoton GmbH, Salzburg, Austria · Computer Aided Medical Procedures, Technical University of Munich, Munich, Germany

  10. Geometry-Aligned Semantic Matching for Cross-Modal Planar Image Registration

    Oct 2, 2026Zhiwei Wang, Defeng He, Yuxing Li +2Image MatchingCross-Modal Image Registration

  11. OCA: ODE-Driven Cross-Attention for Image-to-Point-Cloud Registration

    Sep 29, 2026Pei An, Jiaqi Yang, Yulong Wang +2Cross-AttentionPoint Cloud Registration

    Huazhong University of Science and Technology, China · Northwestern Polytechnical University, China · Huazhong Agricultural University, China +2

  12. SAGE: Source-Anchored Guidance via Frequency Equalization for Hierarchical RGB-T Alignment and Fusion

    Sep 25, 2026Timing Li, Yiming Sun, Boan Tao +3Multi-Source Image FusionInfrared-Visible Image Fusion

  13. Diff-RF: Mutually Reinforced Image Registration and Fusion via Degradation-Aware Learning

    Sep 23, 2026Xunpeng Yi, Zaixi Du, Qinglong Yan +3Multi-Source Image FusionCross-Modal Image Registration

    Electronic Information School, Wuhan University, Wuhan 430072, China

  14. ZIL: Zero-shot Image-to-LiDAR Registration

    Sep 19, 2026Zijun Li, Xiaotian Sun, Xuelun Shen +6Cross-Modal Image RegistrationCamera-LiDAR Fusion

    Xiamen University · Meta

  15. XCalib Depth-Guided Geometric Optimization for Dense Thermal-Visible Video Registration

    Sep 18, 2026Aurelien Godet, Gabriel Jobert, Mauro Dalla MuraCross-Modal Image Registration

    Univ. Grenoble Alpes, CNRS, Grenoble INP–UGA, GIPSA-lab, 38000 Grenoble, France · Lynred, 364 Avenue de Valence, 38113 Veurey-Voroize, France · Institut Universitaire de France (IUF), France

  16. BINDER: A Latent Variable Model for Probabilistic Medical Image Registration

    Sep 17, 2026Stefano Cerri, Amirhossein Hassankhani, Yaël Balbastre +1Medical Image RegistrationCross-Modal Image Registration

    Copenhagen Research Centre for Biological and Precision Psychiatry, Mental Health Centre Copenhagen, Copenhagen University Hospital, Denmark, and the Pioneer Centre for Artificial Intelligence, University of Copenhagen, Denmark · Department of Neuroscience and Biomedical Engineering, Aalto University, Finland · Department of Experimental Psychology, Division of Psychology and Language Sciences, University College London +1

  17. Mask 2D-3D: Adaptive Dual-Masked Autoencoder Network for Image-to-Point Cloud Registration

    Sep 16, 2026Zhixin Cheng, Jiacheng Deng, Xiaotian Yin +3Masked AutoencodersPoint Cloud Registration

    School of Computer Science and Technology, Hefei University of Technology, Hefei 230601, China · School of Information Science and Technology, University of Science and Technology of China, Hefei 230027, China · Institute of Advanced Technology, University of Science and Technology of China, Hefei 230027, China

  18. Multi-Session Multimodal Underwater Mapping with Acoustic and Optical Imaging

    Sep 15, 2026Precious Philip-Ifabiyi, Valerio Franchi, Fausto Ferreira +1Factor Graph OptimizationCross-Modal Image Registration

    Computer Vision and Robotics Research Institute (ViCOROB), University of Girona, Campus Montilivi, Edifici P4, Girona, 17003, Catalonia, Spain · University of Zagreb Faculty of Electrical Engineering and Computing, Zagreb, Croatia · University of Zagreb Faculty of Electrical Engineering and Computing, Laboratory for Underwater Systems and Technologies (LABUST), Zagreb, Croatia +1

  19. Benchmarking Intra-Patient 3D Deformable Multimodal Image Registration

    Sep 14, 2026Matteo Barbieri, Giammarco La Barbera, Juan Pablo De La Plata +3Medical Image RegistrationCross-Modal Image Registration

    IMAG2, Institut IMAGINE, Université Paris Cité, Paris, France · Replico SAS, Paris, France · Université Paris Cité, Department of Pediatric Surgery, Hôpital Necker Enfants-Malades, Assistance Publique–Hôpitaux de Paris (AP-HP), Paris, France +2

  20. DRS-VPT: Directly Relocalizing in a Scan with Vision Point Transformers

    Sep 11, 2026Lanke Frank Tarimo Fu, Maurice Fallon3D ViTsCamera Pose Estimation

    University of Oxford, Oxford OX2 6NN, United Kingdom

  21. Aligned Radiometric RGB-Thermal Fusion for UAV Facade Anomaly Screening

    Sep 11, 2026Yuan Yang, Shulei Li, Haobo LiangThermal ImagingInfrared-Visible Image Fusion

    Hong Kong Center for Construction Robotics, Hong Kong SAR, China

  22. Evaluation Principles for MRI-MRA Registration in Trigeminal Neuralgia: An ROI-Centered Neurovascular Benchmark

    Sep 8, 2026Xupeng Zhang, Xihang Wang, Michael Xie +6Medical Image RegistrationNeuroimaging

    Department of Electrical and Computer Engineering and Data Science and AI Institute, Johns Hopkins University, Baltimore, MD 21218, USA · Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, MD 21287, USA · Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD 21287, USA

  23. Accurate Reconstruction of Gas Turbine Blade Geometry Using 3D/2D Rigid Registration and CT View Optimization

    Sep 1, 2026Hristo Valtchanov, Nicolas Piché, Vladimir Brailovski +32D-3D Image RegistrationIndustrial Inspection

    1École Polytechnique de Montréal, Montréal, QC, Canada · 2Object Research Systems Inc., Montréal, QC, Canada · 3École de technologie supérieure, Montréal, QC, Canada +1

  24. DPA-I2P: Depth-Guided Projective Alignment for Image-to-Point-Cloud Registration in Autonomous Driving

    Aug 27, 2026Wenxin Zhang, Hang Li, Zhiwei Xu +3Point Cloud RegistrationCross-Modal Image Registration

    Nankai University, Tianjin, China · Haihe Lab of ITAI, Tianjin 300459, China

  25. Geometry-Driven Opti-Acoustic Co-Registration and View-Invariant Reflectivity Mapping for Side-Scan Sonar

    Aug 24, 2026Taqi Hamoda, Nuno GraciasCross-Modal Image RegistrationUnderwater Imaging

    Computer Vision and Robotics Research Institute (ViCOROB) of the University of Girona, Spain

  26. XRF-to-Optical Field-of-View Localization with Vision Language Models

    Aug 18, 2026Xiangyu Yin, Tatjana Paunesku, Letonia Copeland-Hardin +7Cross-Modal Image RegistrationMicroscopy Image Analysis

    Advanced Photon Source, Argonne National Laboratory, Lemont, Illinois, USA · Northwestern University, Chicago, Illinois, USA · University of Chicago, Chicago, Illinois, USA +1

  27. Acquisition Geometry-Assisted Whole-Group Localization of X-ray Fluorescence Maps in Optical Microscopy Images

    Aug 18, 2026Xiangyu Yin, Tatjana Paunesku, Letonia Copeland-Hardin +7Microscopy Image AnalysisCross-Modal Image Registration

    Advanced Photon Source, Argonne National Laboratory, Lemont, Illinois, USA · Northwestern University, Chicago, Illinois, USA · University of Chicago, Chicago, Illinois, USA +1

  28. DMM-Align: Closed-Loop Optimization for 2D-3D Registration with Dual-Role Diffusion

    Aug 17, 2026Chongjian Wang, Junjie Gao2D-3D Image RegistrationCross-Modal Image Registration

    Shandong Women’s University Jinan, China · Shandong University of Science and Technology Qingdao, China

  29. GeoPose: Patient-agnostic CTA-to-DSA registration through projection-space calibration

    Aug 17, 2026Rudolf L. M. van Herten, Robert Graf, Paula Feldman +1Medical Image Registration2D-3D Image Registration

    Weill Cornell Medicine, Cornell Tech New York, NY 10044 · Technical University of Munich 81675 Munich

  30. Modality-Invariant Coarse-to-Fine Retinal Image Registration

    Aug 14, 2026Bo Wen, Nehal Nailesh Mehta, Melanie Tran +3Medical Image RegistrationCross-Modal Image Registration