Cross-Modal Feature Matching

Overview

Cross-modal feature matching identifies which regions, points, or tokens in different modalities refer to the same scene element, enabling tasks such as image registration, 2D–3D alignment, retrieval, and sensor localization. Methods commonly learn shared or modality-adapted features using contrastive alignment, cross-attention, transformers, or pretrained vision models, then refine correspondences with geometric constraints, outlier rejection, and coarse-to-fine search. Evaluation spans settings such as RGB–infrared and optical–SAR registration, image-to-point-cloud matching on RGB-D Scenes and 7-Scenes, and camera–LiDAR localization on KITTI. A central challenge is balancing semantic similarity with geometrically valid matches while maintaining robustness across sensor shifts, domains, and deployment constraints.

Latest papers

CardsList

70 papers5 papers in the last four weeks, down 37% on the four weeks before. 0.0% of all new papers.

  1. CUFormer: Modality-Aware CT-Ultrasound Point Cloud Registration for Orthopedic Navigation

    Nov 1, 2026Lixing Tan, Hongye Hao, Tianrun Gu +4Medical Image RegistrationPoint Cloud Registration

  2. ConstraintMatch: Compositional Image-Text Matching through Constrained Regional Evidence Selection

    Oct 31, 2026Yuhong Zhou, Yubo Gao, Xiangbo ShuCompositional Reasoning in VLMsCross-Modal Retrieval

  3. FlexiMIND: Combined Pretrained Vision Features and Local Structure for Training-Free Deformable Medical Image Registration

    Oct 25, 2026Mojtaba Safari, Mingzhe Hu, Shansong Wang +6Medical Image RegistrationDeformable Image Registration

  4. RankAlign: Vision-Language Representation Alignment via Rank Transformation

    Oct 22, 2026Enzhe Zhao, Marco Fiorucci, Lamberto BallanVision-Language AlignmentCross-Modal Feature Matching

  5. Flow-CLIP: Image-Conditioned Residual Scoring for CompositionalImage-Text Matching

    Oct 15, 2026Minghong Wei, Enguang Zhu, Pu Cao +2Vision-Language AlignmentCross-Modal Feature Matching

  6. TartanMatch: Towards Universal Dense Correspondence Across Modalities

    Oct 10, 2026Hyeokjoon Kwon, Jiting Cai, Ruogu Li +7Cross-Modal Feature MatchingUnified Multimodal Models

  7. Structure-Aware Matching for Robust UAV Thermal-to-Satellite Geo-Localization

    Oct 9, 2026Chun Liu, Yuxin Wang, Zhenxiang Huo +3Cross-View Geo-LocalizationCross-Modal Feature Matching

  8. ARCH-B: Architectural Representation, Comprehension and Hierarchy Benchmark

    Sep 28, 2026Kieran Sagar Parikh, Jose Luis Garcia del Castillo y LopezSemantic CorrespondenceCross-Modal Alignment

  9. UNMATCH: Selective Unbalanced Token-Patch Matching for Forensic Image-Claim Verification

    Sep 24, 2026Xinjin Li, Lian Lian, Yuanzhe Yang +6Claim VerificationDigital Image Forensics

  10. GRIP: Gaussian Rendering as a Cross-Modal Bridge for Image-to-Point Cloud Registration

    Sep 22, 2026Karim Slimani, Catherine Achard, Eric Marchand +12D-3D Image RegistrationPoint Cloud Registration

  11. MatcherCompass: A Deployment-Aware Benchmark to Guide Image Matcher Selection in the Wild

    Sep 22, 2026Hyunwoo Kim, Giseop KimImage MatchingCross-Modal Feature Matching

  12. Mask 2D-3D: Adaptive Dual-Masked Autoencoder Network for Image-to-Point Cloud Registration

    Sep 16, 2026Zhixin Cheng, Jiacheng Deng, Xiaotian Yin +3Masked AutoencodersPoint Cloud Registration

  13. Multimodal Floorplan Encoding: Learning Dense Modality-Invariant Representations

    Sep 11, 2026Xavier Anadón, Rémi Pautrat, Rui WangLatent Space AlignmentCross-Modal Representation Learning

  14. Beyond Ambiguous Visual Cues: Studying Physiological Disruptions and Cross-Modal Inconsistencies in Deepfake Videos

    Sep 11, 2026Chenxi Yang, Yassine Ouzar, Larbi BoubchirRemote PhotoplethysmographyDeepfake Detection

  15. RoMa-ΩΩ: What Feed-Forward 3D Models Know About Image Matching

    Sep 8, 2026David Nordström, Xinyue Zhang, Thibaut Loiseau +2Image Matching3D Representation Learning

  16. DXPR: Depth-Based Vision-LiDAR Cross-Modal Place Recognition Using Vision Foundation Models

    Sep 8, 2026Yungsoo Han, Youngseok Jang, Seungwon Roh +2LiDAR Place RecognitionVisual Place Recognition

  17. Radiation, Rotation and Scale Invariant Feature Descriptor for Multimodal Image Matching

    Sep 6, 2026Yuanxin Ye, Tengfeng Tang, Tao Peng +3Cross-Modal Feature MatchingInvariant Representation Learning

  18. CrossFeat: Bridging Imaging Modalities in Feature Descriptor Space

    Aug 31, 2026Paul Schneider, Nazim HaouchineCross-Modal Representation LearningMultimodal Disentangled Representation Learning

  19. Cross-Spectral Dense Correspondence for Multimodal Spectral Medical Imaging

    Aug 28, 2026Eric L. Wisotzky, Jost Triller, Simon W. Härtl +3Image MatchingCross-Modal Feature Matching

  20. MulVec: Fine-Grained Role-Aware Matching for Training-Free Zero-Shot Composed Image Retrieval

    Aug 26, 2026Zihao Zhang, Dayan Wu, Xinze Liu +6Composed Image RetrievalFine-Grained Image Retrieval

  21. Action-Aligned Retrieval with Pairwise Multimodal Reranking for Text-Based Person Anomaly Search

    Aug 24, 2026Thanh-Khoi Nguyen, Thanh-Nhan Vo, Trong-Thuan Nguyen +1Anomaly DetectionCross-Modal Feature Matching

  22. DMM-Align: Closed-Loop Optimization for 2D-3D Registration with Dual-Role Diffusion

    Aug 17, 2026Chongjian Wang, Junjie Gao2D-3D Image RegistrationCross-Modal Image Registration

  23. TeaMatch: Teachable Cross-Modal Representation Learning for 2D-3D Matching

    Aug 10, 2026Chongjian Wang, Junjie GaoCross-Modal Representation LearningImage Matching

  24. SLAP: Selective Local Vision-Language Alignment for Fish Re-Identification via Partial Optimal Transport

    Aug 9, 2026Cigdem Beyan, Tonje Knutsen Sordalen, Kim Tallaksen HalvorsenInverse Optimal TransportAnimal Re-Identification

  25. Face and Voice Cross-modal Association with Learning Convex Feature Embedding

    Jul 30, 2026Taewan Kim, Jiwoo KangCross-Modal Feature Matching

  26. XMatchAD: A Cross-Modal Matching Perspective on Reconstruction-based Anomaly Detection

    Jul 26, 2026Mingxiu Cai, Zhe Zhang, Gaochang Wu +1Industrial Anomaly DetectionAnomaly Localization

  27. Cross-Coordinate Correspondence Pruning for Image-to-Point Cloud Registration

    Jul 19, 2026Xin Liu, Rong Qin, Huipeng Lin +5Point Cloud RegistrationCross-Modal Feature Matching

  28. SUFLECA: Scaling Up Feature Learning for CAD-to-image Alignment

    Jul 16, 2026Saad Ejaz, Miguel Fernandez-Cortizas, Javier Civera +2Object Pose EstimationGeometric Representation Learning