Overview

Cross-modal retrieval studies how to find relevant items when a query and its targets use different modalities, such as searching videos with text or matching brain signals to images. A common approach trains modality-specific encoders to map data into a shared space using contrastive learning, while other methods align local regions, frames, or tokens for finer matches. Systems also use query-aware fusion, candidate reranking, reasoning, or compact hashing to handle complex searches and large collections. A central challenge is balancing scalable global similarity with compositional detail and robustness to noisy, missing, or mismatched modalities; benchmarks increasingly test these harder settings.

Latest papers

CardsList

199 papers17 papers in the last four weeks, down 35% on the four weeks before. 0.1% of all new papers.

  1. When Does Reusing Layers Help Multimodal Embeddings?

    Nov 15, 2026Zhizhang Hu, Yue ZhangMultimodal EmbeddingRecurrent Transformers

  2. Few-Shot Cross-Subject Neural--Image Retrieval via Stimulus-Anchored Latent Bias Calibration

    Nov 12, 2026Xizhang Yao, Li Zhang, Gan Huang +1Cross-Modal RetrievalDistribution Shift

  3. DuoJEPA: Cross-Modal Translation Between Unaligned Self-Supervised Embedding Spaces

    Nov 11, 2026Mahmut S. Gokmen, Mitchell A. Klusty, Evan W. Damron +3Multimodal SSLCross-Modal Alignment

  4. OpticalRAG: Pixel-Space Compression for Token-Efficient Retrieval-Augmented Generation

    Nov 10, 2026Senhao Liu, Yuheng Zhang, Chunyu Wei +2RAG Context CompressionMultimodal RAG

  5. REFORM-3D: A Representation-Centric Evaluation Framework for 3D Medical Vision Foundation Models

    Nov 6, 2026Maregu Assefa, Muzammal Naseer, Divya Velayudhan +2Medical Imaging Foundation ModelsMedical Image Representation Learning

  6. CAPE-JEPA - Cross-modal Adversarial Probabilistic Embedding JEPA

    Nov 4, 2026Aniket Junghare, Biplab BanerjeeCross-Modal Representation LearningCross-Modal Retrieval

  7. Semantic Prior-Guided Incomplete Cross-Modal Retrieval with Noisy Labels

    Nov 4, 2026Jiali Chen, Ruitao Pu, Yingke Chen +1Cross-Modal RetrievalMissing-Modality Learning

  8. Fuse To Align: Multimodal Representation Learning for Retrieval via Hypergraph Regularization

    Nov 2, 2026Anindya Nag, Ambuj Mehrish, Sebastiano VasconCross-Modal Representation LearningCross-Modal Retrieval

  9. ConstraintMatch: Compositional Image-Text Matching through Constrained Regional Evidence Selection

    Oct 31, 2026Yuhong Zhou, Yubo Gao, Xiangbo ShuCompositional Reasoning in VLMsCross-Modal Retrieval

  10. CrossWeave: Cross-Modal Scene and Instance Retrieval from Sparse 2D-3D Alignment

    Oct 29, 2026Aadith Warrier, Gnana Prakash Punnavajhala, Siddharth Tourani +3Cross-Modal RetrievalCross-Modal Alignment

  11. When Fusion Order Matters: Insights on Progressive Multimodal Representation Learning for Cross-modal Retrieval

    Oct 26, 2026Haoxiang Zhao, Bin Wang, Yaofei Wang +3Multimodal FusionCross-Modal Retrieval

  12. Multimodal Requirements Traceability Link Recovery in Industrial Settings

    Oct 25, 2026Haoming Huang, Shinpei Hayashi, Kazuya Kohata +2Requirements EngineeringMultimodal RAG

  13. Whispers from the Neighbors: Rethinking Caption Consensus as Inference-Time Evidence for Vision-Language Retrieval

    Oct 24, 2026Khang Nhat Hoang Vo, Belal Shoer, Abhirama Subramanyam PenamakuriVision-Language RetrievalCross-Modal Retrieval

  14. Closing the Modality Gap via Simplex-Constrained Representations

    Oct 23, 2026Shubham Gupta, Siva Reddy, Perouz Taslakian +2Modality Gap in VLMsCross-Modal Alignment

  15. Beyond Post-Hoc Rewards: Privileged Reasoning Exploration for Multimodal Embeddings

    Oct 23, 2026Tianyu Yang, Yijun Tian, Lars Benedikt Kaesberg +4Multimodal EmbeddingCross-Modal Retrieval

  16. GeoLEON-CLIP: Graph-Anchored Multimodal Contrastive Learning for Geographic Region Representation

    Oct 23, 2026Radoslaw Malek, Szymon Soltysiak, Aleksandra Kawala-Sterniuk +1Geospatial Representation LearningMultimodal Contrastive Learning

  17. Cascaded Retrieval with Cross-Modal Query Refinement for Efficient Visual Document Search

    Oct 14, 2026Diana Turmakhan, Aseem Srivastava, Vivek Gupta +2Information RetrievalVisual Document Retrieval

  18. What Really Works for Universal Multimodal Embeddings? A Controlled Study of Contrastive Training Strategies

    Oct 10, 2026Duo Li, Haojun Pan, Zuhao Yang +4Multimodal EmbeddingMultimodal Contrastive Learning

  19. EarthAlign: Learning Language-Aligned Representations of Earth System Data

    Oct 10, 2026Fadillah Adamsyah Maani, Numan Saeed, Jiaqi Ma +4Cross-Modal Representation LearningMultimodal Embedding

  20. ROSETTA: Rotation Subspace Estimation for Training-free Transmodal Alignment

    Oct 9, 2026Alex Junho LeeCross-Modal AlignmentLatent Space Alignment

  21. AuraLuxMuse: Adaptive Fusion Modeling for Aesthetic Stage Lighting Design with Music and Expert Guidance

    Oct 8, 2026Junyu Deng, Jiale Cao, Mengtian Li +5Audio-Visual AlignmentCross-Modal Retrieval

  22. Autoregressive Retriever: Improving Query Understanding from Item Feedback for Universal Multimodal Retrieval

    Oct 8, 2026Jianfei Zhao, Yifan Wang, Feng Zhang +7Information RetrievalCross-Modal Retrieval

  23. PathLang: A Language-Centered Benchmark for Vision-Language Models in Computational Pathology

    Oct 8, 2026Fanqi Cheng, Kuo Gong, Shangke Liu +15VLM EvaluationMedical VLMs

  24. A Strong Baseline for Evaluating Vision Encoders in Multimodal Large Language Models

    Oct 4, 2026Yilin Yang, Jun-Tao Tang, Kengyi Wang +3VLM EvaluationMultimodal Large Language Models

  25. Cross-Modal Contrastive Learning for the Retrieval of Immunotherapy-Associated Molecular Signatures from Histopathology

    Oct 4, 2026Sigrid Vila-Bagaria, Mar Teixidó, Miquel Piñol +3Computational PathologyCross-Modal Retrieval

  26. Omni-Embed-Mini: Binding Modalities Without Forgetting via Dense Distillation

    Oct 1, 2026Mohammed Irfan Kurpath, Jaseel Muhammad Kaithakkodan, Sahal Shaji Mullappilly +2Cross-Modal Knowledge DistillationMultimodal Embedding