Cross-Modal Retrieval

Follow this topic Ask about this topic

Momentum

21 papers in the last four weeks, up 250% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 134

All topics

CodeBind: Decoupled Representation Learning for Multimodal Alignment with Unified Compositional Codebook
May 18, 2026Zeyu Chen, Jie Li, Kai HanCross-Modal Learning Multimodal Disentangled Representation Learning
Visual AI Lab, The University of Hong Kong
Brain-to-Image Retrieval and Reconstruction via Multimodal EEG Alignment
May 18, 2026Chi Kit Wong, Yan Liu, Haowen YanEEG-Based Visual Decoding Cross-Modal Alignment
SOLAR: Self-supervised Joint Learning for Symmetric Multimodal Retrieval
May 15, 2026Wenjie Yang, Hang Yu, Yuyu Guo +1Cross-Modal Learning Multimodal IR
Ant Group
GOMA: Toward Structure-Driven Multimodal Alignment from a Graph Signal Smoothing Perspective
May 15, 2026Xu Wang, Xunkai Li, Yinlin Zhu +2Cross-Modal Learning Multimodal IR
School of Airspace Science and Engineering, Shandong University, WeiHai, China · Department of Computer Science, Beijing Institute of Technology, Beijing, China · School of Computer Science and Engineering, Sun Yat-sen University, GuangZhou, China
Differentially Private Motif-Preserving Multi-modal Hashing
May 14, 2026Zehua Cheng, Wei Dai, Jiahao SunCross-Modal Learning Cross-Modal Retrieval
Department of Computer Science University of Oxford Oxford, United Kingdom · FLock.io London, United Kingdom
Neural Visual Decoding via Cognitive guided Adaptive Blurring and Information Constrained Alignment
May 14, 2026Fan Yin, Chuhang Zheng, Peiliang Gong +2EEG-Based Visual Decoding Cross-Modal Alignment
Department of Artificial Intelligence, Nanjing University of Aeronautics and Astronautics, Nanjing, China · Department of Electrical and Information Engineering, Tianjin University, Tianjin, China
Think When Needed: Adaptive Reasoning-Driven Multimodal Embeddings with a Dual-LoRA Architecture
May 14, 2026Longxiang Zhang, Weilong Dai, Guanghao Zhang +2Efficient Multimodal Inference Multimodal Embedding
Alibaba Group
Logit-Attention Divergence: Mitigating Position Bias in Multi-Image Retrieval via Attention-Guided Calibration
May 12, 2026Mingtao Xian, Yifeng Yang, Qinying Gu +2Multimodal Large Language Models Cross-Modal Retrieval
Zhiyuan College, Shanghai Jiao Tong University, Shanghai, China · Shanghai Jiao Tong University, Shanghai, China · Shanghai Artificial Intelligence Laboratory, Shanghai, China +1
MAG-VLAQ: Multi-modal Aerial-Ground Query Aggregation for Cross-View Place Recognition
May 10, 2026Zhengyi Xu, Yuhang Ming, Zhihao Zhan +3Cross-View Geo-Localization Visual Place Recognition
Hangzhou Dianzi University · TopXGun Robotics · University of Zaragoza
Revisiting Uncertainty: On Evidential Learning for Partially Relevant Video Retrieval
May 7, 2026Jun Li, Peifeng Lai, Xuhang Lou +5Cross-Modal Learning Evidential Deep Learning
Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen, China · Peng Cheng Laboratory, Shenzhen, China · Harbin Institute of Technology, Shenzhen, China
T2I-VeRW: Part-level Fine-grained Perception for Text-to-Image Vehicle Retrieval
May 7, 2026Xiao Wang, Ziwen Wang, Weizhe Kong +5Fine-Grained Image Retrieval Cross-Modal Retrieval
Text-to-CAD Retrieval: a Strong Baseline
May 7, 2026Honghu Pan, Zibo Du, Daxiang Liu +2Cross-Modal Retrieval 3D Representation Learning
School of Artificial Intelligence and Robotics, Hunan University · College of Computer Science and Software Engineer, Shenzhen University · Faculty of Science and Technology, University of Macau
ICPR 2026 Competition on Privacy-Preserving Person Re-Identification from Top-View RGB-Depth Camera (TVRID)
May 6, 2026Raphaël Delécluse, Hazem Wannous, Laurent GuimasCross-Modal Retrieval Person Re-Identification
IMT Nord Europe, University of Lille, CNRS UMR 9189 - CRIStal, F-59000 Lille, France · Explain, F-59000 Lille, France
ReasonAudio: A Benchmark for Evaluating Reasoning Beyond Matching in Text-Audio Retrieval
May 5, 2026Honglei Zhang, Yuting Chen, Chenpeng Hu +2Audio Reasoning Audio Understanding
School of Software, Nanjing University Nanjing, China · School of Software, Northwestern Polytechnical University Xi’an, China · College of Computing and Data Science, Nanyang Technological University Singapore, Singapore
Interactive Multi-Turn Retrieval for Health Videos
May 2, 2026Chengzheng Wu, Ke Qiu, Baoming Zhang +3Healthcare Cross-Modal Retrieval
Wuxi Dipont School of Arts and Science · Malou Tech · Chongqing University +2
Multimodal Data Curation Through Ranked Retrieval
May 1, 2026Pratyush Muthukumar, Harshil Kotamreddy, Sarah Amiraslani +4Cross-Modal Learning Cross-Modal Alignment
NVIDIA
Linking spatial biology and clinical histology via Haiku
Apr 30, 2026Yan Cui, Jacob S. Leiby, Wenhui Lei +6Computational Pathology Healthcare
Department of Pathology and Laboratory Medicine, University of Pennsylvania, Philadelphia, PA, USA · Department of Bioengineering, University of Pennsylvania, Philadelphia, PA, USA · Department of Biostatistics, Epidemiology & Informatics, University of Pennsylvania, Philadelphia, PA, USA +1
One Single Hub Text Breaks CLIP: Identifying Vulnerabilities in Cross-Modal Encoders via Hubness
Apr 30, 2026Hiroyuki Deguchi, Katsuki Chousa, Yusuke SakaiCross-Modal Learning Multimodal Robustness
NTT, Inc. · Nara Institute of Science and Technology
Combating Visual Neglect and Semantic Drift in Large Multimodal Models for Enhanced Cross-Modal Retrieval
Apr 28, 2026Guosheng Zhang, Linkai Liu, Keyao Wang +3Multimodal Grounding Cross-Modal Alignment
Baidu Inc.
AnalogRetriever: Learning Cross-Modal Representations for Analog Circuit Retrieval
Apr 25, 2026Yihan Wang, Lei Li, Yao Lai +2Cross-Modal Representation Learning Electronic Design Automation
The University of Hong Kong Hong Kong, China · University of Cambridge Cambridge, United Kingdom · Tsinghua University Beijing, China
Federated Cross-Modal Retrieval with Missing Modalities via Semantic Routing and Adapter Personalization
Apr 24, 2026Hefeng Zhou, Xuan Liu, Sicheng Chen +7Cross-Modal Learning Multimodal Federated Learning
Shanghai Jiao Tong University · Hohai University · Shenzhen Univ of Advanced Technology
Beyond Chain-of-Thought: Rewrite as a Universal Interface for Generative Multimodal Embeddings
Apr 24, 2026Peixi Wu, Ke Mei, Feipeng Ma +15Cross-Modal Alignment Multimodal Embedding
WeChat Vision, Tencent Inc. · Zhejiang University · Tsinghua University +1
MiMIC: Mitigating Visual Modality Collapse in Universal Multimodal Retrieval While Avoiding Semantic Misalignment
Apr 23, 2026Juan Li, Chuanghao Ding, Xujie Zhang +1Cross-Modal Learning Cross-Modal Alignment
State Key Laboratory for Novel Software Technology, Nanjing University
Fast-then-Fine: A Two-Stage Framework with Multi-Granular Representation for Cross-Modal Retrieval in Remote Sensing
Apr 22, 2026Xi Chen, Xu Chen, Xiangyang Jia +3Representation Learning Cross-Modal Alignment
School of Computer Science, Wuhan University, Wuhan, China · Beijing Institute for General Artificial Intelligence (BIGAI), Beijing, China
UniCVR: From Alignment to Reranking for Unified Zero-Shot Composed Visual Retrieval
Apr 22, 2026Haokun Wen, Xuemeng Song, Haoyu Zhang +3Cross-Modal Learning Learning to Rank
Harbin Institute of Technology (Shenzhen) Shenzhen, China · Southern University of Science and Technology Shenzhen, China · Pengcheng Laboratory Shenzhen, China +1
AFMRL: Attribute-Enhanced Fine-Grained Multi-Modal Representation Learning in E-commerce
Apr 22, 2026Biao Zhang, Lixin Chen, Bin Zhang +3Multimodal Large Language Models Cross-Modal Retrieval
Taobao & Tmall Group of Alibaba
Brain-Inspired Capture: Evidence-Driven Neuromimetic Perceptual Simulation for Visual Decoding
Apr 20, 2026Feixue Shao, Guangze Shi, Xueyu Liu +6Representation Learning Brain-Computer Interfaces
School of Mathematics, Taiyuan University of Technology, Shanxi 030024, China · College of Artificial Intelligence, Taiyuan University of Technology, Shanxi 030024, China · National Human Genetics Resource Center, National Research Institute for Family Planning, Beijing 100000, China +1
ReTrack: Evidence-Driven Dual-Stream Directional Anchor Calibration Network for Composed Video Retrieval
Apr 20, 2026Zixu Li, Yupeng Hu, Zhiwei Chen +4Cross-Modal Learning Cross-Modal Representation Learning
School of Software, Shandong University · School of Computer Science and Technology, Shandong Jianzhu University
Bidirectional Small-Granularity Search between Code and Text
Apr 19, 2026Marco A. Valenzuela-Escárcega, Enrique Noriega-Atala, Gus Hahn-Powell +2AI-Assisted Scientific Research Cross-Modal Retrieval
Lex Machina · The University of Arizona, Tucson, AZ, USA
LFRAG: Layout-oriented Fine-grained Retrieval-Augmented Generation on Multimodal Document Understanding
Apr 18, 2026Yifan Zhu, Yu Mi, Yue Lu +2Multimodal RAG Late Interaction Retrieval
Zhejiang University · Hangzhou, China · Institute of Blockchain and Data Security +1

May 18, 2026, cs.CVJ/K move · Enter open · S save

CodeBind: Decoupled Representation Learning for Multimodal Alignment with Unified Compositional Codebook

Zeyu Chen, Jie Li, Kai Han

Visual AI Lab, The University of Hong Kong

Cross-Modal Learning Multimodal Disentangled Representation Learning Cross-Modal Alignment Cross-Modal Retrieval Multimodal Classification Multimodal Learning

Open paper AskPDF arXiv

Multimodal representation alignment is pivotal for large language models and robotics. Traditional methods are often hindered by cross-modal information discrepancies and data scarcity, leading to suboptimal alignment spaces that overlook modality-unique features. We propose CodeBind, a framework that optimizes multimodal representation spaces through a modality-shared-specific codebook design. By incrementally aligning target and bridging modalities, CodeBind bypasses the need for fully paired data. Unlike traditional hard alignment, CodeBind decomposes features into shared components for semantic consistency and specific components for modality-unique details. This design utilizes a compositional vector quantization scheme, where a shared codebook bridges modality gaps and modality-specific codebooks mitigate representation bias by preventing dominant modalities from overshadowing others. Validated across nine modalities (text, image, video, audio, depth, thermal, tactile, 3D point cloud, EEG), CodeBind achieves state-of-the-art performance in multimodal classification and retrieval tasks.

Momentum

Related topics

Latest papers 134