Multimodal Contrastive Learning

Ask about this topic

Momentum

16 papers in the last four weeks, up 45% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 153

All topics
CardsList

  1. Linking spatial biology and clinical histology via Haiku

    Apr 30, 2026Yan Cui, Jacob S. Leiby, Wenhui Lei +6Computational PathologyHealthcare

    Department of Pathology and Laboratory Medicine, University of Pennsylvania, Philadelphia, PA, USA · Department of Bioengineering, University of Pennsylvania, Philadelphia, PA, USA · Department of Biostatistics, Epidemiology & Informatics, University of Pennsylvania, Philadelphia, PA, USA +1

  2. Learning Generalizable Multimodal Representations for Software Vulnerability Detection

    Apr 28, 2026Zeming Dong, Yuejun Guo, Qiang Hu +5Representation LearningSoftware Vulnerability Detection

    University of Luxembourg · 2Luxembourg Institute of Science and Technology · 3Tianjin University

  3. Contrastive Image-Metadata Pre-Training for Materials Transmission Electron Microscopy

    Apr 27, 2026Georgia Channing, Debora Keller, Marta D. Rossell +3Cross-Modal AlignmentMultimodal Contrastive Learning

    Hugging Face · University of Oxford · Empa Dübendorf +1

  4. CLLAP: Contrastive Learning-based LiDAR-Augmented Pretraining for Enhanced Radar-Camera Fusion

    Apr 27, 2026Bingyi Liu, Chuanhui Zhu, Hongfei Xue +5Camera-Radar FusionSelf-Supervised Pre-Training

    Wuhan University of Technology · University of North Carolina at Charlotte · The Hong Kong Polytechnic University +2

  5. Multi-View Synergistic Learning with Vision-Language Adaption for Low-Resource Biomedical Image Classification

    Apr 27, 2026Xiaoliu Luo, Minxue Xiao, Ting Xie +5VLM AdaptationMulti-View Learning

    Chongqing University of Technology · Hebei University of Technology · Nanyang Technological University +3

  6. Robust Audio-Text Retrieval via Cross-Modal Attention and Hybrid Loss

    Apr 25, 2026Meizhu Liu, Matthew Rowe, Amit Agarwal +8Multimodal RobustnessMultimodal Embedding

  7. Contrastive Learning for Multimodal Human Activity Recognition with Limited Labeled Data

    Apr 25, 2026Long Jing, Zhixiong Yang, Yajun Zhang +1Cross-Modal Representation LearningHuman Activity Recognition

    College of Computer Science, Northwest University, Xi’an, China · Xinjiang University, Urumqi, China

  8. CGC: Compositional Grounded Contrast for Fine-Grained Multi-Image Understanding

    Apr 24, 2026Lihao Zheng, Zhenwei Shao, Yu Zhou +5Multimodal GroundingMultimodal Large Language Models

    School of Computer Science and Technology, Hangzhou Dianzi University · Base Model, Li Auto

  9. MoDAl: Self-Supervised Neural Modality Discovery via Decorrelation for Speech Neuroprosthesis

    Apr 22, 2026Yuanhao Chen, Peter ChinBrain-Computer InterfacesNeural Decoding

    Dartmouth College Hanover, NH, USA

  10. AFMRL: Attribute-Enhanced Fine-Grained Multi-Modal Representation Learning in E-commerce

    Apr 22, 2026Biao Zhang, Lixin Chen, Bin Zhang +3Multimodal Large Language ModelsCross-Modal Retrieval

    Taobao & Tmall Group of Alibaba

  11. REVEAL: Multimodal Vision-Language Alignment of Retinal Morphometry and Clinical Risks for Incident AD and Dementia Prediction

    Apr 20, 2026Seowung Leem, Lin Gu, Chenyu You +2Alzheimer's DiseaseMedical Imaging

    J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, United2026 States · Research Institute of Electrical Communication, Tohoku University, Japan · Department of Applied Mathematics & Statistics, Stony Brook University, United StatesApr +1

  12. Handling and Interpreting Missing Modalities in Patient Clinical Trajectories via Autoregressive Sequence Modeling

    Apr 20, 2026Andrew Wang, Ellie Pavlick, Ritambhara SinghMissing-Modality LearningMultimodal Contrastive Learning

    Brown University

  13. Can LLM-Generated Text Empower Surgical Vision-Language Pre-training?

    Apr 20, 2026Chengan Che, Chao Wang, Jiayuan Huang +2Surgical Video UnderstandingMedical VLMs

    Visual Understanding Research Group, Department of Informatics, King’s College London, UK

  14. Better with Less: Tackling Heterogeneous Multi-Modal Image Joint Pretraining via Conditioned and Degraded Masked Autoencoder

    Apr 18, 2026Bowen Peng, Yongxiang Liu, Jie Zhou +4Cross-Modal LearningMasked Autoencoders

    College of Electronic Science and Technology, National University of Defense Technology (NUDT), Changsha 410073, China · Beijing Institute of Remote Sensing Information, Beijing 100192, China

  15. UniCon: Unified Framework for Efficient Contrastive Alignment via Kernels

    Apr 17, 2026Hangke Sui, Yuqing Wang, Minh N DoContrastive LearningCross-Modal Alignment

    Department of Electrical & Computer Engineering, The Grainger College of Engineering, UIUC · Coordinated Science Laboratory, University of Illinois Urbana-Champaign (UIUC) · Siebel School of Computing and Data Science, The Grainger College of Engineering, UIUC +1

  16. Aligning Backchannel and Dialogue Context Representations via Contrastive LLM Fine-Tuning

    Apr 17, 2026Livia Qian, Gabriel SkantzeSpeech Language ModelsMultimodal Contrastive Learning

    Department for Speech, Music and Hearing KTH Royal Institute of Technology, Sweden

  17. Joint-Centric Dual Contrastive Alignment with Structure-Preserving and Information-Balanced Regularization

    Apr 17, 2026Habibeh Naderi, Behrouz Haji Soleimani, Stan MatwinCross-Modal LearningModality Imbalance

    Dalhousie University, Halifax NS, Canada

  18. Crab: Multi Layer Contrastive Supervision to Improve Speech Emotion Recognition Under Both Acted and Natural Speech Condition

    Mar 24, 2026Lucas H. Ueda, João G. T. Lima, Paula D. P. CostaContrastive LearningMultimodal Emotion Recognition

    Dept. of Computer Engineering and Automation (DCA), Faculdade de Engenharia El´etrica e de Computac¸˜ao, and are part of the AI Lab., Recod.ai, Institute of Computing, Universidade Estadual de Campinas, UNICAMP

  19. WikiCLIP: An Efficient Contrastive Baseline for Open-domain Visual Entity Recognition

    Mar 10, 2026Shan Ning, Longtian Qiu, Jiaxuan Sun +1Vision-Language AlignmentMultimodal Contrastive Learning

    ShanghaiTech University, Shanghai, China · Lingang Laboratory, Shanghai, China · Shanghai Engineering Research Center of Intelligent Vision and Imaging

  20. ITO: Multi-View Alignment and Training-Time Fusion for Image-Text Pretraining

    Mar 3, 2026Hanpeng Liu, Zidan Wang, Shuoxi Zhang +6Cross-Modal LearningCross-Modal Alignment

    School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, China · Li Auto Inc.

  21. Re-purposing Multimodal Large Language Models for Audio-Text Retrieval

    Feb 20, 2026Jilan Xu, Carl Thomé, Danijela Horak +2Multimodal Large Language ModelsAudio Understanding

    Visual Geometry Group, University of Oxford · Epidemic Sound · School of Artificial Intelligence, Shanghai Jiao Tong University

  22. Enhancing IMU-Based Online Handwriting Recognition via Contrastive Learning with Zero Inference Overhead

    Feb 4, 2026Jindong Li, Dario Zanca, Vincent Christlein +4Contrastive LearningOnline Handwriting Recognition

    Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany · Munich Center for Machine Learning, Munich, Germany · STABILO International GmbH, Heroldsberg, Germany +2

  23. Cross-Modal Visuo-Tactile Representation Learning with Action Chunking Transformers for Contact-Rich Manipulation

    Jan 31, 2026Yaohua Liu, Rong Fu, Amir H. Gandomi +2Representation LearningCross-Modal Representation Learning

    Chinese Medicine Guangdong Laboratory, Hengqin, Zhuhai 519031, China · Institute of Collaborative Innovation, University of Macau, Macau 999078, China · Faculty of Engineering & IT, University of Technology Sydney, Ultimo, NSW 2007, Australia +3

  24. The Geometric Mechanics of Contrastive Representation Learning: Alignment Potentials, Entropic Dispersion, and Cross-modal Divergence

    Jan 27, 2026Yichao Cai, Zhen Zhang, Yuhang Liu +1Cross-Modal LearningContrastive Learning

    Australian Institute for Machine Learning, Adelaide University · Responsible AI Research Centre

  25. CLIMP: Contrastive Language-Image Mamba Pretraining

    Jan 11, 2026Nimrod Shabtay, Itamar Zimerman, Eli Schwartz +1Cross-Modal LearningVLM Robustness

    Tel-Aviv University · IBM Research

  26. Together, Then Apart: Balancing Alignment and Distinctiveness for Multimodal Survival Analysis

    Nov 22, 2025Wenjing Liu, Qin Ren, Wen Zhang +2Cancer Survival PredictionSurvival Analysis

    Stony Brook University, Stony Brook, NY, USA · Johns Hopkins University, Baltimore, MD, USA · Brookhaven National Laboratory, Upton, NY, USA

  27. Revisiting Audio-language Pretraining for Learning General-purpose Audio Representation

    Nov 20, 2025Wei-Cheng Tseng, Xuanru Zhou, Mingyue Huo +3Audio-Language Model EvaluationAudio Representation Learning

    University of Texas at Austin · Tencent AI Lab Seattle · Zhejiang University +1

  28. Contrastive vision-language learning with paraphrasing and negation

    Nov 20, 2025Kwun Ho Ngan, Saman Sadeghi Afgeh, Joe Townsend +1VLM RobustnessVLM Reasoning

    Fujitsu Research of Europe · United Kingdom · City St George’s, University of London

  29. Theoretical Refinement of CLIP by Utilizing Linear Structure of Optimal Similarity

    Oct 17, 2025Naoki Yoshida, Satoshi Hayakawa, Yuhta Takida +3Cross-Modal LearningKernel Mean Embeddings

    The University of Tokyo · Sony Group Corporation · Sony AI

  30. Multimodal Representation Alignment for Cross-modal Information Retrieval

    Jun 10, 2025Fan Xu, Luis A. LeivaCross-Modal LearningMultimodal IR

    aDepartment of Computer Science, University of Luxembourg, 6, avenue de la Fonte, Esch-sur-Alzette, L-4364, Luxembourg