Multimodal Embeddings

Ask about this topic

Momentum

9 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 45

All topics
CardsList

  1. Omni-Embed-Mini: Binding Modalities Without Forgetting via Dense Distillation

    Oct 1, 2026Mohammed Irfan Kurpath, Jaseel Muhammad Kaithakkodan, Sahal Shaji Mullappilly +2Multimodal EmbeddingsOmni-Modal

    Mohamed Bin Zayed University of Artificial Intelligence (MBZUAI)

  2. ResComEmb: Effective and Efficient Multimodal Embedding via Residual Homogeneity Compression

    Sep 29, 2026Zijing Cai, Yuzhe Wang, Jingxian Zhu +2Multimodal EmbeddingsTask-Aware Compression

    University of Science and Technology of China · Hefei University of Technology · National University of Singapore

  3. Learning Multimodal Embeddings with Evidence-Aligned Readout

    Sep 27, 2026Zirong Chen, Fuda Ye, Enjun Du +8Multimodal EmbeddingsMultimodal Large Language Models

    The Hong Kong University of Science and Technology (Guangzhou) · Tencent Yuanbao · Tsinghua University +3

  4. VaME: Exploring Variational Latent Reasoning for Multimodal Embeddings

    Sep 27, 2026Peixi Wu, Mingzhou Jiang, Feipeng Ma +11Multimodal EmbeddingsMultimodal Retrieval

    University of Science and Technology of China · Tsinghua University · Kuaishou +1

  5. Ovis-Embedding: Pushing the Frontiers of Universal Omni-Modal Embeddings

    Sep 21, 2026Ovis-Embedding TeamMultimodal EmbeddingsOmni-Modal

    Alibaba Token Hub, Alibaba Group

  6. Multi-modal Knowledge Preserving Adapter for Embedding Backward Compatibility

    Sep 15, 2026Jaeseok Byun, Gukyeong Kwon, Han-Kai Hsu +4Multimodal EmbeddingsLarge Language Model Adaptation

    1Seoul National University, South Korea · 2Amazon AGI, USA

  7. Reason What Matters: Retrieval-Grounded Reasoning for Universal Multimodal Embeddings

    Sep 14, 2026Mingzhou Jiang, Peixi Wu, Hang Cheng +7Multimodal EmbeddingsMultimodal Reasoning

    Tsinghua Shenzhen International Graduate School, Tsinghua University · School of Artificial Intelligence and Data Science, USTC · Kuaishou Technology +1

  8. PACE: Progressive Angular-to-Norm Contrastive Embedding

    Sep 14, 2026Yanping Li, Wei Zhou, Yawen Liu +7Multimodal EmbeddingsContrastive Learning

    The Hong Kong University of Science and Technology · Alibaba Group · Huazhong University of Science and Technology +1

  9. MoEMB: Scaling Universal Multimodal Embeddings with Efficient Mixture-of-Experts Models

    Sep 8, 2026Xuanming Cui, Shlok Kumar Mishra, Wentao Bao +6Multimodal EmbeddingsMixture-Of-Experts

    University of Central Florida · Work done at Meta · AI at Meta

  10. GEM: A Generative Embedding Model Bridging Reasoning and Retrieval

    Aug 13, 2026Zhili Shen, Craig MacdonaldMultimodal Embeddings

    University of Glasgow

  11. Can Frontier LLMs Match Natively Multimodal Embeddings? A Comparison on Hard-Negative Text-to-Image Retrieval

    Aug 11, 2026Archan Dutta, Vyanktesh KanungoMultimodal EmbeddingsMultimodal Retrieval

    Westcliff University

  12. Steering dense music retrieval with open-vocabulary concept discovery

    Aug 9, 2026Julien Guinot, Alain Riou, Elio Quinton +1Music Structure AnalysisRetrieval Layer

    Music & Audio Machine Learning Lab, Universal Music Group, London, U.K. · Centre for Digital Music, Queen Mary University of London, U.K.

  13. Geo-Embed: Towards Unified Multimodal Embeddings for Urban Understanding

    Aug 4, 2026Jiapeng Li, Yong Li, Junjie Zhou +2Multimodal EmbeddingsGeogs-Slam

    1Peking University · 2Beijing University of Posts and Telecommunications

  14. UEmbed: Unified Sparse and Dense Multimodal Embeddings

    Aug 3, 2026Tingyu Song, Mingxin Li, Yanzhao Zhang +5Multimodal EmbeddingsEmbedder

    CASIA · University of Chinese Academy of Sciences · Alibaba Group +1

  15. Douyin Multimodal Embedding Model Technical Report

    Aug 3, 2026Haonan Chen, Chu Li, Zhicheng Wang +4Multimodal EmbeddingsMultimodal Large Language Models

    ByteDance Douyin Search Multimodal Team · Renmin University of China GSAI

  16. Illuminating Visual Identity in Universal Multimodal Embeddings

    Aug 3, 2026Jiawei Cao, Junyi Feng, Jiashen Hua +5Multimodal Embeddings

    Shanghai Jiao Tong University · Alibaba Group

  17. PaletteID: Prototype-Composed Semantic Identifiers for Multimodal CTR Prediction

    Jul 31, 2026Huanyu Liu, Baining Chen, Hui Liu +2Multimodal Recommendation ModelMultimodal Embeddings

    Huazhong University of Science and Technology Wuhan, Hubei, China · Central China Normal University Wuhan, Hubei, China

  18. ReLoop-UME: Recurrent Depth with Learnable Retrieval Registers for Universal Multimodal Embedding

    Jul 30, 2026Shijie Wang, Xiangzhao Hao, Yueti Li +3Multimodal EmbeddingsMultimodal Understanding

    Institute of Automation, Chinese Academy of Sciences, Beijing, China · Tsinghua University, Beijing, China · AI Platform, evermind

  19. Toward Generalizable Cognitive Impairment Detection with Speech-Based Multimodal Large Language Models

    Jul 23, 2026Yingchao Huang, Xin Wang, Yuhan Su +1Mild Cognitive ImpairmentAlzheimer

    Faculty of Digital Innovation, Arts & Sciences, Saskatchewan Polytechnic, Regina SK S4S 5X1, Canada · School of Basic Medical Sciences, Hebei University, Baoding 071000, China · Department of Civil & Environmental Engineering and School of Mining & Petroleum Engineering, University of Alberta, Edmonton AB T6G 2H5, Canada

  20. Fusion Embedding: A Unified Embedding Space for Text, Image, Video, and Audio

    Jul 21, 2026Abdul Basit Tonmoy, Kazi Fardinul Hoque, Md. Shahrier Islam Arham +1Text-To-AudioMultimodal Embeddings

    1Eximius Labs · 2Wabash College · 3Skop Intelligence Co.

  21. TabPFN beyond Tabular Data: Calibration and Accuracy on Multimodal Embeddings

    Jul 13, 2026Jingxiang Zhang, Lujia Zhong, Zijie Zhu +2Multimodal ClassificationMultimodal Embeddings

    University of Southern California

  22. CMDR: Contextual Multimodal Document Retrieval

    Jul 7, 2026Ryota Tanaka, Taku Hasegawa, Kyosuke NishidaMultimodal RetrievalMultimodal Embeddings

    Human Informatics Labs., NTT, Inc., Tokyo, Japan

  23. MKGR: Multimodal Knowledge-Graph Representation Learning for Cold-Start Protein-Protein Interaction Prediction

    Jul 2, 2026Wenbo ZhangBiomedical Knowledge GraphKnowledge Graph Embeddings

    College of Computer and Information Science, Southwest University, Chongqing, Chongqing, China

  24. Forewarned is Forearmed: When Non-Sequential Embedding Turns Into an Anomaly Detector

    Jun 29, 2026Elys Allesiardo, Antoine Caubrière, Valentin VielzeufMultimodal EmbeddingsMultimodal Representations

    Orange Research 4 Rue du Clos Courtel, 35510 Cesson-Sévigné, France

  25. LaME: Learning to Think in Latent Space for Multimodal Embedding via Information Bottleneck

    Jun 11, 2026Peixi Wu, Biao Yang, Feipeng Ma +7Multimodal EmbeddingsEfficient Latent Reasoning

    University of Science and Technology of China · 2Kuaishou Technology · 3Zhejiang University +1

  26. MMLongEmbed: Benchmarking Multimodal Embedding Models in Long-Context Scenarios

    Jun 5, 2026Haitian Wang, Ruoxi Sun, Quantong Qiu +5Multimodal EmbeddingsQuestion-Answering Benchmarks

    Soochow University, Suzhou, China · Ant Group, Beijing, China

  27. CCS: Clinical Consensus Selection for Radiology Report Generation

    May 28, 2026Xi Zhang, Yingshu Li, Zaiqiao Meng +2Radiology Report GenerationReport

    School of Computing Science, University of Glasgow · School of Electrical and Computer Engineering, University of Sydney · Language Technology Lab, University of Cambridge

  28. Gemini Embedding 2: A Native Multimodal Embedding Model from Gemini

    May 26, 2026Madhuri Shanbhogue, Zhe Li, Shanfeng Zhang +86Multimodal EmbeddingsMultimodal Retrieval

  29. Contrast to Detect: Dynamic Graph Contrastive Regularization for Unsupervised Anomaly Detection in Multivariate Time Series

    May 22, 2026Yunhua Pei, Zixing Song, Jin Zheng +1Time-Series Anomaly DetectionGraph Anomaly Detection

    School of Computer Science, University of Bristol, Bristol, UK · School of Engineering Mathematics, University of Bristol, Bristol, UK

  30. Conceptualizing Embeddings: Sparse Disentanglement for Vision-Language Models

    May 21, 2026Piotr Kubaty, Patryk Marszałek, Łukasz Struski +3Multimodal Embeddings

    Faculty of Mathematics and Computer Science, Jagiellonian University, Kraków, Poland · Doctoral School of Exact and Natural Sciences, Jagiellonian University, Kraków, Poland

  31. TTE-Flash: Accelerating Reasoning-based Multimodal Representations via Think-Then-Embed Tokens

    May 15, 2026Jianpeng Cheng, Xian Wu, Jiangfan Zhang +10Multimodal EmbeddingsCompact Latent Sensor Tokens

    1Meta AI

  32. Think When Needed: Adaptive Reasoning-Driven Multimodal Embeddings with a Dual-LoRA Architecture

    May 14, 2026Longxiang Zhang, Weilong Dai, Guanghao Zhang +2Multimodal EmbeddingsInference Cost

    Alibaba Group

  33. Uncovering Trajectory and Topological Signatures in Multimodal Pediatric Sleep Embeddings

    May 13, 2026Scott Ye, Harlin LeeSleepMultimodal Embeddings

    Department of Radiology, University of California, San Francisco · School of Data Science and Society, University of North Carolina at Chapel Hill

  34. Fashion130K: An E-commerce Fashion Dataset for Outfit Generation with Unified Multi-modal Condition

    May 11, 2026Yu He, Ting Zhu, Yichun Liu +6GarmentsMultimodal Generation

  35. jina-embeddings-v5-omni: Geometry-preserving Embeddings via Locked Aligned Towers

    May 8, 2026Florian Hönicke, Michael Günther, Andreas Koukounas +4Multimodal EmbeddingsModality-Specific Encoders

    Jina by Elastic

  36. Multimodal Data Curation Through Ranked Retrieval

    May 1, 2026Pratyush Muthukumar, Harshil Kotamreddy, Sarah Amiraslani +4Multimodal EmbeddingsCross-Modal

    NVIDIA

  37. RADIO-ViPE: Online Tightly Coupled Multi-Modal Fusion for Open-Vocabulary Semantic SLAM in Dynamic Environments

    Apr 28, 2026Zaid Nasser, Mikhail Iumanov, Tianhao Li +3Simultaneous Localization And MappingRobotic Perception

    Biomechatronics and Energy-Efficient Robotics (BE2R) Lab, ITMO University, Saint Petersburg, Russia

  38. Beyond Chain-of-Thought: Rewrite as a Universal Interface for Generative Multimodal Embeddings

    Apr 24, 2026Peixi Wu, Ke Mei, Feipeng Ma +15Multimodal EmbeddingsRewrite

    WeChat Vision, Tencent Inc. · Zhejiang University · Tsinghua University +1

  39. FLiP: Towards understanding and interpreting multimodal multilingual sentence embeddings

    Apr 20, 2026Santosh Kesiraju, Bolaji Yusuf, Šimon Sedláček +2Multimodal EmbeddingsMultilingual Language Models

  40. mEOL: Training-Free Instruction-Guided Multimodal Embedder for Vector Graphics and Image Retrieval

    Apr 18, 2026Kyeong Seon Kim, Baek Seong-Eun, Lee Jung-Mok +1Multimodal EmbeddingsScalable Vector Graphic

    1KAIST · 2POSTECH

  41. SIMMER: Cross-Modal Food Image--Recipe Retrieval via MLLM-Based Embedding

    Apr 17, 2026Keisuke Gomi, Keiji YanaiMultimodal EmbeddingsRecipe

    The University of Electro-Communications

  42. Magic-MM-Embedding: Towards Visual-Token-Efficient Universal Multimodal Embedding with MLLMs

    Feb 5, 2026Qi Li, Yanzhe Zhao, Yongxin Zhou +4Multimodal EmbeddingsMultimodal Large Language Models

    Honor Device Co., Ltd., China

  43. CausalEmbed: Auto-Regressive Multi-Vector Generation in Latent Space for Visual Document Embedding

    Jan 29, 2026Jiahao Huo, Yu Huang, Yibo Yan +7Visual Document RetrievalMultimodal Embeddings

    The Hong Kong University of Science and Technology (Guangzhou) · Alibaba Cloud Computing · The Hong Kong University of Science and Technology +1

  44. VLM2GeoVec: Toward Universal Multimodal Embeddings for Remote Sensing

    Dec 12, 2025Emanuel Sánchez Aimar, Gulnaz Zhambulova, Fahad Shahbaz Khan +2Remote SensingMultimodal Embeddings

    Linköping University, Sweden

  45. The P3^3 Dataset: Pixels, Points and Polygons for Multimodal Building Vectorization

    May 21, 2025Raphael Sulzer, Liuyun Duan, Nicolas Girard +1Light Detection And Ranging Point CloudsBuilding Information Modeling

    Université Côte d’Azur, INRIA, Sophia-Antipolis, France · LuxCarta Technology, Mouans-Sartoux, France