Multimodal Large Language Models

Also known as MLLM

Follow this topic Ask about this topic

Momentum

67 papers in the last four weeks, up 91% on the four weeks before. 0.7% of all new papers.

Jul 13Week of Sep 28

Latest papers 676

All topics

Magic-MM-Embedding: Towards Visual-Token-Efficient Universal Multimodal Embedding with MLLMs
Feb 5, 2026Qi Li, Yanzhe Zhao, Yongxin Zhou +4Efficient Multimodal Inference Multimodal Large Language Models
Honor Device Co., Ltd., China
EEmo-Logic: A Unified Dataset and Multi-Stage Framework for Comprehensive Image-Evoked Emotion Assessment
Feb 1, 2026Lancheng Gao, Ziheng Jia, Zixuan Xing +4Multimodal Large Language Models Multimodal QA
Institute of Image Communication and Network Engineering, Shanghai Key Laboratory of Digital Media Processing and Transmissions, Shanghai Jiao Tong University, Shanghai · School of Communication & Electronic Engineering, East China Normal University, Shanghai
A Multimodal Large Language Model-Driven Framework for Context-Aware UAV Emergency Landing Site Selection
Feb 1, 2026Chunliang Hua, Lei Zhang, Jiayang Sun +2UAV Navigation Multimodal Large Language Models
School of Information Science and Engineering, Southeast University, Nanjing 211189, China · LASER, International Digital Economy Academy, Shenzhen 510085, China · Department of Electronic Engineering, East China Normal University, Shanghai 200241, China
MedAD-R1: Consistency-Reinforced Policy Optimization for Interpretable Medical Anomaly Detection
Feb 1, 2026Haitao Zhang, Yingying Wang, Jiaxiang Wang +5Healthcare Group Relative Policy Optimization
School of Informatics, Xiamen University · Institute of Artificial Intelligence, Xiamen University · Zhejiang Expressway Co., Ltd. +3
TimeBlind: A Spatio-Temporal Compositionality Benchmark for Video LLMs
Jan 30, 2026Baiqi Li, Kangyi Zhao, Ce Zhang +3VLM Evaluation Video Understanding
University of North Carolina at Chapel Hill · University of Pittsburgh · Carnegie Mellon University
AVMeme Exam: A Multimodal Multilingual Multicultural Benchmark for LLMs' Contextual and Cultural Knowledge and Thinking
Jan 25, 2026Xilin Jiang, Qiaolin Wang, Junkai Wu +30Audio-Visual Understanding Multimodal Large Language Models
Columbia University · University of Washington · University of Illinois Urbana-Champaign +5
Social Caption: Evaluating Social Understanding in Multimodal Models
Jan 21, 2026Leena Mathur, Bhaavanaa Thumu, Youssouf Kebe +1Multimodal Large Language Models Multimodal Reasoning
School of Computer Science, Carnegie Mellon University
AMVICC: A Novel Benchmark for Cross-Modal Failure Mode Profiling for VLMs and IGMs
Jan 20, 2026Aahana Basappa, Pranay Goel, Anusri Karra +3Reasoning Evaluation Multimodal Large Language Models
Centennial High School, Frisco, Texas, USA · Algoverse AI Research, Palo Alto, Cali- fornia, USA · Lebanon Trail High School, Frisco, Texas, USA +1
ChartAttack: Testing the Vulnerability of LLMs to Malicious Prompting in Chart Generation
Jan 19, 2026Jesus-German Ortiz-Barajas, Jonathan Tonglet, Vivek Gupta +1Data Visualization Adversarial Attacks on VLMs
INSAIT · KU Leuven · Arizona State University +2
Generative Semantic Multi-Object Tracking: A Large-Scale Benchmark and an MLLM-Driven Reasoning Framework
Jan 10, 2026Pan Liao, Feng Yang, Di Wu +3Multimodal Large Language Models Multi-Object Tracking
BabyVision: Visual Reasoning Beyond Language
Jan 10, 2026Liang Chen, Weichu Xie, Yiyan Liang +27VLM Evaluation Visual Reasoning
1UniPat AI · 6Peking University · 3Alibaba Group +8
Towards Multi-modal Multi-turn Safety: From Agentic Interaction to Strategic Alignment
Jan 8, 2026Han Zhu, Jiale Chen, Chengkun Cai +8Language Model Safety Evaluation Multimodal Large Language Models
Hong Kong University of Science and Technology · University College London · AISpeech +1
FastSLM: Hierarchical Temporal Abstraction for Efficient Long-Form Speech Adaptation
Jan 8, 2026Junseok Lee, Chang-Jae ChunMultimodal Large Language Models Speech Processing
OKESTRO · Sejong University
ELF: A Family of Encoder-Free ECG-Language Models
Jan 5, 2026William Han, Tony Chen, Chaojing Duan +6Healthcare Electrocardiography
Carnegie Mellon University, USA · Allegheny Health Network, USA · University of California, Los Angeles, USA +1
NarrativeTrack: Evaluating Entity-Centric Reasoning for Narrative Understanding
Jan 3, 2026Hyeonjeong Ha, Jinjin Ge, Bo Feng +2VLM Evaluation Video Understanding
Apple · University of Illinois Urbana-Champaign
BrepLLM: Enabling Large Language Models to Understand Boundary Representations
Dec 18, 2025Liyuan Deng, Hao Guo, Yongkang Dai +5Multimodal Large Language Models 3D Representation Learning
Northwestern Polytechnical University · National University of Singapore · Hong Kong University of Science and Technology +1
EchoingPixels: Aliasing-Resistant Joint Token Reduction for Audio-Visual LLMs
Dec 11, 2025Chao Gong, Depeng Wang, Zhipeng Wei +3Rotary Positional Embeddings Multimodal Large Language Models
1Fudan University · 2Ant Group · 3UC Berkley
Enhancing Large Language Model-Based Systems for End-to-End Circuit Analysis Problem Solving
Dec 10, 2025Liangliang Chen, Weiyu Sun, Huiru Xie +2LLM Answer Verification Educational Technology
School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA 30332 USA
Visual Species Recognition with Large Multimodal Models as Post-Hoc Correctors
Dec 10, 2025Tian Liu, Anwesha Basu, James Caverlee +1Large Vision-Language Models Multimodal Large Language Models
Department of Computer Science and Engineering, Texas A&M University · Department of AI, University of Macau
VKnowU: Evaluating Visual Knowledge Understanding in Multimodal LLMs
Nov 25, 2025Tianxiang Jiang, Sheng Xia, Yicheng Xu +5VLM Evaluation Multimodal Large Language Models
University of Science and Technology of China · 2Shanghai AI Laboratory · 3Nanjing University +2
Towards Benign Memory Forgetting for Selective Multimodal Large Language Model Unlearning
Nov 25, 2025Zhen Zeng, Leijiang Gu, Zhangling Duan +4VLM Unlearning Multimodal Large Language Models
Hefei University of Technology, China · Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, China · University of Amsterdam, the Netherlands
Beyond Description: Cognitively Benchmarking Fine-Grained Action for Embodied Agents
Nov 24, 2025Dayong Liu, Chao Xu, Weihong Chen +5AI Agent Evaluation Multimodal Large Language Models
Zhejiang University · IROOTECH TECHNOLOGY · Wolf 1069 b Lab, Sany Group +2
VisReason: A Large-Scale Dataset for Visual Chain-of-Thought Reasoning
Nov 21, 2025Lingxiao Li, Yifan Wang, Xinyan Gao +3Visual Spatial Reasoning Visual Reasoning
Boston University, Boston, MA, USA · Stony Brook University, Stony Brook, NY, USA · MMLab, The Chinese University of Hong Kong, Hong Kong SAR, China
A Comprehensive Study on Visual Token Redundancy for Discrete Diffusion-based Multimodal Large Language Models
Nov 19, 2025Duo Li, Zuhao Yang, Xiaoqin Zhang +2Multimodal Large Language Models Diffusion Language Model Inference
CCDS, NTU, Singapore · CCST, ZJUT, China · Terminus AI Lab, UCAS, China
LLM4Delay: Flight Delay Prediction via Cross-Modality Adaptation of Large Language Models and Aircraft Trajectory Representation
Oct 24, 2025Thaweerath Phisannupawong, Joshua Julian Damanik, Han-Lim ChoiAir Traffic Management Intelligent Transportation Systems
Department of Aerospace Engineering, Korea Advanced Institute of Science and Technology, Daejeon, 34141, Republic of Korea.
Robobench: A Comprehensive Evaluation Benchmark for Multimodal Large Language Models as Embodied Brain
Oct 20, 2025Yulin Luo, Chun-Kai Fan, Menghang Dong +19Long-Horizon Robotic Manipulation Multimodal Large Language Models
State Key Laboratory of Multimedia Information Processing, School of Computer2026 Science, Peking University · Institute for Brain and Intelligence, Fudan University · University of Science andJul Technology Beijing +2
MCA: Modality Composition Awareness for Robust Composed Multimodal Retrieval
Oct 17, 2025Qiyu Wu, Shuyang Cui, Satoshi Hayakawa +3Multimodal Robustness Multimodal Large Language Models
Sony Group Corporation · Sony AI
Constructive Distortion: Improving MLLMs with Attention-Guided Image Warping
Oct 10, 2025Dwip Dalal, Gautam Vashishtha, Utkarsh Mishra +6Object Hallucination in VLMs Multimodal Large Language Models
University of Illinois Urbana–Champaign · Skan AI · Texas A&M University +1
LM Fight Arena: Benchmarking Large Multimodal Models via Game Competition
Oct 10, 2025Yushuo Zheng, Tongrui Ye, Zicheng Zhang +3Multimodal Large Language Models AI Agent Benchmarks
Shanghai Jiao Tong University, Shanghai, China · Shanghai AI Lab, Shanghai, China · Tongji University, Shanghai, China
Training-free Uncertainty Guidance for Complex Visual Tasks with MLLMs
Oct 1, 2025Sanghwan Kim, Rui Xiao, Stephan Alaniz +2Multimodal Large Language Models Long-Video Understanding
1Technical University of Munich · 2Munich Center for Machine Learning · 20263Helmholtz Munich +2

Feb 5, 2026, cs.CVJ/K move · Enter open · S save

Magic-MM-Embedding: Towards Visual-Token-Efficient Universal Multimodal Embedding with MLLMs

Qi Li, Yanzhe Zhao, Yongxin Zhou, Yameng Wang+3

Honor Device Co., Ltd., China

Efficient Multimodal Inference Multimodal Large Language Models Multimodal Embedding Cross-Modal Retrieval

Open paper AskPDF arXiv

Multimodal Large Language Models (MLLMs) have shown immense promise in universal multimodal retrieval, which aims to find relevant items of various modalities for a given query. However, their practical application is often hindered by the substantial computational cost incurred from processing a large number of tokens from visual inputs. In this paper, we propose Magic-MM-Embedding, a series of novel models that achieve both high efficiency and state-of-the-art performance in universal multimodal embedding. Our approach is built on two synergistic pillars: (1) a highly efficient MLLM architecture incorporating visual token compression to drastically reduce inference latency and training time, and (2) a multi-stage progressive training strategy designed to not only recover but significantly boost performance. This coarse-to-fine training paradigm begins with extensive continued training to restore multimodal understanding and generation capabilities, progresses to large-scale contrastive pretraining and hard negative mining to enhance discriminative power, and culminates in a task-aware fine-tuning stage guided by an MLLM-as-a-Judge for precise data curation. Comprehensive experiments show that our model outperforms existing methods by a large margin while being more inference-efficient.

Momentum

Related topics

Latest papers 676