Multimodal Large Language Models

Also known as MLLM

Follow this topic Ask about this topic

Momentum

67 papers in the last four weeks, up 91% on the four weeks before. 0.7% of all new papers.

Jul 13Week of Sep 28

Latest papers 676

All topics

Is It Time for the Renaissance of Salient Object Detection in the Era of MLLMs?
Jul 31, 2026Wenzhuo Zhao, Xiuzhi Li, Zhongkuan Mao +6VLM Evaluation Salient Object Detection
College of Computer Science, Sichuan University, China · National Key Laboratory of Fundamental Science on Synthetic Vision, Sichuan University, China · School of Information and Communication Engineering, University of ElectronicScience and Technology of China, China
Faster but Different: Diagnosing and Controlling Content Drift in Accelerated Multimodal Diffusion Language Models
Jul 31, 2026Yaoxuan Dou, Yang ShuMultimodal Large Language Models Diffusion Language Model Inference
School of Mathematics and Statistics, Beijing Institute of Technology Beijing, China
CAER: Conflict-Aware Evidence Routing with Dual Prefix Experts for Multimodal Large Language Models
Jul 31, 2026Zixuan Liu, Juntao Cai, Xiaoxu Cai +2Mixture of Experts Multimodal Large Language Models
Zhejiang Key Lab of Accessible Perception and Intelligent Systems, Zhejiang University, Hangzhou 310027, China
SafeNexus: Discovering and Steering Modality-Universal Safety Neurons in MLLMs
Jul 31, 2026Jian Yu, Fei Shen, Cong Wang +5Multimodal Robustness Multimodal Large Language Models
1Nanjing University of Science and Technology · 2National University of Singapore · 3Nanjing University +2
Performance of large language models in the optical diagnosis of colorectal polyps
Jul 31, 2026Joshua C. Vences, William T. Tran, Nikko Gimpaya +15Endoscopy Multimodal Large Language Models
1. Scarborough Health Network Research Institute, Toronto, Ontario, Canada · 2. Division of Gastroenterology, Hepatology and Nutrition, and The SickKids Learning and Research Institutes, The Hospital for Sick Children, Toronto, Ontario, Canada · 3. Department of Paediatrics, Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada +11
Capturing Token Tendencies for Training-Free Token Pruning in Multimodal Large Language Models
Jul 30, 2026Jie Ma, Zhike Qiu, Jie Gao +4Efficient Multimodal Inference Multimodal Large Language Models
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University · School of Information Engineering, Xiamen Ocean Vocational College · Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University, Sino-Russian Research Center for Digital Economy
MMLDSum-LLM: Multimodal Long-Document Summarization with Visual-Alignment and Keyword-Aware
Jul 30, 2026Xianpeng Zhang, Jiahua Yang, Dongyu Chen +7Multimodal Large Language Models Multimodal Model Evaluation
OPPO Guangdong Mobile Telecommunications Co., Ltd.
FiRE: Enhancing MLLMs with Fine-Grained Context Learning for Complex Image Retrieval
Jul 30, 2026Bohan Hou, Haoqiang Lin, Xuemeng Song +4Fine-Grained Image Retrieval Multimodal Large Language Models
Shandong University Qingdao, Shandong, China · City University of Hong Kong Hong kong, China · Harbin Institute of Technology (Shenzhen) Shenzhen, Guangdong, China +2
One Anchor for All: Unified Multilingual and Multimodal Safety Alignment for LVLMs
Jul 30, 2026Enyi Shi, Fei Shen, Chuancheng Shi +4VLM Robustness Multimodal Large Language Models
1Nanjing University of Science and Technology · 2National University of Singapore · 3The University of Sydney +2
MMHBench: A Multi-Perspective Benchmark for Mental Health Understanding in Long-Form Videos
Jul 30, 2026Jinpeng Hu, Erqiang Wang, Shan Wang +4Mental Health Multimodal Large Language Models
Hefei University of Technology · Faculty of Psychology, Beijing Normal University · The Chinese University of Hong Kong, Shenzhen +1
Semantic-Aligned Structural Abstraction for Multimodal Sentiment Analysis
Jul 30, 2026Wei Chen, Junkai Li, Tongguan Wang +4Multimodal Large Language Models Multimodal Classification
Huazhong Agricultural University Wuhan, China · Hubei University Wuhan, China · Engineering Research Center of Intelligent Technology for Agriculture, Hubei Engineering Technology Research Center of Agricultural Big Data, Key Laboratory of Smart Farming for Agricultural Animals.
Witness Evidence Portfolios: Single-Prefill Risk Detection for Closed Multimodal Answers
Jul 30, 2026Fexiang Liu, Shiye Wang, Qiang Qiu +1VLM Evaluation Multimodal Large Language Models
1State Key Laboratory of AI Safety, Institute of Computing Technology, CAS · University of Chinese Academy of Sciences
MMOOC: A Comprehensive Benchmark for Out-of-Context Evaluation in Multimodal Large Language Models
Jul 30, 2026Wenjie Zhu, Yabin Zhang, Wenjun Zeng +1VLM Robustness Multimodal Large Language Models
The Hong Kong Polytechnic University · Harbin Institute of Technology (Shenzhen) · Eastern Institute of Technology, Ningbo
Progressive Multimodal Alignment for Continual Instruction Tuning
Jul 29, 2026Duzhen Zhang, Yahan Yu, Qiaoyi Su +2Cross-Modal Alignment Multimodal Large Language Models
Mohamed bin Zayed University of Artificial Intelligence · Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences · Kyoto University +2
Which Modality Decides? Counterfactual Modality Attribution for Multimodal LLMs
Jul 29, 2026Vahidin Hasic, Chao Wang, Luis C. Garcia-Peraza-Herrera +2Multimodal Large Language Models Multimodal Model Interpretability
Faculty of Electrical Engineering, University of Sarajevo, Bosnia and Herzegovina · King’s College London, United Kingdom
Understanding Knowledge Transfer Mechanism in Heterogeneous MLLM Fusion: A Simple Linear Approach
Jul 29, 2026Yinghao Hou, Jiahe Fan, Yuanhao Pu +2Multimodal Large Language Models Multimodal Reasoning
University of Science and Technology of China
Symphony of Bias: Exploring Gender Associations with Musical Instruments in Multimodal LLMs
Jul 29, 2026Farhan Farsi, Shayan Bali, Mohammad Heydari Rad +2Gender Bias in Language Models Multimodal Large Language Models
Amirkabir University of Technology · King’s College London · University of Tehran +1
Seeing or Knowing? Visual Context Sensitivity in Multimodal Large Language Models
Jul 28, 2026Jiaang Li, Chengzu Li, Zhaochong An +4VLM Evaluation Multimodal Large Language Models
University of Copenhagen · University of Cambridge · 3ETH Zürich +1
A Cost-Effective Multimodal LLM Reasoning Framework for Question Answering over Irregular Clinical Time Series
Jul 28, 2026Frank Nie, Ethan B Liu, Yuan Zhu +2Irregular Time-Series Modeling Efficient Multimodal Inference
Shandong University China · University of Auckland New Zealand
SepPrune:A Separator-based Pruning Framework for Efficient Multimodal Large Language Models
Jul 28, 2026Yuchen Wang, Qihui Zhu, Yang Liu +2Efficient Multimodal Inference Multimodal Large Language Models
MoE Key Lab of BIPC, NEL-BITA, University of Science and Technology of China, Hefei, China · ChangXin Memory Technologies, Hefei, China · APKL of BIIP, IAI, Hefei Comprehensive National Science Center, Hefei, China
OmniDelta: Skill-Driven Budget Allocation for Token Compression in OmniLLMs
Jul 28, 2026Haoyang Huang, Wenjie Huang, Tianqi Xu +14Efficient Multimodal Inference Audio Token Compression
Zhejiang University · Qwen Application, Alibaba · Carnegie Mellon University +2
FORGE: Frame Orthogonality in Relevance Geometry for Long-Form Video Understanding
Jul 28, 2026Ghazal Kaviani, Ghassan AlRegibEfficient Multimodal Inference Multimodal Large Language Models
1OLIVES at the Center for Signal and Information Processing (CSIP), School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, USA.
Rethinking CD: A Reproducibility Study and Extension on the Ineffectiveness of Contrastive Decoding at Mitigating Object Hallucinations in MLLMs
Jul 28, 2026Arnav Bendre, Guneesh Gupta, Kavish Grover +2Object Hallucination in VLMs Multimodal Large Language Models
Department of Hydro and Renewable Energy Indian Institute of Technology, Roorkee · Department of Electrical Engineering Indian Institute of Technology, Roorkee · Department of Mechanical Engineering Indian Institute of Technology, Roorkee +2
LENS: Adaptive Spatio-Temporal Zooming for Keyframe Sampling in Long-Form Videos
Jul 27, 2026Ce Zhang, Jinxi He, Katia Sycara +1Multimodal Large Language Models Long-Video Understanding
Robotics Institute, Carnegie Mellon University
Evolving Safety Landscape of Multi-modal Large Language Models: A Survey of Emerging Threats and Safeguards
Jul 27, 2026Xi Li, Shu Zhao, Xiaohan Zou +6Adversarial Attacks on VLMs Multimodal Large Language Models
University of Alabama at Birmingham · NVIDIA · Penn State University +4
Chart-Supported or Model-Supplied? Examining MLLM-Generated Claims for Accessible Visualization
Jul 27, 2026Ishrat Jahan Eliza, Md Dilshadur RahmanData Visualization LLM Grounding
University of Utah
PerceptionBench: Evaluating Atomic Visual Perception in Multimodal Large Language Models
Jul 27, 2026Zichao Lin, Yifeng Xie, Bowen Qu +30Object Hallucination in VLMs Multimodal Large Language Models
Moonshot AI
RP-OPSD: Resolution-Privileged On-Policy Self-Distillation for Multimodal Large Language Models
Jul 27, 2026Qihui Zhu, Yuchen Wang, Zijian Wen +7Multimodal Large Language Models Self-Distillation
University of Science and Technology of China · 2ChangXin Memory Technologies, Inc.
Mixture-of-Thought-Tokens: Unifying Perception and Reasoning for Free-form Multimodal Grounding
Jul 27, 2026Tianyi Gao, Han Fang, Tianyi Ding +9Multimodal Grounding Multimodal Large Language Models
State Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University · Xingchen AGI Lab, China Telecom Artificial Intelligence Technology (Beijing) Co., Ltd · Beijing University of Posts and Telecommunications +2
Disentangling Semantic Attention from Structural Bias in the Attention Manifold
Jul 27, 2026Pengkun Jiao, Bin Zhu, Jingjing Chen +1Object Hallucination in VLMs Multimodal Large Language Models
Fudan University · Singapore Management University

Jul 31, 2026, cs.CVJ/K move · Enter open · S save

Is It Time for the Renaissance of Salient Object Detection in the Era of MLLMs?

Wenzhuo Zhao, Xiuzhi Li, Zhongkuan Mao, Ronghao Xian+5

College of Computer Science, Sichuan University, China · National Key Laboratory of Fundamental Science on Synthetic Vision, Sichuan University, China · School of Information and Communication Engineering, University of ElectronicScience and Technology of China, China

VLM Evaluation Salient Object Detection Multimodal Large Language Models Visual Saliency

Open paper AskPDF arXiv

The zero-shot capabilities of multimodal large language models (MLLMs) are pushing salient object detection (SOD) beyond task-specific supervision. To disentangle MLLMs beyond conventional mask-based evaluation, we decompose SOD into localization and segmentation, and re-engineer datasets with phrases, boxes, and attributes, establishing a diagnostic benchmark for MLLM saliency perception (SaliLLM). SaliLLM uncovers a striking capability mismatch: MLLMs outperform state-of-the-art (SOTA) methods in localization, yet remain substantially weaker in segmentation. Further analyses attribute this gap primarily to mismatches between MLLMs and annotations over foreground cardinality, granularity, and extent. Motivated by this diagnosis, we recast zero-shot SOD as protocol-aligned Foreground Organization and introduce the first training-free framework that leverages Gestalt-inspired Collaborative attention for Unified SOD (FOCUS). FOCUS couples top-down Bayesian-surprise calibration of protocol-conditioned foreground granularity with bottom-up propagation of MLLMs evidence over entity-centric perceptual manifolds induced by self-supervised features, yielding coherent object extents as prompts for a general segmenter. Across 13 RGB, RGB-D, and RGB-T SOD benchmarks, FOCUS generally surpasses SOTA methods without training, reducing mean absolute error by 11%, 34%, and 48% compared with fully, weakly, and self-supervised methods, respectively. Our findings signal the renaissance of SOD: from task-specific supervision to zero-shot foreground organization. Code is available in the supplementary material.

Momentum

Related topics

Latest papers 676