Multimodal Large Language Models

Also known as MLLM

Follow this topic Ask about this topic

Momentum

67 papers in the last four weeks, up 91% on the four weeks before. 0.7% of all new papers.

Jul 13Week of Sep 28

Latest papers 676

All topics

Reliability-Prioritized Fine-Grained Generation in Multimodal Large
Jun 28, 2026Xiaomeng Fan, Wei Wu, Yuwei Wu +9Direct Preference Optimization Multimodal Large Language Models
Beijing Key Laboratory of Intelligent Information Technology, School of Computer Science & Technology, Beijing Institute of Technology · Guangdong Laboratory of Machine Perception and Intelligent Computing, Shenzhen MSU-BIT University · Department of Electrical and Computer System Engineering, Monash University
Enhancing Part-Level Point Grounding for Any Open-Source MLLMs
Jun 28, 2026Jin-Cheng Jhang, Fu-En Wang, Xin Yang +4Multimodal Large Language Models Vision-Language Grounding
1National Tsing Hua University · 2Amazon
Low-cost concept-based localized explanations: How far can we get with training-free approaches?
Jun 27, 2026Darian Fernández-Gutiérrez, Rafael Bello, Marilyn Bello +1VLM Evaluation Zero-Shot Learning
Dept. of Computer Science, Central University ”Marta Abreu” of Las Villas (UCLV), 50100 Santa Clara, Cuba · Dept. of Computer Science and Artificial Intelligence, University of Granada (UGR), 18071 Granada, Spain.
Personalizing MLLMs via Reinforced Multimodal Reference Game
Jun 27, 2026Deepayan Das, Davide Talon, Yiming Wang +2Multimodal Large Language Models Personalized Language Models
University of Trento, Trento, Italy · Fondazione Bruno Kessler, Trento, Italy
IMCBench: A benchmark for multimodal LLMs in Image-grounded Medical Conversations
Jun 26, 2026Maria Xenochristou, Ashutosh Joshi, Korosh Vatanparvar +10Multimodal Large Language Models Clinical Language Model Evaluation
Amazon Health AI
RSICCLLM: A Multimodal Large Language Model for Remote Sensing Image Change Captioning
Jun 26, 2026Yelin Wang, Zijia Song, Shuo Ye +6Remote Sensing Image Understanding VLM Adaptation
State Key Laboratory of AI Safety, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China · Harbin Institute of Technology, Shenzhen, China · Great Bay University, Dongguan, China +1
Video-MME-Logical: A Controlled Diagnostic Benchmark for Video Temporal-Logical Reasoning
Jun 26, 2026Hohin Kwan, Hongyu Li, Ray Zhang +5VLM Evaluation Multimodal Large Language Models
1HKUST · 2Colab, Beihang University · 3CUHK
MER-R1: Multimodal Emotion Reasoning via Slow-Fast Thinking Synergy
Jun 26, 2026Zhiyuan Han, Beier Zhu, Wenwen Tong +8RL for Language Model Reasoning Multimodal Large Language Models
University of Science and Technology of China · 2SenseTime Research · Institute of Artificial Intelligence, Hefei Comprehensive National Science Center +1
Fine-tuning a multimodal large language model for clinician-grade autism behavioral scoring from short home videos
Jun 25, 2026Mohammadmahdi Honarmand, Parnian Azizian, Aaron Kline +9Autism Spectrum Disorder LLM Fine-Tuning
Department of Mechanical Engineering, Stanford University, Stanford, CA 94305, USA · Department of Pediatrics, Stanford University, Stanford, CA 94305, USA · Department of Biomedical Data Science, Stanford University, Stanford, CA 94305, USA +2
Paying More Attention to Visual Tokens in Self-Evolving Large Multimodal Models
Jun 25, 2026Shravan Venkatraman, Ritesh Thawkar, Omkar Thawakar +4Multimodal Large Language Models VLM Reasoning
Mohamed bin Zayed University of Artificial Intelligence · Aalto University · Australian National University +1
TOPS: First-Principles Visual Token Pruning via Constructing Token Optimal Preservation Sets for Efficient MLLM Inference
Jun 25, 2026Tinghao Wang, Yichen Guo, Rui Huang +11Efficient VLM Inference Multimodal Large Language Models
State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University · Nanyang Technological University · University of Electronic Science and Technology of China +1
Event-Aware Instructed Assistant for Referring Video Segmentation
Jun 25, 2026Jinyu Liu, Henghui Ding, Shuting He +1Referring Video Object Segmentation Multimodal Large Language Models
Institute of Big Data, College of Computer Science and Artificial Intelligence, Fudan University, Shanghai, China · Shanghai University of Finance and Economics, China · Institute of Trustworthy Embodied AI, Fudan University, Shanghai, China
SocialPersona: Benchmarking Personalized Profiling and Response with Multimodal Social-Media Context
Jun 25, 2026Qinkai Zhang, Yanyan Zhao, Xin Lu +3LLM Personalization Multimodal Large Language Models
Harbin Institute of Technology
Position Rebinding Cache Reuse: Replay-Free Visual Revisiting for Interleaved Multimodal Reasoning
Jun 25, 2026Mengzhao Wang, Yanli Ji, Wangmeng Zuo +2Efficient Multimodal Inference KV Caching
Sun Yat-sen University · Shenzhen Loop Area Institute · Harbin Institute of Technology (HIT) +3
DiCoBench: Benchmarking Multi-Image Fine-Grained Perception via Differential and Commonality Visual Cues
Jun 25, 2026Geng Li, Yuxin PengVisual Reasoning Multimodal Large Language Models
Wangxuan Institute of Computer Technology, Peking University, Beijing, China
Staying VIGILant: Mitigating Visual Laziness via Counterfactual Visual Alignment in MLLMs
Jun 24, 2026Xi Xiao, Chen Liu, Chih-Ting Liao +9Multimodal Large Language Models Visual Grounding
UAB · Yale · UNSW +6
What We are Missing in Multimodal LLM Evaluation?
Jun 24, 2026Po-han Li, Shenghui Chen, Sandeep Chinchali +1Spatiotemporal Reasoning Multimodal Large Language Models
The University of Texas at Austin, USA
From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Models
Jun 24, 2026Haoxiang Sun, Tao Wang, Li Yuan +2Vision-Language Models Multimodal Large Language Models
School of Computer Science, Sichuan University, No. 24 South Section 1, Yihuan Road, Chengdu, 610065, Sichuan, China · School of Electronic and Computer Engineering, Peking University Shenzhen Graduate School, 2199 Lishui Road, Shenzhen, 518055, Guangdong, China · Institute of Artificial Intelligence (TeleAI), China Telecom and Northwestern Polytechnical University, 127 Youyi West Road, Xi’an, 710072, Shaanxi, China
ShutterMuse: Capture-Time Photography Guidance with MLLMs
Jun 24, 2026Jiayu Li, Yixiao Fang, Tianyu Hu +5VLM Evaluation Multimodal Large Language Models
1Fudan University · 2StepFun
Towards a Dynamic and Fixed-budget Memory Bank for Efficient Streaming Video Understanding
Jun 24, 2026Baiyang Song, Yuli Lin, Qiong Wu +5Streaming Video Understanding Multimodal Large Language Models
1Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University, 361005, P.R. China
Are We There Yet? Exploring the Capabilities of MLLMs in Assistive AI Applications
Jun 23, 2026Shayon Dasgupta, Avijit Dasgupta, C. V. JawaharVLM Evaluation Scene Text Recognition
IIT BHU · India · CVIT, IIIT Hyderabad
Yuvion VL: A Multimodal Foundation Model for Adversarial Content and AI Safety
Jun 23, 2026Shikai Qiu, Xiaowen Xu, Benlei Cui +55VLM Robustness Multimodal Large Language Models
IV-CoT: Implicit Visual Chain-of-Thought for Structure-Aware Text-to-Image Generation
Jun 23, 2026Zixuan Li, Haokun Lin, Yicheng Xiao +10T2I Generation Multimodal Large Language Models
NLPR, Institute of Automation, Chinese Academy of Sciences · The University of Hong Kong · Ant Group
ViTexQA: A Multi-Frame Temporal Perception Dataset for Video Text Question Answering
Jun 23, 2026Zhentao Guo, Chen Duan, Tongkun Guan +3Multimodal Large Language Models Video QA
Meituan · Shanghai Jiao Tong University
Curvature-Guided Mixing for MLLM Adaptation
Jun 23, 2026Jinglong Yang, Jiaxuan He, Wenjian Huang +2VLM Adaptation Multimodal Large Language Models
Research Institute of Trustworthy Autonomous Systems and Department of Computer Science and Engineering, Southern University of Science and Technology · Department of Computer Science, City University of Hong Kong
ActiveScope: Actively Seeking and Correcting Perception for MLLMs
Jun 23, 2026Yajing Wang, Chao Bi, Junshu Sun +4Multimodal Large Language Models Vision-Language Grounding
University of Chinese Academy of Sciences · State Key Lab of AI Safety, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China. · Harbin Institute of Technology (Weihai).
AVOC: Enhancing Hour-Level Audio-Video Understanding in Omni-Modal LLMs via Retrieval-Inspired Token Compression
Jun 23, 2026Yijing Chen, Wenhui Tan, Xiaoyi Yu +7Audio-Visual Understanding Multimodal Large Language Models
Gaoling School of Artificial Intelligence, Renmin University of China · Huawei Inc.
Towards Fast and Effective Long Video Understanding of Multimodal Large Language Models via Adaptive Quasi-Gaussian Sampling
Jun 23, 2026Kun Zhang, Chenxin Fang, Tao Chen +4Efficient Multimodal Inference Multimodal Large Language Models
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University, 361005, P.R. China
Spectral Evolution-Guided Token Pruning in Multimodal Large Language Models
Jun 23, 2026Bin Chen, Yuxiang Cai, Yadan Luo +3Efficient Multimodal Inference Multimodal Large Language Models
School of Software Technology, Zhejiang University, Ningbo, China · Zhejiang Key Laboratory of Digital-Intelligence Service Technology, China · The University of Queensland, St Lucia, QLD, Australia +2
Accelerating Multimodal Large Language Models with Prior-Corrected Token Reduction
Jun 23, 2026Zengjie Chen, Yuxiang Cai, Jingcai Guo +3Efficient VLM Inference Multimodal Large Language Models
School of Software Technology, Zhejiang University, Ningbo, China · Zhejiang Key Laboratory of Digital-Intelligence Service Technology, China · Hong Kong Polytechnic University, Hong Kong SAR +1

Jun 28, 2026, cs.CVJ/K move · Enter open · S save

Reliability-Prioritized Fine-Grained Generation in Multimodal Large

Xiaomeng Fan, Wei Wu, Yuwei Wu, Zhi Gao+8

Beijing Key Laboratory of Intelligent Information Technology, School of Computer Science & Technology, Beijing Institute of Technology · Guangdong Laboratory of Machine Perception and Intelligent Computing, Shenzhen MSU-BIT University · Department of Electrical and Computer System Engineering, Monash University

Direct Preference Optimization Multimodal Large Language Models LLM Reliability Multimodal Model Evaluation Fine-Grained Visual Perception Multimodal Understanding

Open paper AskPDF arXiv

Multimodal large language models (MLLMs) are increasingly expected to generate fine-grained descriptions of visual content. However, we observe and theoretically show that generating fine-grained responses poses a reliability challenge, \textit{i.e.}, fine-grained generation is more error-prone than coarse-grained generation. This phenomenon suggests that models should generate the finest description that remains reliable rather than simply produce more specific outputs. To investigate this problem, we develop \textsc{GranFact}, a granularity-aware benchmark consisting of expert-verified multi-object images with coarse-to-fine category annotations. Then, we design a hierarchy-aware evaluation algorithm, which assesses both whether model predictions are visually correct and how specific the correct predictions are. We also propose a reliability-prioritized preference optimization method based on Direct Preference Optimization, which penalizes unreliable fine-grained claims while rewarding reliable specificity. Experiments on \textsc{GranFact} show that our method improves fine-grained generation while preserving reliability. Code and data are available here.

Momentum

Related topics

Latest papers 676