Multimodal Large Language Models

Also known as MLLM

Follow this topic Ask about this topic

Momentum

67 papers in the last four weeks, up 91% on the four weeks before. 0.7% of all new papers.

Jul 13Week of Sep 28

Latest papers 676

All topics

Beyond Single Plots: A Benchmark for Question Answering on Multi-Charts
Apr 23, 2026Azher Ahmed Efat, Seok Hwan Song, Wallapak TavanapongData Visualization Multimodal Large Language Models
Department of Computer Science, Iowa State University, Ames, Iowa, USA
Latent Denoising Improves Visual Alignment in Large Multimodal Models
Apr 23, 2026Dhruv Parikh, Jacob Fein-Ashley, Rajgopal Kannan +1VLM Robustness Multimodal Large Language Models
University of Southern California Los Angeles, CA, USA · DEVCOM ARL Army Research Office USA
Can MLLMs "Read" What is Missing?
Apr 23, 2026Jindi Guo, Chaozheng Huang, Xi FangVLM Evaluation Document Understanding
DP Technology
Leveraging Multimodal LLMs for Built Environment and Housing Attribute Assessment from Street-View Imagery
Apr 22, 2026Siyuan Yao, Siavash Ghorbany, Kuangshi Ai +6Multimodal Large Language Models
University of Notre Dame, Notre Dame, IN, 46556, USA.
Unlocking Multi-Spectral Data for Multi-Modal Models with Guided Inputs and Chain-of-Thought Reasoning
Apr 22, 2026Dahun Kim, Ganesh Satish Mallya, Anelia AngelovaRemote Sensing Image Understanding Multimodal Large Language Models
Google DeepMind
Render-in-the-Loop: Vector Graphics Generation via Visual Self-Feedback
Apr 22, 2026Guotao Liang, Zhangcheng Wang, Juncheng Hu +5Multimodal Large Language Models Multimodal Generation
School of Software, Beihang University, China · 3 4Paradigm, China · Department of Computer Science, The University of Hong Kong, China
SSL-R1: Self-Supervised Visual Reinforcement Post-Training for Multimodal Large Language Models
Apr 22, 2026Jiahao Xie, Alessio Tonioni, Nathalie Rauschmayr +2Multimodal Large Language Models Reinforcement Learning with Verifiable Rewards
Max Planck Institute for Informatics, SIC · VIA Research Center · Google
Benchmarking Large Language Models for Safety Data Extraction
Apr 22, 2026Jonas Grill, Thomas Bayer, Sören BerlingerLLM Evaluation LLM Prompting
1SAP SE, Germany. · Institute for Digital Transformation, Ravensburg-Weingarten University.
HyLaR: Hybrid Latent Reasoning with Decoupled Policy Optimization
Apr 22, 2026Tao Cheng, Shi-Zhe Chen, Hao Zhang +3Multimodal Large Language Models Multimodal Reasoning
Tencent PCG, China · Tencent CSIG, China
ATIR: Towards Audio-Text Interleaved Contextual Retrieval
Apr 22, 2026Tong Zhao, Chenghao Zhang, Yutao Zhu +1Multimodal IR Multimodal Large Language Models
Gaoling School of Artificial Intelligence, Renmin University of China
SAKE: Self-aware Knowledge Exploitation-Exploration for Grounded Multimodal Named Entity Recognition
Apr 22, 2026Jielong Tang, Xujie Yuan, Jiayang Liu +6Multimodal Grounding Named Entity Recognition
Sun Yat-sen University Zhuhai, China · Shandong Normal University Jinan, China · University of the Chinese Academy of Sciences Beijing, China +2
AFMRL: Attribute-Enhanced Fine-Grained Multi-Modal Representation Learning in E-commerce
Apr 22, 2026Biao Zhang, Lixin Chen, Bin Zhang +3Multimodal Large Language Models Cross-Modal Retrieval
Taobao & Tmall Group of Alibaba
Bridging Traditional Explainability Methods and Multimodal Multilingual Models: An XAI-Based Analysis
Apr 21, 2026Paweł Pozorski, Jakub Muszyński, Maria GanzhaMultimodal Large Language Models Neural Network Interpretability
student record book number 327304 · student record book number 327246 · thesis supervisor
mllm-shap: A Shapley Value Explainability Platform for Text-Audio Multimodal Large Language Models
Apr 21, 2026Jakub Muszyński, Paweł Pozorski, Maria GanzhaMultimodal Large Language Models Shapley Value Attribution
Warsaw University of Technology, Warsaw, Poland
ProjLens: Unveiling the Role of Projectors in Multimodal Model Safety
Apr 21, 2026Kun Wang, Cheng Qian, Miao Yu +6LLM Backdoor Attacks Multimodal Large Language Models
3Nanyang Technological University · 2Beijing University of Aeronautics and Astronautics · University of Science and Technology of China +2
DUALVISION: RGB-Infrared Multimodal Large Language Models for Robust Visual Reasoning
Apr 20, 2026Abrar Majeedi, Zhiyuan Ruan, Ziyi Zhao +3Cross-Modal Learning Visual Question Answering
University of Wisconsin-Madison · Amazon · Northeastern University
Autonomous Skeletal Landmark Localization towards Agentic C-Arm Control
Apr 20, 2026Jay Jung, Ahmad Arrabi, Jax Luo +2Robotic Control Language Model-Based Control
University of Vermont, Burlington, 05405, Vermont, U.S.A. · Cleveland Clinic, Cleveland, 44195, Ohio, U.S.A.
Revisiting Change VQA in Remote Sensing with Structured and Native Multimodal Qwen Models
Apr 20, 2026Yakoub Bazi, Mohamad M. Al Rahhal, Mansour Zuair +1VLM Evaluation Remote Sensing Image Understanding
Computer Engineering Department, College of Computer and Information Sciences, King Saud University, Riyadh 11543, Saudi Arabia · Applied Computer Science Department, College of Applied Computer Science, King Saud University, Riyadh 11543, Saudi Arabia
EVE: Verifiable Self-Evolution of MLLMs via Executable Visual Transformations
Apr 20, 2026Yongrui Heng, Chaoya Jiang, Han Yang +2Synthetic Data Generation Multimodal Large Language Models
School of Control Science and Engineering, Shandong University Jinan, China · Zeekr, Geely Auto Shanghai, China
Multiplication in Multimodal LLMs: Computation with Text, Image, and Audio Inputs
Apr 20, 2026Samuel G. Balter, Ethan Jerzak, Connor T. JerzakMultimodal Large Language Models Multimodal Reasoning
University of Texas at Austin · National University of Singapore (NUS)
MM-JudgeBias: A Benchmark for Evaluating Compositional Biases in MLLM-as-a-Judge
Apr 20, 2026Sua Lee, Sanghee Park, Jinbae ImLLM-as-a-Judge Multimodal Large Language Models
Seoul National University · NAVER Cloud AI · KAIST AI
Correct When Paired, Wrong When Split: Decoupling and Editing Modality-Specific Neurons in MLLMs
Apr 20, 2026Tingchao Fu, Wenkai Wang, Fanxiao Li +6Knowledge Editing Multimodal Large Language Models
School of Information Science and Engineering, Yunnan University · School of Software, Yunnan University · 3National University of Singapore +1
Where to Focus: Query-Modulated Multimodal Keyframe Selection for Long Video Understanding
Apr 19, 2026Shaoguang Wang, Weiyu Guo, Ziyang Chen +2Multimodal Large Language Models Multimodal QA
Thrust of Artificial Intelligence, HKUST (Guangzhou) Guangzhou, China · Department of CSE, HKUST Hong Kong SAR, China
E2E-GMNER: End-to-End Generative Grounded Multimodal Named Entity Recognition
Apr 19, 2026Meng Zhang, Jinzhong Ning, Xiaolong Wu +2Multimodal Grounding Named Entity Recognition
1Dalian Maritime University · 2Dalian University of Technology
MACS: Modality-Aware Capacity Scaling for Efficient Multimodal MoE Inference
Apr 19, 2026Bo Li, Chuan Wu, Shaolin ZhuEfficient Multimodal Inference Expert Load Balancing
School of Software, Tsinghua University, Beijing, China · TJUNLP Lab, School of Computer Science and Technology, Tianjin University, China · School of New Media and Communication, Tianjin University, China
Instinct vs. Reflection: Unifying Token and Verbalized Confidence in Multimodal Large Models
Apr 19, 2026Yunkai Dang, Yifan Jiang, Yizhu Jiang +3Selective Prediction Confidence Estimation in Language Models
School of Artificial Intelligence, Nanjing University.
RemoteShield: Enable Robust Multimodal Large Language Models for Earth Observation
Apr 19, 2026Rui Min, Liang Yao, Shiyu Miao +5Remote Sensing Image Understanding VLM Robustness
1Hohai University · 2Nanjing University · 3Southeast University
Enhancing Zero-shot Personalized Image Aesthetics Assessment with Profile-aware Multimodal LLM
Apr 19, 2026Chun Wang, Chenfeng Wei, Chenyang Liu +1Zero-Shot Learning Personalized Image Aesthetics Assessment
Mashang Consumer Finance Co., Ltd., Chongqing, China · Xi’an Jiaotong-Liverpool University, Suzhou, China · Beijing University of Posts and Telecommunications, Beijing, China
EvoComp: Learning Visual Token Compression for Multimodal Large Language Models via Semantic-Guided Evolutionary Labeling
Apr 18, 2026Jiafei Song, Fengwei Zhou, Jin Qu +7Efficient Multimodal Inference Multimodal Large Language Models
OPPO CTG
mEOL: Training-Free Instruction-Guided Multimodal Embedder for Vector Graphics and Image Retrieval
Apr 18, 2026Kyeong Seon Kim, Baek Seong-Eun, Lee Jung-Mok +1Multimodal IR Multimodal Large Language Models
1KAIST · 2POSTECH

Apr 23, 2026, cs.CLJ/K move · Enter open · S save

Beyond Single Plots: A Benchmark for Question Answering on Multi-Charts

Azher Ahmed Efat, Seok Hwan Song, Wallapak Tavanapong

Department of Computer Science, Iowa State University, Ames, Iowa, USA

Data Visualization Multimodal Large Language Models Chart QA Multimodal Model Evaluation Multimodal Understanding

Open paper AskPDF arXiv

Charts are widely used to present complex information. Deriving meaningful insights in real-world contexts often requires interpreting multiple related charts together. Research on understanding multi-chart images has not been extensively explored. We introduce PolyChartQA, a mid-scale dataset specifically designed for question answering over multi-chart images. PolyChartQA comprises 534 multi-chart images (with a total of 2,297 sub-charts) sourced from peer-reviewed computer science research publications and 2,694 QA pairs. We evaluate the performance of nine state-of-the-art Multimodal Language Models (MLMs) on PolyChartQA across question type, difficulty, question source, and key structural characteristics of multi-charts. Our results show a 27.4% LLM-based accuracy (L-Accuracy) drop on human-authored questions compared to MLM-generated questions, and a 5.39% L-accuracy gain with our proposed prompting method.

Momentum

Related topics

Latest papers 676