Multimodal Model Evaluation

Ask about this topic

Momentum

49 papers in the last four weeks, up 48% on the four weeks before. 0.5% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 496

All topics
CardsList

  1. PathView-Bench: Can Multimodal Large Language Models Achieve Fine-grained Multiscale Understanding of Pathology Images?

    Jul 30, 2026Zongyi Chen, Yu Liang, Jie Lin +1Computational PathologyMedical VQA

    National Institute for Data Science in Health and Medicine, Xiamen University · Institute of Artificial Intelligence Xiamen University, Xiamen, China · Department of Computer Science School of Informatics Xiamen University, Xiamen, China

  2. MMLDSum-LLM: Multimodal Long-Document Summarization with Visual-Alignment and Keyword-Aware

    Jul 30, 2026Xianpeng Zhang, Jiahua Yang, Dongyu Chen +7Multimodal Large Language ModelsMultimodal Model Evaluation

    OPPO Guangdong Mobile Telecommunications Co., Ltd.

  3. MMHBench: A Multi-Perspective Benchmark for Mental Health Understanding in Long-Form Videos

    Jul 30, 2026Jinpeng Hu, Erqiang Wang, Shan Wang +4Mental HealthMultimodal Large Language Models

    Hefei University of Technology · Faculty of Psychology, Beijing Normal University · The Chinese University of Hong Kong, Shenzhen +1

  4. MMOOC: A Comprehensive Benchmark for Out-of-Context Evaluation in Multimodal Large Language Models

    Jul 30, 2026Wenjie Zhu, Yabin Zhang, Wenjun Zeng +1VLM RobustnessMultimodal Large Language Models

    The Hong Kong Polytechnic University · Harbin Institute of Technology (Shenzhen) · Eastern Institute of Technology, Ningbo

  5. Talked Out of the Truth: Sycophancy in the Reasoning Chains of Multimodal Models

    Jul 30, 2026Mahir Numayeer Islam, Gakuto Okuyama, Nikolaus Siauw +3LLM SycophancyMultimodal CoT Reasoning

    Adelaide University · Akita International University · RNA Tech +2

  6. AHA-Memes: A Fine-Grained Multimodal Benchmark for Understanding Hate in Arabic Memes

    Jul 29, 2026Mohamed Bayan Kmainasi, Ali Ezzat Shahroor, Abul Hasnat +3Arabic NLPHate Speech Detection

    Qatar Computing Research Institute, Qatar · 2APAVI.AI, France · 3Hamad Bin Khalifa University, Qatar +1

  7. SciFigQual-Bench: A Benchmark for Scientific Figure Quality Assessment with Full-Manuscript Context

    Jul 29, 2026Zihan Deng, Chuanzhi Xu, Huiqi Liang +3Automated EvaluationImage Quality Assessment

    The University of Hong Kong · The University of Sydney · University of Electronic Science and Technology of China

  8. ICDAR 2026 Competition on Information Extraction from Atomic Layer Deposition/Etching (ALD/E) Scientific Figures

    Jul 29, 2026Fahad Ahmed, Sören Auer, Jennifer D'SouzaVisual Question AnsweringDocument Information Extraction

    TIB - Leibniz Information Centre for Science and Technology, Hannover, Germany · L3S Research Center, Leibniz University, Hannover, Germany

  9. See2Think: Do Multimodal Models Really Use Intermediate Visual States?

    Jul 29, 2026Siyu Yan, Zhuoran Yan, Haiying Xu +10Visual ReasoningMultimodal Reasoning

    1The Hong Kong University of Science and Technology · 3Shanghai AI Laboratory · 2Central South University +4

  10. SafeBuild-Bench: A Temporal-Robust Construction Safety Benchmark with Graph-Enhanced Data Mining

    Jul 29, 2026Yi Cui, Zilin Wang, Yijie Xu +5Multimodal RobustnessBenchmark Construction

    Hong Kong University of Science and Technology (Guangzhou) Guangzhou, China · The Hong Kong University of Science and Technology(Guangzhou) Guangzhou, China · School of Management Northwest Polytechnical University Xi’an Xi’an, China +4

  11. MultivationBench: A Benchmark for Multimodal Sequential Motivation Reasoning

    Jul 29, 2026Kawai Chung, Chunkit Chan, Yauwai Yim +12Multimodal ReasoningMultimodal Model Evaluation

    ♠The Hong Kong University of Science and Technology

  12. Symphony of Bias: Exploring Gender Associations with Musical Instruments in Multimodal LLMs

    Jul 29, 2026Farhan Farsi, Shayan Bali, Mohammad Heydari Rad +2Gender Bias in Language ModelsMultimodal Large Language Models

    Amirkabir University of Technology · King’s College London · University of Tehran +1

  13. Evaluating Multi-Turn Multimodal Diagnostic Reasoning on Challenging Real-World Clinical Cases

    Jul 28, 2026Rui Yang, Weihao Xuan, Yi Lin +23Medical VLMsMulti-Turn Dialogue Evaluation

    Center for Biomedical Data Science, Duke-NUS Medical School, Singapore, Singapore · Duke-NUS AI + Medical Sciences Initiative, Duke-NUS Medical School, Singapore, Singapore · Department of Population Health Sciences, Weill Cornell Medicine, New York, NY, USA +24

  14. CLBench-V: Evaluating Multimodal Context Learning from Grounding to Knowledge Acquisition

    Jul 28, 2026Lai Wei, Chengqi Li, Jiapeng Li +3Multimodal GroundingMultimodal ICL

    School of Computer Science, Shanghai Jiao Tong University · 2Zhongguancun Academy · 3Shanghai Innovation Institute

  15. Neurai-VN Benchmark: Standardized Machine Learning Models for Multimodal Digital Phenotyping in Mental Health Classification

    Jul 28, 2026Quoc-Cuong Pham, Hoang-Thuy-Duong Vu, Thi-Thanh-Huong Ha +1Depression DetectionMental Health

    College of Engineering and Computer Science, VinUni-Illinois Smart Health Center, VinUniversity, Hanoi, Vietnam. · School of Biomedical Engineering, International University, Vietnam National University HCMC Ho Chi Minh, Vietnam.

  16. Chart-Supported or Model-Supplied? Examining MLLM-Generated Claims for Accessible Visualization

    Jul 27, 2026Ishrat Jahan Eliza, Md Dilshadur RahmanData VisualizationLLM Grounding

    University of Utah

  17. PerceptionBench: Evaluating Atomic Visual Perception in Multimodal Large Language Models

    Jul 27, 2026Zichao Lin, Yifeng Xie, Bowen Qu +30Object Hallucination in VLMsMultimodal Large Language Models

    Moonshot AI

  18. ClinFusion: A Vision-Centric Multimodal LLM System for Holistic Medical Understanding

    Jul 27, 2026Hangjie Yuan, Yichen Qian, Zhiwei Tang +21Medical Report GenerationMedical VQA

    1DAMO Academy, Alibaba Group, Hangzhou, China · 3Hupan Laboratory, Hangzhou, China · 2DAMO Academy, Alibaba Group, Beijing, China +7

  19. Task-Conditional Faithfulness Auditing of Multimodal LLMs for Grid Diagnosis

    Jul 27, 2026Tianqiao Zhao, Meng Yue, Jianhui WangLLM AuditingMultimodal Model Evaluation

    The University of Texas at Arlington, Arlington, TX, USA · Brookhaven National Laboratory, Upton, NY, USA · Southern Methodist University, Dallas, TX, USA

  20. StanceFlip: A Comprehensive Multi-Dimensional Benchmark for Multimodal Conversational Stance Flipping Forecasting

    Jul 27, 2026Heyan Chai, Xin Li, Wenjie Wang +5Multimodal ReasoningMultimodal Model Evaluation

    College of Computer Science and Software Engineering, Shenzhen University Shenzhen, China · Harbin Institute of Technology Shenzhen, China · Shenzhen University Shenzhen, China +1

  21. A Controlled Visual-Backbone Benchmark for Multimodal Short-Term Solar Irradiance Forecasting

    Jul 26, 2026Oshadha Samarakoon, Dushan Herath, Ishara Ranmandala +4Vision TransformerTime Series Forecasting

    Dept. of EEE, University of Peradeniya · Peradeniya, Sri Lanka · MARC, University of Peradeniya

  22. Novel Claim or Déjà Vu? Rethinking "Contamination-Free'' Dynamic Evaluation for Multimodal Automated Fact-Checking

    Jul 26, 2026Haorui He, Xinwen Chen, Dacheng Wen +3Benchmark ContaminationAutomated Fact-Checking

    Department of Interactive Media, Hong Kong Baptist University · School of Computing and Data Science, The University of Hong Kong · Faculty of Science and Technology, Beijing Normal-Hong Kong Baptist University

  23. Spatial-IQ: Deconstructing Spatial Intelligence via Hierarchical Capability Tests

    Jul 24, 2026Patrick Rim, Tom Long, Ekta Prashnani +6Spatial Reasoning BenchmarksVisual Spatial Reasoning

    1NVIDIA Research · 2Yale University

  24. RadSight: Towards Perceptually Reliable Multimodal Radiology Image Understanding

    Jul 24, 2026Jianqin Liu, Weiwei Cao, Wanxing Chang +7Radiology VLMsMedical Image Grounding

    1DAMO Academy, Alibaba Group · University of Electronic Science and Technology of China

  25. Benchmarking Fine-tuning and Retrieval Strategies for a Multimodal Language Model on the NRC Reactor Operator Licensing Examination

    Jul 24, 2026Isak Hwang, Yoon Pyo LeeRetrieval-Augmented GenerationLLM Fine-Tuning

    aDepartment of Nuclear Engineering, Hanyang University, 222 Wangsimni-ro, 04763, Seongdong-gu, Seoul, South Korea · bThe Grainger College of Engineering, Nuclear, Plasma & Radiological Engineering, University of Illinois Urbana-Champaign, Urbana, IL, USA

  26. Medical-Checklist: Assessing the Comprehension of Medical Images by Multimodal Models

    Jul 24, 2026Bannapol Limanond, Masanori Suganuma, Takayuki OkataniMedical VLMsMultimodal Model Evaluation

  27. Unlearning Under Imbalance: Benchmarking Fairness in Multimodal LLM Unlearning

    Jul 23, 2026Lorenzo Orsingher, Thomas De Min, Massimiliano Mancini +2VLM UnlearningAlgorithmic Fairness

    University of Trento, Trento, Italy · Fondazione Bruno Kessler, Trento, Italy

  28. Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose?

    Jul 22, 2026Qiwei Ma, Chunping Qiu, Xinjun Cheng +5Remote Sensing Image UnderstandingRemote Sensing VQA

    School of Artificial Intelligence and Robotics, Hunan University, Changsha, 410082, China · Intelligent Game and Decision Lab (IGDL), Beijing, 100091, China · cYuelushan Center for Industrial Innovation, Changsha, 410082, China

  29. MV-Bench: Benchmarking Multimodal Large Language Models for Coordinated Multi-View Interface Construction

    Jul 22, 2026Yue Zhao, Hongxu Liu, Feiyu Wang +5Data VisualizationCode Generation

    Shandong Second Medical University · Shandong University · Bairong Inc. +2

  30. Silent Failures in Multimodal Agentic Search:A Diagnostic Taxonomy and Cross-Judge Evaluation

    Jul 22, 2026Zhengxian Wu, Junjie Gao, Kai YangMultimodal GroundingAgentic Search

    Ant Group · Hangzhou, China