VLM Evaluation

VLM: Vision-Language Model

Ask about this topic

Momentum

71 papers in the last four weeks, up 69% on the four weeks before. 0.7% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 658

All topics
CardsList

  1. Natural Language Camera Movement Understanding

    Jul 3, 2026Yuwen Tan, Joey Huang, Jin Huang +2VLM EvaluationVideo-Language Models

    Boston University, Boston, MA 02215, USA · Pixocial Technology, Bellevue, WA 98004, USA

  2. VISTA: Auditing Semantic Divergence in Vision-Language Models

    Jul 3, 2026Junchi Liao, Jiawen Deng, Fuji RenVLM EvaluationVision-Language Models

    University of Electronic Science and Technology of China

  3. GuideMe: Multi-Domain Task Guidance and Intervention in Streaming Video

    Jul 3, 2026Fang Liu, Jinpeng Chen, Ke Xu +7VLM EvaluationStreaming Video Understanding

    City University of Hong Kong · Huawei Research · University of Science and Technology of China +2

  4. MatPhaseBench: A Semantics-Guided Benchmark for Materials Phase Diagrams Understanding

    Jul 3, 2026Hanwen Wang, Sihan Liang, Zhiwei Liu +4VLM EvaluationAI for Science

    Computer Network Information Center, Chinese Academy of Sciences University of Chinese Academy of Sciences Beijing, China · University of Manchester Manchester, UK · Institute of Metal Research, Chinese Academy of Sciences Shenyang, China +1

  5. Prior Bias in Vision Language Models on UML Diagram Interpretation

    Jul 3, 2026Zaiyu Cheng, Khai-Nguyen Nguyen, Antonio MastropaoloVLM EvaluationSoftware Engineering

    Dept. of Computer Science William & Mary, USA

  6. Search-based Testing of Vision Language Models for In-Car Scene Understanding

    Jul 2, 2026Lev Sorokin, Chen Yang, Ken E. Friedl +1VLM EvaluationAutomated Test Generation

    BMW Group, Technical University of Munich · Munich, Germany · Technical University of Munich +2

  7. AnyGroundBench: A Multi-Domain Adaptation Benchmark for Video Grounding in VLMs

    Jul 2, 2026Rintaro Otsubo, Ryo Fujii, Reina Ishikawa +6VLM EvaluationTemporal Video Grounding

    Keio University · Keio AI Research Center · Keio University School of Medicine +1

  8. Evaluating Vision-Language Models as a Zero-Shot Learning Alternative to You Only Look Once and Optical Character Recognition for Nigerian License Plate Recognition

    Jul 2, 2026Ismail Ismail Tijjani, Ahmad Abubakar Mustapaha, Sunusi Ibrahim Muhammad +1VLM EvaluationZero-Shot Learning

    department of Mechatronics Engineering, Bayero University Kano(BUK). Kano, Nigeria. · School of Computer Science and Engineering, VIT-AP Uiversity, Andhra Pradesh, India. · department of Petroleum Engineering Bayero University Kano(BUK). Kano, Nigeria. +1

  9. Assessing VLM Reliability for Medical Image Quality Evaluation Under Corruption and Bias

    Jul 2, 2026Sofiane Ouaari, Kevin Vorwalder, Nico PfeiferVLM EvaluationImage Corruption Robustness

    Methods in Medical Informatics, Department of Computer Science, University of Tuebingen, Germany. · Institute for Bioinformatics and Medical Informatics (IBMI), University of Tuebingen, Germany.

  10. MMBench-Live: A Continuously Evolving Benchmark for Multimodal Models

    Jul 2, 2026Yuanzhi Liu, Shousheng Zhao, Bo Zhou +2VLM EvaluationBenchmark Construction

    1Beijing University of Posts and Telecommunications, Beijing, China

  11. Disentangling Pictorial Cue Understanding from Language Bias in VLMs via Depth Ordering Task

    Jul 1, 2026Yiqian Liu, Iuliia Kotseruba, John K. TsotsosVLM EvaluationVision-Language Models

    York University, Toronto, Canada · University of Guelph, Guelph, Canada

  12. MoHallBench: A Benchmark for Motion Hallucination in Video Large Language Models

    Jul 1, 2026Sihan Chen, Jiale Li, Jianghang Lin +1VLM EvaluationHallucination Detection in VLMs

    State Key Laboratory of General Artificial Intelligence, Peking University, Shenzhen Graduate School, Shenzhen, China · South China University of Technology, Guangzhou, China · Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University, Xiamen, China

  13. LongVQUBench: Benchmarking Long-Term Video Quality Understanding of Vision-Language Models

    Jul 1, 2026Arpita Nema, Hanwei Zhu, Xi Zhang +1VLM EvaluationVideo Quality Assessment

    Nanyang Technological University, Singapore

  14. MindEdit-Bench: Benchmarking Object-Level Counterfactual Spatial Reasoning in VLMs from In-the-Wild Photos

    Jul 1, 2026Leyuan Yu, Xiao Tang, Minghao Liu +6VLM EvaluationSpatial Reasoning Benchmarks

    ZODA · Tongji University · Zhejiang University +1

  15. StochasT: Learning with Stochastic Turn Depth for Visual Instruction Tuning

    Jul 1, 2026Yuan Qing, Chengzhi Mao, Boqing GongVLM EvaluationVLM Robustness

    Boston University, Boston, USA · Rutgers University, New Brunswick, USA

  16. Identifying and Resolving Pitfalls of Knowledge-Based VQA Benchmarks: Auditing, Repairing, and Augmenting

    Jun 30, 2026Qian Ma, S M Rayeed, Charles V. Stewart +2VLM EvaluationVisual Question Answering

    Rensselaer Polytechnic Institute, Troy NY 12047, USA · AT&T Chief Data Office, Bedminster NJ 07921, USA

  17. Criterion-Conditional In-Context Learning: Evaluating Criterion-Shift Adaptation in Vision-Language Models

    Jun 30, 2026Kaiyun Yang, Ruilin Yang, Zhimin Yao +2VLM EvaluationMultimodal ICL

    University of Science and Technology of China, Hefei, China · Megvii Technology Inc., Beijing, China.

  18. No Place to Hide: Benchmarking Video Hallucination with Background-Controlled Pairs

    Jun 30, 2026Haojian Huang, Harold Haodong Chen, Meng Luo +6VLM EvaluationMultimodal Hallucination

    The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China · Knowin AI, China · National University of Singapore, Singapore +4

  19. Seeing Is Not Sharing: Some Vision-Language Models Overestimate Common Ground in Asymmetric Dialogue

    Jun 30, 2026Nan Li, Albert Gatt, Massimo PoesioVLM EvaluationVision-Language Grounding

    Utrecht University, Utrecht, The Netherlands

  20. Visual Semantic Entropy: Do Vision Language Models Recognize Visual Ambiguity?

    Jun 30, 2026Ta Duc Huy, Trang Nguyen, Townim Chowdhury +5VLM EvaluationVisual Question Answering

    Australian Institute for Machine Learning, Adelaide University, Australia · Flinders University, Australia

  21. Beyond Single Character: Evaluating MLLMs for Sentence-Level Oracle Bone Inscription Understanding

    Jun 30, 2026Ziqi Li, Zijian Chen, Tingzhu Chen +1VLM EvaluationDocument Understanding

    Nanjing University of Science and Technology, Nanjing 210094, China · Shanghai Jiao Tong University, Shanghai 200240, China · Shanghai Artificial Intelligence Laboratory, Shanghai 200232, China

  22. SADL: What to Ignore? A Benchmark for Subject-Aware Distractor Localization

    Jun 29, 2026Cao-Tri Nguyen, Nguyen-Khoa Luong, Vinh-Tiep Nguyen +1VLM EvaluationLarge Vision-Language Models

    University of Science Vietnam National University Ho Chi Minh City Ho Chi Minh City, Vietnam · University of Information Technology Vietnam National University Ho Chi Minh City Ho Chi Minh City, Vietnam · University of Science John Von Neumann Institute Vietnam National University Ho Chi Minh City Ho Chi Minh City, Vietnam

  23. From Accuracy to Visual Dependence: Auditing and Filtering Modality Collapse in Traffic VideoQA

    Jun 29, 2026Sena Korkut, María Alejandra Bravo Sarmiento, Sanghwan Kim +1VLM EvaluationVision-Language Models

    Technical University of Munich, Munich, Germany · Helmholtz Zentrum München, Munich, Germany · Munich Center for Machine Learning, Munich, Germany

  24. SHOVIR: A Benchmark for Evaluating Vision Shortcut Learning in Radiology Report Generation

    Jun 29, 2026Filippo Ruffini, Marco Salmé, Rosa Sicilia +2VLM EvaluationRadiology Report Generation

    Unit of Artificial Intelligence and Computer Systems, Department of Engineering, Universit`a Campus Bio-Medico di Roma, Rome, Italy · Department of Diagnostics and Intervention, Radiation Physics, Biomedical Engineering, Ume˚a University, Ume˚a, Sweden · UniCamillus-Saint Camillus International University of Health Sciences, Rome, Italy

  25. Resolution Thresholds in VLM Detection of Harmful ASCII Art Across Construction Modes and Languages

    Jun 28, 2026Yikai Hua, Peter WestVLM EvaluationVLM Robustness

    Department of Computer Science The University of British Columbia

  26. Position: Vision-Language-Action Models Cannot Be Verified to Perform Physical Reasoning

    Jun 28, 2026Taozhao Chen, Ian Manchester, Huaming ChenVLM EvaluationPhysical Reasoning

    School of Electrical and Computer Engineering The University of Sydney Sydney, NSW, Australia · School of Aerospace, Mechanical and Mechatronic Engineering The University of Sydney Sydney, NSW, Australia

  27. When Does Synthetic CT Transfer? A Label-Free Donor/Host Diagnostic for Medical Vision-Language Model Routing on Real Lung CT

    Jun 28, 2026Fakrul Islam TusharVLM EvaluationSynthetic-to-Real Domain Adaptation

    Department of Radiology and Imaging Sciences, University of Arizona

  28. Can OCR-VLMs Read Devanagari? A Stress-Test Benchmark and Post-Correction Study

    Jun 28, 2026Aditya Pratap SinghVLM EvaluationVLM Robustness

  29. Low-cost concept-based localized explanations: How far can we get with training-free approaches?

    Jun 27, 2026Darian Fernández-Gutiérrez, Rafael Bello, Marilyn Bello +1VLM EvaluationZero-Shot Learning

    Dept. of Computer Science, Central University ”Marta Abreu” of Las Villas (UCLV), 50100 Santa Clara, Cuba · Dept. of Computer Science and Artificial Intelligence, University of Granada (UGR), 18071 Granada, Spain.

  30. On Test-Time Scaling for Vision-Language Models

    Jun 27, 2026Fawaz Sammani, Tzoulio Chamiti, Nikos DeligiannisVLM EvaluationTest-Time Scaling for VLMs

    ETRO Department, Vrije Universiteit Brussel, Belgium · imec, Kapeldreef 75, B-3001 Leuven, Belgium