VLM Evaluation

VLM: Vision-Language Model

Ask about this topic

Momentum

70 papers in the last four weeks, up 67% on the four weeks before. 0.7% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 649

All topics
CardsList

  1. Composition, Not Conversation: VLMs Lose the Scene, Not the Thread

    Sep 29, 2026L. D. M. S. Sai Teja, Ufaq Khan, N. Siva Gopala Krishna +5VLM EvaluationVisual Question Answering

    NIT Silchar · MBZUAI · BML Munjal University +1

  2. It's Not What the Image Shows: Irrelevant Context Destabilises VLM Judges Without Informing Them

    Sep 29, 2026Nagham Omar, Mahmoud Jabarin, Kinan Ibraheem +1VLM EvaluationFigurative Language Understanding

    Faculty of Data and Decision Sciences, Technion

  3. Faster and Better? Benchmark Bugs and Design Limitations Distort the Evaluation of Vision-Language-Action Acceleration

    Sep 29, 2026Qiwei Chen, Kaijun Zhou, Nuohui Shi +3VLM EvaluationEfficient VLA Model Inference

    Shanghai Jiao Tong University

  4. Hierarchical Compression of Vision-Language Model Benchmarks

    Sep 29, 2026Hyunjong Ok, Seunggu Kang, Jaeho LeeVLM Evaluation

    Pohang University of Science and Technology · Upstage AI

  5. Benchmarking Vision-Language Models on Synapse Detection and Proofreading in Connectomics

    Sep 29, 2026Yicong Li, Junjie Wang, Leander Lauenburg +5VLM EvaluationVLM Adaptation

    Harvard University, Cambridge, MA, USA · Boston College, Chestnut Hill, MA, USA · Nanyang Technological University, Singapore

  6. Similar Choices, Different Attention: Cross-Modal Associations in Humans and Vision-Language Models

    Sep 29, 2026Sumin Hong, Katsumi Ibaraki, Renee Shi +2VLM EvaluationCross-Modal Alignment

    University of Notre Dame

  7. ScAn-Bench: Evaluating Scaling Analysis Methodology

    Sep 28, 2026Artin Sermaxhaj, Nastaran Alipour, Donat Sinani +4VLM EvaluationLLM Evaluation

    University of Freiburg · Zuse School ELIZA · Juelich Supercomputing Center (JSC), Research Center Juelich (FZJ)

  8. When Words Speak Louder than Images: Towards Understanding Language Bias in Vision-Language Models

    Sep 28, 2026Yizhou Fang, Siyue Chen, Zimo Qi +3VLM EvaluationVision-Language Models

    University of Waterloo · Independent Researcher · Johns Hopkins University +3

  9. THEIA: A Multimodal Dataset and Benchmark for Vision-Language Analysis of Layout

    Sep 28, 2026Giuseppe Chiari, Michele Piccoli, Federico Viola +1VLM EvaluationElectronic Design Automation

    DEIB Politecnico di Milano Milan, Italy, 20133

  10. ControlTrace: Recovering Control Fields for Hidden-Content Recognition

    Sep 28, 2026Zijian Liu, Yaoguang Chen, Liwei Liu +4VLM EvaluationVision-Language Models

    Shanghai Jiao Tong University · Ant Group

  11. When VLMs Trust Context: Evaluating Scene Text Recognition under Misleading Context

    Sep 28, 2026Yuxing Cheng, Yuan Wu, Yi ChangVLM EvaluationCounterfactual Evaluation of VLMs

    School of Artificial Intelligence, Jilin University · Engineering Research Center of Knowledge-Driven Human-Machine Intelligence, MOE, China · International Center of Future Science, Jilin University

  12. Before the Token Commits: Trajectory-Level Benchmarking of Visual Hallucinations in Diffusion VLMs

    Sep 28, 2026Yadong Wang, Siping Yue, Yu Tian +2VLM EvaluationVision-Language Models

    Nanjing University of Aeronautics and Astronautics · State Key Laboratory of Ocean Sensing, ZJU-Hangzhou Global Scientific and Technological Innovation Center, Zhejiang University, Hangzhou, 311215, China · Security Capability Center

  13. When Does an Image Determine the Answer? Benchmarking Visual Answerability across Charts and Scenes

    Sep 28, 2026Sungguk Cha, Mintae Kim, Youngsub Han +2VLM EvaluationVisual Question Answering

    LG Uplus, Seoul, South Korea

  14. Seeing and Solving Are Not Enough for Vision-Language Models

    Sep 27, 2026Ziheng Wang, Mingxuan Xie, Yilin Liu +3VLM EvaluationVisual Question Answering

    Sun Yat-sen University · Zhejiang University · The Hong Kong University of Science and Technology +2

  15. A Visual Classification Dataset and Model Evaluation for Historical Manuscript Illustrations

    Sep 27, 2026Yoav Evron, Michal Bar-Asher Siegal, Michael FireVLM EvaluationHistorical Document Analysis

    Faculty of Computer and Information Science, Ben-Gurion University of the Negev, Be’er Sheva, Israel · The Goldstein-Goren Department of Jewish Thought, Ben-Gurion University of the Negev, Be’er Sheva, Israel

  16. MoGround: Measuring and Mitigating Modality Distraction in Vision-Language Models

    Sep 27, 2026Luca Zhou, Bo Zhao, Rose Yu +2VLM EvaluationMultimodal Grounding

    Sapienza University of Rome · Harvard University · UC San Diego +2

  17. EyeVQA: Benchmarking Ophthalmic Vision-Language Models from Recognition to Spatial Grounding

    Sep 26, 2026Gujie Shao, Zixun Xie, Xuechun Xing +7VLM EvaluationMedical VQA

  18. GHOST-Q: Towards Studying Grounding Hallucinations Overlooked Under Same-score TradeOffs in Quantized VLMS

    Sep 24, 2026Saim Rehman, Muhammad ShafiqueVLM EvaluationVLM Quantization

    eBRAIN Lab, Division of Engineering, New York University Abu Dhabi (NYUAD), Abu Dhabi, UAE

  19. An Empirical Study of VLM Pipelines for Long-Document QA

    Sep 24, 2026Kenan E. Ak, Jay Mohta, Gwang Gook Lee +2VLM EvaluationTool Use in VLMs

  20. Reasoning Instructions Can Break Answer Decoding in Vision--Language Models

    Sep 24, 2026Zeyan Li, Siyuan Qiu, Jianfeng XuVLM EvaluationLanguage Model Generation Evaluation

    Shanghai Jiao Tong University

  21. Gender Bias in Vision-Language In-Context Learning

    Sep 23, 2026Tong Xiang, Yuta Nakashima, Noa GarciaVLM EvaluationIn-Context Learning

    The University of Osaka, Japan

  22. Beyond Balanced Accuracy: A Resolution and Parity-Controlled Benchmark for Vision-Language and Vision-Only Defect Assessment in UAV Power-Line Inspection

    Sep 23, 2026Linghao Zhang, Siyu Xiang, Junwei Kuang +1VLM EvaluationAnomaly Detection

    State Grid Sichuan Electric Power Research Institute, Chengdu 610041, China · Power System Security and Operation Key Laboratory of Sichuan Province

  23. What Looks Like a Capability Limit in Vision-Language Models Is a Readout Limit

    Sep 23, 2026Alfredo F. Frontera Del ValleVLM EvaluationVision-Language Grounding

    Columbia University

  24. PRISM-VLM: A Multi-Axis Discriminative Benchmark for Compact Vision-Language Models

    Sep 23, 2026Sanghee Park, Kee-Eung KimVLM EvaluationVLM Robustness

    NAVER Cloud AI · KAIST AI

  25. Feed the Panel Dimensions, Not Verdicts: Rubric-Decomposed Fusion of Vision-Language Aesthetic Judges

    Sep 22, 2026Amit Jadhav, Shaurya Beriwala, Beomjin KimVLM EvaluationVision-Language Models

    Purdue University Fort Wayne

  26. Do LiDAR Language Models Really Understand Spatio-temporal Relationships?

    Sep 21, 2026Runyi Yang, Murat Akkoyun, Di Wen +8VLM EvaluationHallucination Detection in VLMs

    INSAIT, Sofia University “St. Kliment Ohridski”, Bulgaria · Karlsruhe Institute of Technology, Germany · Hunan University, China

  27. ChartJudgeBench: Evaluating LMM Judges for Chart-to-Code Generation

    Sep 21, 2026Lijian Wu, Henry Hengyuan Zhao, Zijian Zhang +3VLM EvaluationLLM Evaluation

    CSU-JPG, Central South University · National University of Singapore

  28. LegendBench: A Diagnostic Benchmark for Legend Understanding with Counterfactual Interventions

    Sep 21, 2026Xinnuo Zhang, Zhike Tang, Jing Xu +2VLM EvaluationCounterfactual Evaluation of VLMs

    The Hong Kong University of Science and Technology (Guangzhou)

  29. Benchmarking MLLMs via Cognitive Expected Scene Graph for Safety-Critical Visual Negation Understanding

    Sep 17, 2026Zhiyun Jiang, Hanyong Wang, Binbin Liang +3VLM Evaluation

    Sichuan University, Chengdu, China · Beijing Institute of Technology, Beijing, China

  30. Can Vision-Language Models Judge Olympic Diving? From Reasoning to Scores in Zero-Shot Action Quality Assessment

    Sep 16, 2026Henry O. Velesaca, David Freire-Obregon, Luigi Miranda +1VLM EvaluationAction Quality Assessment

    ESPOL Polytechnic University, Campus Gustavo Galindo, Guayaquil, Ecuador · Software Engineering Department, Research Center for Information and Communication Technologies (CITIC-UGR), University of Granada, 18071, Granada, Spain · SIANI, Universidad de Las Palmas de Gran Canaria, Spain +1