VLM Evaluation

VLM: Vision-Language Model

Ask about this topic

Momentum

71 papers in the last four weeks, up 69% on the four weeks before. 0.7% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 649

All topics
CardsList

  1. Auditing Data Leakage in Whole-Slide Image Multimodal Benchmarks

    Jul 14, 2026Wenhao Zhang, Zhongliang Zhou, John Kang +1VLM EvaluationData Leakage

    University of Virginia · Merck & Co., Inc.

  2. DeepBias: Adaptive In-depth Probing of Social Biases in LVLMs

    Jul 13, 2026Anqi Li, Jie Zhang, Zhongqi Wang +4VLM EvaluationLanguage Model Bias Evaluation

  3. DynEval: Holistic Evaluations of T2I Generative Models in the Wild

    Jul 13, 2026Shyam Marjit, Dheeraj Baiju, Anuj Shikarkhane +3VLM EvaluationAutomated Evaluation

    Indian Institute of Science · VCL, IISc · Hugging Face

  4. 3D-DefectBench: A Controlled Factorial Study of Vision-Language Model Evaluation Pipelines for Fine-Grained 3D Generation Defects

    Jul 12, 2026Zhenyu Zhao, Nanshan Jia, Jihyeon Je +7VLM Evaluation

    Roblox Corporation · Berkeley AI Research Lab & Department of Industrial Engineering and Operations Research, University of California, Berkeley · Computer Science Department, Stanford University +1

  5. SynthDocBench: Controlled Benchmark for Long-Context Visual Document Understanding

    Jul 11, 2026Abhigya Verma, Khyati Mahajan, Amit Kumar Saha +4VLM EvaluationVision-Language Models

    ServiceNow AI · Mila · Université de Montréal

  6. What Does Your Short-Answer VQA Score Actually Measure? Evaluator-Dependent Instability in Multimodal Short-Answer Benchmarks

    Jul 11, 2026Guanhua Ye, Niu Jingbin, Yan Li +4VLM EvaluationVisual Question Answering

    Beijing University of Posts and Telecommunications Beijing, China

  7. Evolution of Accuracy and Visual-Cognitive Errors in a Decade of Vision-Language AI Models

    Jul 10, 2026Shravan Murlidaran, Miguel P. EcksteinVLM EvaluationImage Captioning

    aPsychological & Brain Sciences, University of California, Santa Barbara, , Santa Barbara, 93106, California, USA · bDepartment of Computer Science, University of California, Santa Barbara, , Santa Barbara, 93106, California, USA · cDepartment of Electrical and Computer Engineering, University of California, Santa Barbara, , Santa Barbara, 93106, California, USA

  8. OmniMapBench: Benchmarking Visual-Centric Reasoning on Diverse Map Documents

    Jul 10, 2026Yang Chen, Yunwen Li, Yufan Shen +6VLM EvaluationDocument Understanding

    Shanghai Artificial Intelligence Laboratory · Zhejiang University · M-A-P +2

  9. MultiView-Bench: A Diagnostic Benchmark for World-Centric Multi-View Integration in VLMs

    Jul 9, 2026Hantao Zhang, Jinru Sui, Ed Li +2VLM EvaluationVision-Language Models

    Yale University · University of Edinburgh

  10. AUTOPILOT VQA: Benchmarking Vision-Language Models for Incident-Centric Dashcam Understanding

    Jul 9, 2026Siddharth Damodharan, Radhika Gupta, Ali Alshami +2VLM EvaluationAutonomous Driving Benchmarks

    University of Colorado Colorado Springs · University of Michigan · University of Notre Dame

  11. OmniFood-Bench: Evaluating VLMs for Nutrient Reasoning and Personalized Health Advice

    Jul 9, 2026Qian Jiang, Zhecheng Shi, Jingpu Yang +2VLM EvaluationMedical VLMs

    Northeastern University at Qinhuangdao · The Hong Kong University of Science and Technology (Guangzhou) · BeiHang University +1

  12. Blind-Spots-Bench: Evaluating Blind Spots in Multimodal Models

    Jul 9, 2026Matteo Santelmo, Xiuying Wei, Israa Fakih +5VLM EvaluationLLM Evaluation

    Ecole Polytechnique Fédérale de Lausanne (EPFL), Switzerland

  13. When Thinking Hurts: Epistemic Signals in the Reasoning Chains of Visual Language Models

    Jul 9, 2026Mayank SingalVLM EvaluationUncertainty Estimation for VLA Models

    Independent Researcher.

  14. HIVE: Understanding Post-Hallucination Reasoning in Vision Language Models

    Jul 8, 2026Feng He, Zhenting Wang, Qifan Wang +4VLM EvaluationVLM Hallucination

    Purdue University · Rutgers University · Meta AI +2

  15. Generalist Vision-Language Models for Fast Radio Burst detection: a zero-shot benchmark against a specialized detector

    Jul 8, 2026Raiff H. Santos, Amilcar R. Queiroz, Tharcisyo S. S. Duarte +2VLM EvaluationZero-Shot Learning

    Universidade Federal de Campina Grande, R. Apr´ıgio Veloso 882, Bairro Universit´ario, 58429-900, Campina Grande, PB, Brazil · Instituto de Forma¸c˜ao de Educadores, Universidade Federal do Cariri, Rua Oleg´ario Em´ıdio de Ara´ujo, s/n, Aldeota, 63260-000, Brejo Santo, CE, Brazil

  16. Does AI Understand Imaging? A Systematic Benchmark of Agentic AI for Computational Imaging Tasks

    Jul 8, 2026Ethan Chung, Chuanjun Zheng, Jasper Tan +3VLM EvaluationAI Agent Benchmarks

    University of Hawaii at Manoa · Glass Imaging

  17. Comparative Study of Domain-adapted VLMs for General Document Visual Question Answering

    Jul 8, 2026Miguel Lopez-Duran, Elena Marrero, Julian Fierrez +8VLM EvaluationDocument Understanding

    BiometricsAI, Universidad Autónoma de Madrid (UAM), Spain

  18. UI2App: Benchmarking Visual Interaction Inference in Executable Web Application Generation

    Jul 7, 2026Grace Man Chen, Litao Guo, Yifan Wu +5VLM EvaluationWeb Application Generation

    1The Hong Kong University of Science and Technology (Guangzhou) · 2The Hong Kong University of Science and Technology

  19. VendorBench-100: A Unified Cross-Paradigm Benchmark for Deepfake Image Detection

    Jul 7, 2026Sharayu N. Deshmukh, Md Rashidunnabi, Nelton Tiago Gemo +3VLM EvaluationDeepfake Detection

    Universidade da Beira Interior Covilha, Portugal · Department of Computer Science Shri Guru Buddhi Swami College Purna, India · School of Computational Science Swami Ramanand Tirtha Marathwada University Nanded, India

  20. Pluralis v0.1: Towards a Multicultural, Multimodal, Multilingual Benchmark for AI Risk and Reliability

    Jul 7, 2026Alicia Parrish, Rajat Shinde, Sanket Badhe +57VLM EvaluationCross-Cultural Language Model Evaluation

  21. Is the Geometry Doing the Work? An Operating-Point Audit of Hierarchy in Hyperbolic Vision-Language Models

    Jul 6, 2026Jaeyoung Kim, Eunseok Kim, Dongsuk JangVLM EvaluationVision-Language Models

    MADI

  22. SteelBench: Evaluating Vision-Language Models in Real-World Industrial Environments

    Jul 6, 2026Suryanarayana Reddy Yarrabothula, Manisha Chawla, Kunal Sinha +5VLM EvaluationVideo Understanding

    Indian Institute of Technology Bhilai · Steel Authority of India Limited · VIT Vellore

  23. Does It Fail to See or Fail to Know? Attributing Errors in Vision-Language Models

    Jul 6, 2026Khang Nhat Hoang Vo, Artem Vazhentsev, Artem Shelmanov +2VLM EvaluationVision-Language Models

    1MBZUAI · 2The University of Melbourne

  24. RoboVista: Evaluating Vision Language Models for Diverse Robot Applications

    Jul 6, 2026Shuangyu Xie, Kaiyuan Chen, Ziyang Chen +8VLM EvaluationEmbodied QA

    University of California, Berkeley · Princeton University · Google DeepMind

  25. HCSU: A Dataset and Benchmark for Fine-Grained Historical Calligraphy Style Understanding

    Jul 5, 2026Yinsheng Yao, Yan Liu, Chen YeVLM EvaluationLarge Vision-Language Models

    School of Computer Science and Technology, Tongji University, Shanghai, China · The Key Laboratory of Embedded System and Service Computing, Ministry of Education, Shanghai, China

  26. When Simpler Is Better: Evaluating Translation Pipelines for Medieval Latin Manuscripts

    Jul 4, 2026Nguyen Kim Hai Bui, Md. Easin Arafat, Tamás Gábor Orosz +1VLM EvaluationLow-Resource MT

    Eötvös Loránd University · King Fahd University of Petroleum and Minerals

  27. ClinOCR-Bench: A Comprehensive Clinical Scanned Document Dataset for Optical Character Recognition Model Evaluation

    Jul 4, 2026Enshuo Hsu, Jin Zhou, Kirk RobertsVLM EvaluationOptical Character Recognition

    McWilliams School of Biomedical Informatics, University of Texas Health Science Center at Houston, Houston, Texas, USA. · Enterprise Development & Integration, University of Texas MD Anderson Cancer Center, Houston, TX, USA.

  28. Do Medical Vision Language Models Actually See? A Counterfactual Grounding Framework and Hard-Negative Contrastive Training for Visually-Reliant Medical VLMs

    Jul 4, 2026Anas Zafar, Leema Krishna Murali, Siddhant Bharadwaj +2VLM EvaluationCounterfactual Evaluation

    The University of Texas MD Anderson Cancer Center · Eisai Inc. · Cohere Labs Community +1

  29. IDEAL-Bench: Indoor Dataset and Evaluation suite for Analyzing 3D Layout reasoning

    Jul 3, 2026Yuening Cai, Junwei Zhou, Youran Qu +1VLM EvaluationSpatial Reasoning Benchmarks

    Department of Computer Science Dartmouth College

  30. Brand-as-Memory: Vision-Language Models Encode Causal, Mechanistically Localizable Credibility Priors for News Sources

    Jul 3, 2026Chih-Ting Liao, Xin CaoVLM EvaluationVLM Interpretability

    University of New South Wales