VLM Evaluation

VLM: Vision-Language Model

Follow this topic Ask about this topic

Momentum

70 papers in the last four weeks, up 67% on the four weeks before. 0.7% of all new papers.

Jul 13Week of Sep 28

Latest papers 649

All topics

The Effects of Visual Priming on Cooperative Behavior in Vision-Language Models
Apr 30, 2026Kenneth J. K. OngVLM Evaluation VLM Robustness
1ST Engineering, Singapore.
Auditing Frontier Vision-Language Models for Trustworthy Medical VQA: Grounding Failures, Format Collapse, and Domain Adaptation
Apr 30, 2026Xupeng Chen, Binbin Shi, Chenqian Le +5VLM Evaluation Healthcare
New York University, New York, USA · Tsinghua University, Beijing, China · Columbia University, New York, USA +1
WaferSAGE: Large Language Model-Powered Wafer Defect Analysis via Synthetic Data Generation and Rubric-Guided Reinforcement Learning
Apr 30, 2026Ke Xu, Zhongyuan LianVLM Evaluation Visual Question Answering
Shanghai Huahong Grace Semiconductor Manufacturing Corporation, Shanghai, 201203, China · Dept. of Automation, School of Information Science and Engineering, East China University of Science and Technology, Shanghai, 200237, China
Revealing the Impact of Visual Text Style on Attribute-based Descriptions Produced by Large Visual Language Models
Apr 30, 2026Xiaomeng Wang, Martha Larson, Zhengyu ZhaoVLM Evaluation Vision-Language Models
Radboud University · Nijmegen, Netherlands · Xi’an Jiaotong University +1
Beyond Screenshots: Evaluating VLMs' Understanding of UI Animations
Apr 28, 2026Chen Liang, Xirui Jiang, Naihao Deng +2VLM Evaluation Video Understanding
University of Michigan
QCalEval: Benchmarking Vision-Language Models for Quantum Calibration Plot Understanding
Apr 28, 2026Shuxiang Cao, Zijian Zhang, Abhishek Agarwal +29VLM Evaluation In-Context Learning
1NVIDIA · University of Toronto · 13Vector Institute for Artificial Intelligence +10
VLM Judges Can Rank but Cannot Score: Task-Dependent Uncertainty in Multimodal Evaluation
Apr 28, 2026Divake Kumar, Sina Tayebati, Devashri Naik +2VLM Evaluation Vision-Language Models
University of Illinois at Chicago · 2AI Labs at Capital One
DRAGON: A Benchmark for Evidence-Grounded Visual Reasoning over Diagrams
Apr 28, 2026Anirudh Iyengar Kaniyar Narayana Iyengar, Tampu Ravi Kumar, Gaurav Najpande +4VLM Evaluation Visual Reasoning
Arizona State University · Adobe Research · University of Maryland
FCMBench-Video: Benchmarking Document Video Intelligence
Apr 28, 2026Runze Cui, Fangxin Shang, Yehui Yang +3VLM Evaluation Document Understanding
AI Lab, Qifu Technology, Beijing, China · School of Future Technology, South China University of Technology, Guangzhou, China · Pazhou Lab, Guangzhou, China +1
One Perturbation, Two Failure Modes: Probing VLM Safety via Embedding-Guided Typographic Perturbations
Apr 28, 2026Ravikumar Balakrishnan, Sanket MendaparaVLM Evaluation VLM Robustness
Cisco Systems
Probing CLIP's Comprehension of 360-Degree Textual and Visual Semantics
Apr 27, 2026Hai Wang, Xiaochen Yang, Mingzhi Dong +1VLM Evaluation VLM Adaptation
Department of Statistical Science, University College London, UK · School of Mathematics and Statistics, University of Glasgow, UK · Department of Computer Science, University of Bath, UK.
A systematic evaluation of vision-language models for observational astronomical reasoning tasks
Apr 27, 2026Wenke Ren, Hengxiao Guo, Wenwen Zuo +1VLM Evaluation Vision-Language Models
Shanghai Astronomical Observatory, Chinese Academy of Sciences, Shanghai, China · Harvard University, Boston, Massachusetts, USA
AutoGUI-v2: A Comprehensive Multi-Modal GUI Functionality Understanding Benchmark
Apr 27, 2026Hongxin Li, Xiping Wang, Jingran Su +4VLM Evaluation GUI Agents
University of Chinese Academy of Sciences (UCAS) · 2New Laboratory of Pattern Recognition (NLPR), CASIA · 3State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS), CASIA +3
SycoPhantasy: Quantifying Sycophancy and Hallucination in Small Open Weight VLMs for Vision-Language Scoring of Fantasy Characters
Apr 27, 2026Arya Shah, Deepali Mishra, Chaklam SilpasuwanchaiVLM Evaluation Vision-Language Models
IIT Gandhinagar Gandhinagar, India · IIT Kanpur Kanpur, India · Asian Institute of Technology Bangkok, Thailand
ReVSI: Rebuilding Visual Spatial Intelligence Evaluation for Accurate Assessment of VLM 3D Reasoning
Apr 27, 2026Yiming Zhang, Jiacheng Chen, Jiaqi Tan +3VLM Evaluation Spatial Reasoning Benchmarks
1Simon Fraser University · 2Hong Kong University of Science and Technology · University of Waterloo +1
PushupBench: Your VLM is not good at counting pushups
Apr 25, 2026Shengzhi Li, Jiarun Chen, Karun Sharma +2VLM Evaluation Video-Language Model Evaluation
GAZE: Grounded Agentic Zero-shot Evaluation with Viewer-Level Tools and Literature Retrieval on Rare Brain MRI
Apr 25, 2026Duaa Alim, Mogtaba Alim, Liam ChalcroftVLM Evaluation Rare Disease Diagnosis
Imperial College London, UK · University of Toronto, Canada · University College London, UK
When Prompts Override Vision: Prompt-Induced Hallucinations in LVLMs
Apr 23, 2026Pegah Khayatan, Jayneel Parekh, Arnaud Dapogny +3VLM Evaluation LLM Hallucination Mitigation
1ISIR, Sorbonne Universit´e, Paris, France · 2Valeo.ai, Paris, France
From Codebooks to VLMs: Evaluating Automated Visual Discourse Analysis for Climate Change on Social Media
Apr 23, 2026Katharina Prasse, Steffen Jung, Isaac Bravo +4VLM Evaluation Social Media Analysis
Chair of Machine Learning, University of Mannheim Mannheim, BW 68131, Germany · Department of Governance, Technical University Munich München, BA 80333, Germany · Clausthal University of Technology Clausthal-Zellerfeld, NI 38678, Germany +1
Seeing Isn't Believing: Uncovering Blind Spots in Evaluator Vision-Language Models
Apr 23, 2026Mohammed Safi Ur Rahman Khan, Sanjay Suryanarayanan, Tushar Anand +1VLM Evaluation VLM Robustness
♠Nilekani Centre at AI4Bharat ♢Indian Institute of Technology Madras · ♠Nilekani Centre at AI4Bharat · ♣BITS Pilani, Hyderabad
VG-CoT: Towards Trustworthy Visual Reasoning via Grounded Chain-of-Thought
Apr 23, 2026Byeonggeuk Lim, Kyeonghyun Kim, JungMin Yun +1VLM Evaluation CoT Reasoning
Graduate School of Advanced Imaging Science, Multimedia & Film, Chung-Ang University1 · Department of Artificial Intelligence, Chung-Ang University2
Can MLLMs "Read" What is Missing?
Apr 23, 2026Jindi Guo, Chaozheng Huang, Xi FangVLM Evaluation Document Understanding
DP Technology
OMIBench: Benchmarking Olympiad-Level Multi-Image Reasoning in Large Vision-Language Model
Apr 22, 2026Qiguang Chen, Chengyu Luan, Jiajun Wu +7VLM Evaluation Visual Reasoning
Research Center for Social Computing and Interactive Robotics, Harbin Institute of Technology · Central South University · Fudan University +3
The Expense of Seeing: Attaining Trustworthy Multimodal Reasoning Within the Monolithic Paradigm
Apr 22, 2026Karan GoyalVLM Evaluation Multimodal Reasoning
IIIT Delhi, India
Evaluating Remote Sensing Image Captions Beyond Metric Biases
Apr 22, 2026Ziyun Chen, Fan Liu, Liang Yao +3VLM Evaluation Remote Sensing Image Understanding
Hohai University Nanjing, China · Cardiff University Cardiff, UK
EgoDyn-Bench: Evaluating Ego-Motion Understanding in Vision-Centric Foundation Models for Autonomous Driving
Apr 22, 2026Finn Rasmus Schäfer, Yuan Gao, Dingrui Wang +5VLM Evaluation Autonomous Driving Benchmarks
Professorship of Autonomous Vehicle Systems, Technical University of Munich, Munich, Germany · Bayerische Motoren Werke AG, Munich, Germany · Data Analytics and Machine Learning Group, Technical University of Munich, Munich, Germany
Culturally uneven urban perception in large language models
Apr 21, 2026Rong Zhao, Wanqi Liu, Zhizhou Sha +3VLM Evaluation Social Bias in Language Models
Centre for Advanced Spatial Analysis (CASA), UCL, London, UK · Department of Computer Science, UT Austin, Austin, TX, USA · School of Architecture, Tsinghua University, Beijing, China
DistortBench: Benchmarking Vision Language Models on Image Distortion Identification
Apr 21, 2026Divyanshu Goyal, Akhil Eppa, Vanya Bannihatti KumarVLM Evaluation Benchmark Construction
Adobe Inc.
Assessing VLM-Driven Semantic-Affordance Inference for Non-Humanoid Robot Morphologies
Apr 21, 2026Jess Jones, Raul Santos-Rodriguez, Sabine HauertVLM Evaluation Cross-Embodiment Robot Learning
Bristol Robotics Laboratory, University of Bristol Bristol, United Kingdom · University of Bristol Bristol, United Kingdom
Seeing Candidates at Scale: Multimodal LLMs for Visual Political Communication on Instagram
Apr 21, 2026Michael Achmann-Denkler, Mario Haim, Christian WolffVLM Evaluation Social Media Analysis
Media Informatics Group University of Regensburg Regensburg, Germany · Department of Media and Communication Ludwig-Maximilians-Universität Munich, Germany

Apr 30, 2026, cs.AIJ/K move · Enter open · S save

The Effects of Visual Priming on Cooperative Behavior in Vision-Language Models

Kenneth J. K. Ong

1ST Engineering, Singapore.

VLM Evaluation VLM Robustness Vision-Language Models

Open paper AskPDF arXiv

As Vision-Language Models (VLMs) become increasingly integrated into decision-making systems, it is essential to understand how visual inputs influence their behavior. This paper investigates the effects of visual priming on VLMs' cooperative behavior using the Iterated Prisoner's Dilemma (IPD) as a test scenario. We examine whether exposure to images depicting behavioral concepts (kindness/helpfulness vs. aggressiveness/selfishness) and color-coded reward matrices alters VLM decision patterns. Experiments were conducted across multiple state-of-the-art VLMs. We further explore mitigation strategies including prompt modifications, Chain of Thought (CoT) reasoning, and visual token reduction. Results show that VLM behavior can be influenced by both image content and color cues, with varying susceptibility and mitigation effectiveness across models. These findings not only underscore the importance of robust evaluation frameworks for VLM deployment in visually rich and safety-critical environments, but also highlight how architectural and training differences among models may lead to distinct behavioral responses-an area worthy of further investigation.

Momentum

Related topics

Latest papers 649