Position Bias in VLMs

VLM: Vision-Language Model

Follow this topic Ask about this topic

Latest papers

9 papers2 papers in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

alkhder at ImageEval 2026 Shared Tasks: Constrained Selection and Rotation-Averaged Logit Scoring for Multimodal Hallucination Detection
Oct 15, 2026Maher Pasa, Maria Hanini, Amro Najjar +1Position Bias in VLMs Hallucination Detection in VLMs
Altınbaş University, Türkiye · Imperial College London · Luxembourg Institute of Science and Technology +1
When the Judge Acts: Auditing VLM-Guided Image Selection on Culturally Situated Prompts
Oct 1, 2026Huichan SeoVLM Evaluation Position Bias in VLMs
Independent Researcher
MedProb: Probing Internal Representations of Vision-Language Models for Medical Question Answering
Sep 3, 2026Erfan Nourbakhsh, Ke Yang, Anthony RiosPosition Bias in VLMs Medical VQA
The University of Texas at San Antonio
Order Matters: LVLMs as Judges for Temporal Reasoning in Image Sequences
Aug 11, 2026Martina Ianaro, Guilherme Fernandes, Maurizio Gabbrielli +1VLM Evaluation Position Bias in VLMs
University of Bologna Bologna, Italy · NOVA School of Science and Technology NOVA Laboratory for Computer Science and Informatics Lisbon, Portugal
Evaluating the Diagnostic Robustness of Vision-Language Models Under Visual and Textual Perturbations
Aug 5, 2026Ali Khoramfar, Mohammad Javad Dousti, Alireza Mohamadian +1VLM Evaluation VLM Robustness
Department of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran · Advanced Diagnostic and Interventional Radiology Research Center (ADIR), Tehran University of Medical Sciences, Tehran, Iran
SynthDocBench: Controlled Benchmark for Long-Context Visual Document Understanding
Jul 11, 2026Abhigya Verma, Khyati Mahajan, Amit Kumar Saha +4VLM Evaluation Position Bias in VLMs
ServiceNow AI · Mila · Université de Montréal
Why Far Looks Up: Probing Spatial Representation in Vision-Language Models
May 28, 2026Cheolhong Min, Jaeyun Jung, Daeun Lee +5Representation Learning Visual Spatial Reasoning
Seoul National University · The Ohio State University · NVIDIA
MJ1: Multimodal Judgment via Grounded Verification
Mar 9, 2026Bhavesh Kumar, Dylan Feng, Leonard TangPosition Bias in VLMs MLLM Evaluation
Haize Labs
CLIP Is Shortsighted: Paying Attention Beyond the First Sentence
Feb 25, 2026Marc-Antoine Lavoie, Anas Mahmoud, Aldo Zaimi +2Position Bias in VLMs Vision-Language Alignment
University of Toronto Robotics Institute · Mila - Quebec AI Institute

Oct 15, 2026J/K move · Enter open · S save

alkhder at ImageEval 2026 Shared Tasks: Constrained Selection and Rotation-Averaged Logit Scoring for Multimodal Hallucination Detection

Maher Pasa, Maria Hanini, Amro Najjar, Hasan Alkhder

Altınbaş University, Türkiye · Imperial College London · Luxembourg Institute of Science and Technology+1

Position Bias in VLMs Hallucination Detection in VLMs VLM Evaluation

Open paper AskPDF arXiv

We describe our submission to Subtask~1b of ImageEval 2026. The task consists of selecting the single visually valid statement from three candidates paired with an image, and is in both English and Modern Standard Arabic (MSA). Our system uses a pre-trained 7B vision--language model in a zero-shot setting, without task-specific training or fine-tuning. We formulate the task as a constrained selection problem and choose the answer using next-token log-probabilities. To reduce answer-position bias, we apply a Latin-square rotation to the candidate statements. Our system achieves CI scores of 0.0510 on the English test set and 0.0960 on the MSA test set, reducing CI relative to the official 3B baselines reported on devtest by 83.7% and 80.4%, respectively.