VLM Calibration

VLM: Vision-Language Model

Overview

Vision-language model calibration studies whether confidence in image-text predictions reflects their actual correctness, supporting safer decisions such as abstaining or requesting more evidence. Approaches include temperature and logit scaling, prompt and embedding calibration, conformal prediction, confidence probes, and training or decoding methods that use visual evidence to detect hallucinations. These methods are evaluated across zero-shot classification, visual question answering, detection, and specialized settings such as medical imaging, documents, and autonomous driving, including under distribution shift. Calibration can improve selective prediction, but standard metrics may not reveal whether confidence tracks visual grounding or sound reasoning, and reliability can break under severe shifts or deliberate perturbations.

Latest papers

CardsList

91 papers11 papers in the last four weeks, up 83% on the four weeks before. 0.1% of all new papers.

  1. A-TPT: Angular Diversity Calibration Properties for Test-Time Prompt Tuning of Vision-Language Models

    Oct 30, 2025Shihab Aaqil Ahamed, Udaya S. K. P. Miriya Thanthrige, Ranga Rodrigo +1Test-Time Adaptation of VLMsVLM Calibration