VLM Calibration

VLM: Vision-Language Model

Ask about this topic

Momentum

13 papers in the last four weeks, up 30% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 47

All topics
CardsList

  1. Towards Reliable Vision-Language Models for Autonomous Driving

    Oct 1, 2026Manasa Mariam Mammen, Priyanka Mary Mammen, Zafer Kayatas +1VLM RobustnessImage Corruption Robustness

    Technical University of Munich, Heilbronn, Germany · Mercedes Benz AG, Sindelfingen, Germany · University of Massachusetts, Amherst, USA

  2. SubRot: Signed Gradient Subspace Calibration for VLM Rotation Quantization

    Sep 28, 2026Zhenhao Shang, Haizhao Jing, Haokui Zhang +4VLM QuantizationRotation-Based Quantization

    Northwest Polytechnical University · Nanjing University of Science and Technology · Intellifusion +1

  3. Domain Recentering and Confidence-Weighted Prior Calibration for Vision-Language Models

    Sep 24, 2026Youngeun Seol, Jimin Shin, Heeseo Yoon +1Source-Free Domain AdaptationUnsupervised Domain Adaptation

    Department of Computer Science and Engineering, Ewha Womans University

  4. Perception, Layout, and Validation: Calibrated Confidence for Reliable Straight-Through Processing of Financial Documents

    Sep 17, 2026Yichao Jin, Yushuo Wang, Yuxuan Han +7Document Information ExtractionVLM Calibration

    OCBC, Singapore

  5. Calibrated Probabilistic Obstruction Reasoning with Vision-Language Models for Grasping in Clutter

    Sep 16, 2026Thanh-Tuan Tran, Ngoc-Chien Chu, Thanh Nguyen Canh +3Robotic GraspingRobotic Manipulation

    University of Engineering and Technology, Vietnam National University, Hanoi, 10000, Vietnam · School of Information Science, Japan Advanced Institute of Science and Technology, Ishikawa, 923-1211, Japan · Department of Robotics, Hanyang University, Gyeonggi-do, 15588, Korea

  6. The Mirage of Calibrated Confidence: Trajectory-Independence of Verbalized Confidence in Vision-Language Models

    Sep 16, 2026Jisoo Yang, Jaeho Han, Trung X. Pham +1VLM EvaluationConfidence Estimation in Language Models

    Department of Artificial Intelligence, Chung-Ang University, Republic of Korea · Van Lang University, Ho Chi Minh City, Vietnam

  7. Can VLMs Reliably Assess Sidewalk Accessibility Attributes from Pedestrian-Level Imagery?

    Sep 15, 2026Seung Jae Lieu, Diego Morra, Chiara Cadoni +3VLM EvaluationUrban Planning

    Senseable City Lab Massachusetts Institute of Technology Cambridge, MA 02139

  8. Bridging the Confidence Gap: Temperature Scaling for Calibrating Test-Time Prompt Tuning

    Sep 15, 2026Yuwei Liang, Jian Liang, Dapeng Hu +2Post-Hoc CalibrationTest-Time Adaptation of VLMs

    School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China · NLPR & MAIS, Institute of Automation, Chinese Academy of Sciences, Beijing, China · Independent Researcher

  9. SAVOR: Self-Aware Visual Grounding via Confidence-Calibrated Reinforcement Learning for Multimodal Hallucination Mitigation

    Sep 15, 2026Zixiu Ding, Zilin Zhao, Yingjie He +3Object Hallucination in VLMsVisual Grounding

    Central South University · Peking University

  10. Human-Grounded Calibration for Long-Text Image-Text Congruence in Vision-Language Models

    Sep 14, 2026Alessandro Gambetti, Qiwei HanText-Image AlignmentVision-Language Retrieval

    NOVA School of Science and Technology · Universidade NOVA de Lisboa · Caparica, Portugal +2

  11. Vision-Language Models for Criterion-Level Grading of Handwritten Examinations in Outcome-Based Education

    Sep 13, 2026Asif Hasan Tonmoy, Saad Ahmed, Md Khalid Syfullah +1VLM EvaluationRubric-Based Evaluation

  12. Learning to Adapt and Calibrate: Score Distribution Alignment for Few-Shot Uncertainty Prediction in Medical VLMs

    Sep 9, 2026Xuan Cuong Ngo, Ngan LeVLM AdaptationConformal Prediction

    University of Arkansas Fayetteville, Arkansas, USA

  13. Vision-language models know more about agriculture than they show and rubric-grounded verifications close the gap

    Sep 8, 2026Earl Ranario, Jared Smith, Lars Lundqvist +2Agricultural Image AnalysisPlant Disease Classification

    University of California, Davis

  14. IntroConformal: Conformal Factuality Guarantees for Large Vision-Language Models via Introspective Signals

    Sep 1, 2026Md. Atabuzzaman, Christian Alexander, Chris ThomasVLM EvaluationLarge Vision-Language Models

    Department of Computer Science Virginia Tech

  15. Good Memory Has ECC: Evaluating the Memory of Vision-Language Models Beyond Accuracy

    Aug 31, 2026Shmuel Berman, Jia DengVLM EvaluationMemory-Augmented VLMs

    Department of Computer Science Princeton University

  16. Rethinking the Test-Time Prompt Tuning Objective from the Perspective of Calibration

    Aug 31, 2026Jungwon Choi, Hyeonseo Jang, Kibok Lee +1VLM CalibrationUncertainty Calibration

    Department of Computer Science and Engineering, Chung-Ang University · Department of Statistics and Data Science, Yonsei University

  17. Frontier vision-language models have overtaken young adults at detecting AI-generated portraits -- but not their calibration

    Aug 31, 2026Sunwhi Kim, Sunyul Kim, Meounggun Jo +1VLM EvaluationVision-Language Models

    Hwasung Medi-Science University, Dept. of Bio-Healthcare · Hwasung Medi-Science University, Dept. of Bio-Healthcare, Republic of Korea · Yonsei University, Graduate School of Engineering, Dept. of Artificial Intelligence +5

  18. SpanCalib-VLM: Calibrated Hallucination Span Detection in Vision-Language Models

    Aug 30, 2026Amanuel Gizachew Abebe, Yasmin MoslemHallucination Detection in VLMsHallucination Detection

    Shaggar Institute of Technology · Shaggar City, Ethiopia · Trinity College Dublin +1

  19. MVC-Bench: Benchmarking Calibration of Medical Vision-Language Models

    Aug 27, 2026Ashshak Sharifdeen, Shihab Aaqil Ahamed, Ufaq Khan +6VLM EvaluationVLM Robustness

    1Mohamed bin Zayed University of AI · 2Sabaragamuwa University of Sri Lanka · 3Digital Platform Development, SLT PLC

  20. TRAPSBench: Vision-Language Models Encode but Fail to Express Epistemic Restraint

    Aug 13, 2026Fnu Pramono, John Cai, Sourabh KulkarniVLM EvaluationVision-Language Models

    Meta Superintelligence Labs · Reflection AI

  21. LookBack: Where and How to Score LVLM Responses via Visual Reference Usage

    Aug 12, 2026Beomsik Cho, Jinhyeong Kim, Dongseok Lee +1VLM EvaluationHallucination Detection in VLMs

    Yonsei University

  22. When Visual Signals Mislead: A Mechanistic Study of Attribute Hallucination in Vision-Language Models

    Aug 11, 2026Yufei Zhang, Chenlu Zhan, Hongwei WangHallucination Detection in VLMsVLM Adaptation

    Zhejiang University

  23. CARE: Confidence-Aware Reasoning for Reliable Medical VQA

    Aug 11, 2026Yuetian Du, Yucheng Wang, Zhenyuan Chen +9Medical VQAMedical VLMs

    Zhejiang University · Ant Group · University of Michigan +1

  24. Vision-Language Model Confidence Is Not a Property of the Answer

    Aug 6, 2026Reza Khanmohammadi, Erfan Miahi, Ivan Brugere +4VLM RobustnessAdversarial Attacks on VLMs

    Michigan State University · JPMorgan AI Research · Henry Ford Health

  25. Confidence Estimation for Financial Vision-Language Models in Chart and Document Understanding

    Aug 6, 2026Reza Khanmohammadi, Simerjot Kaur, Charese H. Smiley +2Visual Question AnsweringSelective Prediction

    Michigan State University East Lansing, Michigan, USA · JPMorgan AI Research New York, New York, USA

  26. Respect Your Zero-Shot Uncertainty: Conservative Calibration for Test-Time-Adapted Vision-Language Models

    Aug 6, 2026Jingyan Jiang, Yaru Sun, Xiao Chen +5VLM AdaptationTest-Time Adaptation of VLMs

    1Shenzhen Technology University · 3Shenzhen University · 2Tsinghua University +1

  27. Perceptual Anchoring: Prototype-Guided Text Calibration for Training-free Open-Vocabulary Semantic Segmentation

    Aug 4, 2026Wanli Ma, Jiangwen Lu, Qinmu Peng +1Open-Vocabulary Semantic SegmentationVision-Language Alignment

    School of Electronic Information and Communications, Huazhong University of Science and Technology, Wuhan 430074, China · National Anti-counterfeit Engineering Research Center, Huazhong University of Science and Technology, Wuhan 430074, China · School of Automation, Hangzhou Dianzi University, Hangzhou 310018, China

  28. Confident but Unreliable: A Behavioral Safety Audit of Vision-Language Models on Brain MRI

    Aug 3, 2026Amir Sabbaghziarani, Mohammadsajad Abavisani, Sergey PlisVLM EvaluationVLM Hallucination

    TReNDS Center Atlanta, GA, USA

  29. Can You Trust the Confidence? ConfBench for Vision-Language Models on Document Extraction

    Aug 3, 2026Priyashree Roy, Sujitha Martin, Mohammad Rostami +6VLM EvaluationDocument Understanding

    Amazon Web Services

  30. When Model Priors Conflict with Visual Evidence: Mitigating Commonsense-Driven Hallucinations by Selective Prior Calibration

    Jul 31, 2026Kesheng Chen, Yamin Hu, Wenjian LuoVLM HallucinationVLM Calibration

    Guangdong Provincial Key Laboratory of Novel Security Intelligence Technologies Institute of Cyberspace Security School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen, China

  31. Mitigating Class-Tail Undercoverage in Medical Vision-Language Models under Clinical Shift

    Jul 30, 2026Mushir Akhtar, M. TanveerGroup-Conditional Conformal PredictionConformal Prediction

    Department of Mathematics, Indian Institute of Technology Indore, India

  32. Small Vision-Language Models Know When They Are Wrong But Cannot Say So: A Two-Model Study of Stated versus Internal Confidence Under Realistic Image Degradation

    Jul 24, 2026M M Asif FerdousVLM RobustnessVision-Language Models

    Independent Researcher

  33. Confidence Scores in Open-Vocabulary Detection Are a Biased Mixture of Scale and Semantics

    Jul 13, 2026Yi Tang Soon, Jun-Wei HsiehOpen-Vocabulary Object DetectionObject Detection

    Institute of Intelligence Systems, National Yang Ming Chiao Tung University, Tainan, Taiwan · College of Artificial Intelligence and Green Energy, National Yang Ming Chiao Tung University, Hsinchu, Taiwan

  34. MED-DSLC: Multi-Expert-Domain Classification via Domain Supervision and Logit Calibration

    Jul 13, 2026Zheng Zeng, Deepak Sridhar, Nuno VasconcelosVLM RobustnessVLM Adaptation

    University of California, San Diego, USA

  35. When Prompts Ignore Structure: Graph-Based Attribute Reasoning for Calibrated VLMs

    Jul 8, 2026Tanay Sodha, Aditya Sharma, Ramya Hebbalaguppe +2Vision-Language ModelsVLM Adaptation

    Department of Computer Science and Information Systems, Birla Institute of Technology and Science, Pilani, India · TCS Research, New Delhi, India

  36. Just how sure are you? Improving Verbalized Uncertainty Calibration in Medical VQA

    Jun 25, 2026Eren Senoglu, Federico Toschi, Nicolo Brunello +2Medical VQALanguage Model Calibration

    Politecnico di Milano

  37. Each Judge Its Own Yardstick: Discovering Per-VLM Taxonomies for Physical Video Evaluation

    Jun 22, 2026Yu Cao, Ziquan Liu, Zhensong Zhang +3VLM EvaluationPhysical Consistency in Video Generation

    Queen Mary University of London · Huawei Darwin Research Center · Imperial College London

  38. Look Again Before You Abstain:Budgeted Conformal Evidence Acquisition for Reliable Vision-Language Model

    Jun 15, 2026Jian Xu, Delu Zeng, John Paisley +1Hallucination Detection in VLMsActive Perception

    RIKEN iTHEMS · RIKEN AIP · South China University of Technology +1

  39. FUSE: Quantifying Uncertainty in Vision-Language Models by Bayesian Fusing Epistemic and Aleatoric Uncertainty

    Jun 1, 2026Harry Zhang, Luca CarloneUncertainty Estimation for VLA ModelsVision-Language Models

    Massachusetts Institute of Technology

  40. Density-Aware Translation of Spurious Correlations in Zero-Shot VLMs

    Jun 1, 2026Afsaneh Hasanebrahimi, Hanxun Huang, Christopher Leckie +1VLM RobustnessVision-Language Models

    School of Computing and Information Systems, The University of Melbourne, Victoria, Australia.

  41. CHASD: Language Increment-Calibrated Contrastive Decoding against Hallucination in LVLMs

    May 22, 2026Xiaoyi Huang, Kejia Zhang, Zhiming LuoHallucination Detection in VLMsEfficient VLM Inference

    Institute of Artificial Intelligence, Xiamen University · Department of Artificial Intelligence, Xiamen University

  42. Ranking-Aware Calibration for Reliable Multimodal Reinforcement Learning

    May 16, 2026Peng Cui, Boyao Yang, Jun ZhuMultimodal RobustnessVLM Reasoning

    Dept. of Comp. Sci. & Tech., Institute for AI, BNRist Center, Tsinghua-Bosch Joint ML Center, THBI Lab, Tsinghua University, Beijing 100084, China · Dept. of Automation, Tsinghua University, Beijing 100084, China

  43. Grounded or Guessing? LVLM Confidence Estimation via Blind-Image Contrastive Ranking

    May 11, 2026Reza Khanmohammadi, Erfan Miahi, Simerjot Kaur +4VLM EvaluationVision-Language Models

    Michigan State University · Independent AI Researcher · JPMorgan AI Research +1

  44. Online Self-Calibration Against Hallucination in Vision-Language Models

    May 1, 2026Minghui Chen, Chenxu Yang, Hengjie Zhu +3Vision-Language ModelsHallucination in Language Models

    Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China · School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China

  45. Improving Calibration in Test-Time Prompt Tuning for Vision-Language Models via Data-Free Flatness-Aware Prompt Pretraining

    Apr 30, 2026Hyeonseo Jang, Jaebyeong Jeon, Joong-Won Hwang +1Deep Learning OptimizationVision-Language Models

    1Yonsei University · 2ETRI

  46. Overconfidence and Calibration in Medical VQA: Empirical Findings and Hallucination-Aware Mitigation

    Apr 2, 2026Ji Young Byun, Young-Jin Park, Jean-Philippe Corbeil +1Vision-Language ModelsVLM Hallucination

    Johns Hopkins University, School of Medicine · Massachusetts Institute of Technology · Microsoft Healthcare & Life Sciences

  47. How (Mis)calibrated is your Federated CLIP and what to do about it?

    Dec 3, 2025Mainak Singha, Masih Aminbeidokhti, Paolo Casari +3Vision-Language ModelsVLM Adaptation

    University of Trento, Italy · ´Ecole de technologie sup´erieure, QC, Canada · AMIAD, Pˆole Recherche, Palaiseau, France +2