VLM Robustness

VLM: Vision-Language Model

Overview

Vision-language model robustness asks whether a model’s answers stay grounded and dependable when images or prompts are corrupted, altered, unfamiliar, or in conflict. Researchers test these failures with adversarial attacks, corruption and out-of-distribution benchmarks, prompt and context variations, and measures of grounding, consistency, calibration, and safety. Common defenses include adversarial training, test-time adaptation, visual evidence selection, and interventions on model representations or attention. A central challenge is that clean accuracy and even stable answers can hide reliance on shortcuts, while improving robustness can cost accuracy, utility, or efficiency.

Latest papers

CardsList

471 papers22 papers in the last four weeks, down 58% on the four weeks before. 0.2% of all new papers.

  1. Suppressing the Shortcut Hidden Behind the Gains of VideoLLM Fine-Tuning

    Nov 19, 2026Youngwoo Shin, Jongsuk Kim, Junmo KimVideo-Language ModelsVisual Evidence Sensitivity in VLMs

  2. Pixel2Perspective: A Benchmark for Multi-Modal and Multi-View Generalization in Vision-Language Models

    Nov 18, 2026Aditya Gandhamal, Aniruddh Sikdar, Arya Kishor +1VLM RobustnessVLM Evaluation

  3. M3^3-Test: Coverage Gaps in Joint-Perturbation Testing of Visual Question Answering

    Nov 17, 2026Enhui Wan, Xiaowan WangVLM EvaluationVLM Robustness

  4. SmoothShift: Disrupting Visual Adversarial Attacks on LVLMs at Test Time

    Nov 16, 2026Xiaoqing Chen, Jiayi Ouyang, Dongrui WuVLM RobustnessAdversarial Attacks on VLMs

  5. Scale-Induced Semantic Shift in Visual Prompt Injection Against VLMs and Web Agents

    Nov 12, 2026Yiheng Zhao, Runze Ji, Chenyu Yi +4Adversarial Attacks on VLMsPrompt Injection

  6. DiFiT: Distribution-Fidelity-guided Visual Token Pruning for Multimodal Large Language Models

    Nov 11, 2026Jingyuan Zhang, Nihao Niu, Xinyang Lv +4Visual Token PruningLVLM Pruning

  7. Back to the Question: Tracing Visual Distraction Through Text Tokens

    Nov 11, 2026Marie Amale Huynh, Regev Cohen, Serena Yeung-Levy +1VLM RobustnessReasoning for VLMs

  8. Beyond Attack-Based Accuracy: Rethinking Adversarial Robustness Evaluation Through Structural Gradient Alignment

    Nov 11, 2026Hanrui Wang, Yu Luo, Shuo Wang +3Adversarial RobustnessVLM Robustness

  9. Evaluating Cross-Signal Coherence in Mammography Vision-Language Models

    Nov 9, 2026Rebeca Nam, Chase M. Fensore, Christian A. Fauria-Robinson +2VLM EvaluationFaithfulness in VLMs

  10. Batch-Conditioned Semantic Anchors for Robust Transductive Adaptation of Vision--Language Models

    Nov 4, 2026Mohammed Rahman Sherif Khan Mohammad, Ardhendu Behera, Sandip Pradhan +2VLM AdaptationTest-Time Adaptation of VLMs

  11. Traffic-VL: Reinforced Vision-Language Models for Generalizable End-to-End Traffic Signal Control

    Nov 4, 2026Xingchen Zou, Maonan Wang, Kemou Jiang +5Traffic Signal ControlRL for VLMs

  12. MIRA: Reinforcing Multimodal Reasoning via Deceptive Contextual Augmentation

    Nov 2, 2026Zhihan Yin, Jianxin Liang, Yifeng Yao +5Reasoning for VLMsVLM Robustness

  13. Label-Free Localization and Test-Time Suppression of CLIP's Typographic Circuits

    Nov 1, 2026Bohan Liu, Wenqian Ye, Guangzhi Xiong +3VLM RobustnessAdversarial Attacks on VLMs

  14. Textual Response-Aware Guidance for Zero-Shot Adversarial Robustness of Vision-Language Models

    Oct 29, 2026Yubo Cui, Xianchao Guan, Zheng ZhangVLM RobustnessAdversarial Attacks on VLMs

  15. Execution Logs Sway VLM Judges of Robot Progress

    Oct 25, 2026Weiyan Zhao, Sunny YangVLM RobustnessVision-Language Model-as-a-Judge

  16. Search-Based Testing of Modality Sensitivity in Vision Language Models

    Oct 23, 2026Oliver Weißl, Eduardo Breitembach, Andrea StoccoVLM EvaluationVLM Robustness

  17. MAGIC: Margin-gated Contrastive Debiasing with Evidence Restoration for VLM Test-time Robustness Scaling

    Oct 23, 2026Shunshun Gu, Enze Zhang, Ming Pei +2VLM RobustnessTest-Time Scaling for VLMs

  18. Mitigating Saliency Collapse: Robust Saliency-Aware Long-Text Image-Text Alignment

    Oct 22, 2026Qiuyu Kong, Zanxi Ruan, Marco Cristani +1Vision-Language AlignmentImage-Text Retrieval

  19. A Unified Evaluation Framework of Physical Adversarial Robustness in the Edge VLM Era

    Oct 21, 2026Eric Liang, Alan Luo, Kaiwen YuanVLM RobustnessAdversarial Attacks on VLMs

  20. Can Quantum Layers offer Performance and Security Advantages in Vision-Language Models?

    Oct 20, 2026Md Khalid Syfullah, Alvi Ataur KhalilQuantum Machine LearningVLM Robustness

  21. DISTRACT: Degradation-Indexed Study of Textual Reference Across Competing Targets

    Oct 20, 2026Dan Zlotnikov, Ohad Ben-ShaharMultimodal Visual Object TrackingVLM Robustness

  22. Beyond the Evidence Boundary: Behavioral Mirage Under Progressive Degradation in Medical VLMs

    Oct 20, 2026Edric Castel C. Hao, Rez Samantha Z. FlorescaMedical VLMsVLM Robustness

  23. Robustness of Internal Signals for Hallucination Detection in Vision-Language Models

    Oct 19, 2026Allison Chen, William Yang, Salma Abdel Magid +3Hallucination Detection in VLMsVLM Robustness

  24. TRACE: Training-aware Robustness and Challenge Evaluation for Text-Vision Embedding Models

    Oct 19, 2026Pume Tuchinda, Tinnakit Udsa, Peerat LimkonchotiwatVLM EvaluationVLM Robustness

  25. ViCoR: Estimating Visual Necessity via Counterfactual Residuals for Multimodal Medical Data Selection

    Oct 18, 2026Haotian Gan, Yudong Li, Xintian Li +2Medical VLMsVLM Robustness

  26. Investigating Length Bias and Robustness in LVLMs for Multiple-Choice Question Answering

    Oct 17, 2026Md. Atabuzzaman, Hani Alomari, Chris ThomasVLM RobustnessMultiple-Choice Question Answering