Adversarial Attacks on VLMs

VLM: Vision-Language Model

Overview

This field studies how image perturbations, embedded text, physical patches, poisoned training data, and multi-turn prompts can make models misread scenes, follow malicious instructions, leak information, or fail in agent tasks. Approaches include gradient-based and transferable attacks, typographic and visual prompt injection, jailbreak red-teaming, and backdoors, evaluated across tasks such as visual question answering, captioning, document understanding, video, and robotics. Defenses range from adversarial training and robust encoders to test-time transformations, token or attention interventions, prompt screening, and response monitoring. A central challenge is improving safety and robustness without sacrificing clean accuracy, utility, or latency, while accounting for uneven transfer across models, modalities, languages, and deployment settings.

Latest papers

CardsList

196 papers12 papers in the last four weeks, down 45% on the four weeks before. 0.1% of all new papers.

  1. Reading Scene States: Uncovering Safety Failures in Vision-Language Models

    Nov 17, 2026Tongxi Wu, Yuyang Cheng, Jiacheng Xian +4VLM SafetyAdversarial Attacks on VLMs

  2. SmoothShift: Disrupting Visual Adversarial Attacks on LVLMs at Test Time

    Nov 16, 2026Xiaoqing Chen, Jiayi Ouyang, Dongrui WuVLM RobustnessAdversarial Attacks on VLMs

  3. Scale-Induced Semantic Shift in Visual Prompt Injection Against VLMs and Web Agents

    Nov 12, 2026Yiheng Zhao, Runze Ji, Chenyu Yi +4Adversarial Attacks on VLMsPrompt Injection

  4. AnyBreak: Towards Jailbreaking Any T2I Model for Any Concept

    Nov 9, 2026Qi Lu, Zehui Guo, Yucheng Zhao +3Adversarial Attacks on VLMsAdversarial Attacks on Diffusion Models

  5. Query-Only Prompt-Agnostic Attacks on Visual In-Context Learning

    Nov 8, 2026Xiao Hu, Muhammad Ibrahim, Hao Wen +3Black-Box Adversarial AttacksIn-Context Learning

  6. PrivMark: Pixel-Space Steering against Privacy Leakage in Vision-Language Models

    Nov 7, 2026Ruofan Xing, Arman Akbari, Weikai Lin +2Privacy Protection in VLMsAdversarial Attacks on VLMs

  7. The Pen is Mightier than the Pixel: Natural Textual Unlearnable Example for Large Vision Language Models

    Nov 3, 2026Chenyu Yi, Jiawen Zong, Sami Hormi +3Unlearnable ExamplesAdversarial Attacks on VLMs

  8. Label-Free Localization and Test-Time Suppression of CLIP's Typographic Circuits

    Nov 1, 2026Bohan Liu, Wenqian Ye, Guangzhi Xiong +3VLM RobustnessAdversarial Attacks on VLMs

  9. Textual Response-Aware Guidance for Zero-Shot Adversarial Robustness of Vision-Language Models

    Oct 29, 2026Yubo Cui, Xianchao Guan, Zheng ZhangVLM RobustnessAdversarial Attacks on VLMs

  10. Where Can We Fool the Model's Mind? Response-Guided Semantic Probing and Adaptive Routing for Transferable Attacks on Black-Box MLLMs

    Oct 27, 2026Ahmed Abdelnaby, Mohamed ElmahallawyAdversarial Attacks on VLMsTransfer-Based Adversarial Attacks

  11. SPOOK: Sparse Pixel Optimization for Off-Manifold Knowledge in Vision Encoders

    Oct 23, 2026Ankit Gupta, Akshat Pandya, Christoph Adami +1Representation Geometry in VLMsVisual Representation Learning

  12. A Unified Evaluation Framework of Physical Adversarial Robustness in the Edge VLM Era

    Oct 21, 2026Eric Liang, Alan Luo, Kaiwen YuanVLM RobustnessAdversarial Attacks on VLMs

  13. GeoEdit: Adversarial De-Evidencing for Silent Geoprivacy Protection via Image Editing

    Oct 19, 2026Yu Yan, Shengjia Cheng, Fei Ma +2Privacy Protection in VLMsAdversarial Attacks on VLMs

  14. FusionAudit: Pathway-Conditioned Robustness Auditing for Native Multimodal Models

    Oct 15, 2026Jiaming Zhang, Zherui Li, Siqi Guo +3VLM RobustnessAdversarial Attacks on VLMs

  15. GeoCloak: An Agentic Framework for Semantics-Preserving Geolocation Privacy via Peripheral Clue Manipulation

    Oct 14, 2026Yixin Wu, Mingjie Li, Yun Shen +2Privacy Protection in VLMsAdversarial Attacks on VLMs

  16. DPOison-VL: Clean Preference Poisoning in Vision-Language Direct Preference Optimization

    Oct 13, 2026Chengtao Jian, Kai YangData Poisoning AttacksAdversarial Attacks on VLMs

  17. Answer It or Not? Towards Prompt-Adapted Adversarial Images on Vision Language Models

    Oct 12, 2026Shunyuan Bai, Yuchen Ren, Le Yang +3Adversarial Attacks on VLMsPrivacy Protection in VLMs

  18. Scenes as an Attack Surface: Uncovering Scene-Grounded Safety Failures in MLLMs

    Oct 8, 2026Tongxi Wu, Yuyang Cheng, Jiacheng Xian +5MLLM SafetyAdversarial Attacks on VLMs

  19. Detecting Adversarial Images through Response Profiles of Vision-Language Models

    Oct 7, 2026Arash Vashagh, Roozbeh Razavi-FarAdversarial Example DetectionVLM Robustness

  20. Understanding and Mitigating Token-Pruning-Induced Vulnerabilities in VLMs

    Oct 7, 2026Shuailong Wang, Xinyu Lyu, Shengming Yuan +3Visual Token PruningVLM Robustness

  21. Visual Memory Attacks Can Persist Through The KV Cache

    Oct 6, 2026David Dobre, Leo Schwinn, Gauthier Gidel +3Adversarial Attacks on VLMsBackdoor Attacks on VLMs

  22. Visual-Invariance-Augmented Feature Optimal Alignment for Transferable Adversarial Attacks against Closed-Source MLLMs

    Oct 4, 2026Xiaojun Jia, Simeng Qin, Yiming Li +5Adversarial Attacks on VLMsAdversarial Attacks

  23. Corrupted but Correct: Why Vision-Language Models Lie to Themselves Internally

    Oct 2, 2026Arun Josephraj Arokiaraj, Chenyi Huang, Zekun Wu +1VLM RobustnessAdversarial Attacks on VLMs

  24. Walking the Embedding Space: Datastore Extraction from Multimodal RAG

    Oct 1, 2026Maria Carmen Jica, Ali Satvaty, Suzan Verberne +1Multimodal RAGAdversarial Attacks on VLMs