cs.AINov 3, 2026

The Pen is Mightier than the Pixel: Natural Textual Unlearnable Example for Large Vision Language Models

Authors: Chenyu Yi, Jiawen Zong, Sami Hormi, Bingquan Shen, Xudong Jiang, Alex Chichung Kot

Organizations: Nanyang Technological University, School of Electrical & Electronic Engineering · DSO National Laboratories, Singapore · National University of Singapore · Shenzhen MSU-BIT University

Abstract

The proliferation of Large Vision Language Models (LVLMs), trained on vast and often sensitive datasets, raised concerns regarding data privacy and unauthorized usage. Unlearnable Examples (UEs), which subtly perturb training data to mislead the models, have emerged as a promising defense method. This paper presents the first exploration of UEs specifically on LVLMs, which poses unique challenges due to their inherent multimodal nature. We propose a novel text-based perturbation method, Natural Textual Unlearnable Examples (NTUE), which can effectively mislead LVLMs by subtly manipulating the image label, establishing a shortcut between an identity of interest and a separate target, without introducing factual misinformation or affecting readability. Comprehensive experiments compared with traditional UE methods demonstrate the superior performance of NTUE. Our findings show that NTUE achieves a high success rate with a poison rate as low as 5%, underscoring its potential as a practical and robust solution for protecting multimodal data in the era of LVLMs.

Figures & tables

Explore similar work

CardsList
  1. Words Before Pixels: Selective Modality Routing for Vision-Language Model Unlearning

    Oct 31, 2026Laura Yao, Haochen Zhang, Jinhao Duan +2VLM Unlearning

  2. To See is Not to Learn: Protecting Multimodal Data from Unauthorized Fine-Tuning of Large Vision-Language Model

    May 14, 2026Chengshuai Zhao, Zhen Tan, Dawei Li +2VLM RobustnessMultimodal Robustness

  3. Erase Persona, Forget Lore: Benchmarking Multimodal Copyright Unlearning in Large Vision Language Models

    May 5, 2026JuneHyoung Kwon, JungMin Yun, YoungBin KimVLM EvaluationVLM Unlearning