MLLM Unlearning

MLLM: Multimodal Large Language Model

Follow this topic Ask about this topic

Momentum

1 paper in the last four weeks, down 67% on the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 29

All topics

SIEVE: Selective attention-value Suppression for Vision-Language Models Unlearning
Oct 1, 2026Si Qi Goh, Cap Dang Xuan Kiet, Tat-Jen Cham +1VLM Unlearning Privacy-Preserving Language Models
Digital Trust Centre, Nanyang Technological University, Singapore · College of Computing and Data Science, Nanyang Technological University, Singapore
Where Identity Lives: Localized, Retain-Free Identity Unlearning in Multimodal Large Language Models
Aug 31, 2026Kangwook Ko, Jaehyuk Jang, Wonjun Lee +2MLLM Unlearning Privacy Protection in VLMs
KAIST
LEMUR: Latent Entropy-aware Multimodal Unlearning via Visual-anchored Reasoning Redirection
Aug 12, 2026Xinhao Zhong, Yuxia Qiao, Junhao Li +3VLM Unlearning Multimodal Large Language Models
3Pengcheng Laboratory · 1Harbin Institute of Technology, Shenzhen · 2Tsinghua University
PRMU: A Corpus-Free Benchmark for Person-Centric Knowledge Unlearning in Multimodal Large Language Models
Aug 11, 2026Huafeng Chen, Yueming Lyu, Ziyuan Chen +4MLLM Unlearning Machine Unlearning
School of Intelligence Science and Technology, Nanjing University · Department of Computing, Imperial College London
A Model Merging Approach for Continual MLLM Unlearning
Aug 5, 2026Yuhang Wang, Linlin Zhang, Haoxuan Ji +3Multimodal Large Language Models MLLM Unlearning
1Xidian University, Xi’an, China · 2Xi’an Jiaotong University, Xi’an, China
Does Forgetting Transfer Across Modalities? A Real-World Benchmark for Cross-Modal Knowledge Unlearning Evaluation
Aug 4, 2026Chunlin Liu, Junnian Chen, Haitong Jiang +7VLM Evaluation VLM Unlearning
1Shenzhen University · 2Hebei University of Technology · 3Ludwig Maximilian University of Munich +1
Exploring and Bridging Knowledge Holes in Unlearned Multimodal Large Language Models
Aug 3, 2026Junxiang You, Junkai Chen, Yuhao He +3Multimodal Large Language Models MLLM Unlearning
University of Chinese Academy of Sciences · Institute of Automation, Chinese Academy of Sciences · 3Cloudspace Technology
Toward Fine-Grained Forgetting:Attribute Unlearning for Multimodal Large Language Models
Aug 2, 2026Junkai Lin, Junkai Chen, Siqi Hou +5VLM Unlearning Privacy Leakage in Language Models
Institute of Automation, Chinese Academy of Sciences · The Chinese University of Hong Kong · The Australian National University +3
Unlearning Under Imbalance: Benchmarking Fairness in Multimodal LLM Unlearning
Jul 23, 2026Lorenzo Orsingher, Thomas De Min, Massimiliano Mancini +2VLM Unlearning Algorithmic Fairness
University of Trento, Trento, Italy · Fondazione Bruno Kessler, Trento, Italy
Stochastic Meta-Unlearning: Bridging Language Backbone and Multimodal Unlearning
Jul 21, 2026Zijie Liu, Jinhao Duan, Gaowen Liu +2VLM Unlearning Vision-Language Models
UNC at Chapel Hill · Cisco Research · Michigan State University
One Modality to Forget Them All: Enhancing Cross-Modal Unlearning in Vision-Language Models
Jul 17, 2026Sudharshan Balaji, Yili Ren, Guangjing Wang +2VLM Unlearning VLM Robustness
University of South Florida · USA · University of Massachusetts Lowell
Multimodal Unlearning Across Vision, Language, Video, and Audio: Survey of Methods, Datasets, and Benchmarks
Jul 8, 2026Nobin Sarwar, Shubhashis Roy Dipta, Zheyuan Liu +1VLM Unlearning MLLM Unlearning
University of Maryland, Baltimore County · University of Notre Dame · UNC Chapel Hill
POPS: Recovering Unlearned Multi-Modality Knowledge in MLLMs with Prompt-Optimized Parameter Shaking
Jul 7, 2026Zhangheng LI, Jianing Zhu, Junyuan Hong +4Multimodal Large Language Models Privacy Leakage in Language Models
University of Texas at Austin · DEVCOM Army Research Laboratory
PPE-Bench: A Benchmark for Evaluating MLLM Unlearning under Private-Public Entanglement
Jul 3, 2026Xianren Zhang, Delvin Ce Zhang, Dongwon Lee +1Privacy Leakage in Language Models MLLM Unlearning
The Pennsylvania State University · University of Sheffield
MLUBench: A Benchmark for Lifelong Unlearning Evaluation in MLLMs
Jun 11, 2026He Li, Haoang Chi, Qizhou Wang +6VLM Unlearning Multimodal Large Language Models
College of Computer Science and Technology, National University of Defense Technology, Changsha, China · TMLR Group, Hong Kong Baptist University, Hong Kong, China · School of Statistics and Data Science, Shanghai University of Finance and Economics, Shanghai, China +2
SPACE: Source-free Proxy Anchor Concept Erasure for MLLMs
Jun 1, 2026Zhijing Zhang, Jiaqi Ding, Qianshan Wei +5VLM Unlearning Multimodal Large Language Models
School of Computer Science and Engineering, Southeast University · Institute of Automation, Chinese Academy of Sciences
On the Robustness of Machine Unlearning for Vision-Language Models
May 26, 2026Yujie Lin, Kaidi Jia, Jiayao Ma +2VLM Evaluation VLM Unlearning
1Xiamen University
Visual-Noise Guided In-Context Distillation for Multimodal Large Language Model Unlearning
May 26, 2026Junkai Chen, Yuhao He, Junxiang You +3VLM Unlearning Multimodal Large Language Models
Institute of Automation, Chinese Academy of Sciences · School of Advanced Interdisciplinary Sciences, UCAS
CATA: Continual Machine Unlearning via Conflict-Averse Task Arithmetic
May 18, 2026Shen Lin, Junhao Dong, Rongjie Chen +3VLM Unlearning Vision-Language Models
1Fujian Normal University · 2Nanyang Technological University · 3Xidian University
ASRU: Activation Steering Meets Reinforcement Unlearning for Multimodal Large Language Models
May 15, 2026Jiahui Guang, Haiyan Wang, Yingjie Zhu +4VLM Unlearning Multimodal Large Language Models
Harbin Institute of Technology, Shenzhen, China · Peng Cheng Laboratory, Shenzhen, China · The Hong Kong Polytechnic University, Hong Kong, China +1
ICED: Concept-level Machine Unlearning via Interpretable Concept Decomposition
May 14, 2026Shen Lin, Jing Lin, Junhao Dong +2VLM Unlearning MLLM Unlearning
1Fujian Normal University · 2Nanyang Technological University · University of New South Wales +1
PPU-Bench:Real World Benchmark for Personalized Partial Unlearning in Vision Language Models
May 9, 2026Jiahui Guang, Zexun Zhan, Zhenlin Xu +5VLM Evaluation VLM Unlearning
Harbin Institute of Technology, Shenzhen, China · Sichuan University, Chengdu, China · Harbin Institute of Technology, Weihai, China +3
ICU-Bench:Benchmarking Continual Unlearning in Multimodal Large Language Models
May 7, 2026Yuhang Wang, Wenjie Mei, Junkai Zhang +3Privacy-Preserving Language Models Multimodal Large Language Models
School of Computer Science and Technology Xidian University
Null Space Constrained Contrastive Visual Forgetting for MLLM Unlearning
May 7, 2026Yuhang Wang, Zhenxing Niu, Haoxuan Ji +3VLM Unlearning Multimodal Large Language Models
School of Computer Science and Technology, Xidian University · Xi’an Jiaotong University
Before Forgetting, Learn to Remember: Revisiting Foundational Learning Failures in LVLM Unlearning Benchmarks
May 5, 2026JuneHyoung Kwon, MiHyeon Kim, Eunju Lee +3VLM Evaluation VLM Unlearning
Department of Artificial Intelligence, Chung-Ang University · KT Corporation · Graduate School of Advanced Imaging Sciences, Multimedia and Film, Chung-Ang University
Erase Persona, Forget Lore: Benchmarking Multimodal Copyright Unlearning in Large Vision Language Models
May 5, 2026JuneHyoung Kwon, JungMin Yun, YoungBin KimVLM Evaluation VLM Unlearning
Department of Artificial Intelligence, Chung-Ang University · Graduate School of Advanced Imaging Sciences, Multimedia and Film, Chung-Ang University
Metric Unreliability in Multimodal Machine Unlearning: A Systematic Analysis and Principled Unified Score
May 4, 2026Abdullah Ahmad Khan, Hamid Laga, Ferdous SohelVLM Evaluation VLM Unlearning
Murdoch University
Suppression Is Not Forgetting: Residual Recoverability in Visual Concept Unlearning for VLMs
Apr 3, 2026Zhangyun Tan, Zeliang Zhang, Jiani Liu +4VLM Evaluation VLM Unlearning
University of Rochester
Towards Benign Memory Forgetting for Selective Multimodal Large Language Model Unlearning
Nov 25, 2025Zhen Zeng, Leijiang Gu, Zhangling Duan +4VLM Unlearning Multimodal Large Language Models
Hefei University of Technology, China · Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, China · University of Amsterdam, the Netherlands

Oct 1, 2026, cs.LGJ/K move · Enter open · S save

SIEVE: Selective attention-value Suppression for Vision-Language Models Unlearning

Si Qi Goh, Cap Dang Xuan Kiet, Tat-Jen Cham, Kwok-Yan Lam

Digital Trust Centre, Nanyang Technological University, Singapore · College of Computing and Data Science, Nanyang Technological University, Singapore

VLM Unlearning Privacy-Preserving Language Models MLLM Unlearning Privacy Protection in VLMs Machine Unlearning

Open paper AskPDF arXiv

The ability of vision-language models (VLMs) to associate visual identities with biographical information creates a need for selective unlearning of personally identifiable information (PII) while preserving permitted knowledge about the same individual. This setting is challenging because both sensitive and retained information can share the same visual inputs and intermediate representations. We introduce SIEVE, a simple and effective framework for selective VLM unlearning. SIEVE directly regularizes attention-value representations while also controlling model outputs. SIEVE suppresses attention values for forget examples toward a constant zero, while preserving retain-example representations by matching them to a frozen reference model. These objectives are combined with sequence-level forget and retain supervision, enabling targeted forgetting without largely affecting retained knowledge. Extensive experiments show that SIEVE achieves state-of-the-art performance on unlearning with multiple model-modality settings, while maintaining competitive retained utility. Ablation studies further show that value suppression and negative cross-entropy contribute complementary forgetting signals, while reference-based value matching substantially reduces utility degradation. These results demonstrate that attention values provide an effective intervention point for selective multimodal unlearning when sensitive and retained knowledge are closely related.

Momentum

Related topics

Latest papers 29