cs.CVNov 17, 2026

Fast and Strong Image Protection against Diffusion Personalization

Authors: Jiwon Park, Jihye Kang, Namhyuk Ahn

Organizations: Inha University

Abstract

Personalized text-to-image diffusion models can reproduce a person from a handful of photographs. Image protection perturbs each image before publication so that fine-tuning on it fails, but it optimizes every perturbation from scratch, so its cost grows with the number of images. We present the protective diffusion model (PDM), which is trained once and samples the perturbation of a new image over many denoising steps. PDM distills an iterative teacher and is then post-trained with the target residual projection (TRP) loss as a reward, a stronger objective than existing ones. PDM outperforms nine baselines on faces and artworks and nearly matches its teacher at a tenth of the cost.

Figures & tables

Appendix figures & tables3 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. PersGuard: Preventing Malicious Personalization in Text-to-Image Diffusion Models via Model Backdoors

    Feb 22, 2025Xinwei Liu, Xiaojun Jia, Yuan Xun +2T2I GenerationT2I Diffusion Models

  2. IDDM: Identity-Decoupled Personalized Diffusion Models with a Tunable Privacy-Utility Trade-off

    Apr 1, 2026Linyan Dai, Xinwei Zhang, Haoyang Li +2T2I Diffusion ModelsImage Generation

  3. Purify Once, Edit Freely: Breaking Image Protections under Model Mismatch

    Mar 13, 2026Qichen Zhao, Shengfang Zhai, Xinjian Bai +4Adversarial PurificationAdversarial Robustness