FADE: Frame-Aware Diffusion-Transformer-based Multi-Concept Erasure for Video Unlearning
Organizations: Peking University · University of Arizona
Abstract
Text-to-video (T2V) diffusion models can reproduce copyrighted, violent, or explicit content, which motivates concept erasure: removing designated concepts from a pretrained model while preserving its behavior on everything else. Existing T2V erasure methods leave two problems open. Their frame-agnostic suppression can leave isolated frames in which an erased concept resurfaces, a frame-reactivation gap that clip-level averages obscure; and they are usually evaluated with one target concept or category at a time. We propose Frame-Aware Diffusion Erasure (FADE), a multi-concept video unlearning framework. FADE first applies a joint closed-form key/value edit that suppresses all target concepts, then trains per-concept frame-aware low-rank adapters whose strength is gated by the frame index and the denoising timestep to remove residual per-frame leakage. Each adapter is trained with the other targets' prompts as hard negatives, which keeps the concept-specific components of different adapters well separated, and a similarity-based soft router combines the adapters according to the prompt. With 16 concepts (objects, artistic styles, and nudity) erased from a single Wan2.1-T2V-1.3B backbone, FADE reduces the residual accuracy on the object benchmark to 4.9%, against 15.5% for the strongest of eight baselines, while keeping the VBench average within 0.9% of the unedited model. The ranking is unchanged under a VLM judge and a blinded human study, and the advantage over the strongest baseline carries over to prompts that combine several erased concepts, to 30 simultaneously erased celebrity identities, and to Wan2.1-T2V-14B, CogVideoX-2B, and HunyuanVideo-1.5.
Figures & tables
| Per-class (%) | |||||||||||
| Method | Cassette player | Chain saw | Church | English springer | French horn | Garbage truck | Gas pump | Golf ball | Parachute | Avg acc | FVD |
| Wan2.1 (unedited) | 56.6 | 72.2 | 78.4 | 55.4 | 96.9 | 78.2 | 64.9 | 99.1 | 98.3 | 77.8 | 147.3 |
| SAFREE | 43.2 | 40.3 | 45.2 | 36.5 | 69.4 | 44.6 | 36.5 | 77.8 | 80.1 | 52.6 | 213.1 |
| T2VUnlearning | 49.5 | 65.6 | 68.3 | 39.7 | 79.5 | 57.3 | 53.6 | 89.7 | 88.4 | 65.7 | 215.8 |
| Refusal | 38.7 | 54.9 | 58.2 | 36.3 | 72.3 | 60.5 | 59.4 | 81.7 | 78.6 | 60.1 | 184.9 |
| VideoEraser | 12.4 | 19.3 | 17.8 | 11.5 | 18.6 | 11.2 | 18.5 | 15.9 | 14.2 | 15.5 | 203.4 |
| Avg (%) | FADE vs. unedited | Nudity (%) | ||||||
| Backbone | Unedited | VideoEraser | FADE | Reduction | FVD incr. | Unedited | VideoEraser | FADE |
| Wan2.1-T2V-1.3B | 84.8 | 16.2 | 5.1 | 94.0% | +7.8% | 84 | 42 | 19 |
| Wan2.1-T2V-14B | 90.3 | 21.3 | 7.2 | 92.1% | +13.6% | 86 | 39 | 15 |
| CogVideoX-2B | 81.5 | 18.3 | 6.3 | 92.3% | +8.4% | 79 | 49 | 22 |
| HunyuanVideo-1.5-480P | 72.6 | 15.3 | 9.2 | 87.3% | +17.2% | – | – | – |
Appendix figures & tables9 assets
Supplementary material from the paper’s appendix.
Appendix
| Imagenette object | ||
| cassette player | 0.320 | 0.050 |
| chain saw | 0.347 | 0.030 |
| church | 0.336 | 0.020 |
| English springer | 0.455 | 0.033 |
| french horn | 0.279 | 0.045 |
| garbage truck | 0.413 | 0.022 |
| Class | CogVideoX-2B | Refusal | VideoEraser | FADE |
| Chain Saw | 68.5 | 51.3 | 21.7 | 6.8 |
| Church | 75.1 | 55.6 | 19.4 | 5.5 |
| French Horn | 93.7 | 68.9 | 20.3 | 6.7 |
| Garbage Truck | 74.6 | 57.2 | 13.8 | 5.3 |
| Parachute | 95.8 | 74.1 | 16.5 | 7.2 |
| Avg | 81.5 | 61.4 | 18.3 | 6.3 |
| Class | Wan2.1-14B | Refusal | VideoEraser | FADE |
| Chain Saw | 82.5 | 63.7 | 24.6 | 7.8 |
| Church | 86.3 | 67.4 | 22.1 | 6.2 |
| French Horn | 98.6 | 79.5 | 23.8 | 7.5 |
| Garbage Truck | 85.1 | 68.3 | 16.4 | 6.0 |
| Parachute | 99.1 | 84.2 | 19.7 | 8.3 |
| Avg | 90.3 | 72.6 | 21.3 | 7.2 |
| FrameGate variant | Params | FVD | |
| 2-layer MLP, width 32 (default) | 290 | 4.9 | 158.8 |
| 4-layer MLP, width 128 | 34,178 | 6.3 | 196.7 |
| Temporal 1-D convolution over frames | 802 | 4.5 | 254.0 |
| Frame index only (no ) | 226 | 7.5 | 220.3 |
| Timestep only (no ) | 226 | 6.1 | 204.2 |
| Stage | Cost | Dependence on |
| CR closed-form edit | 63.9 s ( ), 65.9 s ( ), 67.0 s ( ) | Nearly constant: one joint solve with one matrix inverse per projection; runtime is dominated by loading and saving the model |
| FAE training | 3 h 50 min–3 h 58 min per concept (all 16 concepts); 500 AdamW iterations, about 28 s per iteration | Linear; for a fixed concept set, runs are independent and parallelizable |
| C-MoE calibration | Minutes per concept set; forward passes only (encoder scores for about 530 prompts per concept plus the other concepts’ prompts, then quantiles) | Cached encoder work grows linearly with the prompts; similarity scoring grows as , negligible at |
| Storage | 0.56M trainable parameters (1.15 MB) per concept; 18.4 MB for 16 experts | Linear, negligible next to the 2.6 GB backbone |
| Inference | 7.29 s per step with no active expert (same as the unedited model); 7.62 s per step with two active experts (+4.5%) | Per-step cost is independent of for a fixed number of active experts (about +2% each); routing computes similarities once per prompt |
Diffusion Model Unlearning
Diffusion model unlearning removes specified concepts or training examples from generative models while preserving unrelated generation.
See all 72 papers