Anti-I2V: Safeguarding your photos from malicious image-to-video generation
Organizations: Qualcomm AI Research†
Abstract
Advances in diffusion-based video generation models, while significantly improving human animation, poses threats of misuse through the creation of fake videos from a specific person's photo and text prompts. Recent efforts have focused on adversarial attacks that introduce crafted perturbations to protect images from diffusion-based models. However, most existing approaches target image generation, while relatively few explicitly address image-to-video diffusion models (VDMs), and most primarily focus on UNet-based architectures. Hence, their effectiveness against Diffusion Transformer (DiT) models remains largely under-explored, as these models demonstrate improved feature retention, and stronger temporal consistency due to larger capacity and advanced attention mechanisms. In this work, we introduce Anti-I2V, a novel defense against malicious human image-to-video generation, applicable across diverse diffusion backbones. Instead of restricting noise updates to the RGB space, Anti-I2V operates in both the * and frequency domains, improving robustness and concentrating on salient pixels. We then identify the network layers that capture the most distinct semantic features during the denoising process to design appropriate training objectives that maximize degradation of temporal coherence and generation fidelity. Through extensive validation, Anti-I2V demonstrates state-of-the-art defense performance against diverse video diffusion models, offering an effective solution to the problem.
Figures & tables
| CelebV-Text | UCF101 | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Model | Method | ISM | C-FIQA | Q-A(F) | Q-A(V) | DINO | ISM | C-FIQA | Q-A(F) | Q-A(V) | DINO |
| CogVideoX-5B | Clean | 0.721 | 0.522 | 0.746 | 0.802 | 0.828 | 0.466 | 0.373 | 0.361 | 0.436 | 0.801 |
| SDS+ [ 63 ] | 0.591 | 0.482 | 0.473 | 0.563 | 0.754 | 0.381 | 0.291 | 0.286 | 0.344 | 0.754 | |
| SDS- [ 63 ] | 0.607 | 0.497 | 0.511 | 0.594 | 0.747 | 0.386 | 0.298 | 0.313 | 0.393 | 0.760 | |
| AdvDM [ 29 ] | 0.583 | 0.473 | 0.463 | 0.543 | 0.748 | 0.370 | 0.292 | 0.271 | 0.342 | 0.753 | |
| MIST [ 30 ] | 0.561 | 0.463 | 0.476 | 0.577 | 0.750 | 0.355 | 0.290 | 0.262 | 0.340 | 0.751 | |
| CogVideoX-5B [ 24 ] - OpenSora 1.2 [ 69 ] | CogVideoX-5B [ 24 ] - DynamiCrafter [ 61 ] | |||||||||
| Method | ISM | C-FIQA | Q-A(F) | Q-A(V) | DINO | ISM | C-FIQA | Q-A(F) | Q-A(V) | DINO |
| SDS+ [ 63 ] | 0.606 | 0.493 | 0.514 | 0.582 | 0.764 | 0.309 | 0.428 | 0.432 | 0.519 | 0.614 |
| SDS- [ 63 ] | 0.568 | 0.504 | 0.563 | 0.641 | 0.757 | 0.286 | 0.422 | 0.493 | 0.579 | 0.664 |
| AdvDM [ 29 ] | 0.608 | 0.491 | 0.506 | 0.593 | 0.754 | 0.337 | 0.428 | 0.389 | 0.511 | 0.631 |
| MIST [ 30 ] | 0.547 | 0.490 | 0.522 | 0.636 | 0.726 | 0.289 | 0.440 | 0.384 | 0.518 | 0.633 |
| VGMShield [ 43 ] | 0.566 | 0.503 | 0.548 | 0.632 | 0.751 | 0.322 | 0.462 | 0.387 | 0.504 | 0.688 |
| Method | ISM | Q-A (F) | Q-A (V) | DINO-SIM |
|---|---|---|---|---|
| Ours (RGB) | 0.55 | 0.50 | 0.58 | 0.76 |
| + DiffPure [ 39 ] | 0.33 (-0.22) | 0.49 (-0.01) | 0.59 (+0.01) | 0.74 (-0.02) |
| + GrIDPure [ 68 ] | 0.60 (+0.05) | 0.70 (+0.20) | 0.75 (+0.17) | 0.84 (+0.08) |
| + Impress [ 6 ] | 0.58 (+0.03) | 0.52 (+0.02) | 0.61 (+0.03) | 0.76 (-0.00) |
| + JPEG Compression | 0.57 (+0.02) | 0.51 (+0.01) | 0.58 (-0.00) | 0.78 (+0.02) |
| + Gaussian Blur | 0.63 (+0.08) | 0.43 (-0.07) | 0.51 (-0.07) | 0.80 (+0.04) |
| Method | ISM | Q-A (F) | Q-A (V) | DINO-SIM |
|---|---|---|---|---|
| RGB | 0.582 | 0.624 | 0.692 | 0.788 |
| 0.672 | 0.707 | 0.765 | 0.833 | |
| Frequency | 0.633 | 0.576 | 0.641 | 0.802 |
| RGB + | 0.613 | 0.525 | 0.618 | 0.784 |
| RGB + Frequency | 0.587 | 0.567 | 0.645 | 0.796 |
| + Frequency (DSP) | 0.582 | 0.521 | 0.610 | 0.781 |
| Budget | ISM | C-FIQA | Q-A (F) | Q-A (V) | DINO |
|---|---|---|---|---|---|
| 0.469 | 0.456 | 0.485 | 0.567 | 0.775 | |
| 0.462 | 0.448 | 0.481 | 0.562 | 0.760 | |
| 0.473 | 0.468 | 0.491 | 0.588 | 0.775 |
| CogVideoX-5B - Wan2.2-TI2V-5B | |||||
| Method | ISM | C-FIQA | Q-A(F) | Q-A(V) | DINO |
| Clean | 0.672 | 0.517 | 0.841 | 0.899 | 0.815 |
| SDS+ | 0.538 | 0.478 | 0.512 | 0.622 | 0.741 |
| SDS- | 0.608 | 0.504 | 0.573 | 0.667 | 0.766 |
| AdvDM | 0.544 | 0.456 | 0.528 | 0.624 | 0.743 |
| MIST | 0.635 | 0.476 | 0.574 | 0.678 | 0.790 |
| Loss Type | ISM | Q-A (F) | Q-A (V) | DINO |
| [A1] : Denoising Loss | 0.582 | 0.521 | 0.610 | 0.781 |
| [A2] : [A1] + IRC | 0.535 | 0.518 | 0.607 | 0.776 |
| [A3] : [A1] + IRA-VAE (U) | 0.514 | 0.507 | 0.583 | 0.774 |
| [A4] : [A1] + IRA-VAE (T) | 0.507 | 0.503 | 0.580 | 0.771 |
| [A5] : [A1] + IRA-Denoiser (U) | 0.507 | 0.486 | 0.572 | 0.775 |
| [A6] : [A1] + IRA-Denoiser (T) | 0.493 | 0.484 | 0.575 | 0.772 |
| Setting | ISM | Q-A (F) | Q-A (V) | DINO |
|---|---|---|---|---|
| Full (27+) | 0.458 | 0.479 | 0.560 | 0.762 |
| Last-3 | 0.462 | 0.481 | 0.562 | 0.760 |
| Last-1 | 0.460 | 0.486 | 0.565 | 0.762 |
| Last-2 | 0.460 | 0.487 | 0.568 | 0.767 |
| Last-4 | 0.470 | 0.489 | 0.570 | 0.764 |
| Method | Metric | Clean | Anti-I2V |
|---|---|---|---|
| CogVideoX [ 24 ] | ISM | 0.646 | 0.407 |
| C-FIQA | 0.519 | 0.462 | |
| Q-A (Frame) | 0.771 | 0.474 | |
| Q-A (Video) | 0.825 | 0.553 | |
| DINO | 0.869 | 0.776 | |
| DynamiCrafter [ 61 ] | ISM | 0.558 | 0.208 |
| Method | SSIM | LPIPS | PSNR |
|---|---|---|---|
| SDS (+) | 0.84 | 0.206 | 32.5 |
| SDS (-) | 0.86 | 0.192 | 33.7 |
| AdvDM | 0.84 | 0.205 | 32.6 |
| MIST | 0.82 | 0.271 | 31.4 |
| VGMShield | 0.84 | 0.191 | 33.2 |
| Ours | 0.80 | 0.200 | 32.2 |
Image-to-Video Generation
Image-to-video generation creates coherent moving clips from still images, guided by learned models and controls such as motion, camera, or text.
See all 93 papers