Reject and Report: Forgery-Evident Undetectable Watermarks for Generative Image Models
Organizations: University of Waterloo · Vector Institute · KTH Royal Institute of Technology
Abstract
Provenance schemes such as those based on content watermarks let images from a generative model be traced back to it. A practical watermarking scheme must be accurate at a low false-positive rate (FPR), robust under content-preserving processing, and undetectable. In addition, it must resist forgery; otherwise, even from a single watermarked image and a surrogate model, an adversary can imprint the watermark onto an arbitrary image or regenerate new content that carries it, falsely attributing harmful content to a model or making authentic photographs appear AI-generated. We argue that a watermarking scheme should not only reject forgeries but also report them: a forgery rejected as unwatermarked leaves no trace of the attempt. State-of-the-art forgery-resilient undetectable watermarking schemes, such as SemBind, fall short on both counts. External anomaly detectors that do report forgeries either miss most of them or falsely flag genuine images after common processing. We propose Tripwire-WM, the first forgery-evident framework for undetectable watermarks. It commits the semantics of the generated image to the magnitudes of the initial latent noise, which the sign-based watermarks leave unused, through a distribution-preserving embedding; a forged image carries a valid watermark but with a commitment that does not match its content, so the detector both rejects it and reports it as forged. Built on the pseudorandom code (PRC) watermark and Gaussian Shading++, Tripwire-WM provably preserves their undetectability. On MS-COCO, with the owner's own model as the surrogate, it accepts no imprinting forgery, compared with up to 55.0% for SemBind, and reports all of them as forged; it also accepts at most 1.8% of reprompting forgeries, against up to 46.2% for SemBind. Meanwhile, it accepts at least 99% of genuine watermarked images at 10^{-6} FPR and matches the robustness of the base schemes.
Figures & tables
| Watermarked | Reprompting Forgery | Imprinting Forgery | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SD 2.1 | SD 1.5 | SD 2.1 | SD 1.5 | |||||||||
| Dataset | Sign | Defense | Accept ( ) | Alert ( ) | Accept ( ) | Alert ( ) | Accept ( ) | Alert ( ) | Accept ( ) | Alert ( ) | Accept ( ) | Alert ( ) |
| COCO | PRC | None | 100.0 0.00 | – | 95.6 0.96 | ✗ | 75.1 3.11 | ✗ | 0 99.0 2.24 0 | ✗ | 0 99.0 2.24 0 | ✗ |
| SemBind | 100.0 0.00 | – | 16.9 2.10 | ✗ | 0 2.6 1.02 | ✗ | 0 17.0 4.47 0 | ✗ | 00 1.0 2.24 0 | ✗ | ||
| G-Cos | 0 99.3 0.84 | 0.7 0.84 | 72.9 1.19 | 24.0 1.46 | 13.3 0.76 | 70.5 2.94 | 0 97.0 2.74 0 | 00 3.0 2.74 | 0 37.0 13.51 | 0 63.0 13.51 | ||
| L-SPD | 0 99.8 0.27 | 0.2 0.27 | 83.2 2.54 | 13.7 2.02 | 82.3 3.91 | 0 1.5 0.79 | 100.0 0.00 0 | 00 0.0 0.00 | 100.0 0.00 0 | 00 0.0 0.00 0 | ||
| JPEG ( ) | Blur ( ) | Noise ( ) | Median ( ) | Resize ( ) | Regen-Diff | Regen-VAE | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Dataset | Sign | Defense | Accept ( ) | Alert ( ) | Accept ( ) | Alert ( ) | Accept ( ) | Alert ( ) | Accept ( ) | Alert ( ) | Accept ( ) | Alert ( ) | Accept ( ) | Alert ( ) | Accept ( ) | Alert ( ) |
| COCO | PRC | None | 96.9 0.96 | – | 91.0 1.90 | – | 0 99.6 0.65 | – | 88.3 1.40 | – | 0 99.4 0.65 | – | 90.9 1.08 | – | 88.7 2.28 | – |
| SemBind | 94.1 1.29 | – | 79.3 2.64 | – | 0 99.0 1.17 | – | 78.2 2.28 | – | 0 98.0 0.50 | – | 82.9 1.88 | – | 85.0 2.85 | – | ||
| G-Cos | 68.3 1.92 | 29.6 1.52 | 0 0.4 0.42 | 96.8 0.84 | 0 91.9 2.10 | 0 7.9 1.78 | 0 7.9 1.92 | 87.9 2.43 | 0 82.2 2.14 | 17.7 2.28 | 12.0 3.77 | 84.9 4.23 | 43.9 2.16 | 49.8 2.71 | ||
| L-SPD | 97.9 0.96 | 0 0.0 0.00 | 97.0 0.71 | 0 0.2 0.45 | 0 99.8 0.45 | 0 0.0 0.00 | 94.4 1.19 | 0 1.4 0.96 | 0 99.9 0.22 | 0 0.0 0.00 | 96.9 0.74 | 0 0.0 0.00 | 93.3 1.25 | 0 0.4 0.22 | ||
| PGID-F | 83.6 3.15 | 13.6 2.86 | 0 9.1 2.16 | 82.9 1.95 | 0 88.9 2.90 | 11.1 2.90 | 40.9 2.82 | 48.0 3.10 | 0 88.0 1.58 | 11.4 1.71 | 88.0 2.55 | 0 3.4 1.64 | 75.3 3.44 | 13.6 2.75 | ||
Appendix figures & tables1 asset
Supplementary material from the paper’s appendix.
Appendix
| MS-COCO | SDP | |||||
|---|---|---|---|---|---|---|
| Sign | Index | Fails | Agree. | Index | Fails | Agree. |
| PRC | 98.6 | 1.98 | 0.756 | 98.0 | 2.96 | 0.756 |
| GS++ | 98.9 | 0.10 | 0.988 | 98.5 | 0.49 | 0.988 |