Latent Watermarks under Generative Editing: A Benchmark and Analysis of Detection Survival
Organizations: Department of ECE & INMC Seoul National University Seoul, South Korea
Abstract
Ordinary prompt-based editing can cause latent watermark detection to fail without explicitly targeting the watermark. We benchmark eight watermark methods against five editors across four generative backbones, four editing strengths, and five semantic categories, with edit-validity and threshold checks. Separating editing from seven subsequent distortions reveals that editing alone primarily distinguishes Tree-Ring, while added distortions expose a broader spectrum of detection survival. Sequential edits reveal a second hidden difference: score separation can decline while detection rates remain near their ceiling. Across methods, standardized clean score separation () organizes composite-survival tiers, whereas spatial overlap adds little to predicting edit-only survival beyond clean detectability. Embedding-strength interventions in two methods link higher clean separation to higher post-edit separation. In HSTR, the margin contrast is positive, while the angular layout contrast at matched clean separation remains unresolved. Together, outcome decomposition and continuous separation expose differences hidden by aggregate TPR. Method tiers are stable under threshold recalibration at the main operating points and alternative composite weights. Clean is thus a useful empirical diagnostic within this benchmark, with mixed transfer to unseen methods. Code and supporting artifacts are planned for a separate release.
Figures & tables
| P2P | P2P+NTI | InfEdit | FlowEdit-SD3 | FlowEdit-FLUX | ||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Method | Edit only | Post-dist. | Edit only | Post-dist. | Edit only | Post-dist. | Edit only | Post-dist. | Edit only | Post-dist. |
| Tree-Ring | 0.632 | 0.356 | 0.804 | 0.471 | 0.682 | 0.444 | 0.692 | 0.403 | 0.734 | 0.427 |
| ZoDiac | 0.996 | 0.818 | 1.000 | 0.873 | 0.992 | 0.908 | 0.986 | 0.877 | 0.992 | 0.880 |
| PRC | 0.994 | 0.800 | 1.000 | 0.861 | 1.000 | 0.928 | 1.000 | 0.861 | 1.000 | 0.848 |
| HSTR | 1.000 | 0.934 | 1.000 | 0.952 | 1.000 | 0.965 | 1.000 | 0.944 | 1.000 | 0.937 |
| HSQR | 1.000 | 0.991 | 1.000 | 0.996 | 1.000 | 0.997 | 1.000 | 0.992 | 1.000 | 0.991 |
| Editor | LPIPS | DINO | CLIP | BLIP2 ITM |
|---|---|---|---|---|
| P2P | 0.282 | 0.793 | 0.020 | 0.177 |
| P2P+NTI | 0.283 | 0.747 | 0.025 | 0.202 |
| InfEdit | 0.250 | 0.751 | 0.034 | 0.308 |
| FlowEdit-SD3 | 0.205 | 0.751 | 0.044 | 0.321 |
| FlowEdit-FLUX | 0.187 | 0.812 | 0.018 | 0.064 |
| Pooled model | AUC |
|---|---|
| LPIPS only | 0.633 |
| Clean only | 0.916 |
| + LPIPS | 0.945 |
Appendix figures & tables30 assets
Supplementary material from the paper’s appendix.
Appendix
| Method | Unit | Extension 500 | Full 600 |
|---|---|---|---|
| Tree-Ring | image | 0.017 | 0.016 |
| ZoDiac | image | 0.020 | 0.018 |
| HSTR | image | 0.027 | 0.024 |
| HSQR | image | 0.028 | 0.025 |
| PRC | image | 0.034 | 0.030 |
| T2S | key–image | 0.010 | 0.010 |
| WM | Cond | Pooled FPR | Min key | Max key | Overdisp. | |
|---|---|---|---|---|---|---|
| T2S | Clean | 0.0100 | 0.0033 | 0.0200 | 0.915 | 0.7153 |
| T2S | Brightness | 0.0100 | 0.0017 | 0.0233 | 1.024 | 0.4157 |
| T2S | Contrast | 0.0100 | 0.0033 | 0.0250 | 0.915 | 0.7153 |
| T2S | JPEG | 0.0100 | 0.0017 | 0.0200 | 0.996 | 0.4909 |
| T2S | Blur | 0.0100 | 0.0017 | 0.0233 | 1.061 | 0.3196 |
| T2S | BM3D | 0.0100 | 0.0000 | 0.0233 | 1.153 | 0.1418 |
| Method | P2P | P2P+NTI | InfEdit | FE-SD3 | FE-FLUX |
|---|---|---|---|---|---|
| Tree-Ring | 0.25 | 0.36 | 0.32 | 0.29 | 0.32 |
| ZoDiac | 0.75 | 0.82 | 0.86 | 0.83 | 0.83 |
| HSTR | 0.93 | 0.95 | 0.97 | 0.95 | 0.94 |
| HSQR | 0.99 | 0.99 | 1.00 | 0.99 | 0.99 |
| GS | 1.00 | 1.00 | 1.00 | 1.00 | 0.99 |
| Editor | Method | Avg 5 ( ) | Avg 5 ( ) | |
|---|---|---|---|---|
| P2P | Tree-Ring | 0.39 | 0.37 | -0.024 |
| ZoDiac | 0.84 | 0.83 | -0.012 | |
| PRC | 0.82 | 0.80 | -0.022 | |
| HSTR | 0.94 | 0.90 | -0.041 | |
| HSQR | 0.99 | 0.99 | +0.001 | |
| TAG | 1.00 | 1.00 | +0.000 |
| Method | P2P | P2P+NTI | InfEdit | FE-SD3 | FE-FLUX | Clean |
|---|---|---|---|---|---|---|
| Tree-Ring | 0.39 / 0.37 | 0.51 / 0.49 | 0.47 / 0.40 | 0.44 / 0.39 | 0.47 / 0.46 | 4.05 |
| ZoDiac | 0.84 / 0.82 | 0.89 / 0.87 | 0.92 / 0.90 | 0.89 / 0.88 | 0.89 / 0.89 | 8.03 |
| PRC | 0.82 / 0.79 | 0.88 / 0.84 | 0.94 / 0.93 | 0.88 / 0.87 | 0.87 / 0.86 | 9.62 |
| HSTR | 0.94 / 0.93 | 0.96 / 0.95 | 0.97 / 0.96 | 0.95 / 0.94 | 0.94 / 0.94 | 10.69 |
| HSQR | 0.99 / 0.99 | 1.00 / 0.99 | 1.00 / 0.99 | 0.99 / 0.99 | 0.99 / 0.99 | 20.67 |
| TAG | 1.00 / 1.00 | 1.00 / 1.00 | 1.00 / 1.00 | 1.00 / 1.00 | 1.00 / 0.99 | 22.60 † |
| P2P | P2P+NTI | InfEdit | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Method | 0.7 | 0.4 | 0.2 | 0.0 | 0.7 | 0.4 | 0.2 | 0.0 | 0.7 | 0.4 | 0.2 | 0.0 |
| Tree-Ring | 0.396 | 0.391 | 0.381 | 0.384 | 0.516 | 0.513 | 0.504 | 0.501 | 0.562 | 0.474 | 0.446 | 0.442 |
| ZoDiac | 0.843 | 0.841 | 0.831 | 0.823 | 0.893 | 0.888 | 0.876 | 0.881 | 0.930 | 0.918 | 0.912 | 0.903 |
| PRC | 0.832 | 0.824 | 0.815 | 0.806 | 0.889 | 0.878 | 0.878 | 0.869 | 0.934 | 0.937 | 0.931 | 0.932 |
| HSTR | 0.939 | 0.942 | 0.930 | 0.925 | 0.962 | 0.958 | 0.955 | 0.958 | 0.975 | 0.970 | 0.970 | 0.971 |
| HSQR | 0.992 | 0.992 | 0.991 | 0.993 | 0.997 | 0.997 | 0.996 | 0.994 | 0.997 | 0.997 | 0.996 | 0.996 |
| Budget ( ) | LPIPS | DINO | CLIP | BLIP2 ITM |
|---|---|---|---|---|
| (nominal) | 0.089 | 0.928 | 0.0031 | -0.024 |
| (selected) | 0.187 | 0.812 | 0.0177 | 0.064 |
| 0.538 | 0.522 | 0.0425 | 0.275 | |
| SD3 (reference) | 0.205 | 0.751 | 0.0438 | 0.321 |
| Held-out | Position | Mean abs. err | Max abs. err | |
|---|---|---|---|---|
| Tree-Ring | 4.05 | extrap.(low) | 0.2622 | 0.3329 |
| ZoDiac | 8.03 | interp. | 0.0785 | 0.1923 |
| PRC | 9.62 | interp. | 0.0692 | 0.1395 |
| HSTR | 10.69 | interp. | 0.0120 | 0.0472 |
| HSQR | 20.67 | interp. | 0.0087 | 0.0419 |
| T2S | 23.35 | extrap.(high) | 0.0031 | 0.0204 |
| Method | LPIPS | PSNR | SSIM | |
|---|---|---|---|---|
| HSTR | 0.15 | 0.2827 | 18.19 | 0.6969 |
| 0.30 | 0.3847 | 15.89 | 0.5822 | |
| 0.50 | 0.4499 | 14.55 | 0.5108 | |
| 0.70 | 0.4834 | 13.67 | 0.4707 | |
| 1.00 | 0.5170 | 12.47 | 0.4268 | |
| Tree-Ring | 0.15 | 0.2545 | 19.30 | 0.7297 |
| Method | % | ratio (rnd/high) | TOST | Equiv? | |
|---|---|---|---|---|---|
| HSQR | 5 | 1.166 | -0.752 | 0.9983 | no |
| 10 | 1.036 | -0.211 | 0.0001 | yes | |
| 20 | 0.953 | 0.353 | 0.0001 | yes | |
| 30 | 0.925 | 0.655 | 0.0139 | yes | |
| 50 | 0.924 | 0.787 | 0.0071 | yes | |
| HSTR | 5 | 1.227 | -1.265 | 1.0000 | no |
| Method | |||||
|---|---|---|---|---|---|
| ZoDiac | 1.22 | 1.12 | 1.00 | 0.97 | 0.95 |
| PRC | 1.23 | 1.10 | 1.02 | 1.00 | 1.00 |
| T2S | 1.43 | 1.24 | 1.07 | 1.00 | 0.97 |
| GS | 80.8 | 20.1 | 4.56 | 2.53 | 1.41 |
| TAG | 5.60 | 3.11 | 1.91 | 1.45 | 1.20 |
| Method | Clean | Gini | Entropy n | Top-10% | Moran’s | Center | Radial |
|---|---|---|---|---|---|---|---|
| frac | ratio | HF/LF | |||||
| Tree-Ring | 4.05 | 0.605 | 0.939 | 0.455 | 0.630 | 0.419 | 0.0026 |
| ZoDiac | 8.03 | 0.605 | 0.940 | 0.454 | 0.659 | 0.402 | 0.0021 |
| PRC | 9.62 | 0.656 | 0.924 | 0.507 | 0.634 | 0.409 | 0.0022 |
| HSTR | 10.69 | 0.662 | 0.919 | 0.514 | 0.622 | 0.901 | 0.0015 |
| HSQR | 20.67 | 0.629 | 0.927 | 0.484 | 0.635 | 0.882 | 0.0014 |
| Step 0 | Step 1 | Step 2 | Step 3 | Step 4 | Step 5 | |||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Method | TPR | TPR | TPR | TPR | TPR | TPR | ||||||
| Tree-Ring | 0.98 | 4.05 | 0.77 | 2.83 | 0.40 | 1.86 | 0.21 | 1.48 | 0.12 | 1.18 | 0.06 | 0.92 |
| ZoDiac | 1.00 | 8.03 | 0.99 | 5.31 | 0.95 | 3.87 | 0.93 | 3.19 | 0.87 | 2.84 | 0.77 | 2.44 |
| PRC | 1.00 | 9.62 | 1.00 | 5.54 | 1.00 | 4.38 | 1.00 | 3.91 | 1.00 | 3.40 | 1.00 | 3.09 |
| HSTR | 1.00 | 10.69 | 1.00 | 6.48 | 1.00 | 5.32 | 1.00 | 4.97 | 1.00 | 4.43 | 0.98 | 3.92 |
| HSQR | 1.00 | 20.67 | 1.00 | 11.65 | 1.00 | 9.86 | 1.00 | 9.17 | 1.00 | 8.45 | 1.00 | 7.82 |
| Method | Step | No dist. | Bright. | Contr. | JPEG | Blur | BM3D | VAE-B | VAE-C | Mean 7 | Comp. 8 | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Tree-Ring | 0 | 100 | 0.980 | 0.460 | 0.930 | 0.500 | 0.920 | 0.820 | 0.510 | 0.510 | 0.664 | 0.704 |
| 1 | 99 | 0.768 | 0.323 | 0.687 | 0.404 | 0.737 | 0.576 | 0.424 | 0.374 | 0.504 | 0.537 | |
| 2 | 99 | 0.404 | 0.141 | 0.343 | 0.283 | 0.364 | 0.273 | 0.333 | 0.293 | 0.290 | 0.304 | |
| 3 | 99 | 0.212 | 0.091 | 0.152 | 0.182 | 0.202 | 0.172 | 0.242 | 0.192 | 0.176 | 0.181 | |
| 4 | 99 | 0.121 | 0.040 | 0.081 | 0.141 | 0.111 | 0.091 | 0.172 | 0.131 | 0.110 | 0.111 | |
| 5 | 98 | 0.061 | 0.020 | 0.051 | 0.092 | 0.071 | 0.061 | 0.143 | 0.102 | 0.077 | 0.075 |
| Method | Category | Mean TPR | 95% CI |
|---|---|---|---|
| Tree-Ring | Attribute_Color Change | 0.4044 | 0.0077 |
| Background Swap | 0.3931 | 0.0444 | |
| Object Swap | 0.3978 | 0.0216 | |
| Pose_Shape Change | 0.4153 | 0.0071 | |
| Style Transfer | 0.4137 | 0.0115 | |
| ZoDiac | Attribute_Color Change | 0.9000 | 0.0097 |
| Editor | Backbone | Procedure | Guidance | Parameter | 0.7 | 0.4 | 0.2 | 0.0 |
| P2P | SD2.1-base | DDIM inversion (empty prompt, 50 steps), then 50-step DDIM editing | 7.5 | 0.7 | 0.4 | 0.2 | 0.0 | |
| P2P+NTI | SD2.1-base | Null-text inversion (50 steps, 10 inner steps), computed once per source; editing as in P2P | 7.5 | 0.7 | 0.4 | 0.2 | 0.0 | |
| InfEdit | LCM DreamShaper v7 | Inversion-free, 15 LCM steps | 2.0 (source 1.0) | 0.7 | 0.4 | 0.2 | 0.0 | |
| FlowEdit-SD3 | SD3 Medium | , | 3.5 / 13.5 | 15 | 30 | 40 | 50 | |
| FlowEdit-FLUX | FLUX.1-dev | , | 1.5 / 5.5 | 9 | 17 | 23 | 28 |
| Method | Editors | Unadjusted range | Adjusted range | |
|---|---|---|---|---|
| Tree-Ring | 5 | 0.594–0.839 | 0.582–0.838 | 0.014 |
| ZoDiac | 5 | 0.986–1.000 | 0.985–1.000 | 0.001 |
| PRC | 3 | 0.995–1.000 | 0.993–1.000 | 0.002 |
| HSTR | 5 | 1.000–1.000 | 1.000–1.000 | 0.000 |
| HSQR | 5 | 1.000–1.000 | 1.000–1.000 | 0.000 |
| T2S | 3 | 1.000–1.000 | 1.000–1.000 | 0.000 |
| Method | Embedding | Key / payload | Detection score |
|---|---|---|---|
| Tree-Ring | Ring pattern in the channel-3 Fourier disk of (radius 14; 613 coefficients) | Per-image key from a 2,048-key codebook | distance |
| HSTR | Central latent crop: Hermitian-symmetric ring pattern in the channel-3 disk (613 coefficients) and a Gaussian key in the channel-0 ring (556) | Per-image key from a 2,048-key codebook | minimum channel |
| HSQR | QR code (version 1) in channel-3 rFFT coefficients of the central crop (1,764) | Per-image key from a 2,048-key codebook | distance |
| ZoDiac | Ring pattern in the channel-3 Fourier disk (radius 10; 317 coefficients) of an optimized latent (100 Adam iterations, SSIM target 0.92) | One key | distance |
| GS | 256-bit message over the latent ( spatial replication), ChaCha20-encrypted | Per-image key and message | Bit accuracy |
| PRC | Pseudorandom code over 16,384 latent signs | One global key; 512-bit message | Parity log-likelihood |
| Editor | Comparison | Target | Effect | 95% CI | 0 in CI? | |
|---|---|---|---|---|---|---|
| P2P+NTI | Layout | 5 | 100 | yes | ||
| P2P+NTI | Layout | 8 | 100 | yes | ||
| InfEdit | Layout | 5 | 97 | yes | ||
| InfEdit | Layout | 8 | 94 | yes | ||
| FlowEdit-SD3 | Layout | 5 | 100 | yes | ||
| FlowEdit-SD3 | Layout | 8 | 100 | yes |