Probing Local Conditional Fit for Diffusion Model Membership Inference
Organizations: Sony Group Corporation · KAIST
Abstract
Membership inference determines whether a candidate example was used to train a text-to-image diffusion model and is an important tool for auditing training-data use. We identify a directional membership signal in conditional prediction shifts, the changes in predicted noise under alternative text conditions at a fixed noisy input: whether movement toward the alternative prediction initially lowers or raises the denoising loss from its value under the original caption. Members exhibit less room for such local improvement. To quantify this response, we propose LoFIT (Local Conditional Fit), which measures the initial response of the denoising loss along normalized prediction shifts and aggregates it across multiple text conditions and diffusion states. LoFIT requires no target-model gradients and can be computed using only forward queries to the denoiser. Evaluations on four datasets show improved membership discrimination across fine-tuned and pretrained models. LoFIT distinguishes members early in fine-tuning, while the naive denoising-loss baseline remains near chance. Controlled comparisons show that the membership signal is concentrated in the first-order response, with little discrimination from prediction-shift magnitude alone.
Figures & tables
| Flickr30k | COCO | Pokemon | ||||
| Method | AUROC | TPR@1%FPR | AUROC | TPR@1%FPR | AUROC | TPR@1%FPR |
| SD v1.4 | ||||||
| Naive loss | 0.524 | 0.013 | 0.527 | 0.018 | 0.576 | 0.029 |
| PIA | 0.507 | 0.010 | 0.503 | 0.012 | 0.552 | 0.027 |
| SecMI | 0.551 | 0.017 | 0.562 | 0.012 | 0.538 | 0.022 |
| SD-MIA | 0.519 | 0.013 | 0.517 | 0.013 | 0.502 | 0.019 |
| Metric | Naive loss | PIA | SecMI | SD-MIA | PFAMI | CLiD th | CLiD vec | LoFIT |
|---|---|---|---|---|---|---|---|---|
| AUROC | 0.527 | 0.521 | 0.512 | 0.571 | 0.516 | 0.557 | 0.548 | 0.602 |
| TPR@5%FPR | 0.072 | 0.072 | 0.063 | 0.112 | 0.066 | 0.075 | 0.076 | 0.101 |
| Flickr30k | COCO | Pokemon | LAION-MI | |||||
| Method | AUROC | TPR@1% FPR | AUROC | TPR@1% FPR | AUROC | TPR@1% FPR | AUROC | TPR@5% FPR |
| All reference families (LAION-MI: 36 references; Table 2 uses 7) | ||||||||
| LoFIT | 0.935 | 0.454 | 0.954 | 0.478 | 0.896 | 0.272 | 0.573 | 0.085 |
| CLiD th ( ) | 0.731 | 0.106 | 0.752 | 0.130 | 0.764 | 0.058 | 0.563 | 0.084 |
| CLiD th (oracle ) | 0.813 | 0.092 | 0.824 | 0.083 | 0.815 | 0.079 | 0.569 | 0.083 |
| Empty reference only | ||||||||
| Reference directions | Flickr30k | COCO | Pokemon | LAION-MI |
|---|---|---|---|---|
| Combined edits | 0.880 | 0.909 | 0.810 | 0.569 |
| Gaussian, | 0.854 | 0.903 | 0.805 | 0.534 |
| Flickr30k | COCO | Pokemon | LAION-MI | |||||
|---|---|---|---|---|---|---|---|---|
| Readout | AUROC | TPR@1% FPR | AUROC | TPR@1% FPR | AUROC | TPR@1% FPR | AUROC | TPR@5% FPR |
| Loss gap | 0.813 | 0.092 | 0.818 | 0.078 | 0.804 | 0.065 | 0.549 | 0.076 |
| Normalized gap | 0.906 | 0.334 | 0.930 | 0.380 | 0.882 | 0.127 | 0.567 | 0.085 |
| Shift magnitude | 0.503 | 0.012 | 0.487 | 0.014 | 0.457 | 0.024 | 0.480 | 0.053 |
| LoFIT | 0.935 | 0.454 | 0.954 | 0.478 | 0.896 | 0.272 | 0.602 | 0.101 |
Appendix figures & tables16 assets
Supplementary material from the paper’s appendix.
Appendix
| Model | Dataset | Effective batch | Evaluated update |
|---|---|---|---|
| SD v1.4 | Flickr30k | 16 | 20,000 |
| COCO | 256 | 1,000 | |
| Pokemon | 256 | 200 | |
| SD v2.1 | Flickr30k | 16 | 20,000 |
| COCO | 256 | 1,000 | |
| Pokemon | 256 | 200 |
| Prompt family | Construction |
|---|---|
| Standard language-model rewrites | |
| Token-level edits | Small wording changes, including one- or two-word synonym substitutions that preserve meaning. |
| Paraphrases | Rephrase the caption while preserving its meaning, including light and heavy rewrites with increasing changes in wording. |
| Style changes | Change how the caption is presented. |
| Semantic edits | Change depicted entities or actions, including variants that alter one, two, or three or more content words. |
| Combined edits | Change both wording and semantic content. |
| Reference family | Flickr30k | COCO | Pokemon | LAION-MI |
|---|---|---|---|---|
| Standard language-model rewrites | ||||
| Token-level edits | 6 | 8 | 14 | 6 |
| Paraphrases | 8 | 12 | 18 | 8 |
| Style changes | 2 | 4 | 4 | 2 |
| Semantic edits | 8 | 10 | 19 | 8 |
| Combined edits | 5 | 5 | 5 | 5 |
| Configuration | Flickr30k | COCO | Pokemon |
|---|---|---|---|
| Combined edits | 5 | 5 | 5 |
| Semantic edits | 2 | 2 | 5 |
| Heavy paraphrases | 2 | 2 | 5 |
| Empty prompt | 1 | 1 | 1 |
| Total references | 10 | 10 | 16 |
| Timesteps | 12 | 4 | 4 |
| Target setting | CLiD th | CLiD vec |
|---|---|---|
| SD v1.4 Flickr30k | Oracle | Shadow-trained classifier |
| SD v1.4 COCO, Pokemon | Oracle and | Target two-fold cross-fitting |
| SD v2.1, all datasets | Fixed ; unlabeled target-pool scaling | Target two-fold cross-fitting |
| SD-XL, all datasets | Target cross-fitting for scaler and | Target two-fold cross-fitting |
| SD v1.5 LAION-MI | Oracle | Target two-fold cross-fitting |
| Membership score | Before matching | After matching |
|---|---|---|
| CLIP image-text similarity | 0.668 | 0.503 |
| Comparison | Group 1 size | Group 2 size | AUROC |
|---|---|---|---|
| Members vs. all non-members (before) | 6,400 | 9,578 | 0.611 |
| Members vs. matched non-members (after) | 6,400 | 6,400 | 0.571 |
| Members vs. excluded non-members | 6,400 | 3,178 | 0.691 |
| Matched vs. excluded non-members | 6,400 | 3,178 | 0.635 |
| Flickr30k | COCO | Pokemon | LAION-MI | |||||
|---|---|---|---|---|---|---|---|---|
| Score | AUROC | TPR@1% FPR | AUROC | TPR@1% FPR | AUROC | TPR@1% FPR | AUROC | TPR@5% FPR |
| (ours) | 0.935 | 0.454 | 0.954 | 0.478 | 0.896 | 0.272 | 0.602 | 0.101 |
| 0.893 | 0.183 | 0.915 | 0.246 | 0.837 | 0.062 | 0.595 | 0.086 | |
| 0.886 | 0.184 | 0.910 | 0.216 | 0.835 | 0.087 | 0.595 | 0.088 | |
| 0.917 | 0.377 | 0.944 | 0.410 | 0.891 | 0.255 | 0.602 | 0.101 | |
| Reference family | Flickr30k | COCO | Pokemon | LAION-MI |
|---|---|---|---|---|
| Token-level edits | ||||
| Paraphrases | ||||
| Style changes | ||||
| Semantic edits | ||||
| Combined edits | ||||
| Random captions |
| Reference | Flickr30k | COCO | Pokemon | LAION-MI |
|---|---|---|---|---|
| Caption references | ||||
| Empty prompt | ||||
| Combined edits | ||||
| Random captions | ||||
| Semantic edits | ||||
| Paraphrases | ||||
| References | Flickr30k | COCO | Pokemon | LAION-MI |
|---|---|---|---|---|
| Caption pool | 0.935 | 0.954 | 0.896 | 0.573 |
| Caption + Gaussian | 0.946 | 0.966 | 0.910 | 0.575 |
| Flickr30k | COCO | Pokemon | LAION-MI | |||||
| Score and references | AUROC | TPR@1% FPR | AUROC | TPR@1% FPR | AUROC | TPR@1% FPR | AUROC | TPR@5% FPR |
| Official CLiD | ||||||||
| CLiD th , oracle | 0.603 | 0.031 | 0.650 | 0.044 | 0.576 | 0.041 | 0.535 | 0.084 |
| Loss-based controls | ||||||||
| Naive denoising loss | 0.522 | 0.014 | 0.525 | 0.018 | 0.554 | 0.026 | 0.521 | 0.071 |
| Mean loss gap, empty | 0.627 | 0.063 | 0.673 | 0.059 | 0.523 | 0.041 | 0.536 | 0.081 |
| CogVideoX-2b | Wan2.1 | |||||||
|---|---|---|---|---|---|---|---|---|
| Anime-Shooter | OpenVid | Anime-Shooter | OpenVid | |||||
| Method | AUROC | TPR@5% FPR | AUROC | TPR@5% FPR | AUROC | TPR@5% FPR | AUROC | TPR@5% FPR |
| Naive loss | 0.580 | 0.122 | 0.504 | 0.044 | 0.515 | 0.072 | 0.502 | 0.056 |
| PIA | 0.547 | 0.090 | 0.502 | 0.052 | 0.504 | 0.052 | 0.490 | 0.050 |
| SecMI | 0.508 | 0.074 | 0.591 | 0.108 | 0.488 | 0.068 | 0.493 | 0.046 |
| CLiD th ( ) | 0.870 | 0.530 | 0.594 | 0.114 | 0.564 | 0.074 | 0.547 | 0.072 |
Membership Inference Attacks
Membership inference attacks test whether records or entities were used to train a machine-learning model, revealing potential privacy leakage.
See all 125 papers