Timing is Everything: Inferring Temporal Membership in Continually Updated Models
Organizations: Stevens Institute of Technology Hoboken, New Jersey, USA · University of Connecticut Storrs, Connecticut, USA
Abstract
Continual model updating has become a common practice in the deployment of machine learning systems. However, the dynamic training behaviors give rise to new risks not sufficiently addressed by existing studies. In this paper, we present the first systematic study of temporal privacy risk in continually updated deep learning models. We formalize the notion of temporal membership in continually updated models. We then define the temporal membership inference attack, which seeks to infer whether and when individual samples were involved in model training, at both timestamp-level and interval-level granularities. To this end, we propose TMIA, a novel black-box attack that leverages bidirectional LSTMs to infer temporal membership from model outputs observed across successive updates. Through extensive experiments on three language models and three image classification models, we show that TMIA is highly effective and significantly outperforms existing baselines. Finally, we evaluate three potential defenses, revealing the trade-off between privacy protection and model utility.
Figures & tables
| Study | Operation | Frequency | Attack Input |
| ( Jagielski et al., 2023 ) | INS only | One-time | |
| ( Naderloui et al., 2025 ; Hayes et al., 2024 ; Chen et al., 2021 ) | DEL only | One-time | |
| ( Michel et al., 2026 ) | INS only | One-time | |
| Ours | INS & DEL | Repeatedly |
| Model | Dataset | TMIA (Ours) | Timestamp-wise MIA | Update-wise MIA | ||||||
| T-Pre | T-Rec | T-F1 | T-Pre | T-Rec | T-F1 | T-Pre | T-Rec | T-F1 | ||
| Pythia-70M | SST-5 | 88.78 | 94.06 | 91.34 | 69.26 | 88.21 | 77.59 | 52.01 | 65.25 | 57.88 |
| News20 | 82.55 | 84.58 | 83.55 | 57.33 | 79.44 | 66.60 | 29.01 | 59.81 | 39.07 | |
| MNLI | 83.67 | 91.19 | 87.27 | 72.91 | 94.16 | 82.18 | 45.35 | 75.41 | 56.64 | |
| T5 | SST-5 | 84.73 | 92.19 | 88.30 | 61.53 | 90.94 | 73.40 | 46.35 | 89.87 | 61.16 |
| News20 | 80.51 | 88.10 | 84.13 | 57.25 | 81.31 | 67.19 | 31.78 | 63.26 | 42.30 | |
| Model | Dataset | TMIA (Ours) | Timestamp-wise MIA | Update-wise MIA | ||||||
| I-Pre | I-Rec | I-F1 | I-Pre | I-Rec | I-F1 | I-Pre | I-Rec | I-F1 | ||
| Pythia-70M | SST-5 | 80.89 | 87.70 | 84.16 | 56.47 | 57.57 | 57.01 | 46.93 | 68.35 | 55.65 |
| News20 | 75.04 | 79.58 | 77.24 | 47.52 | 50.85 | 49.13 | 30.66 | 64.35 | 41.53 | |
| MNLI | 78.84 | 76.63 | 77.72 | 46.50 | 59.73 | 52.29 | 39.16 | 74.89 | 51.43 | |
| T5 | SST-5 | 68.70 | 77.97 | 73.04 | 53.23 | 61.25 | 56.96 | 29.85 | 87.63 | 44.53 |
| News20 | 74.15 | 71.69 | 72.90 | 50.31 | 51.92 | 51.10 | 35.70 | 68.67 | 46.98 | |
| Model | Dataset | TMIA (Ours) | Timestamp-wise MIA | Update-wise MIA | ||||||
| T-Pre | T-Rec | T-F1 | T-Pre | T-Rec | T-F1 | T-Pre | T-Rec | T-F1 | ||
| Llama-3B | Squad | 99.48 | 81.59 | 89.65 | 53.87 | 95.70 | 68.79 | 32.87 | 47.11 | 38.72 |
| Simpleqa | 98.25 | 92.15 | 95.25 | 59.05 | 99.98 | 74.06 | 57.83 | 47.56 | 52.19 | |
| Llama-8B | Squad | 96.22 | 85.16 | 90.35 | 50.61 | 94.98 | 65.88 | 32.34 | 46.66 | 38.21 |
| Simpleqa | 95.61 | 75.45 | 84.34 | 55.08 | 99.95 | 70.88 | 56.73 | 45.66 | 50.6 | |
| Timestamp-level | Interval-level | |||||
|---|---|---|---|---|---|---|
| Updates | T-Pre | T-Rec | T-F1 | I-Pre | I-Rec | I-F1 |
| Uncorrelated | 88.81 | 91.51 | 90.14 | 72.10 | 89.92 | 80.03 |
| Correlated insertion | 88.50 | 91.70 | 90.07 | 71.50 | 90.60 | 79.92 |
| Correlated removal | 88.30 | 91.20 | 89.73 | 71.40 | 89.80 | 79.55 |
| Correlated (both) | 87.60 | 91.80 | 89.65 | 70.20 | 91.30 | 79.37 |
| Timestamp-level | Interval-level | |||||
|---|---|---|---|---|---|---|
| Setting | T-Pre | T-Rec | T-F1 | I-Pre | I-Rec | I-F1 |
| Full precision | 88.81 | 91.51 | 90.14 | 72.10 | 89.92 | 80.03 |
| 8-bit | 83.64 | 77.26 | 80.32 | 70.61 | 74.53 | 72.52 |
| 4-bit | 75.72 | 54.33 | 63.27 | 62.52 | 62.49 | 62.50 |
| Access to | Timestamp-level | Interval-level | ||||
|---|---|---|---|---|---|---|
| model updates | T-Pre | T-Rec | T-F1 | I-Pre | I-Rec | I-F1 |
| Full sequence | 88.81 | 91.51 | 90.14 | 72.10 | 89.92 | 80.03 |
| of snapshots | 69.07 | 76.98 | 72.82 | 60.54 | 69.39 | 64.66 |
| of snapshots | 40.42 | 60.55 | 48.48 | 37.96 | 35.10 | 36.47 |
| Dataset/Model | Defense | Timestamp-level | Interval-level | Model Utility | |||||
| T-Pre | T-Rec | T-F1 | I-Pre | I-Rec | I-F1 | Train. Acc | Test. Acc | ||
| SST-5/Pythia-70M | W/o defense | 88.78 | 94.06 | 91.34 | 80.89 | 87.70 | 84.16 | 99.18 | 43.26 |
| Label-only output | 84.79 | 91.44 | 87.99 | 67.90 | 83.39 | 74.85 | 99.18 | 43.25 | |
| Dropout p=30% | 80.71 | 71.77 | 75.36 | 73.63 | 72.84 | 73.22 | 65.12 | 40.13 | |
| Dropout p=50% | 76.39 | 46.99 | 58.18 | 64.15 | 43.51 | 51.82 | 60.11 | 41.24 | |
| DP | 71.60 | 24.03 | 35.99 | 27.47 | 14.93 | 19.35 | 54.67 | 40.11 | |
Appendix figures & tables7 assets
Supplementary material from the paper’s appendix.
Appendix
| Dataset | Modality | Feature dim. | # labels | # train samples | # test samples |
|---|---|---|---|---|---|
| SST-5 | Text | 512 | 5 | 8,544 | 2,210 |
| News20 | Text | 512 | 20 | 11,314 | 7,532 |
| MNLI | Text | 512 | 3 | 50,000 | 9,815 |
| CIFAR-10 | Image | 3072 | 10 | 50,000 | 10,000 |
| SVHN | Image | 3072 | 10 | 73,257 | 26,032 |
| CINIC-10 | Image | 3072 | 10 | 90,000 | 90,000 |
| Model | # Layers | Layer width | # of Parameters |
|---|---|---|---|
| Pythia-70M | 6 | 512 | 70M |
| GPT-2 Small | 12 | 768 | 124M |
| T5 | 12 | 512 | 220M |
| ResNet-18 | 18 | {64,128,256,512} | 11.7M |
| SimpleCNN | 4 | {32,64,128,128} | 1.2M |
| MobileNet | 28 | {32–1024} | 4.2M |
| Model | Dataset | TMIA (Ours) | Timestamp-wise MIA | Update-wise MIA | ||||||
| I-Pre | I-Rec | I-F1 | I-Pre | I-Rec | I-F1 | I-Pre | I-Rec | I-F1 | ||
| Llama-3B | Squad | 97.37 | 82.59 | 89.37 | 38.42 | 84.67 | 52.86 | 34.30 | 10.90 | 16.54 |
| Simpleqa | 97.23 | 92.89 | 95.01 | 34.98 | 59.15 | 43.96 | 60.01 | 8.84 | 15.41 | |
| Llama-8B | Squad | 94.63 | 87.14 | 90.73 | 35.32 | 82.68 | 49.50 | 33.86 | 10.55 | 16.09 |
| Simpleqa | 96.46 | 73.22 | 83.25 | 31.71 | 49.91 | 38.78 | 58.82 | 8.35 | 14.62 | |
Membership Inference Attacks
Membership inference attacks test whether records or entities were used to train a machine-learning model, revealing potential privacy leakage.
See all 125 papers