Do unlearning algorithms learn the right features?
Organizations: CISPA Helmholtz Center for Information Security · Saarland University · Department of Computer Science, University of Copenhagen
Abstract
Machine unlearning is commonly evaluated with standard post-deletion metrics that compare an unlearned model to one retrained on the remaining data. Such snapshot evaluations can conceal consequential differences in the features the two models encode. We prove that if an unlearned and a retrained model agree on their outputs but encode different features, a single gradient step on their prediction heads can break this agreement. We further show that deleting an arbitrarily small fraction of the data can cause retraining to select qualitatively different features, so matching retraining can require learning features that the full model never had. We then introduce a measure of feature recovery that separates missing from extraneous features. Across eight unlearning methods, models that perform well on standard metrics often fail to recover the retrained features. This mismatch predicts deviations from retraining under subsequent relearning and downstream adaptation, and directly correcting it systematically reduces these deviations.
Figures & tables
| Retrain | Initial model | IU | ReprUnl | LTD | SalUn | FT | NegGrad+ | AMUN | RL | |
| Feature Discrepancy | 0.000 | 0.049 | 0.050 | 0.079 | 0.099 | 0.134 | 0.139 | 0.144 | 0.151 | 0.160 |
| Mean Accuracy (%) | 90.29 | 89.71 | 89.69 | 85.61 | 85.49 | 80.40 | 79.62 | 84.44 | 78.00 | 75.46 |
Appendix figures & tables19 assets
Supplementary material from the paper’s appendix.
Appendix
| Method | Retain Acc. | Forget Acc. | Test Acc. |
| Retrain | |||
| FT | |||
| AMUN | |||
| NegGrad+ | |||
| IU | |||
| LTD |
| Method | Retain Acc. | Forget Acc. | Test Acc. |
| Retrain | |||
| FT | |||
| AMUN | |||
| NegGrad+ | |||
| IU | |||
| LTD |
Machine Unlearning
Machine unlearning removes the influence of selected data or concepts from trained models while preserving useful behavior and avoiding full retraining.
See all 372 papers