cs.AINov 2, 2026

Forgetting to Improve: Principled Data Removal in Active Learning

Authors: Manuel Wendl, Erik Englesson, Andreas Krause, Carl Henrik Ek

Organizations: ETH Zürich · University of Cambridge · Karolinska Institutet

Abstract

The uncertainty of a statistical model is most commonly factorized into an aleatoric and an epistemic part. This factorization changes how predictions are interpreted in downstream decision tasks. Importantly, except for the idealistic scenario with no model mismatch, the quantification is a characteristic of the model and not the data generating process. In this paper, we propose Forgetting to Improve a method that reduces this discrepancy by incorporating the task into the modeling framework. Our key insight is to acknowledge that in scenarios of model mismatch, data can have a detrimental effect on the modeling for a specific task. Based on this insight, we propose an influence function for Gaussian process models that allows for principled removal of detrimental data samples. We showcase the flexibility of this approach by demonstrating significant improvements across a range of tasks, including Bayesian optimization, model-based reinforcement learning, and transductive learning.

Figures & tables

Appendix figures & tables23 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Efficient machine unlearning with minimax optimality

    Apr 7, 2026Jingyi Xie, Linjun Zhang, Sai LiMachine UnlearningStatistical Learning Theory

  2. Goal-Oriented Influence-Maximizing Data Acquisition for Learning and Optimization

    Feb 23, 2026Weichi Yao, Bianca Dumitrascu, Bryan R. Goldsmith +1Active Information GatheringActive Learning

  3. We Should Distinguish Unlearning From Untraining

    Apr 9, 2026Eleni Triantafillou, Ahmed Imtiaz Humayun, Monica Ribero +3Machine UnlearningMachine Unlearning Evaluation