cs.LGNov 13, 2026

When Does Oversampling Help? A Decision Framework for Imbalanced Data Streams Under Label Delay and Concept Drift

Authors: Ahmed Awad, Anirudh Sengar

Organizations: Faculty of Engineering & IT, The British University in Dubai, Dubai, UAE. · Faculty of Computers and Artificial Intelligence, Cairo University, Giza, Egypt.

Abstract

For imbalanced data streams with delayed labels, is it worth adding a streaming oversampler, or does continuous re-evaluation of earlier predictions already recover the cost of the delay? We address this through an extensive experimental comparison of streaming oversampling and continuous re-evaluation under joint class imbalance, concept drift, and label delay. Streaming oversamplers are typically evaluated under the test-then-train assumption of immediate labels; their behaviour under these conditions, assessed through re-evaluation, has not been systematically studied. We close this gap with a decision framework that predicts when oversampling adds value over re-evaluation, organised around three axes: drift density, minority-class learnability, and delay relative to the refinement window, and operationalised as a competition between a recovery channel (re-evaluation) and a minority-coverage channel (oversampling). Evaluating 1515 classifiers on 66 synthetic and 66 real streams, we find: re-evaluation recovers delay-induced loss on drift-active streams but is silent on stationary ones; oversampling's marginal contribution over re-evaluation is statistically detectable in only one real-data configuration; and cost--performance Pareto recommendations from synthetic streams do not transfer to real data, where fronts partition by drift regime. Method selection should therefore be conditioned on the stream's profile and re-estimated as it evolves, not inherited from synthetic benchmarks.

Figures & tables

Explore similar work

CardsList
  1. A Temporal Algebraic Framework for Data Stream Evaluation Under Delayed Labels and Distribution Shifts

    Nov 16, 2026Ronaldo C. Prati, Elaine Ribeiro de FariaTemporal Distribution ShiftDistribution Shift Detection

  2. Inference-Time Prior Adaptation for Imbalanced Data Streams under Concept Drift

    Oct 23, 2026Tobias Callies, Eirini Ntoutsi, Arthur ZimekClassificationConcept Drift

  3. Beyond Imbalance Ratio: Data Characteristics as Critical Moderators of Oversampling Method Selection

    Apr 6, 2026Yuwen Jiang, Songyun YeClass-Imbalanced LearningClassification