Drift Detection
Drift detection focuses on identifying changes in the statistical properties of data streams over time, a phenomenon known as concept drift, impacting the performance of machine learning models. Current research emphasizes developing unsupervised methods, particularly those leveraging deep learning representations (like autoencoders) and generative adversarial networks (GANs), to detect both global and localized drifts, as well as addressing the challenges posed by high-dimensional data and limited labeled data. Effective drift detection is crucial for maintaining the accuracy and reliability of machine learning systems across diverse applications, from wildlife monitoring and manufacturing to fraud detection and personalized recommendations, enabling timely model adaptation and improved system performance.
Papers
Out-of-Distribution Detection and Data Drift Monitoring using Statistical Process Control
Ghada Zamzmi, Kesavan Venkatesh, Brandon Nelson, Smriti Prathapan, Paul H. Yi, Berkman Sahiner, Jana G. Delfino
Unveiling Group-Specific Distributed Concept Drift: A Fairness Imperative in Federated Learning
Teresa Salazar, João Gama, Helder Araújo, Pedro Henriques Abreu
Localizing Anomalies in Critical Infrastructure using Model-Based Drift Explanations
Valerie Vaquet, Fabian Hinder, Jonas Vaquet, Kathrin Lammers, Lars Quakernack, Barbara Hammer
One or Two Things We know about Concept Drift -- A Survey on Monitoring Evolving Environments
Fabian Hinder, Valerie Vaquet, Barbara Hammer