Distribution Data
Distribution data, encompassing both in-distribution (ID) and out-of-distribution (OOD) data, is a critical area of machine learning research focused on improving model robustness and reliability. Current research emphasizes developing methods for detecting and handling OOD data, including techniques that leverage graph theory, contrastive learning, and diffusion models, as well as adapting existing models through reweighting and fine-tuning strategies. This work is crucial for building safer and more dependable AI systems across various applications, from autonomous vehicles to medical image analysis, by mitigating the risks associated with unexpected or unseen data. A key challenge remains effectively handling imbalanced datasets and complex real-world distribution shifts.
Papers
Revisiting Out-of-distribution Robustness in NLP: Benchmark, Analysis, and LLMs Evaluations
Lifan Yuan, Yangyi Chen, Ganqu Cui, Hongcheng Gao, Fangyuan Zou, Xingyi Cheng, Heng Ji, Zhiyuan Liu, Maosong Sun
Exploring Simple, High Quality Out-of-Distribution Detection with L2 Normalization
Jarrod Haas, William Yolland, Bernhard Rabus
Unleashing Mask: Explore the Intrinsic Out-of-Distribution Detection Capability
Jianing Zhu, Hengzhuang Li, Jiangchao Yao, Tongliang Liu, Jianliang Xu, Bo Han
A Functional Data Perspective and Baseline On Multi-Layer Out-of-Distribution Detection
Eduardo Dadalto, Pierre Colombo, Guillaume Staerman, Nathan Noiry, Pablo Piantanida
Building One-class Detector for Anything: Open-vocabulary Zero-shot OOD Detection Using Text-image Models
Yunhao Ge, Jie Ren, Jiaping Zhao, Kaifeng Chen, Andrew Gallagher, Laurent Itti, Balaji Lakshminarayanan
SR-OOD: Out-of-Distribution Detection via Sample Repairing
Rui Sun, Andi Zhang, Haiming Zhang, Jinke Ren, Yao Zhu, Ruimao Zhang, Shuguang Cui, Zhen Li
Hybrid Energy Based Model in the Feature Space for Out-of-Distribution Detection
Marc Lafon, Elias Ramzi, Clément Rambour, Nicolas Thome