Learning with Noisy Labels

Overview

Learning with noisy labels asks how models can learn useful decision rules when training targets disagree with the underlying truth, as often happens with crowd annotations, medical labels, and automatically generated supervision. Common approaches include robust losses and noise-transition models, sample selection and reweighting, co-teaching, label correction, and self-supervised or representation-based methods that identify suspicious examples without trusting their labels. Methods are tested on controlled synthetic corruption and real-world benchmarks such as CIFAR and Clothing1M, as well as in medical imaging, graphs, and other domains where noise may depend on the example or annotator. A central challenge is that noise structure and data difficulty matter: small-loss filtering can discard hard but correct examples, and success on closed-set synthetic benchmarks may not transfer to open-set noise or deployment settings without clean labels for evaluation.

Latest papers

151 papers10 papers in the last four weeks, down 29% on the four weeks before. 0.1% of all new papers.

Jan 30, 2021

Learning From How Humans Correct

In industry NLP application, our manually labeled data has a certain number of noisy data. We present a simple method to find the noisy data and relabel them manually, meanwhile we collect the correction information. Then we present novel method to incorporate the human correction information into deep learning model. Human know how to correct noisy data. So the correction information can be inject into deep learning model. We do the experiment on our own text classification dataset, which is manually labeled, because we need to relabel the noisy data in our dataset for our industry application. The experiment result shows that our learn-on-correction method improve the classification accuracy from 91.7% to 92.5% in test dataset. The 91.7% accuracy is trained on the corrected dataset, which improve the baseline from 83.3% to 91.7% in test dataset. The accuracy under human evaluation achieves more than 97%.