GERIS: A Game-Theoretic Framework for Filtering Instance-Dependent Label Noise in License Plate Data Augmentation
Organizations: Department of Computer Science, University of Alberta, Alberta, Canada · Department of Computer Science, University of Alberta Edmonton, Alberta, Canada · Department of Mathematics and Computer Science, Amirkabir University of Technology, Iran · Department of Mathematics & Computer Science, Amirkabir University of Technology Tehran, Iran
Abstract
In this paper, we propose GERIS, a game-theoretic framework for instance selection in the data augmentation phase of license plate recognition systems. During augmentation, synthetic license plate images are generated and transformed using stochastic noise to simulate real-world conditions. However, certain noise configurations lead to highly distorted, unreadable images that degrade model performance by introducing instance-dependent label noise. GERIS formulates a non-cooperative game in which each noise vector competes for inclusion in the training set based on its similarity to labeled data and its contribution to model reliability. By identifying and pruning low-quality instances, GERIS improves the overall quality of the augmented dataset. Unlike traditional black-box learning methods, GERIS offers a transparent, theoretically grounded mechanism for data filtering. Experimental results demonstrate that GERIS outperforms existing instance selection methods in terms of classification accuracy and robustness.
Figures & tables
| Instance Selection Methods | Description | Ref. | ||
| Filtering-based Instance Selection | Distance-based filtering selects instances by their proximity to others. | DBSCAN | A density-based clustering algorithm groups data points without requiring a preset cluster count, selecting representatives from dense regions. | [ 2 ] |
| K-nearest Neighbors (KNN) | KNN classifies data points by their nearest neighbors’ majority class. K-means clusters data by similarity, selecting centroids as representatives. | [ 13 ] | ||
| Isolation Forest | An isolation forest detects anomalies by isolating rare, distinct instances using random forests. | [ 14 ] | ||
| K-means | K-means clusters data into k groups by minimizing squared distances to centroids, using them as representatives. | [ 15 ] | ||
| Condensed Nearest Neighbor | A method that iteratively selects only correctly classified, essential instances for an accurate reduced dataset. | [ 16 ] | ||
| Class distribution filtering selects instances to represent the dataset’s class diversity. | Edited Nearest Neighbor (ENN) | A method that removes misclassified or redundant instances by comparing them to their nearest neighbors, boosting model performance. | [ 17 ] | |
| Transformation | Description |
| Salt and Pepper | The Salt and Pepper noise is a simple noise that simulates dead pixels in a camera and digital noise. This noise uses two values corresponding to salt and pepper, respectively, and . |
| Blur | The Blur noise uses Gaussian and median filters to add a blur effect to the images. This noise uses two parameters, filter size, and variance. An increase in filter size or variance will increase the blur. |
| Circular Light | The circular light noise is the simulation of the reflection of light in some images in the form of fuzzy circles. To obtain such noise, first, we apply a median filter to smooth it out and prevent unwanted circular lights. After that, we convert the image format from RGB to YUV and add noise to its Y channel. The noise is a Gaussian kernel amplified by a factor . |
| Light | The light noise is the replica of high exposure in images that adds extra brightness to an image. This phenomenon makes text to be less readable. To construct such noise, we proceed as the Circular light noise and convert the image format to YUV after applying median smoothing. Following these steps, we add light noise as a constant to the Y channel of the image. |
| Gradient Light | The gradient light noise is another light noise that can produce noises similar to light beams. This noise occurs when a light source is in the environment and the camera’s lens is not clean. The initial steps for producing this noise are similar to other light noises. After obtaining YUV channels, we select a linear path and add a constant to the Y channel. In the last step, we convert the image to RGB channels and obtain a noisy image. |
| Negative | The negative noise works the opposite way of the light noises. This noise lowers the exposure and light in the image by deducting a constant from the Y channel of the YUV format of the image. YUV format of the image and reverse conversions are similar to light noises, and the only difference is the subtraction part. |
| Method | F1 | ||||
| KNN | 73.61 ( 0.002) | 48.62 ( 0.000) | 97.72 ( 0.000) | 48.69 ( 0.000) | 99.48 ( 0.0) |
| MLP | 73.28 ( 0.003) | 49.54 ( 0.000) | 97.04 ( 0.000) | 46.85 ( 0.000) | 99.84 ( 0.000) |
| Naïve Bayes | 78.49 ( 0.015) | 55.07 ( 0.000) | 99.15 ( 0.000) | 84.27 ( 0.002) | 92.11 ( 0.0) |
| SVM | 73.67 ( 0.003) | 49.16 ( 0.000) | 97.61 ( 0.000) | 48.27 ( 0.000) | 99.69 ( 0.000) |
| Rand Forest | 73.80 ( 0.002) | 49.05 ( 0.000) | 97.76 ( 0.000) | 48.78 ( 0.000) | 99.64 ( 0.000) |
| One Class SVM | 56.45 ( 0.023) | 29.60 ( 0.002) | 87.06 ( 0.001) | 39.63 ( 0.003) | 87.75 ( 0.001) |
| Method | Run Time (s) | Memory Usage (MB) |
| KNN | 2.09 ( 0.58) | 212.38 ( 18.29) |
| MLP | 6.18 ( 1.58) | 194.34 ( 26.57) |
| Naïve Bayes | 3.07 ( 0.05) | 183.33 ( 5.65) |
| SVM | 2.13 ( 0.05) | 210.71 ( 8.67) |
| Rand Forest | 1.80 ( 0.02) | 241.83 ( 9.57) |
| One Class SVM | 2.17 ( 0.06) | 203.37 ( 21.27) |
| Training Data | Filtering Method | Digits | Alphabets | |||||||
| Real Data | Synthetic | Accuracy | F1 | Precision | Recall | Accuracy | F1 | Precision | Recall | |
| ✓ | ✗ | ✗ | 87.23 | 79.79 | 79.56 | 80.99 | 70.5 | 57.75 | 62.25 | 58.32 |
| ✗ | ✓ | ✗ | 94.95 | 94.84 | 95.67 | 94.5 | 92.71 | 82.61 | 82.53 | 87.79 |
| ✗ | ✓ | Naive Bayes | 96.21 | 96.21 | 96.4 | 96.07 | 94.52 | 86.62 | 86.91 | 88.28 |
| ✓ | ✓ | Naive Bayes | 96.21 | 96.21 | 96.4 | 96.07 | 95.75 | 87.61 | 86.8 | 90.59 |
| ✗ | ✓ | GERIS | 96.64 | 96.26 | 96.67 | 95.93 | 96.41 | 87.98 | 89.06 | 88.04 |