Diffusion-Based Feature Denoising with NNMF for Robust handwritten digit multi-class classification
Organizations: Doctoral School of Computer Science, University of Szeged, Árpád tér 2, H-6720 Szeged, Hungary · University Research and Innovation Center (EKIK), Óbuda University, Bécsi út 96/b, H-1034 Budapest, Hungary
Abstract
This work presents a robust multi-class classification framework for handwritten digits that combines diffusion-driven feature denoising with a hybrid feature representation. Inspired by our previous work on brain tumor classification, the proposed approach operates in a feature space to improve the robustness to noise and adversarial attacks. This manuscript is submitted as an extended abstract rather than a full-length press-ready paper. First, the input images are converted into tight, interpretable exemplification using Non-negative Matrix Factorization (NNMF). In parallel, special deep features are extracted using a computational neural network (CNN). These integral features are combined into a united hybrid representation. The main objective of this work is to extend our previously validated two-class framework to a multi-class handwritten digit classification scenario. To improve robustness, a step diffusion operation is used in the feature space by gradually adding Gaussian noise. A feature denoiser network is trained to reverse this operation and rebuild clean representations from tilted inputs. The courteous features are then applied for multi-class classification. The suggested method is evaluated in both baseline and adversarial settings using AutoAttack. The experimental outcome present that the diffusion-based hybrid model is both effective and robust, the CNN baseline models outperforming while maintain powerful classification performance. These results explain the activity of feature-level diffusion defense for reliable multi-class handwritten digit classification.
Figures & tables
| Case | Accuracy | Precision | Recall | F1 | MCC | Balanced Acc | ROC-AUC | LogLoss | Brier |
|---|---|---|---|---|---|---|---|---|---|
| Clean_Base | 0.992 | 0.9921 | 0.992 | 0.9920 | 0.9911 | 0.992 | 0.99997 | 1.4756 | 0.6605 |
| Clean_Def | 0.942 | 0.9430 | 0.942 | 0.9418 | 0.9357 | 0.942 | 0.99827 | 1.5407 | 0.6822 |
| Robust_Base | 0.507 | 0.7088 | 0.507 | 0.4869 | 0.4771 | 0.507 | 0.97116 | 1.8536 | 0.7740 |
| Robust_Def | 0.582 | 0.6333 | 0.582 | 0.5751 | 0.5408 | 0.582 | 0.96883 | 1.7957 | 0.7580 |
| Case | Accuracy | Precision | Recall | F1 | MCC | Balanced Acc | ROC-AUC | LogLoss | Brier |
|---|---|---|---|---|---|---|---|---|---|
| Clean_Base | 0.9960 | 0.9961 | 0.9960 | 0.9960 | 0.9956 | 0.9960 | 0.99996 | 1.4693 | 0.6582 |
| Clean_Def | 0.9720 | 0.9722 | 0.9720 | 0.9719 | 0.9689 | 0.9720 | 0.9991 | 1.5132 | 0.6734 |
| Robust_Base | 0.6920 | 0.7711 | 0.6920 | 0.6864 | 0.6663 | 0.6920 | 0.9912 | 1.6933 | 0.7259 |
| Robust_Def | 0.7270 | 0.7966 | 0.7270 | 0.7346 | 0.7047 | 0.7270 | 0.9889 | 1.6817 | 0.7236 |