Robust Lightweight Deep Learning Models for Oral Cancer Screening
Organizations: Indian Institute of Science · KLES’ Institute of Dental Sciences · Indian Institue of Science · Biocon Foundation
Abstract
Oral cancer is a leading cause of mortality in low-to-middle-income countries, where a shortage of specialists delays diagnosis. While point-of-care screening via smartphones offers a scalable solution, developing robust AI for resource-constrained settings poses significant challenges, including class imbalance in training data, variable data quality, and computational constraints on edge devices. In this paper, we present the optimisation of lightweight deep learning models for smartphone-based oral cancer screening. Using a diverse, multi-centre retrospective dataset of approximately 30,000 images acquired over a decade, we systematically evaluate state-of-the-art convolutional, transformer, and hybrid architectures. Through rigorous pipeline ablation, we demonstrate that directly optimising hybrid architectures for the edge strictly outperforms computationally heavy paradigms, such as large models or knowledge distillation. Furthermore, interpretability analysis and simulated noise-stress tests revealed that the system anchors on clinical features and remains robust to unstructured sensor noise, despite vulnerabilities to impulse bit errors. In the held-out test set, our optimised MobileViTv2 models achieved an average sensitivity of 83.2 1.5% and an average specificity of 86.0 0.8%, with the best model exhibiting 87.4% sensitivity, 86.5% specificity, and a critical negative predictive value of 97.2% with reference to specialist labels. These results confirm that with targeted architectural selection and streamlined optimisation, interpretable and robust lightweight AI models exhibit high potential for edge deployment to enable automated triage in primary care settings.
Figures & tables
| Provisional Diagnosis | Count | Category |
|---|---|---|
| Normal/Normal variations | 22438 | Non-suspicious |
| Benign | 870 | |
| Other | 1379 | |
| Homogenous Leukoplakia | 1828 | Suspicious |
| Oral Lichen Planus | 578 | |
| Tobacco Pouch Keratosis | 1898 |
| Model | Type | Params | Input size | Key design |
| MobileViTv2-1.0 | Hybrid | 4.9M | 256x256 | Separable self-attention for efficient contextual learning |
| EdgeNeXt-S | Hybrid | 5.6M | 256x256 | Adaptive convolution and split depth-wise transpose attention (SDTA) |
| DeiT-Ti | Transformer | 5.0M | 224x224 | Distillation-based training with teacher-student framework |
| NASNet-Mobile | CNN | 5.3M | 512x512 | Neural architecture search (NAS)-designed with depthwise separable convolutions |
| MobileNetV3-L | CNN | 5.4M | 512x512 | Inverted residuals, squeeze-and-excite modules, h-swish activation |
| EfficientNetV2 | CNN | 7.1M | 512x512 | Fused-MBConv blocks with squeeze-and-excite for efficiency |
| Augmentation | Metric | MobileViTv2 | EdgeNeXt-S | DeiT-Ti | MobileNetV3-L | EffNetV2-B0 | NASNet-Mobile |
|---|---|---|---|---|---|---|---|
| Baseline | Sensitivity | 75.48 3.69 | 72.01 3.48 | 69.39 4.25 | 59.48 12.46 | 61.03 8.50 | 72.11 3.85 |
| Specificity | 90.45 3.03 | 90.42 2.61 | 91.52 1.68 | 93.99 2.61 | 94.91 2.50 | 90.95 2.54 | |
| Best pair | 80.76,88.31) | (77.07,88.40) | (75.33,89.02) | (74.51,91.64) | (75.23,89.96) | (79.02,87.36) | |
| GM | 84.45 | 82.54 | 81.89 | 82.63 | 82.27 | 83.09 | |
| SAM Output | Sensitivity | 73.61 4.30 | 74.12 2.82 | 67.71 2.34 | 76.15 1.80 | 74.90 2.67 | 73.30 2.91 |
| Specificity | 92.68 1.85 | 92.60 1.31 | 92.03 1.95 | 90.44 1.46 | 90.64 2.48 | 91.55 1.75 |
| Method | Metric | MobileViTv2 | EdgeNeXt-S | DeiT-Ti | MobileNetV3-L | EffNetV2-B0 | NASNet-Mobile |
|---|---|---|---|---|---|---|---|
| Baseline | Sensitivity | 75.48 3.69 | 72.01 3.48 | 69.39 4.25 | 59.48 12.46 | 61.03 8.50 | 72.11 3.85 |
| Specificity | 90.45 3.03 | 90.42 2.61 | 91.52 1.68 | 93.99 2.61 | 94.91 2.50 | 90.95 2.54 | |
| Best pair | (80.76,88.31) | (77.07,88.40) | (75.33,89.02) | (74.51,91.64) | (75.23,89.96) | (79.02,87.36) | |
| GM | 84.45 | 82.54 | 81.89 | 82.63 | 82.27 | 83.09 | |
| NIQE Reweighting | Sensitivity | 69.90 3.96 | 63.21 8.14 | 65.14 5.15 | 65.12 5.60 | 62.28 3.28 | 64.38 4.13 |
| Specificity | 92.15 2.75 | 90.60 3.05 | 91.68 4.48 | 91.39 2.60 | 92.28 4.50 | 91.37 1.40 |
| Method | Metric | MobileViTv2 | EdgeNeXt-S | DeiT-Ti | MobileNetV3-L | EffNetV2-B0 | NASNet-Mobile |
|---|---|---|---|---|---|---|---|
| Baseline | Sensitivity | 75.48 3.69 | 72.01 3.48 | 69.39 4.25 | 59.48 12.46 | 61.03 8.50 | 72.11 3.85 |
| Specificity | 90.45 3.03 | 90.42 2.61 | 91.52 1.68 | 93.99 2.61 | 94.91 2.50 | 90.95 2.54 | |
| Best pair | (80.76,88.31) | (77.07,88.40) | (75.33,89.02) | (74.51,91.64) | (75.23,89.96) | (79.02,87.36) | |
| GM | 84.45 | 82.54 | 81.89 | 82.63 | 82.27 | 83.09 | |
| Random Undersampling | Sensitivity | 83.63 3.60 | 82.03 2.54 | 83.13 2.87 | 82.57 3.29 | 82.82 11.71 | 81.42 3.09 |
| Specificity | 85.17 3.66 | 85.54 2.23 | 82.88 2.46 | 81.32 2.42 | 77.86 7.29 | 81.71 4.73 |
| Fold | Sensitivity (%) | Specificity (%) | Best Pair (%) |
|---|---|---|---|
| 1 | 84.37 ± 2.65 | 85.81 ± 2.41 | 87.41, 86.49 |
| 2 | 82.99 ± 3.51 | 86.20 ± 3.47 | 83.21, 86.98 |
| 3 | 84.08 ± 3.55 | 85.02 ± 4.12 | 83.44, 86.81 |
| 4 | 80.46 ± 2.94 | 86.99 ± 3.16 | 83.95, 85.62 |
| 5 | 84.23 ± 1.82 | 86.22 ± 2.16 | 85.16, 86.17 |
| Teacher Model (Baseline Sens, Spec) | KD Loss (%) | Student Sensitivity (%) | Student Specificity (%) | Student Best Pair (Sens, Spec) (%) |
|---|---|---|---|---|
| MobileViTv2 baseline (no KD) | 75.48 3.69 | 90.45 3.03 | 80.76, 88.31 | |
| ViT-B/16 (79.94%, 89.51%) | 50 | 84.22 3.56 | 87.37 3.53 | 85.47, 88.64 |
| 100 | 79.55 3.37 | 89.71 2.65 | 85.47, 85.18 | |
| EfficientNetV2-L (84.34%, 88.92%) | 50 | 82.44 2.64 | 86.33 2.83 | 87.72, 82.97 |
| 100 | 38.16 32.92 | 62.83 31.86 | 55.89, 56.38 | |
| Swin-B (80.24%, 88.88%) | 50 | 83.50 3.05 | 87.37 3.12 | 82.59, 89.48 |
| Noise Type | Intensity (%) | Sensitivity (%) | Specificity (%) |
|---|---|---|---|
| Baseline (No noise) | 0 | 87.4 | 86.5 |
| Gaussian | 15 | 76.0 | 83.4 |
| 20 | 68.8 | 86.4 | |
| 25 | 58.4 | 89.5 | |
| Stripe | 2 | 80.8 | 82.4 |
| 5 | 64.6 | 85.8 |