eess.IVNov 1, 2026

Cross-Dataset Generalization of Glaucoma Detection CNNs: Effects of Operating Threshold, Multi-Source Training, and Color Normalization

Authors: Al-Amin Rahman, Saifuddin Ahmed, Resalat Ahmed

Organizations: Department of Electrical and Electronic Engineering, Sylhet Engineering College, Sylhet, Bangladesh (Affiliated with Shahjalal University of Science & Technology, Sylhet)

Read PDF
Ask AI
Cite

Copy citation

DOINot available for this paper

Abstract

Deep learning models for glaucoma detection are usually tested on images from the same dataset used for training. That says little about how they will work at a new hospital or with a new camera. We fine-tuned five ImageNet-pretrained CNNs (ResNet50, DenseNet121, MobileNetV2, EfficientNet-B0, InceptionV3) with identical settings on one of three public fundus datasets (ACRIMA, ORIGA, RIM-ONE DL). Each was tested on a held-out part of its own dataset and on the other two datasets in full. We used three random seeds and report mean and SD over seeds. Mean in-domain AUC was 0.913 and cross-source AUC was 0.702, a drop of 0.211 (SD 0.030; 95% CI 0.135 to 0.286). After correction for multiple comparisons we found no evidence that any architecture did better, though three seeds give low power. At thresholds set on the source validation data, specificity fell from 0.870 to 0.506 and sensitivity from 0.831 to 0.726. Resetting the threshold on 10% of the target images raised specificity to 0.670 but lowered sensitivity to 0.609, and balanced accuracy rose only from 0.616 to 0.639. Training on two sources together did not help (held-out AUC 0.695 versus 0.702). LAB reference normalization (cross-source AUC 0.755) and strong color augmentation (0.754) gave similar gains, cutting the drop to about 0.16. Ben Graham normalization (0.733) and CLAHE (0.712) helped less, and gray-world (0.696) did not help. The two best methods raised specificity but lowered sensitivity. On G1020, used only for testing, AUC stayed near 0.5 in every condition, and networks trained within G1020 were also close to chance. Strong in-domain results do not show that a glaucoma model will work on new data. Normalization and color augmentation reduce the drop but do not remove it. Studies should report external validation and check the operating threshold, not only AUC.

More in this topic

Cross-Dataset Generalization

Cross-dataset generalization studies whether AI models retain accuracy, calibration, and usefulness on data from sources beyond their training set.

See all 144 papers

Explore similar work

CardsList
Sep 24, 2026

Detecting Glaucoma Across Multi-ethnic Myopic and Non-Myopic Populations Using an Uncertainty-Aware Vision Transformer: A Multicentre Model Development and Validation Study

Background: Artificial intelligence (AI)-based glaucoma detection from colour fundus photographs (CFP) offers scalable screening, but performance may decline on external datasets because of differences in ground-truth definitions, populations, and coexisting conditions such as high myopia (HM). We developed and validated a Vision Transformer-based deep learning (DL) model for glaucoma detection across multi-ethnic cohorts with and without HM. Methods: A ViT-B/16 model with predictive uncertainty estimation was developed using 56,483 CFPs (57.1% with myopia; 14.4% with HM). Glaucoma labels were standardised using clinical, imaging, and perimetry data. The model was validated on 16 independent datasets across three continents, including four datasets with explicit HM labels. Findings: Internal AUROC was 98.7% (95% CI 98.2-99.1%), with sensitivity 94.5% and specificity 97.3%. Across 16 external datasets from eight countries, AUROCs ranged from 86.4% to 99.6%. In HM eyes, internal AUROC was 97.8% (95% CI 96.1-99.2%), with sensitivity 94.8% and specificity 93.7%. External HM AUROCs were 86.5% in the Beijing Eye Study and 93.3%, 91.8%, and 85.5% in hospital-based datasets from Taiwan, Thailand, and South Korea. In an exploratory HM clinical evaluation, the model had higher CFP-only diagnostic accuracy than ophthalmologists and trained graders (92.0% vs 70.0%; p=0.008) and performed comparably to glaucoma specialists using full clinical information. Interpretation: The model showed robust glaucoma detection across myopic and non-myopic multi-ethnic populations and may support AI-assisted screening in settings with high HM prevalence.

Raghavan Lavanya, Yangqin Feng, Ten Cheer Quek +36

Singapore Eye Research Institute, Singapore National Eye Centre, Singapore · Ophthalmology & Visual Sciences Academic Clinical Program (Eye ACP), Duke-NUS Medical School, Singapore · Institute of Advanced Intelligence and Computing, Agency for Science, Technology and Research, Singapore +14

Fundus ImagingGlaucoma Detection
AskPDF
Apr 14, 2026

Fundus Image-based Glaucoma Screening via Retinal Knowledge-Oriented Dynamic Multi-Level Feature Integration

While deep learning has advanced automated glaucoma screening via color fundus photography, existing purely data-driven models often overfit to confounding imaging artifacts and struggle to capture unpredictable pathological cues located beyond predefined anatomical boundaries. To address these limitations, we propose a retinal knowledge-oriented framework that synergizes dynamic multi-scale feature learning with domain-specific anatomical priors. The proposed architecture adopts a tri-branch structure to jointly model the global retinal context, the structural characteristics of the optic cup and disc, and dynamically cropped pathological regions. Specifically, we devise a Dynamic Window Mechanism (DWM) that adaptively discovers diagnostically informative patches via image-level supervision. Furthermore, we introduce a Knowledge-Enhanced Convolutional Block Attention Module (KE-CBAM) that explicitly incorporates retinal priors from a pre-trained foundation model RETFound to guide spatial attention, preventing the network from assigning spurious weights to irrelevant background noise. Extensive evaluations on the large-scale AIROGS dataset demonstrate that our method achieves a state-of-the-art AUC of 98.5%98.5\% and an accuracy of 94.6%94.6\%. More importantly, the integration of anatomical priors effectively mitigates the inherent class imbalance, significantly improving the detection of referable glaucoma cases. Additional validations on the SMDG-19 benchmark further confirm its superior cross-domain generalization, indicating that our contribution provides a robust, interpretable, and scalable solution for real-world clinical glaucoma diagnosis. Our code is available at https://github.com/magiczhuo/Glaucoma-Detection

Chi Liu, Yuzhuo Zhou, Sheng Shen +9

Faculty of Data Science, City University of Macau, Avenida Padre Tomás Pereira, Taipa, 999078, Macao, China · State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Vision Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou, 510000, Guangdong, China · Hainan International College, Minzu University of China, Li’an International Education Innovation Pilot Zone, Lingshui, 572423, Hainan, China +4

Glaucoma DetectionMedical Image AnalysisMedical DiagnosisRetinal Disease ClassificationFundus Imaging
AskPDF
Jul 28, 2026

Balanced Soft mixture-of-expert model for Glaucoma Detection

Glaucoma is a group of eye diseases that damage the optic nerve, often caused by elevated intraocular pressure. It is a leading cause of irreversible vision loss and is typically developed slowly and painlessly, making it difficult to notice until significant damage has occurred. Therefore, early detection is crucial to prevent or slow the progression of vision loss. In recent years, deep learning based uni-modal models have improved the accuracy and efficiency of glaucoma detection, empowering doctors with tools for earlier diagnosis, better monitoring, and timely treatment. Building on this, multi-modal models have emerged, leveraging the strengths of different imaging modalities to learn richer and more robust representations, further enhancing glaucoma detection accuracy. However, multi-modal learning faces challenges such as imbalanced and under-optimized uni-modal representations due to joint learning objectives. To address this, we propose a balanced soft mixture-experts model with three experts and load balancing loss. The performance is measured by AUC, our proposed method surpasses the performance of all uni-modal baselines, conventional multi-modal models, and current stateof- the-art balanced multi-modal models. The proposed model can be generalized to other disease detections such as diabetic retinopathy.

Sai Venkatesh Chilukoti, Krishna Rauniyar, Min Shi +1

School of Computing and Informatics, University of Louisiana at Lafayette, 301 East Lewis Street, Lafayette, 70504, LA, USA.

Multimodal ClassificationMixture-of-Experts ModelsMultimodal FusionGlaucoma Detection
AskPDF