This study evaluates pneumonia classification in chest X-rays using VGG19, MobileNetV2, ResNet50, and a custom CNN, and explores Generative Adversarial Network (GAN)-based synthetic data augmentation. MobileNetV2 achieved the highest reported accuracy of 88% with balanced class-wise performance. The custom CNN achieved pneumonia recall of 92.67% and precision of 79.43%, highlighting a precision-recall trade-off. Accuracy, F1-score, precision, recall, confusion matrices, and training curves were used to assess performance. Synthetic pneumonia images were combined with real images to investigate whether augmentation could improve classification performance. In the reported VGG19 comparison, augmented-data training accuracy reached approximately 100%, while validation accuracy remained near 50%, below the real-data validation accuracy. This experiment therefore did not demonstrate a validation-performance benefit from GAN augmentation. The classifier comparison highlights differences in accuracy and pneumonia recall, while the augmentation experiment indicates the need for further evaluation of synthetic-image quality and training settings.
Figures & tables
Fig. 1: Shown is a generic architecture of a sequential CNN applied for chest X-ray pneumonia detection.
Fig. 2: Shown is a Resnet50 Architecture
Fig. 3: Shown is a MobileNet Architecture
Fig. 4: Shown is a VGG19 Architecture
Fig. 5: Images showing x-ray image (pneumonia and normal image)
Fig. 6: Shown is a sample of a synthetic chest X-ray image.
Hyperparameter
Custom CNN
Base Architecture
None
Optimizer
Adam
Learning Rate
0.001
Activation Functions
ReLU (Conv, Dense), Sigmoid (Output)
Dropout
0.5
Pooling
MaxPooling2D
TABLE I: Tuned Hyperparameters for Custom CNN and MobileNetV2 Models
Hyperparameter
ResNet50
Base Architecture
ResNet50
Optimizer
Adam
Learning Rate
Default (0.001)
Activation Functions
ReLU (Backbone), Sigmoid (Output)
Dropout
None
Pooling
GlobalAveragePooling2D
TABLE II: Tuned Hyperparameters for ResNet50 and VGG19 Models
Fig. 7: Training Epoch For CNN model
Fig. 8: CNN - Loss VS Epoch
Model
Class
Precision
Recall
F1-Score
Support
CNN
0
0.91
0.76
0.83
150
1
0.79
0.93
0.86
150
Acc.
0.84 (300)
Macro Avg
0.85
0.84
0.84
300
Wtd. Avg
0.85
0.84
0.84
300
MobileNetV2
0
0.88
0.89
0.88
150
TABLE III: Classification Reports for Various Models
Model
Accuracy
F1 Score
Precision
Recall
CNN
0.8433
0.8554
0.7943
0.9267
MobileNet
0.8800
0.8792
0.8851
0.8733
ResNet50
0.7667
0.7756
0.7469
0.8067
VGG19
0.8233
0.8285
0.8050
0.8533
TABLE IV: Performance Metrics for Various Models
Fig. 10: Confusion Matrix for Various Models
Fig. 11: Accuracy VS Epoch for CNN and MobileNet
Fig. 13: VGG19 training and validation accuracy with real data and GAN-augmented data.
Fig. 14: ROC Curve Comparison
Fig. 15: Precision Recall Curve for CNN and MobileNet
Fig. 16: Precision Recall Curve for Resnet50 and VGG19
Generative augmentation is often proposed as a remedy for small medical-image datasets, but synthetic images are only useful when they improve downstream task performance. "Augmentation" here means synthetic supplementation: GAN-generated samples added to the real training pool, not geometric or photometric transforms of existing images. Twelve class-plane StyleGAN2-ADA generators were trained on constrained BRISC 2025 partitions to test whether their output, with or without InceptionV3 feature-space filtering, improves held-out tumour classification across three classifier families: a random forest (RF) on InceptionV3 features, a compact two-headed convolutional neural network (CNN), and MobileViTV2, a mobile hybrid convolutional-transformer. Each was evaluated at 1:1 and 1:2 real-to-synthetic ratios. An independent GPT-5.5 blind test placed gated real-versus-synthetic discrimination at 57.73% (95% CI: 54.48--60.92%) on the model-legible subset -- modestly above chance. The RF classifier did not benefit from the synthetic MRIs. The CNN showed consistent mean gains that did not survive Holm correction. MobileViTV2 showed the clearest benefit: filtered 1:1 augmentation improved tumour classification accuracy by 1.02% absolute (95% CI: 0.54--1.54%; Holm-corrected p = 0.0104). A secondary efficiency analysis found that every augmented CNN condition selected its checkpoint 42--64% earlier than baseline, while compute-matched MobileViTV2 runs reached selection after 50--67% fewer real-data epochs. Overall, augmentation utility was found to be architecture- and ratio-dependent, not guaranteed by visual fidelity alone.
Generative adversarial networks (GANs) are increasingly used to augment medical imaging datasets, but synthetic images do not necessarily provide downstream classification benefits. This study investigates whether class-specific Deep Convolutional Generative Adversarial Network (DCGAN) augmentation improves brain tumor classification when the classifier and evaluation set are held constant. Experiments were conducted on 7,200 brain magnetic resonance imaging (MRI) scans across four classes: glioma, meningioma, pituitary tumor, and no tumor. For each class, 1,400 real images were used for training and 400 were reserved for testing. A baseline Swin Transformer classifier was trained using only the real training images and compared with a second model trained using the same real images augmented with 500 DCGAN-generated images per class. Both conditions were evaluated on the identical held-out test set. The two models achieved the same overall accuracy of 96%, while macro F1 remained effectively unchanged and ROC-AUC decreased slightly from 0.987 to 0.982 after augmentation. Class-level analysis showed small redistributions in errors rather than a consistent performance gain. FID values between real and synthetic images ranged from 209.15 to 314.27, indicating substantial distributional differences under the adopted evaluation setup. These results suggest that synthetic augmentation should not be assumed to improve medical image classification and should instead be evaluated for both distributional fidelity and downstream task utility.
Irhum Jawad Khan, Talha bin Aslam
School of Electrical Engineering and Computer Science (SEECS) National University of Sciences and Technology (NUST) Islamabad, Pakistan · Independent Researcher Islamabad, Pakistan
Generative Adversarial Networks (GANs) can help overcome data scarcity in computer vision tasks by generating additional training samples. In this work, we explore generative data augmentation in two low-resource domains: Bangla handwritten character recognition and chest X-ray image analysis. We use DCGAN-based models trained on 64x64 images to generate synthetic samples and evaluate their quality using Inception Score (IS), Fréchet Inception Distance (FID), and visualization methods such as t-SNE and UMAP. To measure practical usefulness, we train image classifiers using real data and a combination of real and synthetic data. Experimental results show that synthetic augmentation improves data diversity and consistently increases classification performance in limited-data settings. We also investigate training stability techniques, including gradient penalty and spectral normalization, and perform ablation studies on synthetic-to-real data ratios and sample filtering strategies. In addition, we discuss challenges related to medical image evaluation, dataset licensing, and privacy concerns of synthetic data. Our approach is simple, reproducible, and provides a strong baseline for generative augmentation in resource-constrained imaging applications.
Md. Sohanuzzaman Soad, Mahady Al Hady, S M Rafiuddin Rifat +1
Department of Computer Science and Engineering University of Asia Pacific Dhaka, Bangladesh