Fair Lung Disease Diagnosis from Chest CT via Gender-Adversarial Attention Multiple Instance Learning

Aditya Parikh; Aasa Feragen

cs.CVMar 13, 2026

Fair Lung Disease Diagnosis from Chest CT via Gender-Adversarial Attention Multiple Instance Learning

Authors: Aditya Parikh, Aasa Feragen

Organizations: Technical University of Denmark (DTU), Kongens Lyngby, Denmark

Abstract

We present a fairness-aware framework for multi-class lung disease diagnosis from chest CT volumes, developed for the Fair Disease Diagnosis Challenge at the PHAROS-AIF-MIH Workshop (CVPR 2026). The challenge requires classifying CT scans into four categories -- Healthy, COVID-19, Adenocarcinoma, and Squamous Cell Carcinoma -- with performance measured as the average of per-gender macro F1 scores, explicitly penalizing gender-inequitable predictions. Our approach addresses two core difficulties: the sparse pathological signal across hundreds of slices, and a severe demographic imbalance compounded across disease class and gender. We propose an attention-based Multiple Instance Learning (MIL) model on a ConvNeXt backbone that learns to identify diagnostically relevant slices without slice-level supervision, augmented with a Gradient Reversal Layer (GRL) that adversarially suppresses gender-predictive structure in the learned scan representation. Training incorporates focal loss with label smoothing, stratified cross-validation over joint (class, gender) strata, and targeted oversampling of the most underrepresented subgroup. At inference, all five-fold checkpoints are ensembled with horizontal-flip test-time augmentation via soft logit voting and out-of-the-fold threshold optimization for robustness. Our model achieves a mean validation competition score of 0.685 (std - 0.030), with the best single fold reaching 0.759. All training and inference code is publicly available at https://github.com/ADE-17/cvpr-fair-chest-ct

Figures & tables

Figure 1: Representative axial CT slices for each diagnostic category. (a) Healthy lungs exhibit clear parenchyma. (b) COVID-19 infection presents with characteristic bilateral ground-glass opacities distributed across the lung fields. (c) Adenocarcinoma and (d) Squamous Cell Carcinoma represent the two malignant categories, each presenting as distinct focal lung lesions. The subtle visual differences between disease classes, and the fact that abnormalities occupy only a small fraction of slices within a full CT volume, motivate our attention-based MIL approach.

Panel of Figure 2 — Figure 2: Dataset characteristics. (top) Distribution of scans by class and gender, highlighting the severe intersectional scarcity of female Squamous Cell Carcinoma (SCC) cases. (bottom) Variance in volumetric depth across classes. The extreme fluctuation in slices per scan (ranging from under 20 to over 800) necessitates our flexible Attention-MIL formulation.

Fold	$P$	M-F1	F-F1	F1-A	F1-G
0	0.698	0.673	0.722	0.807	0.258
1	0.727	0.754	0.699	0.796	0.378
2	0.674	0.658	0.690	0.692	0.500
3	0.688	0.743	0.634	0.803	0.303
4	0.637	0.565	0.709	0.681	0.389
Mean	0.685	0.679	0.691	0.756	0.366

Table 1: Per-fold validation metrics. The competition score

P

is the average of male and female macro-F1. Best fold highlighted in bold .

Figure 3: Weights & Biases validation curves across all 5 folds. The integration of the Gradient Reversal Layer stabilized the initially highly variant training dynamics.

Design Choice	Primary Challenge Addressed	Observed Improvement
Mean Pooling (Baseline)	N/A	Model struggled to detect small tumors; signals diluted by healthy slices.
+ Max Pooling	Localized tumor signal dilution in 3D volumes.	Recovered ability to trigger positive predictions from sparse tumor slices.
+ Attention-MIL	Noise from uninformative background and boundary slices.	Improved spatial robustness by learning to actively ignore empty lung regions.
+ Subgroup Oversampling	Extreme intersectional scarcity (e.g., only 5 Female SCC scans).	Prevented minority class collapse and substantially lifted Female Macro-F1.
+ Gradient Reversal Layer	Entanglement of clinical tumor features with gender features.	Closed the fairness gap, equating Male and Female performance ( $P=0.685$ ).

Table 2: Qualitative ablation study detailing the architectural and methodological evolution of the pipeline. Each component was introduced to address a specific observed bottleneck.

Model	$P$	M-F1	F-F1	F1-A	F1-G	F1-Cov
OOF Global Mean	0.683	0.679	0.688	0.755	0.366	0.813
OOF Global $\pm$	0.032	0.066	0.029	0.056	0.083	0.070
Ens. All+TTA (Test)	–	–	–	–	–	–

Table 3: Out-of-Fold (OOF) evaluation metrics representing the true global performance of the 5-fold ensemble with threshold optimization. Ensemble test metrics to be updated upon label release.

Explore similar work

Apr 8, 2026

Robust Fair Disease Diagnosis in CT Images

Automated diagnosis from chest CT has improved considerably with deep learning, but models trained on skewed datasets tend to perform unevenly across patient demographics. However, the situation is worse than simple demographic bias. In clinical data, class imbalance and group underrepresentation often coincide, creating compound failure modes that neither standard rebalancing nor fairness corrections can fix alone. We introduce a two-level objective that targets both axes of this problem. Logit-adjusted cross-entropy loss operates at the sample level, shifting decision margins by class frequency with provable consistency guarantees. Conditional Value at Risk aggregation operates at the group level, directing optimization pressure toward whichever demographic group currently has the higher loss. We evaluate on the Fair Disease Diagnosis benchmark using a 3D ResNet-18 pretrained on Kinetics-400, classifying CT volumes into Adenocarcinoma, Squamous Cell Carcinoma, COVID-19, and Normal groups with patient sex annotations. The training set illustrates the compound problem concretely: squamous cell carcinoma has 84 samples total, 5 of them female. The combined loss reaches a gender-averaged macro F1 of 0.8403 with a fairness gap of 0.0239, a 13.3% improvement in score and 78% reduction in demographic disparity over the baseline. Ablations show that each component alone falls short. The code is publicly available at https://github.com/Purdue-M2/Fair-Disease-Diagnosis.

Justin Li, Daniel Ding, Asmita Yuki Pritha +3

Carmel High School, Carmel, Indiana, USA · Capstone School Dhaka, Bangladesh · Clarkstown High School South, West Nyack, New York, USA +2

Algorithmic Fairness Medical Image Classification Class-Imbalanced Learning

Ask PDF

Mar 16, 2026

Clinical Priors Guided Lung Disease Detection in 3D CT Scans

Accurate classification of lung diseases from chest CT scans plays an important role in computer-aided diagnosis systems. However, medical imaging datasets often suffer from severe class imbalance, which may significantly degrade the performance of deep learning models, especially for minority disease categories. To address this issue, we propose a gender-aware two-stage lung disease classification framework. The proposed approach explicitly incorporates gender information into the disease recognition pipeline. In the first stage, a gender classifier is trained to predict the patient's gender from CT scans. In the second stage, the input CT image is routed to a corresponding gender-specific disease classifier to perform final disease prediction. This design enables the model to better capture gender-related imaging characteristics and alleviate the influence of imbalanced data distribution. Experimental results demonstrate that the proposed method improves the recognition performance for minority disease categories, particularly squamous cell carcinoma, while maintaining competitive performance on other classes.

Kejin Lu, Jianfa Bai, Qingqiu Li +5

College of Computer Science and Artificial Intelligence, Shanghai Key Laboratory of Intelligent Information Processing, Fudan University · University of Oxford · The Hong Kong University of Science and Technology

Medical Image Classification 3D Medical Imaging Class-Imbalanced Learning

Ask PDF

Mar 16, 2026

Towards Fair and Robust Volumetric CT Classification via KL-Regularised Group Distributionally Robust Optimisation

Automated diagnosis from chest computed tomography (CT) scans faces two persistent challenges in clinical deployment: distribution shift across acquisition sites and performance disparity across demographic subgroups. We address both simultaneously across two complementary tasks: binary COVID-19 classification from multi-site CT volumes (Task 1) and four-class lung pathology recognition with gender-based fairness constraints (Task 2). Our framework combines a lightweight MobileViT-XXS slice encoder with a two-layer SliceTransformer aggregator for volumetric reasoning, and trains with a KL-regularised Group Distributionally Robust Optimisation (Group DRO) objective that adaptively upweights underperforming acquisition centres and demographic subgroups. Unlike standard Group DRO, the KL penalty prevents group weight collapse, providing a stable balance between worst-case protection and average performance. For Task 2, we define groups at the granularity of gender class, directly targeting severely underrepresented combinations such as female Squamous cell carcinoma. On Task 1, our best configuration achieves a challenge F1 of 0.835, surpassing the best published challenge entry by +5.9. On Task 2, Group DRO with α = 0.5 achieves a mean per-gender macro F1 of 0.815, outperforming the best challenge entry by +11.1 pp and improving Female Squamous F1 by +17.4 over the Focal Loss baseline.

Samuel Johnny, Blessed Guda, Goodness Obasi +2

Carnegie Mellon University Africa, Kigali, Rwanda · Carnegie Mellon University, Pittsburgh, USA

Medical Image Classification Distributionally Robust Optimization Algorithmic Fairness Computed Tomography

Ask PDF