Organizations: Department of Applied Mechanics Indian Institute of Technology Delhi · Grainger College of Engineering Nuclear, Plasma & Radiological Engineering Department National Center for Supercomputing Applications, Urbana, IL, USA · Department of Applied Mechanics Yardi School of Artificial Intelligence (ScAI) Grainger College of Engineering Indian Institute of Technology Delhi University of Illinois Urbana-Champaign, Urbana, IL, USA
Protecting patient privacy remains a fundamental barrier to scaling machine learning across healthcare institutions, where centralizing sensitive data is often infeasible due to ethical, legal, and regulatory constraints. Federated learning offers a promising alternative by enabling privacy-preserving, multi-institutional training without sharing raw patient data; however, real-world deployments face severe challenges from data heterogeneity, site-specific biases, and class imbalance, which degrade predictive reliability and render existing uncertainty quantification methods ineffective. Here, we present TrustFed, a federated uncertainty quantification framework that provides distribution-free, finite-sample coverage guarantees under heterogeneous and imbalanced healthcare data, without requiring centralized access. TrustFed introduces a representation-aware client assignment mechanism that leverages internal model representations to enable effective calibration across institutions, along with a soft-nearest threshold aggregation strategy that mitigates assignment uncertainty while producing compact and reliable prediction sets. Using over 430,000 medical images across six clinically distinct imaging modalities, we conduct one of the most comprehensive evaluations of uncertainty-aware federated learning in medical imaging, demonstrating robust coverage guarantees across datasets with diverse class cardinalities and imbalance regimes. By validating TrustFed at this scale and breadth, our study advances uncertainty-aware federated learning from proof-of-concept toward clinically meaningful, modality-agnostic deployment, positioning statistically guaranteed uncertainty as a core requirement for next-generation healthcare AI systems.
Figures & tables
Figure 1: Overview of sample-adaptive federated conformal prediction framework. a Dataset overview: Six dataset involving blood cell microscopy, abdominal computed tomography, dermatoscopic skin lesion, Retinal fundus imaging, kidney tissue microscopy, and colon histopathology are considered to cover the diverse medical imaging modalities. The bar plots show the class distributions of each dataset, while example images illustrate one representative sample per dataset, highlighting the visual characteristics. A schematic human body is used to symbolically represent each dataset. b Federated training: A global model is initialized and broadcast to all clients. Each client performs local training on its private data and uploads the updated parameters, which are then aggregated to update the global model. c Calibration stage: Each client uses a held-out calibration set to compute nonconformity scores and stores them locally. d Sample-adaptive conformal prediction: For a given test sample, its feature space representation is first obtained via the trained model and passed through a similarity estimator. Using K-nearest neighbor search across client feature banks, the most relevant calibration instances are selected. The threshold empirical quantile is obtained by soft nearest threshold aggregation strategy. This quantile, together with the model’s class probabilities from softmax, is used by the prediction set generator to construct a conformal prediction set.
Figure 2: Client similarity assignment and calibration of prediction set under class imbalance. a Client assignment accuracy is computed using Euclidean distance in the feature space. Accuracy improves with larger top-k neighbor sets, ensuring reliable client similarity estimation. b The class distribution across clients and the proportion of samples per client are illustrated for blood cell microscopy. c A test sample (lymphocyte) passed through the trained global model initially yields an uncalibrated set of possible labels. Conformal prediction narrows this to a calibrated prediction set with guaranteed coverage ≥1−α
Figure 3: Comparative coverage and cardinality analysis across the six datasets under class imbalance. a The table compares FCP, Local, and the Proposed approach across six datasets discussed before under coverage levels (1−α)=0.9 and 0.8. It shows that the proposed method consistently achieves empirical coverage close to the nominal level while maintaining competitive prediction set cardinality across datasets. b This plot shows coverage and cardinality as function of 1−α . c This bar chart shows coverage and cardinality variation for α=0.9 and 0.8 under different nearest neighbor (k) values. Larger k improves coverage at the cost of slightly increased cardinality, indicating a trade-off between coverage and set size.
Figure 4: Comparative coverage and cardinality analysis across the datasets under sample imbalance. a The table compares the coverage and cardinality across all six datasets at specified confidence levels (1−α)=0.9 and 0.8. b This plot shows that the FedTrust achieves the required coverage for various values of α . c This bar chart shows top-k client assignment accuracy across datasets. d This pie chart shows the distribution of samples across clients, while maintaining the same class distribution for each client.
Multimodal federated learning enables privacy-preserving collaborative model training across healthcare institutions. However, a fundamental challenge arises from modality heterogeneity: many clinical sites possess only a subset of modalities due to resource constraints or workflow variations. Existing approaches address this through feature imputation networks that synthesize missing modality representations, yet these methods produce point estimates without reliability measures, forcing downstream classifiers to treat all imputed features as equally trustworthy. In safety-critical medical applications, this limitation poses significant risks. We propose the Probabilistic Feature Imputation Network (P-FIN), which outputs calibrated uncertainty estimates alongside imputed features. This uncertainty is leveraged at two levels: (1) locally, through sigmoid gating that attenuates unreliable feature dimensions before classification, and (2) globally, through Fed-UQ-Avg, an aggregation strategy that prioritizes updates from clients with reliable imputation. Experiments on federated chest X-ray classification using CheXpert, NIH Open-I, and PadChest demonstrate consistent improvements over deterministic baselines, with +5.36% AUC gain in the most challenging configuration.
This dissertation investigates privacy-preserving federated learning for Alzheimer's disease classification using three-dimensional MRI data from the Alzheimer's Disease Neuroimaging Initiative (ADNI). Existing methodologies often suffer from unrealistic data partitioning, inadequate privacy guarantees, and insufficient benchmarking, limiting their practical deployment in healthcare. To address these gaps, this research proposes a novel site-aware data partitioning strategy that preserves institutional boundaries, reflecting real-world multi-institutional collaborations and data heterogeneity. Furthermore, an Adaptive Local Differential Privacy (ALDP) mechanism is introduced, dynamically adjusting privacy parameters based on training progression and parameter characteristics, thereby significantly improving the privacy-utility trade-off over traditional fixed-noise approaches. Systematic empirical evaluation across multiple client federations and privacy budgets demonstrated that advanced federated optimisation algorithms, particularly FedProx, could equal or surpass centralised training performance while ensuring rigorous privacy protection. Notably, ALDP achieved up to 80.4% accuracy in a two-client configuration, surpassing fixed-noise Local DP by 5-7 percentage points and demonstrating substantially greater training stability. The comprehensive ablation studies and benchmarking establish quantitative standards for privacy-preserving collaborative medical AI, providing practical guidelines for real-world deployment. This work thereby advances the state-of-the-art in federated learning for medical imaging, establishing both methodological foundations and empirical evidence necessary for future privacy-compliant AI adoption in healthcare.
Tin Hoang
School of Computer Science and Electrical and Electronic Engineering, Faculty of Engineering and Physical Sciences, University of Surrey, Guildford, Surrey, GU2 7XH, UK
Healthcare organizations often cannot freely centralize patient data because medical records are sensitive, regulated, and institutionally controlled. Federated learning offers a practical alternative by allowing hospitals and clinics to train a shared model while keeping raw data local. However, federated learning is not automatically production-ready or private by default. Model updates can still leak information, and decentralized training introduces operational challenges in deployment, monitoring, rollback, debugging, and governance. This paper examines how MLOps practices and the emerging idea of Federated Learning Operations (FLOps) can make federated healthcare machine learning systems scalable, reliable, and trustworthy. It answers three research questions: how containerization and orchestration support federated deployment, how privacy-preserving mechanisms affect trade-offs among privacy, utility, scalability, and operational complexity, and which post-deployment practices are most important for long-term governance. The central argument is that federated healthcare ML requires more than privacy-preserving algorithms. It needs an integrated MLOps architecture that combines reproducible deployment, secure orchestration, model versioning, audit logging, drift monitoring, heterogeneity management, and clear governance.
Sakshi Gorkhali, Jonesh Shrestha
Jarvis College of Computing and Digital Media DePaul University Chicago Illinois United States