Federated Learning for Privacy-Preserving Medical AI
Organizations: School of Computer Science and Electrical and Electronic Engineering, Faculty of Engineering and Physical Sciences, University of Surrey, Guildford, Surrey, GU2 7XH, UK
Abstract
This dissertation investigates privacy-preserving federated learning for Alzheimer's disease classification using three-dimensional MRI data from the Alzheimer's Disease Neuroimaging Initiative (ADNI). Existing methodologies often suffer from unrealistic data partitioning, inadequate privacy guarantees, and insufficient benchmarking, limiting their practical deployment in healthcare. To address these gaps, this research proposes a novel site-aware data partitioning strategy that preserves institutional boundaries, reflecting real-world multi-institutional collaborations and data heterogeneity. Furthermore, an Adaptive Local Differential Privacy (ALDP) mechanism is introduced, dynamically adjusting privacy parameters based on training progression and parameter characteristics, thereby significantly improving the privacy-utility trade-off over traditional fixed-noise approaches. Systematic empirical evaluation across multiple client federations and privacy budgets demonstrated that advanced federated optimisation algorithms, particularly FedProx, could equal or surpass centralised training performance while ensuring rigorous privacy protection. Notably, ALDP achieved up to 80.4% accuracy in a two-client configuration, surpassing fixed-noise Local DP by 5-7 percentage points and demonstrating substantially greater training stability. The comprehensive ablation studies and benchmarking establish quantitative standards for privacy-preserving collaborative medical AI, providing practical guidelines for real-world deployment. This work thereby advances the state-of-the-art in federated learning for medical imaging, establishing both methodological foundations and empirical evidence necessary for future privacy-compliant AI adoption in healthcare.
Figures & tables
| Framework | Easy to use | Documentation | Features | Community | Score |
|---|---|---|---|---|---|
| Flower | Highly user-friendly with intuitive APIs and extensive tutorials. | Comprehensive and well-maintained with numerous tutorials. | Cross-device FL, scalable client-server architecture, FedAvg/SecAgg/DP support, PyTorch integration | 6200+ GitHub stars, 164+ contributors. Active community. | 84.75% |
| PySyft | Steeper learning curve for beginners. | Some documentation may be outdated or less detailed. | Privacy-focused (DP, SMPC), encrypted computation, PyTorch-based | 9600+ GitHub stars, 428+ contributors. | 72.5% |
| OpenFL | Balanced between ease of use and robustness for research and production. | Decent documentation covering installation, tutorials, and API references. | Workflow-based FL, enterprise-ready, model aggregation, PyTorch and TensorFlow support. | 2000+ GitHub stars, 164+ contributors. | 69% |
| NVFlare | Production-focused with good documentation, suitable for users familiar with FL concepts. | Detailed documentation with guides for getting started and advanced topics. | Privacy-preserving FL, large file streaming, multi-cloud support, FedAvg/FedProx | 700+ GitHub stars, 46+ contributors. | 80.5% |
| Diagnosis | #Subjects | Gender (Male/Female) | Age (years) |
|---|---|---|---|
| Cognitively Normal (CN) | 490 | 199/291 | |
| Dementia (AD) | 307 | 174/133 |
| Diagnosis | #Subjects | Gender (Male/Female) | Age (years) |
|---|---|---|---|
| Cognitively Normal (CN) | 50 | 15/35 | |
| Dementia (AD) | 50 | 33/17 |
| Layer | Type | Kernel Size | Pooling | Output Channels |
|---|---|---|---|---|
| Layer 1 | Conv3d + BN + ReLU + MaxPool | (3,3,3) | (4,4,4) | 8 |
| Layer 2 | Conv3d + BN + ReLU | (3,3,3) | - | 8 |
| Layer 3 | Conv3d + BN + ReLU + MaxPool | (3,3,3) | (3,3,3) | 16 |
| Layer 4 | Conv3d + BN + ReLU | (3,3,3) | - | 16 |
| Layer 5 | Conv3d + BN + ReLU + MaxPool | (3,3,3) | (2,2,2) | 32 |
| Layer 6 | Conv3d + BN + ReLU | (3,3,3) | - | 32 |
| Strategy | #Clients | Global Test Accuracy (%) | Global Test F1 (%) |
|---|---|---|---|
| CL (Centralised) | – | 80.2 2.23 | 79.66 2.51 |
| FedAvg | 2 | 79.2 1.94 | 78.84 2.17 |
| FedProx (best ) | 2 | 80.4 2.33 | 80.05 2.44 |
| FedAvg | 3 | 79.2 2.23 | 78.93 2.36 |
| FedProx (best ) | 3 | 81.4 3.20 | 81.26 3.24 |
| SecAgg+ | 3 | 78.2 2.14 | 77.79 2.30 |
| Strategy | #Clients | Privacy Budget ( ) | Global Test Accuracy (%) | Global Test F1 (%) |
|---|---|---|---|---|
| CL (Centralised) | – | – | 78.6 3.38 | 78.06 3.49 |
| ( , )-DP | 2 | 100 | 55.2 4.26 | 50.05 8.29 |
| ( , )-DP | 2 | 500 | 70.2 4.45 | 68.71 5.66 |
| ( , )-DP | 2 | 1000 | 72.0 4.94 | 71.04 5.55 |
| ( , )-DP | 2 | 2000 | 75.6 4.63 | 74.81 5.71 |
| Adaptive ( , )-DP | 2 | initial =100 | 60.8 4.53 | 56.70 8.21 |
| Strategy | Client 1 Test Acc (%) | Client 2 Test Acc (%) | Client 3 Test Acc (%) | Client 4 Test Acc (%) | All Test Acc (%) |
|---|---|---|---|---|---|
| CL | 68.2 2.93 | 72.8 9.66 | 70.6 5.16 | 75.4 1.02 | 80.2 2.23 |
| Strategy | Average Training Time (h:mm:ss) | Relative to Centralised (%) |
|---|---|---|
| CL (Centralised) | 2:52:07 | 100.0 |
| FedAvg | 3:30:22 | 121.9 |
| FedProx | 3:58:00 | 138.0 |
| SecAgg+ | 2:39:56 | 92.9 |
| Local DP | 3:31:50 | 122.6 |
| ALDP | 3:56:43 | 137.2 |
Appendix figures & tables2 assets
Supplementary material from the paper’s appendix.
Appendix
| Category | Parameter | Value | Description |
|---|---|---|---|
| Training | Batch Size | 2–8 | Varies on different number of concurrent clients |
| Training | Learning Rate | Initial learning rate | |
| Training | LR Scheduler | Cosine | Learning rate scheduler |
| Training | Optimizer | AdamW | Optimization algorithm |
| Training | Weight Decay | Weight Decay regularization | |
| Training | Mixed Precision | False | Enable automatic mixed precision |
| Strategy | #Clients | Global Test Accuracy (%) | Global Test F1 (%) | |
|---|---|---|---|---|
| CL (centralised) | - | - | 80.2 2.23 | 79.66 2.51 |
| FedProx | 2 | 79.6 4.32 | 79.11 4.75 | |
| FedProx | 2 | 80.2 2.23 | 79.91 2.33 | |
| FedProx | 2 | 79.2 3.37 | 78.77 3.86 | |
| FedProx | 2 | 80.4 2.33 | 80.05 2.44 | |
| FedProx | 3 | 78.2 4.96 | 77.41 6.15 |