cs.CVMar 7, 2026

PromptGate Client Adaptive Vision Language Gating for Open Set Federated Active Learning

Authors: Adea Nesturi, David Dueñas Gaviria, Jiajun Zeng, Shadi Albarqouni

Organizations: University of Bonn, University Hospital Bonn, Clinic for Diagnostic and Interventional Radiology, 53127 Bonn, Germany

Abstract

Deploying medical AI across resource-constrained institutions demands data-efficient learning pipelines that respect patient privacy. Federated Learning (FL) enables collaborative medical AI without centralising data, yet real-world clinical pools are inherently open-set, containing out-of-distribution (OOD) noise such as imaging artifacts and wrong modalities. Standard Active Learning (AL) query strategies mistake this noise for informative samples, wasting scarce annotation budgets. We propose PromptGate, a dynamic VLM-gated framework for Open-Set Federated AL that purifies unlabeled pools before querying. PromptGate introduces a federated Class-Specific Context Optimization: lightweight, learnable prompt vectors that adapt a frozen BiomedCLIP backbone to local clinical domains and aggregate globally via FedAvg -- without sharing patient data. As new annotations arrive, prompts progressively sharpen the ID/OOD boundary, turning the VLM into a dynamic gatekeeper that is strategy-agnostic: a plug-and-play pre-selection module enhancing any downstream AL strategy. Experiments on distributed dermatology and breast imaging benchmarks show that while static VLM prompting degrades to 50% ID purity, PromptGate maintains >>95% purity with 98% OOD recall.

Figures & tables

Explore similar work

CardsList
  1. FIDAL: Diversity-Aware Federated Active Learning Under Real-World Distribution Shifts

    Sep 10, 2026David Dueñas Gaviria, Shadi AlbarqouniActive LearningFederated Learning

  2. UniPrompt-CL: Efficient Single-Inference Continual Learning for Medical Image Classification

    Aug 14, 2025Gyutae Oh, Jitae ShinContinual LearningDomain-Incremental Learning

  3. Aegis: Generative Gradient Masking for Privacy-Preserving Medical Federated Learning

    Sep 29, 2026Chaoyu Zhang, Shanghao Shi, Heng Jin +3Privacy-Preserving Federated LearningModel Inversion Attacks