mlsanityData to 14 Oct 2026

PromptGate Client Adaptive Vision Language Gating for Open Set Federated Active Learning

arXiv 2603.07163 ↗First posted 7 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Deploying medical AI across resource-constrained institutions demands data-efficient learning pipelines that respect patient privacy. Federated Learning (FL) enables collaborative medical AI without centralising data, yet real-world clinical pools are inherently open-set, containing out-of-distribution (OOD) noise such as imaging artifacts and wrong modalities. Standard Active Learning (AL) query strategies mistake this noise for informative samples, wasting scarce annotation budgets. We propose PromptGate, a dynamic VLM-gated framework for Open-Set Federated AL that purifies unlabeled pools before querying. PromptGate introduces a federated Class-Specific Context Optimization: lightweight, learnable prompt vectors that adapt a frozen BiomedCLIP backbone to local clinical domains and aggregate globally via FedAvg -- without sharing patient data. As new annotations arrive, prompts progressively sharpen the ID/OOD boundary, turning the VLM into a dynamic gatekeeper that is strategy-agnostic: a plug-and-play pre-selection module enhancing any downstream AL strategy. Experiments on distributed dermatology and breast imaging benchmarks show that while static VLM prompting degrades to 50% ID purity, PromptGate maintains >95% purity with 98% OOD recall.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 20 references that are in the map. First posted on arXiv 7 Mar 2026.

Builds on

14 of 20 references.

References · 14

  1. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  2. 2021Learning to Prompt for Vision-Language Modelscited by 2,281
  3. 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 520
  4. 2021Evaluating Deep Neural Networks Trained on Clinical Images in Dermatology with the Fitzpatrick 17k Datasetcited by 185
  5. 2021Disparities in Dermatology AI: Assessments Using Diverse Clinical Imagescited by 134
  6. 2022FLamby: Datasets and Benchmarks for Cross-Silo Federated Learning in Realistic Healthcare Settingscited by 125
  7. 2022Active Learning for Open-set Annotationcited by 34
  8. 2023Think Twice Before Selection: Federated Evidential Active Learning for Medical Image Analysis with Domain Shiftscited by 28
  9. 2024Robust image representations with counterfactual contrastive learningcited by 14
  10. 2025Joint Out-of-Distribution Filtering and Data Discovery Active Learningcited by 7
  11. 2023OpenAL: An Efficient Deep Active Learning Framework for Open-Set Pathology Image Classificationcited by 5
  12. 2024Radio-opaque artefacts in digital mammography: automatic detection and analysis of downstream effectscited by 4
2 more
  1. 2025Bias and Generalizability of Foundation Models across Datasets in Breast Mammographycited by 4
  2. 2025OpenPath: Open-Set Active Learning for Pathology Image Classification via Pre-trained Vision-Language Modelscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Federated CLIP for Resource-Efficient Heterogeneous Medical Image Classification
  2. 2025Federated Learning for Medical Image Classification: A Comprehensive Benchmark
  3. 2025FLIP: Towards Comprehensive and Reliable Evaluation of Federated Prompt Learning
  4. 2025FOCoOp: Enhancing Out-of-Distribution Robustness in Federated Prompt Learning for Vision-Language Models
  5. 2026FedBiCross: Personalized One-Shot Federated Learning on Medical Images
  6. 2026FederatedFactory: Generative One-Shot Learning for Extremely Non-IID Distributed Scenarios
  7. 2026Lethe: How Hard Is It to Forget? A Benchmark for Federated Unlearning in Medical Imaging
  8. 2024Distributionally Robust Alignment for Medical Federated Vision-Language Pre-training Under Data Heterogeneity