mlsanityData to 7 Oct 2026

Federated LoRA Adaptation of BiomedCLIP Across Four International Chest X-Ray Cohorts

arXiv 2609.02101 ↗First posted 2 Sep 2026cs.LG cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Federated learning (FL) lets institutions train a shared model without exchanging data, and Low-Rank Adaptation (LoRA) makes this practical at scale by communicating only compact low-rank updates. Biomedical imaging is a compelling setting for this combination: patient data are archived behind privacy regulations, and institutions differ widely in scanners, protocols, and compute. Such heterogeneity raises the question of how federated LoRA updates should be aggregated, increasingly pressing as multimodal vision-language models become central to medical image analysis. We benchmark federated Parameter-efficient fine-tuning (PEFT) of BiomedCLIP for chest radiograph classification across four public cohorts on three continents (USA, Vietnam, Spain). Federated LoRA adaptation improves shared-class AUC on all four cohorts over the unadapted BiomedCLIP backbone (mean 0.687 to 0.802), showing that the gains come from federated adaptation rather than from the pretrained model's zero-shot ability. Relative to isolated single-cohort training, federation improves the weaker cohorts while largely preserving the strongest and approaches a centralized reference (0.812) that pools all data. The singular value decomposition (SVD)-based product-space aggregation introduced by FlexLoRA is essential to this gain (naive factor averaging drops mean AUC by 0.097), whereas a drift-correcting optimizer (FedProx) shows no benefit over FedAvg in our single-seed runs, consistent with LoRA's low-rank updates already limiting client drift. Biomedical vision-language models can thus be adapted collaboratively across heterogeneous, geographically distributed institutions without centralizing data.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 31 references that are in the map. First posted on arXiv 2 Sep 2026.

Builds on

24 of 31 references.

References · 24

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  4. 2019Advances and Open Problems in Federated Learningcited by 3,021
  5. 2018Federated Optimization in Heterogeneous Networkscited by 2,971
  6. 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 969
  7. 2021FedBN: Federated Learning on Non-IID Features via Local Batch Normalizationcited by 565
  8. 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 564
  9. 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 506
  10. 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 336
  11. 2019PadChest: A large chest x-ray image dataset with multi-label annotated reportscited by 308
  12. 2020VinDr-CXR: An open dataset of chest X-rays with radiologist's annotationscited by 236
12 more
  1. 2023Towards Building the Federated GPT: Federated Instruction Tuningcited by 184
  2. 2024Improving LoRA in Privacy-preserving Federated Learningcited by 158
  3. 2024Federated Fine-tuning of Large Language Models under Heterogeneous Tasks and Client Resourcescited by 93
  4. 2024Selective Aggregation for Low-Rank Adaptation in Federated Learningcited by 80
  5. 2023FedCLIP: Fast Generalization and Personalization for CLIP in Federated Learningcited by 70
  6. 2020On the limits of cross-domain generalization in automated X-ray predictioncited by 61
  7. 2024FedFMS: Exploring Federated Foundation Models for Medical Image Segmentationcited by 21
  8. 2024FedEx-LoRA: Exact Aggregation for Federated and Efficient Fine-Tuning of Foundation Modelscited by 18
  9. 2024VLSM-Adapter: Finetuning Vision-Language Segmentation Efficiently with Lightweight Blockscited by 11
  10. 2025FedSVD: Adaptive Orthogonalization for Private Federated Learning with LoRAcited by 11
  11. 2023From Isolation to Collaboration: Federated Class-Heterogeneous Learning for Chest X-Ray Classificationcited by 2
  12. 2026Parameter Efficient Fine-tuning for Domain-specific Gastrointestinal Disease Recognitioncited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Federated Learning for Medical Image Classification: A Comprehensive Benchmark
  2. 2025Federated CLIP for Resource-Efficient Heterogeneous Medical Image Classification
  3. 2024CCVA-FL: Cross-Client Variations Adaptive Federated Learning for Medical Imaging
  4. 2026PromptGate Client Adaptive Vision Language Gating for Open Set Federated Active Learning
  5. 2026FM2: Unified Federated Foundation Models for Heterogeneous Multimodal Medical Imaging
  6. 2026Model Merging for Medical LVLMs: A Benchmark and a Winner-Take-All Approach
  7. 2025Interpreting Biomedical VLMs on High-Imbalance Out-of-Distributions: An Insight into BiomedCLIP on Radiology
  8. 2026FedPref: Federated Preference Learning for Structured Radiology Report Extraction