mlsanityData to 14 Oct 2026

Improving Learning of New Diseases through Knowledge-Enhanced Initialization for Federated Adapter Tuning

arXiv 2508.10299 ↗First posted 14 Aug 2025cs.LG cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

In healthcare, federated learning (FL) is a widely adopted framework that enables privacy-preserving collaboration among medical institutions. With large foundation models (FMs) demonstrating impressive capabilities, using FMs in FL through cost-efficient adapter tuning has become a popular approach. Given the rapidly evolving healthcare environment, it is crucial for individual clients to quickly adapt to new tasks or diseases by tuning adapters while drawing upon past experiences. In this work, we introduce Federated Knowledge-Enhanced Initialization (FedKEI), a novel framework that leverages cross-client and cross-task transfer from past knowledge to generate informed initializations for learning new tasks with adapters. FedKEI begins with a global clustering process at the server to generalize knowledge across tasks, followed by the optimization of aggregation weights across clusters (inter-cluster weights) and within each cluster (intra-cluster weights) to personalize knowledge transfer for each new task. To facilitate more effective learning of the inter- and intra-cluster weights, we adopt a bi-level optimization scheme that collaboratively learns the global intra-cluster weights across clients and optimizes the local inter-cluster weights toward each client's task objective. Extensive experiments on three benchmark datasets of different modalities, including dermatology, chest X-rays, and retinal OCT, demonstrate FedKEI's advantage in adapting to new diseases compared to state-of-the-art methods.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 45 of its 60 references that are in the map. First posted on arXiv 14 Aug 2025.

Builds on

45 of 60 references.

References · 45

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  5. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  6. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  7. 2018Federated Optimization in Heterogeneous Networkscited by 2,987
  8. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
  9. 2016Progressive Neural Networkscited by 1,361
  10. 2018Efficient Lifelong Learning with A-GEMcited by 1,058
  11. 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 972
  12. 2022Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learningcited by 896
33 more
  1. 2019Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC)cited by 669
  2. 2020The Future of Digital Health with Federated Learningcited by 633
  3. 2020An Efficient Framework for Clustered Federated Learningcited by 511
  4. 2019A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protectioncited by 374
  5. 2021FedDG: Federated Domain Generalization on Medical Image Segmentation via Episodic Learning in Continuous Frequency Spacecited by 287
  6. 2020Personalized Cross-Silo Federated Learning on Non-IID Datacited by 283
  7. 2020VinDr-CXR: An open dataset of chest X-rays with radiologist's annotationscited by 239
  8. 2020Federated Continual Learning with Weighted Inter-client Transfercited by 161
  9. 2024Improving LoRA in Privacy-preserving Federated Learningcited by 161
  10. 2024FLoRA: Federated Fine-Tuning Large Language Models with Heterogeneous Low-Rank Adaptationscited by 146
  11. 2022Federated Class-Incremental Learningcited by 127
  12. 2020Multi-site fMRI Analysis Using Privacy-preserving Federated Learning and Domain Adaptation: ABIDE Resultscited by 122
  13. 2019Overcoming Forgetting in Federated Learning on Non-IID Datacited by 120
  14. 2021Multi-Center Federated Learning: Clients Clustering for Better Personalizationcited by 113
  15. 2022Improving Generalization in Federated Learning by Seeking Flat Minimacited by 98
  16. 2022FedPrompt: Communication-Efficient and Privacy Preserving Prompt Tuning in Federated Learningcited by 91
  17. 2023When Foundation Model Meets Federated Learning: Motivations, Challenges, and Future Directionscited by 84
  18. 2024VoCo: A Simple-yet-Effective Volume Contrastive Learning Framework for 3D Medical Image Analysiscited by 75
  19. 2023FedCLIP: Fast Generalization and Personalization for CLIP in Federated Learningcited by 70
  20. 2019Hierarchically Structured Meta-learningcited by 68
  21. 2021Adapt to Adaptation: Learning Personalization for Cross-Silo Federated Learningcited by 53
  22. 2021A distillation-based approach integrating continual learning and federated learning for pervasive servicescited by 42
  23. 2022Closing the Generalization Gap of Cross-silo Federated Medical Image Segmentationcited by 42
  24. 2022Label-Efficient Self-Supervised Federated Learning for Tackling Data Heterogeneity in Medical Imagingcited by 39
  25. 2021Specificity-Preserving Federated Learning for MR Image Reconstructioncited by 35
  26. 2024A Survey on Efficient Federated Learning Methods for Foundation Model Trainingcited by 29
  27. 2022LifeLonger: A Benchmark for Continual Disease Classificationcited by 28
  28. 2023Federated Domain Generalization: A Surveycited by 25
  29. 2019The impact of patient clinical information on automated skin cancer detectioncited by 21
  30. 2025A Survey on Parameter-Efficient Fine-Tuning for Foundation Models in Federated Learningcited by 17
  31. 2024Synergizing Foundation Models and Federated Learning: A Surveycited by 14
  32. 2024FACMIC: Federated Adaptative CLIP Model for Medical Image Classificationcited by 7
  33. 2025AFCL: Analytic Federated Continual Learning for Spatio-Temporal Invariance of Non-IID Datacited by 3

Built on by

Not cited yet.