mlsanityData to 14 Oct 2026

Boosting multi-demographic federated learning for chest radiograph analysis using general-purpose self-supervised representations

arXiv 2504.08584 ↗First posted 11 Apr 2025cs.CV cs.AI cs.LGcited by 6

Not on the map. Why?

Abstract (arXiv)

Reliable artificial intelligence (AI) models for medical image analysis often depend on large and diverse labeled datasets. Federated learning (FL) offers a decentralized and privacy-preserving approach to training but struggles in highly non-independent and identically distributed (non-IID) settings, where institutions with more representative data may experience degraded performance. Moreover, existing large-scale FL studies have been limited to adult datasets, neglecting the unique challenges posed by pediatric data, which introduces additional non-IID variability. To address these limitations, we analyzed n=398,523 adult chest radiographs from diverse institutions across multiple countries and n=9,125 pediatric images, leveraging transfer learning from general-purpose self-supervised image representations to classify pneumonia and cases with no abnormality. Using state-of-the-art vision transformers, we found that FL improved performance only for smaller adult datasets (P<0.001) but degraded performance for larger datasets (P<0.064) and pediatric cases (P=0.242). However, equipping FL with self-supervised weights significantly enhanced outcomes across pediatric cases (P=0.031) and most adult datasets (P<0.008), except the largest dataset (P=0.052). These findings underscore the potential of easily deployable general-purpose self-supervised image representations to address non-IID challenges in clinical FL applications and highlight their promise for enhancing patient outcomes and advancing pediatric healthcare, where data scarcity and variability remain persistent obstacles.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 40 of its 81 references that are in the map. First posted on arXiv 11 Apr 2025.

Builds on

40 of 81 references.

References · 40

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  6. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  7. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  8. 2019Advances and Open Problems in Federated Learningcited by 3,046
  9. 2018Federated Optimization in Heterogeneous Networkscited by 2,987
  10. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
  11. 2016Federated Learning: Strategies for Improving Communication Efficiencycited by 1,475
  12. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
28 more
  1. 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,186
  2. 2018Federated Learning with Non-IID Datacited by 1,108
  3. 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 972
  4. 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 903
  5. 2016Federated Optimization: Distributed Machine Learning for On-Device Intelligencecited by 564
  6. 2022Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learningcited by 359
  7. 2021Federated Learning on Non-IID Data: A Surveycited by 346
  8. 2019PadChest: A large chest x-ray image dataset with multi-label annotated reportscited by 309
  9. 2020Google Landmarks Dataset v2 -- A Large-Scale Benchmark for Instance-Level Recognition and Retrievalcited by 309
  10. 2019The Non-IID Data Quagmire of Decentralized Machine Learningcited by 305
  11. 2020VinDr-CXR: An open dataset of chest X-rays with radiologist's annotationscited by 239
  12. 2019Fixing the train-test resolution discrepancycited by 209
  13. 2018Spreading vectors for similarity searchcited by 118
  14. 2021Deep Learning for Chest X-ray Analysis: A Surveycited by 84
  15. 2016Learning to Read Chest X-Rays: Recurrent Neural Cascade Model for Automated Image Annotationcited by 59
  16. 2021Collaborative Federated Learning For Healthcare: Multi-Modal COVID-19 Diagnosis at the Edgecited by 56
  17. 2023Are Natural Domain Foundation Models Useful for Medical Image Classification?cited by 46
  18. 2022Transformers in Medical Image Analysis: A Reviewcited by 41
  19. 2022Label-Efficient Self-Supervised Federated Learning for Tackling Data Heterogeneity in Medical Imagingcited by 39
  20. 2022PediCXR: An open, large-scale chest radiograph dataset for interpretation of common thoracic diseases in childrencited by 19
  21. 2022Weighted Ensemble Self-Supervised Learningcited by 19
  22. 2023Private, fair and accurate: Training large-scale, privacy-preserving AI models in medical imagingcited by 17
  23. 2024Comparative Analysis of ImageNet Pre-Trained Deep Learning Models and DINOv2 in Medical Imaging Classificationcited by 14
  24. 2023Enhancing Network Initialization for Medical AI Models Using Large-Scale, Unlabeled Natural Imagescited by 11
  25. 2022Collaborative Training of Medical Artificial Intelligence Models with non-uniform Labelscited by 10
  26. 2023Federated learning for secure development of AI models for Parkinson's disease detection using speech from different languagescited by 9
  27. 2023Preserving privacy in domain transfer of medical AI models comes at no performance costs: The integral role of differential privacycited by 6
  28. 2021Improving Performance of Federated Learning based Medical Image Analysis in Non-IID Settings using Image Augmentationcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 4.

6 papers.