Boosting multi-demographic federated learning for chest radiograph analysis using general-purpose self-supervised representations
Not on the map. Why?
Abstract (arXiv)
Reliable artificial intelligence (AI) models for medical image analysis often depend on large and diverse labeled datasets. Federated learning (FL) offers a decentralized and privacy-preserving approach to training but struggles in highly non-independent and identically distributed (non-IID) settings, where institutions with more representative data may experience degraded performance. Moreover, existing large-scale FL studies have been limited to adult datasets, neglecting the unique challenges posed by pediatric data, which introduces additional non-IID variability. To address these limitations, we analyzed n=398,523 adult chest radiographs from diverse institutions across multiple countries and n=9,125 pediatric images, leveraging transfer learning from general-purpose self-supervised image representations to classify pneumonia and cases with no abnormality. Using state-of-the-art vision transformers, we found that FL improved performance only for smaller adult datasets (P<0.001) but degraded performance for larger datasets (P<0.064) and pediatric cases (P=0.242). However, equipping FL with self-supervised weights significantly enhanced outcomes across pediatric cases (P=0.031) and most adult datasets (P<0.008), except the largest dataset (P=0.052). These findings underscore the potential of easily deployable general-purpose self-supervised image representations to address non-IID challenges in clinical FL applications and highlight their promise for enhancing patient outcomes and advancing pediatric healthcare, where data scarcity and variability remain persistent obstacles.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 40 of its 81 references that are in the map. First posted on arXiv 11 Apr 2025.
Builds on
40 of 81 references.
References · 40
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2019Advances and Open Problems in Federated Learningcited by 3,046
- 2018Federated Optimization in Heterogeneous Networkscited by 2,987
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
- 2016Federated Learning: Strategies for Improving Communication Efficiencycited by 1,475
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
28 more
- 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,186
- 2018Federated Learning with Non-IID Datacited by 1,108
- 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 972
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 903
- 2016Federated Optimization: Distributed Machine Learning for On-Device Intelligencecited by 564
- 2022Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learningcited by 359
- 2021Federated Learning on Non-IID Data: A Surveycited by 346
- 2019PadChest: A large chest x-ray image dataset with multi-label annotated reportscited by 309
- 2020Google Landmarks Dataset v2 -- A Large-Scale Benchmark for Instance-Level Recognition and Retrievalcited by 309
- 2019The Non-IID Data Quagmire of Decentralized Machine Learningcited by 305
- 2020VinDr-CXR: An open dataset of chest X-rays with radiologist's annotationscited by 239
- 2019Fixing the train-test resolution discrepancycited by 209
- 2018Spreading vectors for similarity searchcited by 118
- 2021Deep Learning for Chest X-ray Analysis: A Surveycited by 84
- 2016Learning to Read Chest X-Rays: Recurrent Neural Cascade Model for Automated Image Annotationcited by 59
- 2021Collaborative Federated Learning For Healthcare: Multi-Modal COVID-19 Diagnosis at the Edgecited by 56
- 2023Are Natural Domain Foundation Models Useful for Medical Image Classification?cited by 46
- 2022Transformers in Medical Image Analysis: A Reviewcited by 41
- 2022Label-Efficient Self-Supervised Federated Learning for Tackling Data Heterogeneity in Medical Imagingcited by 39
- 2022PediCXR: An open, large-scale chest radiograph dataset for interpretation of common thoracic diseases in childrencited by 19
- 2022Weighted Ensemble Self-Supervised Learningcited by 19
- 2023Private, fair and accurate: Training large-scale, privacy-preserving AI models in medical imagingcited by 17
- 2024Comparative Analysis of ImageNet Pre-Trained Deep Learning Models and DINOv2 in Medical Imaging Classificationcited by 14
- 2023Enhancing Network Initialization for Medical AI Models Using Large-Scale, Unlabeled Natural Imagescited by 11
- 2022Collaborative Training of Medical Artificial Intelligence Models with non-uniform Labelscited by 10
- 2023Federated learning for secure development of AI models for Parkinson's disease detection using speech from different languagescited by 9
- 2023Preserving privacy in domain transfer of medical AI models comes at no performance costs: The integral role of differential privacycited by 6
- 2021Improving Performance of Federated Learning based Medical Image Analysis in Non-IID Settings using Image Augmentationcited by 4
Built on by
Citing papers per year: 2025: 2; 2026: 4.
6 papers.
- 2025Resolution scaling governs DINOv3 transfer performance in chest radiograph classificationcited by 2
- 2026The pretraining domain outweighs the training objective in setting the privacy-utility trade-off of differentially private medical image analysiscited by 2
- 2025Benchmark Success, Clinical Failure: When Reinforcement Learning Optimizes for Benchmarks, Not Patientscited by 0
- 2026Federated Continual Learning for Privacy-Preserving Hospital Imaging Classificationcited by 0
- 2026Cross-modal linkage risk in clinical vision-language modelscited by 0
- 2026CANDOR: Chance-Calibrated Neighborhood Discordance in Frozen Encoders for Medical Imagingcited by 0
- 2026CANDOR: Chance-Calibrated Neighborhood Discordance in Frozen Encoders for Medical Imaging20 Jul 2026
- 2026Cross-modal linkage risk in clinical vision-language models1 Jun 2026
- 2026The pretraining domain outweighs the training objective in setting the privacy-utility trade-off of differentially private medical image analysis27 Jan 2026
- 2026Federated Continual Learning for Privacy-Preserving Hospital Imaging Classification11 Jan 2026
- 2025Benchmark Success, Clinical Failure: When Reinforcement Learning Optimizes for Benchmarks, Not Patients28 Dec 2025
- 2025Resolution scaling governs DINOv3 transfer performance in chest radiograph classification8 Oct 2025