mlsanityData to 7 Oct 2026

Non-parametric regularization for class imbalance federated medical image classification

arXiv 2407.12446 ↗First posted 17 Jul 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Limited training data and severe class imbalance pose significant challenges to developing clinically robust deep learning models. Federated learning (FL) addresses the former by enabling different medical clients to collaboratively train a deep model without sharing privacy-sensitive data. However, class imbalance worsens due to variation in inter-client class distribution. We propose federated learning with non-parametric regularization (FedNPR and FedNPR-Per, a personalized version of FedNPR) to regularize the feature extractor and enhance useful and discriminative signal in the feature space. Our extensive experiments show that FedNPR outperform the existing state-of-the art FL approaches in class imbalance skin lesion classification and intracranial hemorrhage identification. Additionally, the non-parametric regularization module consistently improves the performance of existing state-of-the-art FL approaches. We believe that NPR is a valuable tool in FL under clinical settings.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 59 of its 81 references that are in the map. First posted on arXiv 17 Jul 2024.

Builds on

59 of 81 references.

References · 59

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  3. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  4. 2019Advances and Open Problems in Federated Learningcited by 3,021
  5. 2017Prototypical Networks for Few-shot Learningcited by 3,001
  6. 2018Federated Optimization in Heterogeneous Networkscited by 2,971
  7. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
  8. 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,080
  9. 2019Federated Learning: Challenges, Methods, and Future Directionscited by 1,531
  10. 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,239
  11. 2019Learning Imbalanced Datasets with Label-Distribution-Aware Margin Losscited by 987
  12. 2019Decoupling Representation and Classifier for Long-Tailed Recognitioncited by 806
38 more
  1. 2021Model-Contrastive Federated Learningcited by 762
  2. 2020The Future of Digital Health with Federated Learningcited by 625
  3. 2021Federated Learning on Non-IID Data Silos: An Experimental Studycited by 566
  4. 2021FedBN: Federated Learning on Non-IID Features via Local Batch Normalizationcited by 565
  5. 2020Federated Learning with Matched Averagingcited by 564
  6. 2017Skin Lesion Analysis Toward Melanoma Detection: A Challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), Hosted by the International Skin Imaging Collaboration (ISIC)cited by 549
  7. 2021Exploiting Shared Representations for Personalized Federated Learningcited by 537
  8. 2019Self-labelling via simultaneous clustering and representation learningcited by 525
  9. 2017A systematic study of the class imbalance problem in convolutional neural networkscited by 510
  10. 2019FedMD: Heterogenous Federated Learning via Model Distillationcited by 454
  11. 2019BBN: Bilateral-Branch Network with Cumulative Learning for Long-Tailed Visual Recognitioncited by 403
  12. 2020Balanced Meta-Softmax for Long-Tailed Visual Recognitioncited by 397
  13. 2021FedDG: Federated Domain Generalization on Medical Image Segmentation via Episodic Learning in Continuous Frequency Spacecited by 284
  14. 2021No Fear of Heterogeneity: Classifier Calibration for Federated Learning with Non-IID Datacited by 241
  15. 2019BCN20000: Dermoscopic Lesions in the Wildcited by 224
  16. 2021Parametric Contrastive Learningcited by 217
  17. 2021Improving Calibration for Long-Tailed Recognitioncited by 212
  18. 2019FedHealth: A Federated Transfer Learning Framework for Wearable Healthcarecited by 182
  19. 2021FedBABU: Towards Enhanced Representation for Federated Image Classificationcited by 180
  20. 2019Privacy-preserving Federated Brain Tumour Segmentationcited by 169
  21. 2020Attribute Prototype Network for Zero-Shot Learningcited by 160
  22. 2021Towards Understanding Knowledge Distillationcited by 158
  23. 2018Multi-Institutional Deep Learning Modeling Without Sharing Patient Data: A Feasibility Study on Brain Tumor Segmentationcited by 148
  24. 2020Rethinking Class-Balanced Methods for Long-Tailed Visual Recognition from a Domain Adaptation Perspectivecited by 143
  25. 2022Rethinking Semantic Segmentation: A Prototype Viewcited by 140
  26. 2020Multi-site fMRI Analysis Using Privacy-preserving Federated Learning and Domain Adaptation: ABIDE Resultscited by 122
  27. 2022FLamby: Datasets and Benchmarks for Cross-Silo Federated Learning in Realistic Healthcare Settingscited by 121
  28. 2015Relay Backpropagation for Effective Learning of Deep Convolutional Neural Networkscited by 115
  29. 2022Federated Learning with Label Distribution Skew via Logits Calibrationcited by 108
  30. 2020Robust Federated Learning: The Case of Affine Distribution Shiftscited by 102
  31. 2021Self-Supervised Aggregation of Diverse Experts for Test-Agnostic Long-Tailed Recognitioncited by 95
  32. 2020Provable Defense against Privacy Leakage in Federated Learning from Representation Perspectivecited by 94
  33. 2021Multi-institutional Collaborations for Improving Deep Learning-based Magnetic Resonance Image Reconstruction Using Federated Learningcited by 78
  34. 2019Astraea: Self-balancing Federated Learning for Improving Classification Accuracy of Mobile Deep Learning Applicationscited by 64
  35. 2022Federated Learning on Heterogeneous and Long-Tailed Data via Classifier Re-Training with Federated Featurescited by 63
  36. 2022Visual Recognition with Deep Nearest Centroidscited by 59
  37. 2020Federated Learning for Computational Pathology on Gigapixel Whole Slide Imagescited by 54
  38. 2021Trustworthy Long-Tailed Classificationcited by 51

50 most cited of 59 All 59 (JSON)

Built on by

Not cited yet.