mlsanityData to 14 Oct 2026

CCFC: Bridging Federated Clustering and Contrastive Learning

arXiv 2401.06634 ↗First posted 12 Jan 2024cs.LG cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Federated clustering, an essential extension of centralized clustering for federated scenarios, enables multiple data-holding clients to collaboratively group data while keeping their data locally. In centralized scenarios, clustering driven by representation learning has made significant advancements in handling high-dimensional complex data. However, the combination of federated clustering and representation learning remains underexplored. To bridge this, we first tailor a cluster-contrastive model for learning clustering-friendly representations. Then, we harness this model as the foundation for proposing a new federated clustering method, named cluster-contrastive federated clustering (CCFC). Benefiting from representation learning, the clustering performance of CCFC even double those of the best baseline methods in some cases. Compared to the most related baseline, the benefit results in substantial NMI score improvements of up to 0.4155 on the most conspicuous case. Moreover, CCFC also shows superior performance in handling device failures from a practical viewpoint.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 37 of its 61 references that are in the map. First posted on arXiv 12 Jan 2024.

Builds on

37 of 61 references.

References · 37

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  5. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  6. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  7. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
  8. 2020Exploring Simple Siamese Representation Learningcited by 2,866
  9. 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,845
  10. 2015Unsupervised Deep Embedding for Clustering Analysiscited by 767
  11. 2021Model-Contrastive Federated Learningcited by 766
  12. 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 734
25 more
  1. 2021FedProto: Federated Prototype Learning across Heterogeneous Clientscited by 352
  2. 2020Contrastive Clusteringcited by 265
  3. 2022Self-Supervised Speech Representation Learning: A Reviewcited by 260
  4. 2016Towards K-means-friendly Spaces: Simultaneous Deep Learning and Clusteringcited by 237
  5. 2017Learning Discrete Representations via Information Maximizing Self-Augmented Trainingcited by 149
  6. 2021Self-Supervised Representation Learning: Introduction, Advances and Challengescited by 148
  7. 2021Multi-Center Federated Learning: Clients Clustering for Better Personalizationcited by 113
  8. 2021Heterogeneity for the Win: One-Shot Federated Clusteringcited by 87
  9. 2022CenterCLIP: Token Clustering for Efficient Text-Video Retrievalcited by 86
  10. 2023Differentially Private Diffusion Models Generate Useful Synthetic Imagescited by 86
  11. 2022Self-Supervised Learning for Videos: A Surveycited by 85
  12. 2021FedProc: Prototypical Contrastive Federated Learning on Non-IID datacited by 81
  13. 2022Deep Clustering: A Comprehensive Surveycited by 78
  14. 2022Divergence-aware Federated Self-Supervised Learningcited by 73
  15. 2022A Comprehensive Survey on Deep Clustering: Taxonomy, Challenges, and Future Directionscited by 73
  16. 2021Collaborative Unsupervised Visual Representation Learning from Decentralized Datacited by 69
  17. 2022Client Selection in Federated Learning: Principles, Challenges, and Opportunitiescited by 62
  18. 2022FedX: Unsupervised Federated Learning with Cross Knowledge Distillationcited by 40
  19. 2024Relaxed Contrastive Learning for Federated Learningcited by 32
  20. 2022Towards Federated Clustering: A Federated Fuzzy c-Means Algorithm (FFCM)cited by 30
  21. 2023A Survey of What to Share in Federated Learning: Perspectives on Model Utility, Privacy Leakage, and Communication Efficiencycited by 21
  22. 2018Evaluation of Community Detection Methodscited by 14
  23. 2022Federated Momentum Contrastive Clusteringcited by 7
  24. 2022Privacy-Preserving Federated Deep Clustering based on GANcited by 5
  25. 2022Federated clustering with GAN-based data synthesiscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 1; 2026: 1.

4 papers.