FedUHD: Unsupervised Federated Learning using In-Memory Hyperdimensional Computing
Not on the map. Why?
Abstract (arXiv)
Unsupervised federated learning (UFL) enables privacy-preserving distributed training without data labeling, yet practical deployment remains challenging due to non-IID data, high computational and communication costs at edge devices, and sensitivity to communication noise. We propose FedUHD, the first UFL framework based on Hyperdimensional Computing (HDC). On the client side, FedUHD employs kNN-based cluster hypervector removal to mitigate non-IID effects by filtering detrimental local outliers. On the server side, cluster-aware HDC aggregation leverages cluster-level statistics to stabilize learning across heterogeneous clients. To further improve efficiency, we design a compute-in-memory (CIM) accelerator based on a novel phase-change memory (PCM) device, integrated with lightweight ASIC digital modules to execute the client-side HDC pipeline within the accelerator. The intrinsic robustness of HDC to low precision and device variations enables efficient mapping onto analog PCM crossbars, exploiting massive parallelism while minimizing data movement. Experimental results show that FedUHD achieves comparable accuracy to state-of-the-art neural network-based UFL methods across all datasets. On HAR and CIFAR10/100, FedUHD delivers an average 2,239x speedup and 1,542x higher energy efficiency on GPU. In addition, FedUHD reduces communication cost by up to 176x on HAR and CIFAR10/100 and demonstrates greater robustness than Orchestra under communication noise. Compared to GPU implementation of FedUHD, the proposed PCM-based accelerator provides an additional 4.07x speedup and three orders of magnitude higher energy efficiency on average. Furthermore, the results demonstrate the benefit of PCM over RRAM as a CIM substrate.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 46 references that are in the map. First posted on arXiv 16 Aug 2025.
Builds on
23 of 46 references.
References · 23
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
- 2015Unsupervised Deep Embedding for Clustering Analysiscited by 763
- 2019FedPAQ: A Communication-Efficient Federated Learning Method with Periodic Averaging and Quantizationcited by 349
- 2021Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive Losscited by 311
- 2021Collaborative Unsupervised Visual Representation Learning from Decentralized Datacited by 68
- 2020Classification using Hyperdimensional Computing: A Reviewcited by 60
11 more
- 2022Orchestra: Unsupervised Federated Learning via Globally Consistent Clusteringcited by 45
- 2020A Theoretical Perspective on Hyperdimensional Computingcited by 43
- 2022FedX: Unsupervised Federated Learning with Cross Knowledge Distillationcited by 40
- 2013Distributed k-Means and k-Median Clustering on General Topologiescited by 24
- 2022Federated Learning from Only Unlabeled Data with Class-Conditional-Sharing Clientscited by 20
- 2024Lifelong Intelligence Beyond the Edge using Hyperdimensional Computingcited by 5
- 2022Neural Network Training on In-memory-computing Hardware with Radix-4 Gradientscited by 4
- 2023Resource-Efficient Federated Hyperdimensional Computingcited by 3
- 2024Efficient Open Modification Spectral Library Searching in High-Dimensional Space with Multi-Level-Cell Memorycited by 3
- 2024SpecPCM: A Low-power PCM-based In-Memory Computing Accelerator for Full-stack Mass Spectrometry Analysiscited by 1
- 2025SparsyFed: Sparse Adaptive Federated Trainingcited by 1
Built on by
Not cited yet.