Interpretable Data Fusion for Distributed Learning: A Representative Approach via Gradient Matching
Not on the map. Why?
Abstract (arXiv)
This paper introduces a representative-based approach for distributed learning that transforms multiple raw data points into a virtual representation. Unlike traditional distributed learning methods such as Federated Learning, which do not offer human interpretability, our method makes complex machine learning processes accessible and comprehensible. It achieves this by condensing extensive datasets into digestible formats, thus fostering intuitive human-machine interactions. Additionally, this approach maintains privacy and communication efficiency, and it matches the training performance of models using raw data. Simulation results show that our approach is competitive with or outperforms traditional Federated Learning in accuracy and convergence, especially in scenarios with complex models and a higher number of clients. This framework marks a step forward in integrating human intuition with machine intelligence, which potentially enhances human-machine learning interfaces and collaborative efforts.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 18 of its 35 references that are in the map. First posted on arXiv 6 May 2024.
Builds on
18 of 35 references.
References · 18
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2018Federated Optimization in Heterogeneous Networkscited by 2,987
- 2018Federated Learning with Non-IID Datacited by 1,108
- 2019Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classificationcited by 851
- 2017Federated Multi-Task Learningcited by 672
- 2018Local SGD Converges Fast and Communicates Littlecited by 605
- 2020Dataset Condensation with Gradient Matchingcited by 516
- 2017Can Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descentcited by 502
- 2022Dataset Distillation by Matching Training Trajectoriescited by 442
- 2020A Unified Theory of Decentralized SGD with Changing Topology and Local Updatescited by 367
- 2018Stochastic Gradient Push for Distributed Deep Learningcited by 152
- 2019Practical Federated Gradient Boosting Decision Treescited by 54
6 more
- 2019Fusion of Deep Neural Networks for Activity Recognition: A Regular Vine Copula Based Approachcited by 3
- 2019Prospect Theory Based Crowdsourcing for Classification in the Presence of Spammerscited by 3
- 2021Enhanced Audit Bit Based Distributed Bayesian Detection in the Presence of Strategic Attackscited by 2
- 2022Efficient Ordered-Transmission Based Distributed Detection under Data Falsification Attackscited by 2
- 2015Distributed Inference in the Presence of Eavesdroppers: A Surveycited by 1
- 2018Score-Matching Representative Approach for Big Data Analysis with Generalized Linear Modelscited by 1
Built on by
Citing papers per year: 2025: 3; 2026: 1.
4 papers.
- 2025TD-RD: A Top-Down Benchmark with Real-Time Framework for Road Damage Detectioncited by 6
- 2025PFedDST: Personalized Federated Learning with Decentralized Selection Trainingcited by 4
- 2026Detail Consistent Stage-Wise Distillation for Efficient 3D MRI Segmentationcited by 2
- 2025E2CB2former: Effecitve and Explainable Transformer for CB2 Receptor Ligand Activity Predictioncited by 0
- 2026Detail Consistent Stage-Wise Distillation for Efficient 3D MRI Segmentation25 May 2026
- 2025E2CB2former: Effecitve and Explainable Transformer for CB2 Receptor Ligand Activity Prediction15 Feb 2025
- 2025PFedDST: Personalized Federated Learning with Decentralized Selection Training11 Feb 2025
- 2025TD-RD: A Top-Down Benchmark with Real-Time Framework for Road Damage Detection24 Jan 2025