A Machine Learning Framework for Distributed Functional Compression over Wireless Channels in IoT
Not on the map. Why?
Abstract (arXiv)
IoT devices generating enormous data and state-of-the-art machine learning techniques together will revolutionize cyber-physical systems. In many diverse fields, from autonomous driving to augmented reality, distributed IoT devices compute specific target functions without simple forms like obstacle detection, object recognition, etc. Traditional cloud-based methods that focus on transferring data to a central location either for training or inference place enormous strain on network resources. To address this, we develop, to the best of our knowledge, the first machine learning framework for distributed functional compression over both the Gaussian Multiple Access Channel (GMAC) and orthogonal AWGN channels. Due to the Kolmogorov-Arnold representation theorem, our machine learning framework can, by design, compute any arbitrary function for the desired functional compression task in IoT. Importantly the raw sensory data are never transferred to a central node for training or inference, thus reducing communication. For these algorithms, we provide theoretical convergence guarantees and upper bounds on communication. Our simulations show that the learned encoders and decoders for functional compression perform significantly better than traditional approaches, are robust to channel condition changes and sensor outages. Compared to the cloud-based scenario, our algorithms reduce channel use by two orders of magnitude.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 51 references that are in the map. First posted on arXiv 24 Jan 2022.
Builds on
10 of 51 references.
References · 10
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2013An Asynchronous Parallel Stochastic Coordinate Descent Algorithmcited by 26
- 2020Communication-Efficient Multimodal Split Learning for mmWave Received Power Predictioncited by 18
- 2019On the Acceleration of Deep Learning Model Parallelism with Stalenesscited by 17
- 2020Training Recommender Systems at Scale: Communication-Efficient Model and Data Parallelismcited by 15
- 2017Asynchronous Coordinate Descent under More Realistic Assumptionscited by 14
- 2018Interpreting Deep Classifier by Visual Distillation of Dark Knowledgecited by 9
- 2019On Distributed Quantization for Classificationcited by 8
- 2021Communication-Efficient Split Learning Based on Analog Communication and Over the Air Aggregationcited by 8
Built on by
Not cited yet.