AirNet: Neural Network Transmission over the Air
Not on the map. Why?
Abstract (arXiv)
State-of-the-art performance for many edge applications is achieved by deep neural networks (DNNs). Often, these DNNs are location- and time-sensitive, and must be delivered over a wireless channel rapidly and efficiently. In this paper, we introduce AirNet, a family of novel training and transmission methods that allow DNNs to be efficiently delivered over wireless channels under stringent transmit power and latency constraints. This corresponds to a new class of joint source-channel coding problems, aimed at delivering DNNs with the goal of maximizing their accuracy at the receiver, rather than recovering them with high fidelity. In AirNet, we propose the direct mapping of the DNN parameters to transmitted channel symbols, while the network is trained to meet the channel constraints, and exhibit robustness against channel noise. AirNet achieves higher accuracy compared to separation-based alternatives. We further improve the performance of AirNet by pruning the network below the available bandwidth, and expanding it for improved robustness. We also benefit from unequal error protection by selectively expanding important layers of the network. Finally, we develop an approach, which simultaneously trains a spectrum of DNNs, each targeting a different channel condition, resolving the impractical memory requirements of training distinct networks for different channel conditions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 37 of its 60 references that are in the map. First posted on arXiv 24 May 2021.
Builds on
37 of 60 references.
References · 37
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
- 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,262
- 2017ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devicescited by 1,200
- 2016Pruning Filters for Efficient ConvNetscited by 1,143
- 2018SNIP: Single-shot Network Pruning based on Connection Sensitivitycited by 812
- 2017Channel Pruning for Accelerating Very Deep Neural Networkscited by 702
- 2018Loss Surfaces, Mode Connectivity, and Fast Ensembling of DNNscited by 588
- 2019Importance Estimation for Neural Network Pruningcited by 541
25 more
- 2017ThiNet: A Filter Level Pruning Method for Deep Neural Network Compressioncited by 442
- 2019HAWQ: Hessian AWare Quantization of Neural Networks with Mixed-Precisioncited by 402
- 2020HRank: Filter Pruning using High-Rank Feature Mapcited by 292
- 2018LQ-Nets: Learned Quantization for Highly Accurate and Compact Deep Neural Networkscited by 274
- 2020ZeroQ: A Novel Zero Shot Quantization Frameworkcited by 269
- 2019Universally Slimmable Networks and Improved Training Techniquescited by 221
- 2019Federated Learning over Wireless Fading Channelscited by 183
- 2019Quantization Networkscited by 153
- 2021Distributed Learning in Wireless Networks: Recent Progress and Future Challengescited by 129
- 2021Semantic Communication Systems for Speech Transmissioncited by 97
- 2019DeepJSCC-f: Deep Joint Source-Channel Coding of Images with Feedbackcited by 96
- 2019BottleNet++: An End-to-End Approach for Feature Compression in Device-Edge Co-Inference Systemscited by 95
- 2019Towards Unified INT8 Training for Convolutional Neural Networkcited by 79
- 2019BottleNet: A Deep Learning Architecture for Intelligent Mobile Cloud Computing Servicescited by 68
- 2019AdaBits: Neural Network Quantization with Adaptive Bit-Widthscited by 64
- 2020Wireless Image Retrieval at the Edgecited by 59
- 2020Bandwidth-Agile Image Transmission with Deep Joint Source-Channel Codingcited by 44
- 2018Post-training 4-bit quantization of convolution networks for rapid-deploymentcited by 42
- 2020Communicate to Learn at the Edgecited by 28
- 2019DeepCABAC: A Universal Compression Algorithm for Deep Neural Networkscited by 26
- 2021An Information-Theoretic Justification for Model Pruningcited by 25
- 2021Deep Joint Source Channel Coding for WirelessImage Transmission with OFDMcited by 22
- 2021Federated mmWave Beam Selection Utilizing LIDAR Datacited by 12
- 2021LIDAR and Position-Aided mmWave Beam Selection with Non-local CNNs and Curriculum Trainingcited by 6
- 2021Denoising Noisy Neural Networks: A Bayesian Approach with Compensationcited by 4
Built on by
Not cited yet.