mlsanityData to 7 Oct 2026

Model Pruning Enables Localized and Efficient Federated Learning for Yield Forecasting and Data Sharing

arXiv 2304.09876 ↗First posted 19 Apr 2023cs.LGcited by 7

Not on the map. Why?

Abstract (arXiv)

Federated Learning (FL) presents a decentralized approach to model training in the agri-food sector and offers the potential for improved machine learning performance, while ensuring the safety and privacy of individual farms or data silos. However, the conventional FL approach has two major limitations. First, the heterogeneous data on individual silos can cause the global model to perform well for some clients but not all, as the update direction on some clients may hinder others after they are aggregated. Second, it is lacking with respect to the efficiency perspective concerning communication costs during FL and large model sizes. This paper proposes a new technical solution that utilizes network pruning on client models and aggregates the pruned models. This method enables local models to be tailored to their respective data distribution and mitigate the data heterogeneity present in agri-food data. Moreover, it allows for more compact models that consume less data during transmission. We experiment with a soybean yield forecasting dataset and find that this approach can improve inference performance by 15.5% to 20% compared to FedAvg, while reducing local model sizes by up to 84% and the data volume communicated between the clients and the server by 57.1% to 64.7%.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 47 of its 84 references that are in the map. First posted on arXiv 19 Apr 2023.

Builds on

47 of 84 references.

References · 47

  1. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  2. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
  3. 2018Federated Optimization in Heterogeneous Networkscited by 2,971
  4. 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,291
  5. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
  6. 2015Learning both Weights and Connections for Efficient Neural Networkscited by 1,998
  7. 2019Federated Learning: Challenges, Methods, and Future Directionscited by 1,531
  8. 2016Pruning Filters for Efficient ConvNetscited by 1,129
  9. 2020Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimizationcited by 897
  10. 2019Towards Federated Learning at Scale: System Designcited by 826
  11. 2018SNIP: Single-shot Network Pruning based on Connection Sensitivitycited by 802
  12. 2020The Future of Digital Health with Federated Learningcited by 625
35 more
  1. 2020What is the State of Neural Network Pruning?cited by 578
  2. 2016Federated Optimization: Distributed Machine Learning for On-Device Intelligencecited by 558
  3. 2020Pre-trained Models for Natural Language Processing: A Surveycited by 504
  4. 2017Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Trainingcited by 471
  5. 2019The State of Sparsity in Deep Neural Networkscited by 471
  6. 2019Robust and Communication-Efficient Federated Learning from Non-IID Datacited by 415
  7. 2019Federated Machine Learning: Concept and Applicationscited by 409
  8. 2018AMC: AutoML for Model Compression and Acceleration on Mobile Devicescited by 375
  9. 2018How Does Batch Normalization Help Optimization?cited by 355
  10. 2019FedPAQ: A Communication-Efficient Federated Learning Method with Periodic Averaging and Quantizationcited by 349
  11. 2021Federated Learning on Non-IID Data: A Surveycited by 345
  12. 2021Pruning and Quantization for Deep Neural Network Acceleration: A Surveycited by 259
  13. 2017Sparse Communication for Distributed Gradient Descentcited by 243
  14. 2018Communication-Efficient On-Device Machine Learning: Federated Distillation and Augmentation under Non-IID Private Datacited by 242
  15. 2017NISP: Pruning Networks using Neuron Importance Score Propagationcited by 228
  16. 2018The Convergence of Sparsified Gradient Methodscited by 228
  17. 2013Predicting Parameters in Deep Learningcited by 223
  18. 2016Using Deep Learning for Image-Based Plant Disease Detectioncited by 216
  19. 2020Federated Learning of a Mixture of Global and Local Modelscited by 208
  20. 2021FedKD: Communication Efficient Federated Learning via Knowledge Distillationcited by 185
  21. 2021Federated Learning for Smart Healthcare: A Surveycited by 182
  22. 2016Practical Secure Aggregation for Federated Learning on User-Held Datacited by 178
  23. 2018Expanding the Reach of Federated Learning by Reducing Client Resource Requirementscited by 162
  24. 2021Efficient Deep Learning: A Survey on Making Deep Learning Models Smaller, Faster, and Bettercited by 153
  25. 2020Federated Learning for Internet of Things: Recent Advances, Taxonomy, and Open Challengescited by 138
  26. 2021Federated Learning for Open Bankingcited by 138
  27. 2019Variance Reduced Local SGD with Lower Communication Complexitycited by 80
  28. 2019Patient Clustering Improves Efficiency of Federated Machine Learning to predict mortality and hospital stay time using distributed Electronic Medical Recordscited by 70
  29. 2018Multi-objective Evolutionary Federated Learningcited by 42
  30. 2019A CNN-RNN Framework for Crop Yield Predictioncited by 36
  31. 2021Contrastive Domain Adaptationcited by 36
  32. 2021The Role of Cross-Silo Federated Learning in Facilitating Data Sharing in the Agri-Food Sectorcited by 16
  33. 2020An autoencoder wavelet based deep neural network with attention mechanism for multistep prediction of plant growthcited by 7
  34. 2019Nemesyst: A Hybrid Parallelism Deep Learning-Based Framework Applied for Internet of Things Enabled Food Retailing Refrigeration Systemscited by 5
  35. 2022Premonition Net, A Multi-Timeline Transformer Network Architecture Towards Strawberry Tabletop Yield Forecastingcited by 4

Built on by

Cited by year

Citing papers per year: 2024: 3; 2025: 4.

7 papers.