mlsanityData to 14 Oct 2026

Edge AI Collaborative Learning: Bayesian Approaches to Uncertainty Estimation

arXiv 2410.08651 ↗First posted 11 Oct 2024cs.LG cs.DC cs.MAcited by 1

Not on the map. Why?

Abstract (arXiv)

Recent advancements in edge computing have significantly enhanced the AI capabilities of Internet of Things (IoT) devices. However, these advancements introduce new challenges in knowledge exchange and resource management, particularly addressing the spatiotemporal data locality in edge computing environments. This study examines algorithms and methods for deploying distributed machine learning within autonomous, network-capable, AI-enabled edge devices. We focus on determining confidence levels in learning outcomes considering the spatial variability of data encountered by independent agents. Using collaborative mapping as a case study, we explore the application of the Distributed Neural Network Optimization (DiNNO) algorithm extended with Bayesian neural networks (BNNs) for uncertainty estimation. We implement a 3D environment simulation using the Webots platform to simulate collaborative mapping tasks, decouple the DiNNO algorithm into independent processes for asynchronous network communication in distributed learning, and integrate distributed uncertainty estimation using BNNs. Our experiments demonstrate that BNNs can effectively support uncertainty estimation in a distributed learning context, with precise tuning of learning hyperparameters crucial for effective uncertainty assessment. Notably, applying Kullback-Leibler divergence for parameter regularization resulted in a 12-30% reduction in validation loss during distributed BNN training compared to other regularization strategies.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 27 of its 38 references that are in the map. First posted on arXiv 11 Oct 2024.

Builds on

27 of 38 references.

References · 27

  1. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  2. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
  3. 2018Exploiting Unintended Feature Leakage in Collaborative Learningcited by 520
  4. 2019Federated Learning in Mobile Edge Networks: A Comprehensive Surveycited by 408
  5. 2018Split learning for health: Distributed deep learning without sharing raw patient datacited by 395
  6. 2020Hands-on Bayesian Neural Networks -- a Tutorial for Deep Learning Userscited by 338
  7. 2018Distributed learning of deep neural network over multiple agentscited by 279
  8. 2021FedKD: Communication Efficient Federated Learning via Knowledge Distillationcited by 187
  9. 2020Privacy and Robustness in Federated Learning: Attacks and Defensescited by 166
  10. 2019Edge AI: On-Demand Accelerating Deep Neural Network Inference via Edge Computingcited by 152
  11. 2022Split Learning over Wireless Networks: Parallel Design and Resource Managementcited by 75
  12. 2020On hallucinations in tomographic image reconstructioncited by 68
15 more
  1. 2020Communication-Efficient and Distributed Learning Over Wireless Networks: Principles and Applicationscited by 62
  2. 2020Communication-Computation Trade-Off in Resource-Constrained Edge Inferencecited by 60
  3. 2023Spatio-Temporal Domain Awareness for Multi-Agent Collaborative Perceptioncited by 52
  4. 2019CubiCasa5K: A Dataset and an Improved Multi-Task Model for Floorplan Image Analysiscited by 50
  5. 2019Wireless Federated Distillation for Distributed Edge Learning with Heterogeneous Datacited by 39
  6. 2019GADMM: Fast and Communication Efficient Framework for Distributed Machine Learningcited by 30
  7. 2020Federated Edge Learning : Design Issues and Challengescited by 26
  8. 2023Selective Knowledge Sharing for Privacy-Preserving Federated Distillation without A Good Teachercited by 25
  9. 2020Communication-Efficient Multimodal Split Learning for mmWave Received Power Predictioncited by 18
  10. 2021DiNNO: Distributed Neural Network Optimization for Multi-Robot Collaborative Learningcited by 16
  11. 2020Model Fusion with Kullback--Leibler Divergencecited by 10
  12. 2021Spatio-Temporal Split Learning for Privacy-Preserving Medical Platforms: Case Studies with COVID-19 CT, X-Ray, and Cholesterol Datacited by 10
  13. 2021FedFog: Network-Aware Optimization of Federated Learning over Wireless Fog-Cloud Systemscited by 6
  14. 2022Model-driven Cluster Resource Management for AI Workloads in Edge Cloudscited by 6
  15. 2024Uncertainty Estimation in Multi-Agent Distributed Learning for AI-Enabled Edge Devicescited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

  1. 2025Federated Distillation on Edge Devices: Efficient Client-Side Filtering for Non-IID Datacited by 0