mlsanityData to 7 Oct 2026

Communication-Efficient Multi-Modal Edge Inference via Uncertainty-Aware Distributed Learning

arXiv 2601.14942 ↗First posted 21 Jan 2026cs.LG eess.SPcited by 0

Not on the map. Why?

Abstract (arXiv)

Semantic communication is emerging as a key enabler for distributed edge intelligence due to its capability to convey task-relevant meaning. However, achieving communication-efficient training and robust inference over wireless links remains challenging. This challenge is further exacerbated for multi-modal edge inference (MMEI) by two factors: 1) prohibitive communication overhead for distributed learning over bandwidth-limited wireless links, due to the multi-modal nature of the system; and 2) limited robustness under varying channels and noisy multi-modal inputs. In this paper, we propose a three-stage communication-aware distributed learning framework to improve training and inference efficiency while maintaining robustness over wireless channels. In Stage~I, devices perform local multi-modal self-supervised learning to obtain shared and modality-specific encoders without device--server exchange, thereby reducing the communication cost. In Stage~II, distributed fine-tuning with centralized evidential fusion calibrates per-modality uncertainty and reliably aggregates features distorted by noise or channel fading. In Stage~III, an uncertainty-guided feedback mechanism selectively requests additional features for uncertain samples, optimizing the communication--accuracy tradeoff in the distributed setting. Experiments on RGB--depth indoor scene classification show that the proposed framework attains higher accuracy with far fewer training communication rounds and remains robust to modality degradation or channel variation, outperforming existing self-supervised and fully supervised baselines.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 43 references that are in the map. First posted on arXiv 21 Jan 2026.

Builds on

30 of 43 references.

References · 30

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
  4. 2020Deep Learning Enabled Semantic Communication Systemscited by 282
  5. 2022Trusted Multi-View Classification with Dynamic Evidential Fusioncited by 167
  6. 2022Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communicationscited by 166
  7. 2019The Roadmap to 6G -- AI Empowered Wireless Networkscited by 150
  8. 2021Learning Task-Oriented Communication for Edge Inference: An Information Bottleneck Approachcited by 105
  9. 2019DeepJSCC-f: Deep Joint Source-Channel Coding of Images with Feedbackcited by 95
  10. 2018Towards an Intelligent Edge: Wireless Communication Meets Machine Learningcited by 94
  11. 2021Semantic Communication Systems for Speech Transmissioncited by 93
  12. 2018Modality Distillation with Multiple Stream Networks for Action Recognitioncited by 83
18 more
  1. 2021Task-Oriented Multi-User Semantic Communicationscited by 72
  2. 2022Robust Semantic Communications with Masked VQ-VAE Enabled Codebookcited by 53
  3. 2021Task-Oriented Communication for Multi-Device Cooperative Edge Inferencecited by 47
  4. 2022A Unified Multi-Task Semantic Communication System for Multimodal Datacited by 40
  5. 2021Trustworthy Multimodal Regression with Mixture of Normal-inverse Gamma Distributionscited by 39
  6. 2023Large AI Model Empowered Multimodal Semantic Communicationscited by 38
  7. 2022Deep Learning Enabled Semantic Communications with Speech Recognition and Synthesiscited by 32
  8. 2021Deep Source-Channel Coding for Sentence Semantic Transmission with HARQcited by 29
  9. 2021Rethinking Modern Communication from Semantic Coding to Semantic Communicationcited by 23
  10. 2022Semantic Communication Meets Edge Intelligencecited by 20
  11. 2022Robust Semantic Communications Against Semantic Noisecited by 15
  12. 2022A Robust Deep Learning Enabled Semantic Communication System for Textcited by 13
  13. 2023Semantic Communication with Memorycited by 12
  14. 2023Physical-layer Adversarial Robustness for Deep Learning-based Semantic Communicationscited by 12
  15. 2024Synchronous Multi-modal Semantic Communication System with Packet-level Codingcited by 7
  16. 2025Task-Oriented Semantic Communication in Large Multimodal Models-based Vehicle Networkscited by 5
  17. 2025Remote Training in Task-Oriented Communication: Supervised or Self-Supervised with Fine-Tuning?cited by 2
  18. 2025Multi-Modal Self-Supervised Semantic Communicationcited by 1

Built on by

Not cited yet.