Communication-Efficient Multi-Modal Edge Inference via Uncertainty-Aware Distributed Learning
Not on the map. Why?
Abstract (arXiv)
Semantic communication is emerging as a key enabler for distributed edge intelligence due to its capability to convey task-relevant meaning. However, achieving communication-efficient training and robust inference over wireless links remains challenging. This challenge is further exacerbated for multi-modal edge inference (MMEI) by two factors: 1) prohibitive communication overhead for distributed learning over bandwidth-limited wireless links, due to the multi-modal nature of the system; and 2) limited robustness under varying channels and noisy multi-modal inputs. In this paper, we propose a three-stage communication-aware distributed learning framework to improve training and inference efficiency while maintaining robustness over wireless channels. In Stage~I, devices perform local multi-modal self-supervised learning to obtain shared and modality-specific encoders without device--server exchange, thereby reducing the communication cost. In Stage~II, distributed fine-tuning with centralized evidential fusion calibrates per-modality uncertainty and reliably aggregates features distorted by noise or channel fading. In Stage~III, an uncertainty-guided feedback mechanism selectively requests additional features for uncertain samples, optimizing the communication--accuracy tradeoff in the distributed setting. Experiments on RGB--depth indoor scene classification show that the proposed framework attains higher accuracy with far fewer training communication rounds and remains robust to modality degradation or channel variation, outperforming existing self-supervised and fully supervised baselines.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 43 references that are in the map. First posted on arXiv 21 Jan 2026.
Builds on
30 of 43 references.
References · 30
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
- 2020Deep Learning Enabled Semantic Communication Systemscited by 282
- 2022Trusted Multi-View Classification with Dynamic Evidential Fusioncited by 167
- 2022Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communicationscited by 166
- 2019The Roadmap to 6G -- AI Empowered Wireless Networkscited by 150
- 2021Learning Task-Oriented Communication for Edge Inference: An Information Bottleneck Approachcited by 105
- 2019DeepJSCC-f: Deep Joint Source-Channel Coding of Images with Feedbackcited by 95
- 2018Towards an Intelligent Edge: Wireless Communication Meets Machine Learningcited by 94
- 2021Semantic Communication Systems for Speech Transmissioncited by 93
- 2018Modality Distillation with Multiple Stream Networks for Action Recognitioncited by 83
18 more
- 2021Task-Oriented Multi-User Semantic Communicationscited by 72
- 2022Robust Semantic Communications with Masked VQ-VAE Enabled Codebookcited by 53
- 2021Task-Oriented Communication for Multi-Device Cooperative Edge Inferencecited by 47
- 2022A Unified Multi-Task Semantic Communication System for Multimodal Datacited by 40
- 2021Trustworthy Multimodal Regression with Mixture of Normal-inverse Gamma Distributionscited by 39
- 2023Large AI Model Empowered Multimodal Semantic Communicationscited by 38
- 2022Deep Learning Enabled Semantic Communications with Speech Recognition and Synthesiscited by 32
- 2021Deep Source-Channel Coding for Sentence Semantic Transmission with HARQcited by 29
- 2021Rethinking Modern Communication from Semantic Coding to Semantic Communicationcited by 23
- 2022Semantic Communication Meets Edge Intelligencecited by 20
- 2022Robust Semantic Communications Against Semantic Noisecited by 15
- 2022A Robust Deep Learning Enabled Semantic Communication System for Textcited by 13
- 2023Semantic Communication with Memorycited by 12
- 2023Physical-layer Adversarial Robustness for Deep Learning-based Semantic Communicationscited by 12
- 2024Synchronous Multi-modal Semantic Communication System with Packet-level Codingcited by 7
- 2025Task-Oriented Semantic Communication in Large Multimodal Models-based Vehicle Networkscited by 5
- 2025Remote Training in Task-Oriented Communication: Supervised or Self-Supervised with Fine-Tuning?cited by 2
- 2025Multi-Modal Self-Supervised Semantic Communicationcited by 1
Built on by
Not cited yet.