Multi-Source and Multi-Dimensional Information Fusion in Resource-Constrained Edge Networks
Not on the map. Why?
Abstract (arXiv)
Multi-source semantic information fusion enables edge networks to support global inference using observations collected by distributed terminals. However, limited communication and computation resources restrict semantic uploading, leaving the edge server with incomplete tokens that differ in modality, semantic granularity, arrival time, and channel condition. The value of these tokens also depends on the complementary or redundant information provided by other terminals. In this paper, we propose a multi-source and multi-dimensional semantic information fusion framework that coordinates terminal uploading and edge-side fusion under resource constraints. We develop Hyper-Slot to combine semantic content with available token attributes through iterative token-to-slot assignment and slot-to-token feedback, producing a compact representation for global inference. To encourage useful semantic uploading, we further design a contribution-based incentive mechanism that uses Hyper-Slot assignments to evaluate information coverage and cross-type complementarity. A bi-level Stackelberg-Nash game determines the server reward pool and terminal transmission-quality strategies while accounting for computation and communication energy costs. Experiments on a tri-modal extension of COCO2014 and image-text retrieval on Flickr30K show that Hyper-Slot improves mAP by 3.66 percentage points and RSum by 15.9 points over the strongest evaluated baselines, respectively, while reducing the number of parameters by more than 80% compared with a naive concatenation-based fusion baseline.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 37 references that are in the map. First posted on arXiv 9 Oct 2026.
Builds on
25 of 37 references.
References · 25
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2016Layer Normalizationcited by 5,669
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
- 2017Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answeringcited by 1,312
- 2020Object-Centric Learning with Slot Attentioncited by 876
- 2018Hypergraph Neural Networkscited by 488
- 2018Stacked Cross Attention for Image-Text Matchingcited by 416
- 2016From Softmax to Sparsemax: A Sparse Model of Attention and Multi-Label Classificationcited by 341
- 2020Deep Learning Enabled Semantic Communication Systemscited by 292
- 2019Edge Intelligence: Paving the Last Mile of Artificial Intelligence with Edge Computingcited by 228
13 more
- 2020Learning the Best Pooling Strategy for Visual Semantic Embeddingcited by 137
- 2020Communication-Efficient Edge AI: Algorithms and Systemscited by 96
- 2021Task-Oriented Multi-User Semantic Communicationscited by 75
- 2020A Lite Distributed Semantic Communication System for Internet of Thingscited by 73
- 2024Communication-Efficient Collaborative Perception via Information Filling with Codebookcited by 68
- 2020Wireless Image Retrieval at the Edgecited by 59
- 2021Task-Oriented Communication for Multi-Device Cooperative Edge Inferencecited by 52
- 2020Text-Free Image-to-Speech Synthesis Using Learned Segmental Unitscited by 51
- 2022A Unified Multi-Task Semantic Communication System for Multimodal Datacited by 41
- 2025CoSDH: Communication-Efficient Collaborative Perception via Supply-Demand Awareness and Intermediate-Late Hybridizationcited by 28
- 2019Affective Computing for Large-Scale Heterogeneous Multimedia Data: A Surveycited by 18
- 2025CoST: Efficient Collaborative Perception From Unified Spatiotemporal Perspectivecited by 8
- 2023QoE-based Semantic-Aware Resource Allocation for Multi-Task Networkscited by 4
Built on by
Not cited yet.