CST: Collaborative Selective Transmission for Communication-Efficient Multimodal Edge Inference
Not on the map. Why?
Abstract (arXiv)
Collaborative multimodal inference improves edge perception by combining observations from distributed sensing devices, but transmitting high-dimensional helper representations incurs substantial communication overhead and can lead to high end-to-end latency. Existing communication-efficient methods reduce payloads through compression, semantic coding, or feature selection, yet typically optimize compactness or task relevance without explicitly accounting for information already represented at the main device. Consequently, task-relevant but redundant helper features may still consume bandwidth. We present Collaborative Selective Transmission (CST), a main-directed query--response framework that retrieves only helper information complementary to the current main representation. Inspired by Partial Information Decomposition and the Multiview Redundancy Assumption, CST learns sample-adaptive, helper-specific sparse retrieval supports while discouraging retrieval of semantics already covered by the main device or duplicated across helpers. During inference, the main device transmits only support indices, and each helper returns the corresponding latent values, avoiding dense helper-feature exchange. Across three real-world multimodal sensing benchmarks, CST transmits no more than 14.18% of helper feature values while achieving best or near-best task performance among the evaluated methods. Experiments on a five-node NVIDIA Jetson Orin Nano testbed across 5--100 Mbps demonstrate up to a 4.27× speedup over Transmit-All in end-to-end inference, confirming practical end-to-end latency reductions.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 40 references that are in the map. First posted on arXiv 22 Aug 2026.
Builds on
28 of 40 references.
References · 28
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsificationcited by 849
- 2022Where2comm: Communication-Efficient Collaborative Perception via Spatial Confidence Mapscited by 255
- 2020When2com: Multi-Agent Perception via Communication Graph Groupingcited by 157
- 2021Split Computing and Early Exiting for Deep Learning Applications: Survey and Research Challengescited by 114
- 2020SPINN: Synergistic Progressive Inference of Neural Networks over Device and Cloudcited by 109
- 2021Learning Task-Oriented Communication for Edge Inference: An Information Bottleneck Approachcited by 105
- 2019BottleNet++: An End-to-End Approach for Feature Compression in Device-Edge Co-Inference Systemscited by 94
- 2023Quantifying & Modeling Multimodal Interactions: An Information Decomposition Frameworkcited by 81
- 2023MM-Fi: Multi-Modal Non-Intrusive 4D Human Dataset for Versatile Wireless Sensingcited by 77
- 2022Multi-modal Sensor Fusion for Auto Driving Perception: A Surveycited by 73
- 2023Factorized Contrastive Learning: Going Beyond Multi-view Redundancycited by 73
16 more
- 2024Communication-Efficient Collaborative Perception via Information Filling with Codebookcited by 67
- 2021Task-Oriented Communication for Multi-Device Cooperative Edge Inferencecited by 47
- 2024What to align in multimodal contrastive learning?cited by 41
- 2022A Unified Multi-Task Semantic Communication System for Multimodal Datacited by 40
- 2023UMC: A Unified Bandwidth-efficient and Multi-resolution based Collaborative Perception Frameworkcited by 29
- 2022Robust Information Bottleneck for Task-Oriented Communication with Digital Modulationcited by 28
- 2019A Survey on Edge Computing Systems and Toolscited by 17
- 2022Semantic Information Recovery in Wireless Networkscited by 12
- 2023FrankenSplit: Efficient Neural Feature Compression with Shallow Variational Bottleneck Injection for Mobile Edge Computingcited by 12
- 2022Collaborative Perception for Autonomous Driving: Current Status and Future Trendcited by 10
- 2025Janus: Collaborative Vision Transformer Under Dynamic Network Environmentcited by 4
- 2025Which2comm: An Efficient Collaborative Perception Framework for 3D Object Detectioncited by 4
- 2025Partial Information Decomposition via Normalizing Flows in Latent Gaussian Distributionscited by 4
- 2024Edge-device Collaborative Computing for Multi-view Classificationcited by 2
- 2025Computation and Communication Co-scheduling for Multi-Task Remote Inferencecited by 1
- 2025A Large-Scale Multimodal Dataset and Benchmarks for Human Activity Scene Understanding and Reasoningcited by 1
Built on by
Not cited yet.