mlsanityData to 14 Oct 2026

Distributed Information Bottleneck Theory for Multi-Modal Task-Aware Semantic Communication

arXiv 2510.04000 ↗First posted 5 Oct 2025cs.IT cs.LG math.ITcited by 1

Not on the map. Why?

Abstract (arXiv)

Semantic communication shifts the focus from bit-level accuracy to task-relevant semantic delivery, enabling efficient and intelligent communication for next-generation networks. However, existing multi-modal solutions often process all available data modalities indiscriminately, ignoring that their contributions to downstream tasks are often unequal. This not only leads to severe resource inefficiency but also degrades task inference performance due to irrelevant or redundant information. To tackle this issue, we propose a novel task-aware distributed information bottleneck (TADIB) framework, which quantifies the contribution of any set of modalities to given tasks. Based on this theoretical framework, we design a practical coding scheme that intelligently selects and compresses only the most task-relevant modalities at the transmitter. To find the optimal selection and the codecs in the network, we adopt the probabilistic relaxation of discrete selection, enabling distributed encoders to make coordinated decisions with score function estimation and common randomness. Extensive experiments on public datasets demonstrate that our solution matches or surpasses the inference quality of full-modal baselines while significantly reducing communication and computational costs.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 27 of its 40 references that are in the map. First posted on arXiv 5 Oct 2025.

Builds on

27 of 40 references.

References · 27

  1. 2016Deep Variational Information Bottleneckcited by 930
  2. 2015Deep Learning and the Information Bottleneck Principlecited by 802
  3. 2022Balanced Multimodal Learning via On-the-fly Gradient Modulationcited by 264
  4. 2020CLUB: A Contrastive Log-ratio Upper Bound of Mutual Informationcited by 235
  5. 2022Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communicationscited by 175
  6. 2021Learning Task-Oriented Communication for Edge Inference: An Information Bottleneck Approachcited by 110
  7. 2018CentralNet: a Multilayer Approach for Multimodal Fusioncited by 86
  8. 2023MM-Fi: Multi-Modal Non-Intrusive 4D Human Dataset for Versatile Wireless Sensingcited by 79
  9. 2021Task-Oriented Multi-User Semantic Communicationscited by 75
  10. 2020The Information Bottleneck Problem and Its Applications in Machine Learningcited by 66
  11. 2020From Semantic Communication to Semantic-aware Networking: Model, Architecture, and Open Problemscited by 52
  12. 2021Task-Oriented Communication for Multi-Device Cooperative Edge Inferencecited by 52
15 more
  1. 2022Wireless Deep Video Semantic Transmissioncited by 50
  2. 2022Multimodal Information Bottleneck: Learning Minimal Sufficient Unimodal and Multimodal Representationscited by 48
  3. 2022A Unified Multi-Task Semantic Communication System for Multimodal Datacited by 41
  4. 2022Deep Learning Enabled Semantic Communications with Speech Recognition and Synthesiscited by 33
  5. 2018Distributed Variational Representation Learningcited by 32
  6. 2022Robust Information Bottleneck for Task-Oriented Communication with Digital Modulationcited by 29
  7. 2020On the Information Bottleneck Problems: Models, Connections, Applications and Information Theoretic Viewscited by 28
  8. 2023A Theory of Multimodal Learningcited by 25
  9. 2025Towards Agentic AI Networking in 6G: A Generative Foundation Model-as-Agent Approachcited by 19
  10. 2022Imitation Learning-based Implicit Semantic-aware Communication Networks: Multi-layer Representation and Collaborative Reasoningcited by 16
  11. 2024Cauchy-Schwarz Divergence Information Bottleneck for Regressioncited by 9
  12. 2024Tackling Distribution Shifts in Task-Oriented Communication with Information Bottleneckcited by 7
  13. 2023Rate-Adaptive Coding Mechanism for Semantic Communications With Multi-Modal Datacited by 6
  14. 2024Cooperative and Collaborative Multi-Task Semantic Communication for Distributed Sourcescited by 5
  15. 2024Compression before Fusion: Broadcast Semantic Communication System for Heterogeneous Taskscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.