mlsanityData to 7 Oct 2026

Task-Oriented Communication for Graph Data: A Graph Information Bottleneck Approach

arXiv 2409.02728 ↗First posted 4 Sep 2024cs.LG cs.SI eess.SPcited by 2

Not on the map. Why?

Abstract (arXiv)

Graph data, essential in fields like knowledge representation and social networks, often involves large networks with many nodes and edges. Transmitting these graphs can be highly inefficient due to their size and redundancy for specific tasks. This paper introduces a method to extract a smaller, task-focused subgraph that maintains key information while reducing communication overhead. Our approach utilizes graph neural networks (GNNs) and the graph information bottleneck (GIB) principle to create a compact, informative, and robust graph representation suitable for transmission. The challenge lies in the irregular structure of graph data, making GIB optimization complex. We address this by deriving a tractable variational upper bound for the objective function. Additionally, we propose the VQ-GIB mechanism, integrating vector quantization (VQ) to convert subgraph representations into a discrete codebook sequence, compatible with existing digital communication systems. Our experiments show that this GIB-based method significantly lowers communication costs while preserving essential task-related information. The approach demonstrates robust performance across various communication channels, suitable for both continuous and discrete systems.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 25 of its 37 references that are in the map. First posted on arXiv 4 Sep 2024.

Builds on

25 of 37 references.

References · 25

  1. 2018How Powerful are Graph Neural Networks?cited by 4,355
  2. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
  3. 2016Deep Variational Information Bottleneckcited by 915
  4. 2015Deep Learning and the Information Bottleneck Principlecited by 793
  5. 2018MINE: Mutual Information Neural Estimationcited by 680
  6. 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
  7. 2020Deep Learning Enabled Semantic Communication Systemscited by 282
  8. 2015Deep Convolutional Networks on Graph-Structured Datacited by 246
  9. 2020Graph Information Bottleneckcited by 168
  10. 2022Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communicationscited by 166
  11. 2022Handling Distribution Shifts on Graphs: An Invariance Perspectivecited by 163
  12. 2019ASAP: Adaptive Structure Aware Pooling for Learning Hierarchical Graph Representationscited by 156
13 more
  1. 2021Graph Learning: A Surveycited by 140
  2. 2020Graph Information Bottleneck for Subgraph Recognitioncited by 119
  3. 2021Learning Task-Oriented Communication for Edge Inference: An Information Bottleneck Approachcited by 105
  4. 2019DeepJSCC-f: Deep Joint Source-Channel Coding of Images with Feedbackcited by 95
  5. 2018Deep Learning for Joint Source-Channel Coding of Textcited by 68
  6. 2022Robust Semantic Communications with Masked VQ-VAE Enabled Codebookcited by 53
  7. 2021Task-Oriented Communication for Multi-Device Cooperative Edge Inferencecited by 47
  8. 2021Mobility-Aware Cluster Federated Learning in Hierarchical Wireless Networkscited by 35
  9. 2021Task-Oriented Image Transmission for Scene Classification in Unmanned Aerial Systemscited by 29
  10. 2022Robust Information Bottleneck for Task-Oriented Communication with Digital Modulationcited by 28
  11. 2023Semantic Importance-Aware Communications Using Pre-trained Language Modelscited by 15
  12. 2021Semantic Communications for Speech Recognitioncited by 5
  13. 2022Learning Based Joint Coding-Modulation for Digital Semantic Communication Systemscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.