mlsanityData to 14 Oct 2026

Trustworthy Image Semantic Communication with GenAI: Explainablity, Controllability, and Efficiency

arXiv 2408.03806 ↗First posted 7 Aug 2024cs.IT cs.LG cs.NIcited by 3

Not on the map. Why?

Abstract (arXiv)

Image semantic communication (ISC) has garnered significant attention for its potential to achieve high efficiency in visual content transmission. However, existing ISC systems based on joint source-channel coding face challenges in interpretability, operability, and compatibility. To address these limitations, we propose a novel trustworthy ISC framework. This approach leverages text extraction and segmentation mapping techniques to convert images into explainable semantics, while employing Generative Artificial Intelligence (GenAI) for multiple downstream inference tasks. We also introduce a multi-rate ISC transmission protocol that dynamically adapts to both the received explainable semantic content and specific task requirements at the receiver. Simulation results demonstrate that our framework achieves explainable learning, decoupled training, and compatible transmission in various application scenarios. Finally, some intriguing research directions and application scenarios are identified.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 12 of its 20 references that are in the map. First posted on arXiv 7 Aug 2024.

Builds on

12 of 20 references.

References · 12

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023Segment Anythingcited by 8,234
  3. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,299
  4. 2016Neural Architectures for Named Entity Recognitioncited by 550
  5. 2020DF-GAN: A Simple and Effective Baseline for Text-to-Image Synthesiscited by 162
  6. 2019DeepJSCC-f: Deep Joint Source-Channel Coding of Images with Feedbackcited by 96
  7. 2023GALIP: Generative Adversarial CLIPs for Text-to-Image Synthesiscited by 85
  8. 2018Deep Joint Source-Channel Coding for Wireless Image Transmissioncited by 38
  9. 2021Mobility-Aware Cluster Federated Learning in Hierarchical Wireless Networkscited by 35
  10. 2021Deep Source-Channel Coding for Sentence Semantic Transmission with HARQcited by 29
  11. 2022Personalized Saliency in Task-Oriented Semantic Communications: Image Transmission and Performance Analysiscited by 23
  12. 2021Blockchain Systems, Technologies and Applications: A Methodology Perspectivecited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 1.

3 papers.