Trustworthy Image Semantic Communication with GenAI: Explainablity, Controllability, and Efficiency
Not on the map. Why?
Abstract (arXiv)
Image semantic communication (ISC) has garnered significant attention for its potential to achieve high efficiency in visual content transmission. However, existing ISC systems based on joint source-channel coding face challenges in interpretability, operability, and compatibility. To address these limitations, we propose a novel trustworthy ISC framework. This approach leverages text extraction and segmentation mapping techniques to convert images into explainable semantics, while employing Generative Artificial Intelligence (GenAI) for multiple downstream inference tasks. We also introduce a multi-rate ISC transmission protocol that dynamically adapts to both the received explainable semantic content and specific task requirements at the receiver. Simulation results demonstrate that our framework achieves explainable learning, decoupled training, and compatible transmission in various application scenarios. Finally, some intriguing research directions and application scenarios are identified.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 12 of its 20 references that are in the map. First posted on arXiv 7 Aug 2024.
Builds on
12 of 20 references.
References · 12
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Segment Anythingcited by 8,234
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,299
- 2016Neural Architectures for Named Entity Recognitioncited by 550
- 2020DF-GAN: A Simple and Effective Baseline for Text-to-Image Synthesiscited by 162
- 2019DeepJSCC-f: Deep Joint Source-Channel Coding of Images with Feedbackcited by 96
- 2023GALIP: Generative Adversarial CLIPs for Text-to-Image Synthesiscited by 85
- 2018Deep Joint Source-Channel Coding for Wireless Image Transmissioncited by 38
- 2021Mobility-Aware Cluster Federated Learning in Hierarchical Wireless Networkscited by 35
- 2021Deep Source-Channel Coding for Sentence Semantic Transmission with HARQcited by 29
- 2022Personalized Saliency in Task-Oriented Semantic Communications: Image Transmission and Performance Analysiscited by 23
- 2021Blockchain Systems, Technologies and Applications: A Methodology Perspectivecited by 6
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 1.
3 papers.