# Trustworthy Image Semantic Communication with GenAI: Explainablity, Controllability, and Efficiency

arXiv: https://arxiv.org/abs/2408.03806 · HTML: https://mlsanity.com/paper/2408.03806/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 12 of its 20 references that are in the map.
- First posted on arXiv 7 Aug 2024.

## Builds on (most cited first, 12 of 12)

- [Learning Transferable Visual Models From Natural Language Supervision](https://mlsanity.com/paper/2103.00020/) (2021)
- [Segment Anything](https://mlsanity.com/paper/2304.02643/) (2023)
- [Semantic Image Synthesis with Spatially-Adaptive Normalization](https://mlsanity.com/paper/1903.07291/) (2019)
- [Neural Architectures for Named Entity Recognition](https://mlsanity.com/paper/1603.01360/) (2016)
- [DF-GAN: A Simple and Effective Baseline for Text-to-Image Synthesis](https://mlsanity.com/paper/2008.05865/) (2020)
- [DeepJSCC-f: Deep Joint Source-Channel Coding of Images with Feedback](https://mlsanity.com/paper/1911.11174/) (2019)
- [GALIP: Generative Adversarial CLIPs for Text-to-Image Synthesis](https://mlsanity.com/paper/2301.12959/) (2023)
- [Deep Joint Source-Channel Coding for Wireless Image Transmission](https://mlsanity.com/paper/1809.01733/) (2018)
- [Mobility-Aware Cluster Federated Learning in Hierarchical Wireless Networks](https://mlsanity.com/paper/2108.09103/) (2021)
- [Deep Source-Channel Coding for Sentence Semantic Transmission with HARQ](https://mlsanity.com/paper/2106.03009/) (2021)
- [Personalized Saliency in Task-Oriented Semantic Communications: Image Transmission and Performance Analysis](https://mlsanity.com/paper/2209.12274/) (2022)
- [Blockchain Systems, Technologies and Applications: A Methodology Perspective](https://mlsanity.com/paper/2105.03572/) (2021)

## Built on by (most cited first, 3 of 3)

- [Generative Semantic Communication: Architectures, Technologies, and Applications](https://mlsanity.com/paper/2412.08642/) (2024)
- [Towards 6G Native-AI Edge Networks: A Semantic-Aware and Agentic Intelligence Paradigm](https://mlsanity.com/paper/2512.04405/) (2025)
- [TISC: A Text-Driven Image Semantic Communication System for Faithful Reconstruction](https://mlsanity.com/paper/2608.16100/) (2026)

## Abstract (arXiv)

Image semantic communication (ISC) has garnered significant attention for its potential to achieve high efficiency in visual content transmission. However, existing ISC systems based on joint source-channel coding face challenges in interpretability, operability, and compatibility. To address these limitations, we propose a novel trustworthy ISC framework. This approach leverages text extraction and segmentation mapping techniques to convert images into explainable semantics, while employing Generative Artificial Intelligence (GenAI) for multiple downstream inference tasks. We also introduce a multi-rate ISC transmission protocol that dynamically adapts to both the received explainable semantic content and specific task requirements at the receiver. Simulation results demonstrate that our framework achieves explainable learning, decoupled training, and compatible transmission in various application scenarios. Finally, some intriguing research directions and application scenarios are identified.