TISC: A Text-Driven Image Semantic Communication System for Faithful Reconstruction
On the map: Diffusion models → Diffusion for compression and wireless
Abstract (arXiv)
Generative image semantic communication converts an image into a text description and then performs text-to-image reconstruction at the receiver via diffusion-based generative models. This paradigm has attracted broad attention due to its extremely low bandwidth cost. However, existing methods still face two critical bottlenecks across image-to-text (I2T) semantic extraction at the transmitter and text-to-image (T2I) semantic reconstruction at the receiver: (i) semantic loss and distortion in I2T, where holistic image descriptions may omit fine-grained object attributes and spatial-position information, causing the generated text to deviate from the original image semantics; and (ii) insufficient semantic faithfulness in T2I, where even with the same semantically faithful text description, different initial noise settings may lead diffusion-based reconstruction to produce images with different levels of semantic consistency with the original image. These issues jointly limit the semantic faithfulness of image reconstruction. To address them, we propose TISC, a text-driven image semantic communication framework tailored for faithful reconstruction. TISC incorporates two key designs: (1) Tree-Structured Attribute Semantic Extraction (TSASE), which decomposes semantic extraction into global scene, background, and object-level attribute descriptions, covering spatial position, shape/pose, color, material, and other physical attributes for each detected object; and (2) an Initial Noise Optimization (INO) mechanism, which selects an initial noise seed at the transmitter according to a comprehensive similarity score that jointly considers visual and semantic consistency. Experiments on multiple datasets show that TSASE improves object-position recovery and semantic description faithfulness, while the INO parameter study supports the adopted configuration for noise selection.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion for compression and wireless, one of 14 directions in Diffusion models. Builds on 31 of its 48 references that are in the map. First posted on arXiv 17 Aug 2026.
Builds on
31 of 48 references.
References · 31
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2024GPT-4o System Cardcited by 4,467
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
- 2015Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Modelscited by 1,352
- 2023A Survey on Multimodal Large Language Modelscited by 898
- 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 416
19 more
- 2024Hallucination of Multimodal Large Language Models: A Surveycited by 380
- 2024A Survey on Hallucination in Large Vision-Language Modelscited by 352
- 2023LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Modelscited by 242
- 2022Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communicationscited by 166
- 20206G Networks: Beyond Shannon Towards Semantic and Goal-Oriented Communicationscited by 108
- 2019DeepJSCC-f: Deep Joint Source-Channel Coding of Images with Feedbackcited by 95
- 2022Semantic Communications for Future Internet: Fundamentals, Applications, and Challengescited by 94
- 2021Semantic Communications: Principles and Challengescited by 90
- 2021Nonlinear Transform Source-Channel Coding for Semantic Communicationscited by 73
- 2024A Noise is Worth Diffusion Guidancecited by 48
- 2023SwinJSCC: Taming Swin Transformer for Deep Joint Source-Channel Codingcited by 43
- 2022Towards Semantic Communications: Deep Learning-Based Image Semantic Codingcited by 35
- 2023Transformer-aided Wireless Image Transmission with Channel Feedbackcited by 19
- 2023Language-Oriented Communication with Semantic Coding and Knowledge Distillation for Text-to-Image Generationcited by 17
- 2024Language-Oriented Semantic Latent Representation for Image Transmissioncited by 10
- 2025Large Language Model-Based Semantic Communication System for Image Transmissioncited by 4
- 2024Image Generative Semantic Communication with Multi-Modal Similarity Estimation for Resource-Limited Networkscited by 3
- 2024Trustworthy Image Semantic Communication with GenAI: Explainablity, Controllability, and Efficiencycited by 3
- 2025SA-OOSC: A Multimodal LLM-Distilled Semantic Communication Framework for Enhanced Coding Efficiency with Scenario Understandingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Language-oriented Semantic Communication for Image Transmission with Fine-Tuned Diffusion Model
- 2024Generative Semantic Communication for Joint Image Transmission and Segmentation
- 2025Latent Feature-Guided Conditional Diffusion for Generative Image Semantic Communication ↗
- 2024SC-CDM: Enhancing Quality of Image Semantic Communication with a Compact Diffusion Model
- 2023Generative Semantic Communication: Diffusion Models Beyond Bit Recovery
- 2025Efficient and Robust Semantic Image Communication via Stable Cascade
- 2024Image Generation with Supervised Selection Based on Multimodal Features for Semantic Communications
- 2024Semantic Successive Refinement: A Generative AI-aided Semantic Communication Framework