Foundation Model-Based Adaptive Semantic Image Transmission for Dynamic Wireless Environments
On the map: Diffusion models → Diffusion for compression and wireless
Abstract (arXiv)
Foundation model-based semantic transmission has recently shown great potential in wireless image communication. However, existing methods exhibit two major limitations: (i) they overlook the varying importance of semantic components for specific downstream tasks, and (ii) they insufficiently exploit wireless domain knowledge, resulting in limited robustness under dynamic channel conditions. To overcome these challenges, this paper proposes a foundation model-based adaptive semantic image transmission system for dynamic wireless environments, such as autonomous driving. The proposed system decomposes each image into a semantic segmentation map and a compressed representation, enabling task-aware prioritization of critical objects and fine-grained textures. A task-adaptive precoding mechanism then allocates radio resources according to the semantic importance of extracted features. To ensure accurate channel information for precoding, a channel estimation knowledge map (CEKM) is constructed using a conditional diffusion model that integrates user position, velocity, and sparse channel samples to train scenario-specific lightweight estimators. At the receiver, a conditional diffusion model reconstructs high-quality images from the received semantic features, ensuring robustness against channel impairments and partial data loss. Simulation results on the BDD100K dataset with multi-scenario channels generated by QuaDRiGa demonstrate that the proposed method outperforms existing approaches in terms of perceptual quality (SSIM, LPIPS, FID), task-specific accuracy (IoU), and transmission efficiency. These results highlight the effectiveness of integrating task-aware semantic decomposition, scenario-adaptive channel estimation, and diffusion-based reconstruction for robust semantic transmission in dynamic wireless environments.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Diffusion for compression and wireless, one of 14 directions in Diffusion models. Builds on 32 of its 47 references that are in the map. First posted on arXiv 28 Sep 2025.
Builds on
32 of 47 references.
Closest ancestors · 2
Same direction, newest first
- 2024Latency-Aware Generative Semantic Communications with Pre-Trained Diffusion Models25 Mar
- 2023Generative Diffusion Models for Radio Wireless Channel Modelling and Sampling10 Aug
Other references · 30
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2023Consistency Modelscited by 1,822
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
- 2020Deep Learning Enabled Semantic Communication Systemscited by 292
- 2023Q-Diffusion: Quantizing Diffusion Modelscited by 273
18 more
- 2020A Lite Distributed Semantic Communication System for Internet of Thingscited by 73
- 2023A Tutorial on Environment-Aware Communications via Channel Knowledge Map for 6Gcited by 61
- 2023Large Language Model Enhanced Multi-Agent Systems for 6G Communicationscited by 53
- 2022Wireless Semantic Communications for Video Conferencingcited by 50
- 2024WirelessLLM: Empowering Large Language Models Towards Wireless Intelligencecited by 44
- 2022Overview of Deep Learning-based CSI Feedback in Massive MIMO Systemscited by 37
- 2023SCAN: Semantic Communication with Adaptive Channel Feedbackcited by 14
- 2024Large Generative Model Assisted 3D Semantic Communicationcited by 12
- 2020A Vision of C-V2X: Technologies, Field Testing and Challenges with Chinese Developmentcited by 11
- 2024Language-Oriented Semantic Latent Representation for Image Transmissioncited by 10
- 2024Generative Semantic Communications with Foundation Models: Perception-Error Analysis and Semantic-Aware Power Allocationcited by 10
- 2024Importance-Aware Image Segmentation-based Semantic Communication for Autonomous Drivingcited by 7
- 2022Wireless Deep Speech Semantic Transmissioncited by 6
- 2023RIS-Enhanced Semantic Communications Adaptive to User Requirementscited by 6
- 2024Feature Allocation for Semantic Communication with Space-Time Importance Awarenesscited by 6
- 2024Semantic Satellite Communications Based on Generative Foundation Modelcited by 6
- 2024Semantic Communication based on Large Language Model for Underwater Image Transmissioncited by 6
- 2024Semantic MIMO Systems for Speech-to-Text Transmissioncited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Adaptive Wireless Image Semantic Transmission: Design, Simulation, and Prototype Validation
- 2026Adaptive Semantic Communication for Wireless Image Transmission Leveraging Mixture-of-Experts Mechanism
- 2024Goal-Oriented Semantic Communication for Wireless Image Transmission via Stable Diffusion
- 2025Semantic Communications with World Models
- 2024Language-oriented Semantic Communication for Image Transmission with Fine-Tuned Diffusion Model
- 2024SC-CDM: Enhancing Quality of Image Semantic Communication with a Compact Diffusion Model
- 2025Latent Feature-Guided Conditional Diffusion for Generative Image Semantic Communication ↗
- 2026Personalized Digital Semantic Communication for Image Transmission with Vision-Language Models