Personalized Digital Semantic Communication for Image Transmission with Vision-Language Models
On the map: Multimodal LLMs / vision-language models → Visual token pruning and efficiency
Abstract (arXiv)
Semantic communication (SC) enables bandwidth-efficient wireless image transmission, but most existing SC schemes are user-agnostic and ignore receiver-dependent semantics. To address this issue, we propose a personalized digital semantic communication (PDSC) framework that integrates a vision-language model (VLM)-based semantic encoder with a latent diffusion model (LDM)-based semantic decoder. Specifically, the semantic encoder extracts source-aware personalized semantic tokens from both the source image and the receiver's historical interactions. These tokens are vector-quantized into discrete semantic indices and further encoded into a compact fixed-length bitstream, enabling compatibility with digital transmission. At the receiver, the semantic decoder reconstructs a personalized image conditioned on the recovered semantic tokens. Furthermore, we formulate a capacity-constrained personalized semantic rate-distortion problem and introduce a semantic distortion metric that jointly characterizes source-semantic fidelity and user-preference alignment. Experiments show that PDSC achieves superior source-semantic consistency and personalization over state-of-the-art SC baselines, including CDDM and MoS, under bandwidth-limited wireless transmission.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Visual token pruning and efficiency, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 0 of its 11 references that are in the map. First posted on arXiv 14 Aug 2026.
Builds on
0 of 11 references.
No references here yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Vision Transformer-based Semantic Communications With Importance-Aware Quantization
- 2025VLF-MSC: Vision-Language Feature-Based Multimodal Semantic Communication System
- 2025Latent Feature-Guided Conditional Diffusion for Generative Image Semantic Communication ↗
- 2024Goal-Oriented Semantic Communication for Wireless Image Transmission via Stable Diffusion
- 2026Adaptive Semantic Communication for Wireless Image Transmission Leveraging Mixture-of-Experts Mechanism
- 2024Adaptive Wireless Image Semantic Transmission: Design, Simulation, and Prototype Validation
- 2024Language-oriented Semantic Communication for Image Transmission with Fine-Tuned Diffusion Model
- 2025Foundation Model-Based Adaptive Semantic Image Transmission for Dynamic Wireless Environments