mlsanityData to 14 Oct 2026

Semantic-Aware Generative Image Transmission for Resource-Constrained Visual IoT Systems

arXiv 2606.28398 ↗First posted 24 Jun 2026cs.CV eess.IVcited by 0

Not on the map. Why?

Abstract (arXiv)

Resource-constrained visual Internet of Things (IoT) systems, such as edge cameras, unmanned sensing platforms, industrial inspection nodes, and remote monitoring sensors, often need to transmit task-relevant visual evidence over low-rate wireless links to an edge/cloud service. Existing image communication methods usually compress or transmit complete global representations, leaving limited room to exploit receiver-side generative restoration. This paper proposes a semantic-aware generative image transmission framework for edge-assisted visual IoT. The image captured by an IoT visual sensor is encoded into a discrete token grid by a VQ encoder. At the IoT transmitter or nearby gateway, token recoverability, estimated from prediction entropy and local structure complexity, is fused with semantic importance obtained from instance segmentation and category-aware scoring. A spatial dispersal sampler then selects the tokens to be transmitted under a bitrate budget. The transmitter sends only the quantization indices of kept tokens and a binary mask map, while the edge/cloud receiver recovers masked tokens through MaskGIT with Halton sequence scheduling. Experiments on Kodak and VisDrone scenes under AWGN and Rayleigh channels show that the proposed method provides a flexible bitrate-quality tradeoff for narrowband visual IoT links. At 0.074 bpp, it uses 44.6% of the transmitted bits of the 0.167-bpp DeepJSCC/WITT reference while achieving 29.9 dB PSNR. A pseudo-GT downstream detection study on Kodak further shows that semantic-aware masking preserves task-relevant objects better than random masking at both 30% and 50% mask ratios.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 29 references that are in the map. First posted on arXiv 24 Jun 2026.

Builds on

18 of 29 references.

References · 18

  1. 2017Attention Is All You Needcited by 60,361
  2. 2017Neural Discrete Representation Learningcited by 4,712
  3. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  4. 2022MaskGIT: Masked Generative Image Transformercited by 1,099
  5. 2024TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generationcited by 202
  6. 2025UniTok: A Unified Tokenizer for Visual Generation and Understandingcited by 153
  7. 2024MaskBit: Embedding-free Image Generation via Bit Tokenscited by 98
  8. 2023SwinJSCC: Taming Swin Transformer for Deep Joint Source-Channel Codingcited by 45
  9. 2022WITT: A Wireless Image Transmission Transformer for Semantic Communicationscited by 37
  10. 2023Generative AI-driven Semantic Communication Networks: Architecture, Technologies and Applicationscited by 36
  11. 2024Joint Source-Channel Coding: Fundamentals and Recent Progress in Practical Designscited by 32
  12. 2025Halton Scheduler For Masked Generative Image Transformercited by 32
6 more
  1. 2023Generative AI for Physical Layer Communications: A Surveycited by 17
  2. 2024Generative AI for Secure Physical Layer Communications: A Surveycited by 17
  3. 2024Diffusion-Aided Joint Source Channel Coding For High Realism Wireless Image Transmissioncited by 11
  4. 2024Process-and-Forward: Deep Joint Source-Channel Coding Over Cooperative Relay Networkscited by 9
  5. 2024Generative Semantic Communication for Joint Image Transmission and Segmentationcited by 6
  6. 2025SING: Semantic Image Communications using Null-Space and INN-Guided Diffusion Modelscited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Semantic Communication based on Generative AI: A New Approach to Image Compression and Edge Optimization
  2. 2024Adaptive Wireless Image Semantic Transmission: Design, Simulation, and Prototype Validation
  3. 2024Vision Transformer-based Semantic Communications With Importance-Aware Quantization
  4. 2026Efficient Semantic Image Communication for Traffic Monitoring at the Edge
  5. 2026Personalized Digital Semantic Communication for Image Transmission with Vision-Language Models
  6. 2025Transferable Deployment of Semantic Edge Inference Systems via Unsupervised Domain Adaption
  7. 2026A Survey on Semantic Communication for Vision: Categories, Frameworks, Enabling Techniques, and Applications
  8. 2026Semantic-Aware UAV Command and Control for Efficient IoT Data Collection ↗