# Vector Quantized Semantic Communication System

arXiv: https://arxiv.org/abs/2209.11519 · HTML: https://mlsanity.com/paper/2209.11519/

## Key facts

- Cited by 16 papers in the map (data through 14 Oct 2026).
- Builds on 11 of its 15 references that are in the map.
- First posted on arXiv 23 Sep 2022.

## Builds on (most cited first, 11 of 11)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [Neural Discrete Representation Learning](https://mlsanity.com/paper/1711.00937/) (2017)
- [Image-to-Image Translation with Conditional Adversarial Networks](https://mlsanity.com/paper/1611.07004/) (2016)
- [Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation](https://mlsanity.com/paper/1308.3432/) (2013)
- [Deep Learning Enabled Semantic Communication Systems](https://mlsanity.com/paper/2006.10685/) (2020)
- [The Roadmap to 6G -- AI Empowered Wireless Networks](https://mlsanity.com/paper/1904.11686/) (2019)
- [Semantic Communication Systems for Speech Transmission](https://mlsanity.com/paper/2102.12605/) (2021)
- [Semantic Communications: Principles and Challenges](https://mlsanity.com/paper/2201.01389/) (2021)
- [Robust Semantic Communications with Masked VQ-VAE Enabled Codebook](https://mlsanity.com/paper/2206.04011/) (2022)
- [Deep Joint Source-Channel Coding for Wireless Image Transmission](https://mlsanity.com/paper/1809.01733/) (2018)

## Built on by (most cited first, 16 of 16)

- [OFDM-Based Digital Semantic Communication with Importance Awareness](https://mlsanity.com/paper/2401.02178/) (2024)
- [MOC-RVQ: Multilevel Codebook-Assisted Digital Generative Semantic Communication](https://mlsanity.com/paper/2401.01272/) (2024)
- [Multi-level Reliability Interface for Semantic Communications over Wireless Networks](https://mlsanity.com/paper/2407.05487/) (2024)
- [Task-Driven Semantic Quantization and Imitation Learning for Goal-Oriented Communications](https://mlsanity.com/paper/2502.17842/) (2025)
- [ProGIC: Progressive and Lightweight Generative Image Compression with Residual Vector Quantization](https://mlsanity.com/paper/2603.02897/) (2026)
- [Importance-Aware Semantic Communication in MIMO-OFDM Systems Using Vision Transformer](https://mlsanity.com/paper/2508.07696/) (2025)
- [Sequence Spreading-Based Semantic Communication Under High RF Interference](https://mlsanity.com/paper/2501.12502/) (2025)
- [TOAST: Task-Oriented Adaptive Semantic Transmission over Dynamic Wireless Environments](https://mlsanity.com/paper/2506.21900/) (2025)
- [VQ-DeepISC: Vector Quantized-Enabled Digital Semantic Communication with Channel Adaptive Image Transmission](https://mlsanity.com/paper/2508.03740/) (2025)
- [Way to Build Native AI-driven 6G Air Interface: Principles, Roadmap, and Outlook](https://mlsanity.com/paper/2508.15277/) (2025)
- [Semantic Communication Enabled Holographic Video Processing and Transmission](https://mlsanity.com/paper/2510.13408/) (2025)
- [Semantic Communication with Hopfield Memories](https://mlsanity.com/paper/2511.10302/) (2025)
- [Large Speech Model Enabled Semantic Communication](https://mlsanity.com/paper/2512.04711/) (2025)
- [A Survey on Semantic Communication for Vision: Categories, Frameworks, Enabling Techniques, and Applications](https://mlsanity.com/paper/2601.22202/) (2026)
- [VQ-DSC-R: Robust Vector Quantized-Enabled Digital Semantic Communication With OFDM Transmission](https://mlsanity.com/paper/2602.15045/) (2026)
- [SAFT: Sensitivity-Aware Filtering and Transmission for Adaptive 3D Point Cloud Communication over Wireless Channels](https://mlsanity.com/paper/2603.26197/) (2026)

## Abstract (arXiv)

Although analog semantic communication systems have received considerable attention in the literature, there is less work on digital semantic communication systems. In this paper, we develop a deep learning (DL)-enabled vector quantized (VQ) semantic communication system for image transmission, named VQ-DeepSC. Specifically, we propose a convolutional neural network (CNN)-based transceiver to extract multi-scale semantic features of images and introduce multi-scale semantic embedding spaces to perform semantic feature quantization, rendering the data compatible with digital communication systems. Furthermore, we employ adversarial training to improve the quality of received images by introducing a PatchGAN discriminator. Experimental results demonstrate that the proposed VQ-DeepSC is more robustness than BPG in digital communication systems and has comparable MS-SSIM performance to the DeepJSCC method.
