Learned Image Transmission with Hierarchical Variational Autoencoder
Not on the map. Why?
Abstract (arXiv)
In this paper, we introduce an innovative hierarchical joint source-channel coding (HJSCC) framework for image transmission, utilizing a hierarchical variational autoencoder (VAE). Our approach leverages a combination of bottom-up and top-down paths at the transmitter to autoregressively generate multiple hierarchical representations of the original image. These representations are then directly mapped to channel symbols for transmission by the JSCC encoder. We extend this framework to scenarios with a feedback link, modeling transmission over a noisy channel as a probabilistic sampling process and deriving a novel generative formulation for JSCC with feedback. Compared with existing approaches, our proposed HJSCC provides enhanced adaptability by dynamically adjusting transmission bandwidth, encoding these representations into varying amounts of channel symbols. Extensive experiments on images of varying resolutions demonstrate that our proposed model outperforms existing baselines in rate-distortion performance and maintains robustness against channel noise. The source code will be made available upon acceptance.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 22 of its 35 references that are in the map. First posted on arXiv 29 Aug 2024.
Builds on
22 of 35 references.
References · 22
- 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,376
- 2018Variational image compression with a scale hyperpriorcited by 910
- 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 642
- 2016Ladder Variational Autoencoderscited by 315
- 2022ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive Codingcited by 296
- 2020Very Deep VAEs Generalize Autoregressive Models and Can Outperform Them on Imagescited by 261
- 2021Checkerboard Context Model for Efficient Learned Image Compressioncited by 193
- 2019DeepJSCC-f: Deep Joint Source-Channel Coding of Images with Feedbackcited by 95
- 2021Nonlinear Transform Source-Channel Coding for Semantic Communicationscited by 73
- 2022Robust Semantic Communications with Masked VQ-VAE Enabled Codebookcited by 53
- 2019Bit-Swap: Recursive Bits-Back Coding for Lossless Compression with Hierarchical Latent Variablescited by 51
- 2023SwinJSCC: Taming Swin Transformer for Deep Joint Source-Channel Codingcited by 43
10 more
- 2022Lossy Image Compression with Quantized Hierarchical VAEscited by 32
- 2021Deep Source-Channel Coding for Sentence Semantic Transmission with HARQcited by 29
- 2023HQ-VAE: Hierarchical Discrete Representation Learning with Variational Bayescited by 27
- 2021Deep Joint Source-Channel Coding for Wireless Image Transmission with Adaptive Rate Controlcited by 26
- 2020Autoencoding Variational Autoencodercited by 24
- 2023Transformer-aided Wireless Image Transmission with Channel Feedbackcited by 19
- 2023Joint Coding-Modulation for Digital Semantic Communications via Variational Autoencodercited by 16
- 2018Neural Joint Source-Channel Codingcited by 5
- 2022Multi-Sample Training for Neural Image Compressioncited by 5
- 2022Adaptive Information Bottleneck Guided Joint Source and Channel Coding for Image Transmissioncited by 3
Built on by
Citing papers per year: 2024: 1.
1 paper.