Deep Joint Source-Channel Coding for Wireless Image Transmission with Adaptive Rate Control
Not on the map. Why?
Abstract (arXiv)
We present a novel adaptive deep joint source-channel coding (JSCC) scheme for wireless image transmission. The proposed scheme supports multiple rates using a single deep neural network (DNN) model and learns to dynamically control the rate based on the channel condition and image contents. Specifically, a policy network is introduced to exploit the tradeoff space between the rate and signal quality. To train the policy network, the Gumbel-Softmax trick is adopted to make the policy network differentiable and hence the whole JSCC scheme can be trained end-to-end. To the best of our knowledge, this is the first deep JSCC scheme that can automatically adjust its rate using a single network model. Experiments show that our scheme successfully learns a reasonable policy that decreases channel bandwidth utilization for high SNR scenarios or simple image contents. For an arbitrary target rate, our rate-adaptive scheme using a single model achieves similar performance compared to an optimized model specifically trained for that fixed target rate. To reproduce our results, we make the source code publicly available at https://github.com/mingyuyng/Dynamic_JSCC.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 11 of its 23 references that are in the map. First posted on arXiv 9 Oct 2021.
Builds on
11 of 23 references.
References · 11
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2017SkipNet: Learning Dynamic Routing in Convolutional Networkscited by 328
- 2017BlockDrop: Dynamic Inference Paths in Residual Networkscited by 185
- 2017Convolutional Networks with Adaptive Inference Graphscited by 147
- 2018Dynamic Channel Pruning: Feature Boosting and Suppressioncited by 129
- 2016Spatially Adaptive Computation Time for Residual Networkscited by 118
- 2019DeepJSCC-f: Deep Joint Source-Channel Coding of Images with Feedbackcited by 95
- 2020Bandwidth-Agile Image Transmission with Deep Joint Source-Channel Codingcited by 42
- 2021Deep Joint Source Channel Coding for WirelessImage Transmission with OFDMcited by 22
- 2019Successive Refinement of Images with Deep Joint Source-Channel Codingcited by 14
Built on by
Citing papers per year: 2022: 5; 2023: 1; 2024: 11; 2025: 7; 2026: 2.
26 papers.
Sort:
By area:
- 2022Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communicationscited by 166
- 2024Joint Source-Channel Coding: Fundamentals and Recent Progress in Practical Designscited by 32
- 2022Efficient Deep Visual and Inertial Odometry with Adaptive Visual Modality Selectioncited by 17
- 2024Semantic-Aware Spectrum Sharing in Internet of Vehicles Based on Deep Reinforcement Learningcited by 17
- 2025Adaptive Semantic Token Communication for Transformer-based Edge Inferencecited by 13
- 2024Diffusion-Aided Joint Source Channel Coding For High Realism Wireless Image Transmissioncited by 11
- 2022Toward Adaptive Semantic Communications: Efficient Data Transmission via Online Learned Nonlinear Transform Source-Channel Codingcited by 8
- 2022Semantics-Empowered Communication: A Tutorial-cum-Surveycited by 8
- 2024Semantic Successive Refinement: A Generative AI-aided Semantic Communication Frameworkcited by 8
- 2025Joint Semantic-Channel Coding and Modulation for Token Communicationscited by 7
- 2024Deep Learning in Physical Layer: Review on Data Driven End-to-End Communication Systems and their Enabling Semantic Applicationscited by 6
- 2024MOC-RVQ: Multilevel Codebook-Assisted Digital Generative Semantic Communicationcited by 5
14 more
- 2024Semantic Edge Computing and Semantic Communications in 6G Networks: A Unifying Survey and Research Challengescited by 5
- 2023Deep Joint Source-Channel Coding with Iterative Source Error Correctioncited by 3
- 2022WiserVR: Semantic Communication Enabled Wireless Virtual Reality Deliverycited by 2
- 2024Multi-User Semantic Fusion for Semantic Communications over Degraded Broadcast Channelscited by 2
- 2024Learned Image Transmission with Hierarchical Variational Autoencodercited by 1
- 2025Lightweight Task-Oriented Semantic Communication Empowered by Large-Scale AI Modelscited by 1
- 2025Distillation-Enabled Knowledge Alignment for Generative Semantic Communications of AIGC Imagescited by 1
- 2024Object-Attribute-Relation Representation Based Video Semantic Communicationcited by 0
- 2024SAFE: Semantic Adaptive Feature Extraction with Rate Control for 6G Wireless Communicationscited by 0
- 2025Knowledge-Base based Semantic Image Transmission Using CLIPcited by 0
- 2025Semantic-Aware Visual Information Transmission With Key Information Extraction Over Wireless Networkscited by 0
- 2025TOAST: Task-Oriented Adaptive Semantic Transmission over Dynamic Wireless Environmentscited by 0
- 2026Deep Joint Source-Channel Coding for Wireless Video Transmission with Asymmetric Contextcited by 0
- 2026On Privacy-Preserving Image Transmission in Low-Altitude Networks: A Swin Transformer-Based Framework with Federated Learningcited by 0
- 2026On Privacy-Preserving Image Transmission in Low-Altitude Networks: A Swin Transformer-Based Framework with Federated Learning12 May 2026
- 2026Deep Joint Source-Channel Coding for Wireless Video Transmission with Asymmetric Context7 Jan 2026
- 2025Joint Semantic-Channel Coding and Modulation for Token Communications19 Nov 2025
- 2025TOAST: Task-Oriented Adaptive Semantic Transmission over Dynamic Wireless Environments27 Jun 2025
- 2025Distillation-Enabled Knowledge Alignment for Generative Semantic Communications of AIGC Images24 Jun 2025
- 2025Lightweight Task-Oriented Semantic Communication Empowered by Large-Scale AI Models16 Jun 2025
- 2025Semantic-Aware Visual Information Transmission With Key Information Extraction Over Wireless Networks15 Jun 2025
- 2025Adaptive Semantic Token Communication for Transformer-based Edge Inference23 May 2025
- 2025Knowledge-Base based Semantic Image Transmission Using CLIP1 Apr 2025
- 2024Semantic Edge Computing and Semantic Communications in 6G Networks: A Unifying Survey and Research Challenges27 Nov 2024
- 2024SAFE: Semantic Adaptive Feature Extraction with Rate Control for 6G Wireless Communications2 Oct 2024
- 2024Joint Source-Channel Coding: Fundamentals and Recent Progress in Practical Designs26 Sep 2024
14 more
- 2024Learned Image Transmission with Hierarchical Variational Autoencoder29 Aug 2024
- 2024Semantic Successive Refinement: A Generative AI-aided Semantic Communication Framework31 Jul 2024
- 2024Multi-User Semantic Fusion for Semantic Communications over Degraded Broadcast Channels15 Jun 2024
- 2024Object-Attribute-Relation Representation Based Video Semantic Communication15 Jun 2024
- 2024Semantic-Aware Spectrum Sharing in Internet of Vehicles Based on Deep Reinforcement Learning11 Jun 2024
- 2024Diffusion-Aided Joint Source Channel Coding For High Realism Wireless Image Transmission27 Apr 2024
- 2024Deep Learning in Physical Layer: Review on Data Driven End-to-End Communication Systems and their Enabling Semantic Applications8 Jan 2024
- 2024MOC-RVQ: Multilevel Codebook-Assisted Digital Generative Semantic Communication2 Jan 2024
- 2023Deep Joint Source-Channel Coding with Iterative Source Error Correction17 Feb 2023
- 2022Semantics-Empowered Communication: A Tutorial-cum-Survey16 Dec 2022
- 2022Toward Adaptive Semantic Communications: Efficient Data Transmission via Online Learned Nonlinear Transform Source-Channel Coding8 Nov 2022
- 2022WiserVR: Semantic Communication Enabled Wireless Virtual Reality Delivery2 Nov 2022
- 2022Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communications19 Jul 2022
- 2022Efficient Deep Visual and Inertial Odometry with Adaptive Visual Modality Selection12 May 2022
- 2022Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communicationscited by 166
- 2024Joint Source-Channel Coding: Fundamentals and Recent Progress in Practical Designscited by 32
- 2022Efficient Deep Visual and Inertial Odometry with Adaptive Visual Modality Selectioncited by 17
- 2024Semantic-Aware Spectrum Sharing in Internet of Vehicles Based on Deep Reinforcement Learningcited by 17
- 2025Adaptive Semantic Token Communication for Transformer-based Edge Inferencecited by 13
- 2022Toward Adaptive Semantic Communications: Efficient Data Transmission via Online Learned Nonlinear Transform Source-Channel Codingcited by 8
- 2022Semantics-Empowered Communication: A Tutorial-cum-Surveycited by 8
- 2024Semantic Successive Refinement: A Generative AI-aided Semantic Communication Frameworkcited by 8
- 2025Joint Semantic-Channel Coding and Modulation for Token Communicationscited by 7
- 2024Deep Learning in Physical Layer: Review on Data Driven End-to-End Communication Systems and their Enabling Semantic Applicationscited by 6
- 2024MOC-RVQ: Multilevel Codebook-Assisted Digital Generative Semantic Communicationcited by 5
- 2024Semantic Edge Computing and Semantic Communications in 6G Networks: A Unifying Survey and Research Challengescited by 5
12 most cited of 25 All 25 (JSON)
- 2026On Privacy-Preserving Image Transmission in Low-Altitude Networks: A Swin Transformer-Based Framework with Federated Learning12 May 2026
- 2026Deep Joint Source-Channel Coding for Wireless Video Transmission with Asymmetric Context7 Jan 2026
- 2025Joint Semantic-Channel Coding and Modulation for Token Communications19 Nov 2025
- 2025TOAST: Task-Oriented Adaptive Semantic Transmission over Dynamic Wireless Environments27 Jun 2025
- 2025Distillation-Enabled Knowledge Alignment for Generative Semantic Communications of AIGC Images24 Jun 2025
- 2025Lightweight Task-Oriented Semantic Communication Empowered by Large-Scale AI Models16 Jun 2025
- 2025Semantic-Aware Visual Information Transmission With Key Information Extraction Over Wireless Networks15 Jun 2025
- 2025Adaptive Semantic Token Communication for Transformer-based Edge Inference23 May 2025
- 2025Knowledge-Base based Semantic Image Transmission Using CLIP1 Apr 2025
- 2024Semantic Edge Computing and Semantic Communications in 6G Networks: A Unifying Survey and Research Challenges27 Nov 2024
- 2024SAFE: Semantic Adaptive Feature Extraction with Rate Control for 6G Wireless Communications2 Oct 2024
- 2024Joint Source-Channel Coding: Fundamentals and Recent Progress in Practical Designs26 Sep 2024
12 newest of 25 All 25 (JSON)