WITT: A Wireless Image Transmission Transformer for Semantic Communications
Not on the map. Why?
Abstract (arXiv)
In this paper, we aim to redesign the vision Transformer (ViT) as a new backbone to realize semantic image transmission, termed wireless image transmission transformer (WITT). Previous works build upon convolutional neural networks (CNNs), which are inefficient in capturing global dependencies, resulting in degraded end-to-end transmission performance especially for high-resolution images. To tackle this, the proposed WITT employs Swin Transformers as a more capable backbone to extract long-range information. Different from ViTs in image classification tasks, WITT is highly optimized for image transmission while considering the effect of the wireless channel. Specifically, we propose a spatial modulation module to scale the latent representations according to channel state information, which enhances the ability of a single model to deal with various channel conditions. As a result, extensive experiments verify that our WITT attains better performance for different image resolutions, distortion metrics, and channel conditions. The code is available at https://github.com/KeYang8/WITT.
Key facts. Cited by 37 papers in the map (data through 14 Oct 2026). Builds on 7 of its 23 references that are in the map. First posted on arXiv 2 Nov 2022.
Builds on
7 of 23 references.
References · 7
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2020Deep Learning Enabled Semantic Communication Systemscited by 292
- 2019DeepJSCC-f: Deep Joint Source-Channel Coding of Images with Feedbackcited by 96
- 2018Deep Learning for Joint Source-Channel Coding of Textcited by 69
- 2020Wireless Image Retrieval at the Edgecited by 59
- 2022Perceptual Learned Source-Channel Coding for High-Fidelity Image Semantic Transmissioncited by 12
Built on by
Citing papers per year: 2023: 5; 2024: 12; 2025: 12; 2026: 8.
37 papers.
Sort:
By area:
- 2023CDDM: Channel Denoising Diffusion Models for Wireless Semantic Communicationscited by 59
- 2023CDDM: Channel Denoising Diffusion Models for Wireless Communicationscited by 19
- 2024Visual Language Model based Cross-modal Semantic Communication Systemscited by 12
- 2024Diffusion-Aided Joint Source Channel Coding For High Realism Wireless Image Transmissioncited by 11
- 2024Robust Image Semantic Coding with Learnable CSI Fusion Masking over MIMO Fading Channelscited by 9
- 2024Semantic Successive Refinement: A Generative AI-aided Semantic Communication Frameworkcited by 9
- 2023Segment Anything Meets Semantic Communicationcited by 8
- 2024Importance-Aware Image Segmentation-based Semantic Communication for Autonomous Drivingcited by 7
- 2024DM-MIMO: Diffusion Models for Robust Semantic Communications over MIMO Channelscited by 6
- 2024Generative Semantic Communication for Joint Image Transmission and Segmentationcited by 6
- 2025DeepSeek-Inspired Exploration of RL-based LLMs and Synergy with Wireless Networks: A Surveycited by 6
- 2023An Efficient Federated Learning Framework for Training Semantic Communication Systemcited by 5
25 more
- 2025Multi-user Wireless Image Semantic Transmission over MIMO Multiple Access Channelscited by 4
- 2024Transformer-Aided Semantic Communicationscited by 3
- 2024Efficient Semantic Communication Through Transformer-Aided Compressioncited by 3
- 2025Semantic Edge-Cloud Communication for Real-Time Urban Traffic Surveillance with ViT and LLMs over Mobile Networkscited by 3
- 2023Semantic Multi-Resolution Communicationscited by 2
- 2024FSSC: Federated Learning of Transformer Neural Networks for Semantic Image Communicationcited by 2
- 2025From Large AI Models to Agentic AI: A Tutorial on Future Intelligent Communicationscited by 2
- 2024SC-CDM: Enhancing Quality of Image Semantic Communication with a Compact Diffusion Modelcited by 1
- 2025Modeling and Performance Analysis for Semantic Communications Based on Empirical Resultscited by 1
- 2025SecDiff: Diffusion-Aided Secure Deep Joint Source-Channel Coding Against Adversarial Attackscited by 1
- 2025Wireless Video Semantic Communication with Decoupled Diffusion Multi-frame Compensationcited by 1
- 2026Scenario-Adaptive MU-MIMO OFDM Semantic Communication With Asymmetric Neural Networkcited by 1
- 2026Progressive Semantic Communication for Efficient Edge-Cloud Vision-Language Modelscited by 1
- 2024Interplay of Semantic Communication and Knowledge Learningcited by 0
- 2025Learnable Residual-Based Latent Denoising in Semantic Communicationcited by 0
- 2025Semantic Communication in Dynamic Channel Scenarios: Collaborative Optimization of Dual-Pipeline Joint Source-Channel Coding and Personalized Federated Learningcited by 0
- 2025TOAST: Task-Oriented Adaptive Semantic Transmission over Dynamic Wireless Environmentscited by 0
- 2025Way to Build Native AI-driven 6G Air Interface: Principles, Roadmap, and Outlookcited by 0
- 2025Synesthesia of Machines (SoM)-Based Task-Driven MIMO System for Image Transmissioncited by 0
- 2026On Privacy-Preserving Image Transmission in Low-Altitude Networks: A Swin Transformer-Based Framework with Federated Learningcited by 0
- 2026Quantum Machine Learning-based 6G edge Network: Enabling Adaptive Communication and Model Aggregationcited by 0
- 2026Semantic-Aware Generative Image Transmission for Resource-Constrained Visual IoT Systemscited by 0
- 2026ComVLA: Communication-Aware Split Inference for VLA Models in 6G-Connected Roboticscited by 0
- 2026Foundation Models for Generalizable Semantic and Goal-Oriented Communicationcited by 0
- 2026Beyond Token Accuracy: Prioritizing What Matters for Visual Reconstructioncited by 0
- 2026Beyond Token Accuracy: Prioritizing What Matters for Visual Reconstruction2 Oct 2026
- 2026Foundation Models for Generalizable Semantic and Goal-Oriented Communication7 Sep 2026
- 2026ComVLA: Communication-Aware Split Inference for VLA Models in 6G-Connected Robotics7 Sep 2026
- 2026Semantic-Aware Generative Image Transmission for Resource-Constrained Visual IoT Systems24 Jun 2026
- 2026Quantum Machine Learning-based 6G edge Network: Enabling Adaptive Communication and Model Aggregation18 May 2026
- 2026On Privacy-Preserving Image Transmission in Low-Altitude Networks: A Swin Transformer-Based Framework with Federated Learning12 May 2026
- 2026Progressive Semantic Communication for Efficient Edge-Cloud Vision-Language Models29 Apr 2026
- 2026Scenario-Adaptive MU-MIMO OFDM Semantic Communication With Asymmetric Neural Network14 Feb 2026
- 2025Wireless Video Semantic Communication with Decoupled Diffusion Multi-frame Compensation4 Nov 2025
- 2025SecDiff: Diffusion-Aided Secure Deep Joint Source-Channel Coding Against Adversarial Attacks3 Nov 2025
- 2025Semantic Edge-Cloud Communication for Real-Time Urban Traffic Surveillance with ViT and LLMs over Mobile Networks25 Sep 2025
- 2025Synesthesia of Machines (SoM)-Based Task-Driven MIMO System for Image Transmission2 Sep 2025
25 more
- 2025Way to Build Native AI-driven 6G Air Interface: Principles, Roadmap, and Outlook21 Aug 2025
- 2025TOAST: Task-Oriented Adaptive Semantic Transmission over Dynamic Wireless Environments27 Jun 2025
- 2025From Large AI Models to Agentic AI: A Tutorial on Future Intelligent Communications28 May 2025
- 2025Modeling and Performance Analysis for Semantic Communications Based on Empirical Results29 Apr 2025
- 2025Multi-user Wireless Image Semantic Transmission over MIMO Multiple Access Channels18 Mar 2025
- 2025Semantic Communication in Dynamic Channel Scenarios: Collaborative Optimization of Dual-Pipeline Joint Source-Channel Coding and Personalized Federated Learning18 Mar 2025
- 2025DeepSeek-Inspired Exploration of RL-based LLMs and Synergy with Wireless Networks: A Survey13 Mar 2025
- 2025Learnable Residual-Based Latent Denoising in Semantic Communication11 Feb 2025
- 2024Efficient Semantic Communication Through Transformer-Aided Compression2 Dec 2024
- 2024Generative Semantic Communication for Joint Image Transmission and Segmentation27 Nov 2024
- 2024SC-CDM: Enhancing Quality of Image Semantic Communication with a Compact Diffusion Model3 Oct 2024
- 2024Semantic Successive Refinement: A Generative AI-aided Semantic Communication Framework31 Jul 2024
- 2024FSSC: Federated Learning of Transformer Neural Networks for Semantic Image Communication31 Jul 2024
- 2024DM-MIMO: Diffusion Models for Robust Semantic Communications over MIMO Channels7 Jul 2024
- 2024Robust Image Semantic Coding with Learnable CSI Fusion Masking over MIMO Fading Channels30 May 2024
- 2024Visual Language Model based Cross-modal Semantic Communication Systems6 May 2024
- 2024Transformer-Aided Semantic Communications2 May 2024
- 2024Diffusion-Aided Joint Source Channel Coding For High Realism Wireless Image Transmission27 Apr 2024
- 2024Interplay of Semantic Communication and Knowledge Learning18 Jan 2024
- 2024Importance-Aware Image Segmentation-based Semantic Communication for Autonomous Driving16 Jan 2024
- 2023An Efficient Federated Learning Framework for Training Semantic Communication System20 Oct 2023
- 2023CDDM: Channel Denoising Diffusion Models for Wireless Semantic Communications16 Sep 2023
- 2023Semantic Multi-Resolution Communications22 Aug 2023
- 2023Segment Anything Meets Semantic Communication3 Jun 2023
- 2023CDDM: Channel Denoising Diffusion Models for Wireless Communications16 May 2023
- 2023CDDM: Channel Denoising Diffusion Models for Wireless Semantic Communicationscited by 59
- 2023CDDM: Channel Denoising Diffusion Models for Wireless Communicationscited by 19
- 2024Diffusion-Aided Joint Source Channel Coding For High Realism Wireless Image Transmissioncited by 11
- 2024DM-MIMO: Diffusion Models for Robust Semantic Communications over MIMO Channelscited by 6
- 2024SC-CDM: Enhancing Quality of Image Semantic Communication with a Compact Diffusion Modelcited by 1
- 2024SC-CDM: Enhancing Quality of Image Semantic Communication with a Compact Diffusion Model3 Oct 2024
- 2024DM-MIMO: Diffusion Models for Robust Semantic Communications over MIMO Channels7 Jul 2024
- 2024Diffusion-Aided Joint Source Channel Coding For High Realism Wireless Image Transmission27 Apr 2024
- 2023CDDM: Channel Denoising Diffusion Models for Wireless Semantic Communications16 Sep 2023
- 2023CDDM: Channel Denoising Diffusion Models for Wireless Communications16 May 2023
- 2024Visual Language Model based Cross-modal Semantic Communication Systemscited by 12
- 2025Semantic Edge-Cloud Communication for Real-Time Urban Traffic Surveillance with ViT and LLMs over Mobile Networkscited by 3
- 2026Progressive Semantic Communication for Efficient Edge-Cloud Vision-Language Modelscited by 1
- 2026Progressive Semantic Communication for Efficient Edge-Cloud Vision-Language Models29 Apr 2026
- 2025Semantic Edge-Cloud Communication for Real-Time Urban Traffic Surveillance with ViT and LLMs over Mobile Networks25 Sep 2025
- 2024Visual Language Model based Cross-modal Semantic Communication Systems6 May 2024
- 2024Robust Image Semantic Coding with Learnable CSI Fusion Masking over MIMO Fading Channelscited by 9
- 2024Semantic Successive Refinement: A Generative AI-aided Semantic Communication Frameworkcited by 9
- 2023Segment Anything Meets Semantic Communicationcited by 8
- 2024Importance-Aware Image Segmentation-based Semantic Communication for Autonomous Drivingcited by 7
- 2024Generative Semantic Communication for Joint Image Transmission and Segmentationcited by 6
- 2025DeepSeek-Inspired Exploration of RL-based LLMs and Synergy with Wireless Networks: A Surveycited by 6
- 2023An Efficient Federated Learning Framework for Training Semantic Communication Systemcited by 5
- 2025Multi-user Wireless Image Semantic Transmission over MIMO Multiple Access Channelscited by 4
- 2024Transformer-Aided Semantic Communicationscited by 3
- 2024Efficient Semantic Communication Through Transformer-Aided Compressioncited by 3
- 2023Semantic Multi-Resolution Communicationscited by 2
- 2024FSSC: Federated Learning of Transformer Neural Networks for Semantic Image Communicationcited by 2
12 most cited of 27 All 27 (JSON)
- 2026Beyond Token Accuracy: Prioritizing What Matters for Visual Reconstruction2 Oct 2026
- 2026Foundation Models for Generalizable Semantic and Goal-Oriented Communication7 Sep 2026
- 2026Semantic-Aware Generative Image Transmission for Resource-Constrained Visual IoT Systems24 Jun 2026
- 2026Quantum Machine Learning-based 6G edge Network: Enabling Adaptive Communication and Model Aggregation18 May 2026
- 2026On Privacy-Preserving Image Transmission in Low-Altitude Networks: A Swin Transformer-Based Framework with Federated Learning12 May 2026
- 2026Scenario-Adaptive MU-MIMO OFDM Semantic Communication With Asymmetric Neural Network14 Feb 2026
- 2025Wireless Video Semantic Communication with Decoupled Diffusion Multi-frame Compensation4 Nov 2025
- 2025SecDiff: Diffusion-Aided Secure Deep Joint Source-Channel Coding Against Adversarial Attacks3 Nov 2025
- 2025Synesthesia of Machines (SoM)-Based Task-Driven MIMO System for Image Transmission2 Sep 2025
- 2025Way to Build Native AI-driven 6G Air Interface: Principles, Roadmap, and Outlook21 Aug 2025
- 2025TOAST: Task-Oriented Adaptive Semantic Transmission over Dynamic Wireless Environments27 Jun 2025
- 2025Modeling and Performance Analysis for Semantic Communications Based on Empirical Results29 Apr 2025
12 newest of 27 All 27 (JSON)