mlsanityData to 7 Oct 2026

DiT-JSCC: Rethinking Deep JSCC with Diffusion Transformers and Semantic Representations

arXiv 2601.03112 ↗First posted 6 Jan 2026eess.IV cs.CVcited by 1

On the map: Diffusion models → Diffusion for compression and wireless

Abstract (arXiv)

Generative joint source-channel coding (GJSCC) has emerged as a new Deep JSCC paradigm for achieving high-fidelity and robust image transmission under extreme wireless channel conditions, such as ultra-low bandwidth and low signal-to-noise ratio. Recent studies commonly adopt diffusion models as generative decoders, but they frequently produce visually realistic results with limited semantic consistency. This limitation stems from a fundamental mismatch between reconstruction-oriented JSCC encoders and generative decoders, as the former lack explicit semantic discriminability and fail to provide reliable conditional cues. In this paper, we propose DiT-JSCC, a novel GJSCC backbone that can jointly learn a semantics-prioritized representation encoder and a diffusion transformer (DiT) based generative decoder, our open-source project aims to promote the future research in GJSCC. Specifically, we design a semantics-detail dual-branch encoder that aligns naturally with a coarse-to-fine conditional DiT decoder, prioritizing semantic consistency under extreme channel conditions. Moreover, a training-free adaptive bandwidth allocation strategy inspired by Kolmogorov complexity is introduced to further improve the transmission efficiency, thereby indeed redefining the notion of information value in the era of generative decoding. Extensive experiments demonstrate that DiT-JSCC consistently outperforms existing JSCC methods in both semantic consistency and visual quality, particularly in extreme regimes.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Diffusion for compression and wireless, one of 14 directions in Diffusion models. Builds on 39 of its 50 references that are in the map. First posted on arXiv 6 Jan 2026.

Builds on

39 of 50 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Semantics-Guided Diffusion for Deep Joint Source-Channel Coding in Wireless Image Transmission2 Jan
  2. 2024Towards Extreme Image Compression with Latent Feature Guidance and Diffusion Prior29 Apr
  3. 2024Diffusion-Aided Joint Source Channel Coding For High Realism Wireless Image Transmission27 Apr
  4. 2023CDDM: Channel Denoising Diffusion Models for Wireless Semantic Communications16 Sep

Other references · 35

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  6. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  7. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  8. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  9. 2022Scalable Diffusion Models with Transformerscited by 5,931
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  11. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  12. 2025DINOv3cited by 1,297
23 more
  1. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
  2. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
  3. 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 707
  4. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 666
  5. 2022All are Worth Words: A ViT Backbone for Diffusion Modelscited by 498
  6. 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 376
  7. 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 322
  8. 2025REPA-E: Unlocking VAE for End-to-End Tuning with Latent Diffusion Transformerscited by 212
  9. 2019Rethinking Lossy Compression: The Rate-Distortion-Perception Tradeoffcited by 207
  10. 2019Seeing What a GAN Cannot Generatecited by 148
  11. 2024PIXART-δ: Fast and Controllable Image Generation with Latent Consistency Modelscited by 139
  12. 2023Towards image compression with perfect realism at ultra-low bitratescited by 99
  13. 2019DeepJSCC-f: Deep Joint Source-Channel Coding of Images with Feedbackcited by 95
  14. 2025What matters for Representation Alignment: Global Information or Spatial Structure?cited by 76
  15. 2021Nonlinear Transform Source-Channel Coding for Semantic Communicationscited by 73
  16. 2022Generative Joint Source-Channel Coding for Semantic Image Transmissioncited by 55
  17. 2021Universal Rate-Distortion-Perception Representations for Lossy Compressioncited by 46
  18. 2023SwinJSCC: Taming Swin Transformer for Deep Joint Source-Channel Codingcited by 43
  19. 2020Bandwidth-Agile Image Transmission with Deep Joint Source-Channel Codingcited by 42
  20. 2021OFDM-guided Deep Joint Source Channel Coding for Wireless Multipath Fading Channelscited by 24
  21. 2023A Hybrid Wireless Image Transmission Scheme with Diffusioncited by 12
  22. 2024DiffCom: Channel Received Signal is a Natural Condition to Guide Diffusion Posterior Samplingcited by 10
  23. 2023Improved Nonlinear Transform Source-Channel Coding to Catalyze Semantic Communicationscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025SING: Semantic Image Communications using Null-Space and INN-Guided Diffusion Models
  2. 2024Rate-Adaptive Generative Semantic Communication Using Conditional Diffusion Models
  3. 2023High Perceptual Quality Wireless Image Delivery with Denoising Diffusion Models
  4. 2024MambaJSCC: Adaptive Deep Joint Source-Channel Coding with Generalized State Space Model
  5. 2024SC-CDM: Enhancing Quality of Image Semantic Communication with a Compact Diffusion Model
  6. 2026Optimally Bridging Semantics and Data: Generative Semantic Communication via Schr"odinger Bridge
  7. 2025Latent Feature-Guided Conditional Diffusion for Generative Image Semantic Communication ↗
  8. 2024Goal-Oriented Semantic Communication for Wireless Image Transmission via Stable Diffusion