mlsanityData to 14 Oct 2026

Dense residual Transformer for image denoising

arXiv 2205.06944 ↗First posted 14 May 2022cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

Image denoising is an important low-level computer vision task, which aims to reconstruct a noise-free and high-quality image from a noisy image. With the development of deep learning, convolutional neural network (CNN) has been gradually applied and achieved great success in image denoising, image compression, image enhancement, etc. Recently, Transformer has been a hot technique, which is widely used to tackle computer vision tasks. However, few Transformer-based methods have been proposed for low-level vision tasks. In this paper, we proposed an image denoising network structure based on Transformer, which is named DenSformer. DenSformer consists of three modules, including a preprocessing module, a local-global feature extraction module, and a reconstruction module. Specifically, the local-global feature extraction module consists of several Sformer groups, each of which has several ETransformer layers and a convolution layer, together with a residual connection. These Sformer groups are densely skip-connected to fuse the feature of different layers, and they jointly capture the local and global information from the given noisy images. We conduct our model on comprehensive experiments. Experimental results prove that our DenSformer achieves improvement compared to some state-of-the-art methods, both for the synthetic noise data and real noise data, in the objective and subjective evaluations.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 36 of its 45 references that are in the map. First posted on arXiv 14 May 2022.

Builds on

36 of 45 references.

References · 36

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  5. 2020End-to-End Object Detection with Transformerscited by 7,414
  6. 2016Densely Connected Convolutional Networkscited by 6,720
  7. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  8. 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
  9. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  10. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,552
  11. 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,369
  12. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,358
24 more
  1. 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,222
  2. 2020Pre-Trained Image Processing Transformercited by 893
  3. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 866
  4. 2021Multi-Stage Progressive Image Restorationcited by 816
  5. 2019Stand-Alone Self-Attention in Vision Modelscited by 542
  6. 2017FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoisingcited by 510
  7. 2017Learning Deep CNN Denoiser Prior for Image Restorationcited by 408
  8. 2021Early Convolutions Help Transformers See Bettercited by 396
  9. 2018Deep Learning for Generic Object Detection: A Surveycited by 392
  10. 2020Learning Enriched Features for Real Image Restoration and Enhancementcited by 312
  11. 2018Toward Convolutional Blind Denoising of Real Photographscited by 274
  12. 2017MemNet: A Persistent Memory Network for Image Restorationcited by 244
  13. 2021LocalViT: Analyzing Locality in Vision Transformerscited by 228
  14. 2021Scaling Local Self-Attention for Parameter Efficient Visual Backbonescited by 220
  15. 2017Benchmarking Denoising Algorithms with Real Photographscited by 209
  16. 2015Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restorationcited by 195
  17. 2018Multi-level Wavelet-CNN for Image Restorationcited by 184
  18. 2018Residual Dense Network for Image Restorationcited by 181
  19. 2019Real Image Denoising with Feature Attentioncited by 176
  20. 2019Variational Denoising Network: Toward Blind Noise Modeling and Removalcited by 117
  21. 2018Neural Nearest Neighbors Networkscited by 98
  22. 2020Spatial-Adaptive Network for Single Image Denoisingcited by 64
  23. 2022Detail-Preserving Transformer for Light Field Image Super-Resolutioncited by 26
  24. 2016Generalized Deep Image to Image Regressioncited by 14

Built on by

Cited by year

Citing papers per year: 2023: 3; 2024: 1; 2025: 2.

6 papers.