Dense residual Transformer for image denoising
Not on the map. Why?
Abstract (arXiv)
Image denoising is an important low-level computer vision task, which aims to reconstruct a noise-free and high-quality image from a noisy image. With the development of deep learning, convolutional neural network (CNN) has been gradually applied and achieved great success in image denoising, image compression, image enhancement, etc. Recently, Transformer has been a hot technique, which is widely used to tackle computer vision tasks. However, few Transformer-based methods have been proposed for low-level vision tasks. In this paper, we proposed an image denoising network structure based on Transformer, which is named DenSformer. DenSformer consists of three modules, including a preprocessing module, a local-global feature extraction module, and a reconstruction module. Specifically, the local-global feature extraction module consists of several Sformer groups, each of which has several ETransformer layers and a convolution layer, together with a residual connection. These Sformer groups are densely skip-connected to fuse the feature of different layers, and they jointly capture the local and global information from the given noisy images. We conduct our model on comprehensive experiments. Experimental results prove that our DenSformer achieves improvement compared to some state-of-the-art methods, both for the synthetic noise data and real noise data, in the objective and subjective evaluations.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 36 of its 45 references that are in the map. First posted on arXiv 14 May 2022.
Builds on
36 of 45 references.
References · 36
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,552
- 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,369
- 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,358
24 more
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,222
- 2020Pre-Trained Image Processing Transformercited by 893
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 866
- 2021Multi-Stage Progressive Image Restorationcited by 816
- 2019Stand-Alone Self-Attention in Vision Modelscited by 542
- 2017FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoisingcited by 510
- 2017Learning Deep CNN Denoiser Prior for Image Restorationcited by 408
- 2021Early Convolutions Help Transformers See Bettercited by 396
- 2018Deep Learning for Generic Object Detection: A Surveycited by 392
- 2020Learning Enriched Features for Real Image Restoration and Enhancementcited by 312
- 2018Toward Convolutional Blind Denoising of Real Photographscited by 274
- 2017MemNet: A Persistent Memory Network for Image Restorationcited by 244
- 2021LocalViT: Analyzing Locality in Vision Transformerscited by 228
- 2021Scaling Local Self-Attention for Parameter Efficient Visual Backbonescited by 220
- 2017Benchmarking Denoising Algorithms with Real Photographscited by 209
- 2015Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restorationcited by 195
- 2018Multi-level Wavelet-CNN for Image Restorationcited by 184
- 2018Residual Dense Network for Image Restorationcited by 181
- 2019Real Image Denoising with Feature Attentioncited by 176
- 2019Variational Denoising Network: Toward Blind Noise Modeling and Removalcited by 117
- 2018Neural Nearest Neighbors Networkscited by 98
- 2020Spatial-Adaptive Network for Single Image Denoisingcited by 64
- 2022Detail-Preserving Transformer for Light Field Image Super-Resolutioncited by 26
- 2016Generalized Deep Image to Image Regressioncited by 14
Built on by
Citing papers per year: 2023: 3; 2024: 1; 2025: 2.
6 papers.
- 2023Image Denoising: The Deep Learning Revolution and Beyond -- A Survey Paper --cited by 71
- 2023GridFormer: Residual Dense Transformer with Grid Structure for Image Restoration in Adverse Weather Conditionscited by 62
- 2025Fast, Accurate Manifold Denoising by Tunneling Riemannian Optimizationcited by 1
- 2025Mathematical Modeling and Convergence Analysis of Deep Neural Networks with Dense Layer Connectivities in Deep Learningcited by 1
- 2023Sparsity and Coefficient Permutation Based Two-Domain AMP for Image Block Compressed Sensingcited by 0
- 2024Deep Learning CT Image Restoration using System Blur and Noise Modelscited by 0
- 2025Mathematical Modeling and Convergence Analysis of Deep Neural Networks with Dense Layer Connectivities in Deep Learning2 Oct 2025
- 2025Fast, Accurate Manifold Denoising by Tunneling Riemannian Optimization24 Feb 2025
- 2024Deep Learning CT Image Restoration using System Blur and Noise Models20 Jul 2024
- 2023GridFormer: Residual Dense Transformer with Grid Structure for Image Restoration in Adverse Weather Conditions29 May 2023
- 2023Sparsity and Coefficient Permutation Based Two-Domain AMP for Image Block Compressed Sensing22 May 2023
- 2023Image Denoising: The Deep Learning Revolution and Beyond -- A Survey Paper --9 Jan 2023