mlsanityData to 7 Oct 2026

Degradation-Noise-Aware Deep Unfolding Transformer for Hyperspectral Image Denoising

arXiv 2305.04047 ↗First posted 6 May 2023eess.IV cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

Hyperspectral imaging (HI) has emerged as a powerful tool in diverse fields such as medical diagnosis, industrial inspection, and agriculture, owing to its ability to detect subtle differences in physical properties through high spectral resolution. However, hyperspectral images (HSIs) are often quite noisy because of narrow band spectral filtering. To reduce the noise in HSI data cubes, both model-driven and learning-based denoising algorithms have been proposed. However, model-based approaches rely on hand-crafted priors and hyperparameters, while learning-based methods are incapable of estimating the inherent degradation patterns and noise distributions in the imaging procedure, which could inform supervised learning. Secondly, learning-based algorithms predominantly rely on CNN and fail to capture long-range dependencies, resulting in limited interpretability. This paper proposes a Degradation-Noise-Aware Unfolding Network (DNA-Net) that addresses these issues. Firstly, DNA-Net models sparse noise, Gaussian noise, and explicitly represent image prior using transformer. Then the model is unfolded into an end-to-end network, the hyperparameters within the model are estimated from the noisy HSI and degradation model and utilizes them to control each iteration. Additionally, we introduce a novel U-Shaped Local-Non-local-Spectral Transformer (U-LNSA) that captures spectral correlation, local contents, and non-local dependencies simultaneously. By integrating U-LNSA into DNA-Net, we present the first Transformer-based deep unfolding HSI denoising method. Experimental results show that DNA-Net outperforms state-of-the-art methods, and the modeling of noise distributions helps in cases with heavy noise.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 41 of its 97 references that are in the map. First posted on arXiv 6 May 2023.

Builds on

41 of 97 references.

References · 41

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  5. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  6. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  7. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  8. 2021ViViT: A Video Vision Transformercited by 1,610
  9. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
  10. 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,218
  11. 2020Pre-Trained Image Processing Transformercited by 891
  12. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
29 more
  1. 2017FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoisingcited by 509
  2. 2020Deep Unfolding Network for Image Super-Resolutioncited by 253
  3. 2016Plug-and-Play ADMM for Image Restoration: Fixed Point Convergence and Applicationscited by 244
  4. 2017MemNet: A Persistent Memory Network for Image Restorationcited by 244
  5. 2021Associating Objects with Transformers for Video Object Segmentationcited by 225
  6. 2020TransPose: Keypoint Localization via Transformercited by 126
  7. 2021Mask-guided Spectral-wise Transformer for Efficient Hyperspectral Image Reconstructioncited by 110
  8. 2021TokenPose: Learning Keypoint Tokens for Human Pose Estimationcited by 106
  9. 2022Degradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive Imagingcited by 66
  10. 2017Hyperspectral Image Restoration via Total Variation Regularized Low-rank Tensor Decompositioncited by 61
  11. 2018Hyperspectral Image Denoising Employing a Spatial-Spectral Deep Residual Convolutional Neural Networkcited by 51
  12. 20203D Quasi-Recurrent Neural Network for Hyperspectral Image Denoisingcited by 44
  13. 2018Non-local Meets Global: An Integrated Paradigm for Hyperspectral Denoisingcited by 39
  14. 2021Fast Hyperspectral Image Denoising and Inpainting Based on Low-Rank and Sparse Representationscited by 39
  15. 2023Spectral Enhanced Rectangle Transformer for Hyperspectral Image Denoisingcited by 35
  16. 2021A Trainable Spectral-Spatial Sparse Coding Model for Hyperspectral Image Restorationcited by 34
  17. 2023DDS2M: Self-Supervised Denoising Diffusion Spatio-Spectral Model for Hyperspectral Image Restorationcited by 32
  18. 2017Weighted Low-rank Tensor Recovery for Hyperspectral Image Restorationcited by 30
  19. 2022RFormer: Transformer-based Generative Adversarial Network for Real Fundus Image Restoration on A New Clinical Benchmarkcited by 24
  20. 2017Denoising Hyperspectral Image with Non-i.i.d. Noise Structurecited by 23
  21. 2022Deep Plug-and-Play Prior for Hyperspectral Image Restorationcited by 22
  22. 2018Tensor N-tubal rank and its convex relaxation for low-rank tensor recoverycited by 19
  23. 2021FastHyMix: Fast and Parameter-free Hyperspectral Image Mixed Noise Removalcited by 19
  24. 2020SMDS-Net: Model Guided Spectral-Spatial Network for Hyperspectral Image Denoisingcited by 12
  25. 2020Hyperspectral Image Denoising via Global Spatial-Spectral Total Variation Regularized Nonconvex Local Low-Rank Tensor Approximationcited by 10
  26. 2023Mixed Attention Network for Hyperspectral Image Denoisingcited by 8
  27. 2022HyDe: The First Open-Source, Python-Based, GPU-Accelerated Hyperspectral Denoising Packagecited by 3
  28. 2022Low-rank Meets Sparseness: An Integrated Spatial-Spectral Total Variation Approach to Hyperspectral Denoisingcited by 1
  29. 2022A Data-driven Loss Weighting Scheme across Heterogeneous Tasks for Image Denoisingcited by 1

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 4.

5 papers.