# Mixed Attention Network for Hyperspectral Image Denoising

arXiv: https://arxiv.org/abs/2301.11525 · HTML: https://mlsanity.com/paper/2301.11525/

## Key facts

- Cited by 8 papers in the map (data through 14 Oct 2026).
- Builds on 15 of its 46 references that are in the map.
- First posted on arXiv 27 Jan 2023.

## Builds on (most cited first, 15 of 15)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [Squeeze-and-Excitation Networks](https://mlsanity.com/paper/1709.01507/) (2017)
- [Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising](https://mlsanity.com/paper/1608.03981/) (2016)
- [Uformer: A General U-Shaped Transformer for Image Restoration](https://mlsanity.com/paper/2106.03106/) (2021)
- [FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoising](https://mlsanity.com/paper/1710.04026/) (2017)
- [Plug-and-Play ADMM for Image Restoration: Fixed Point Convergence and Applications](https://mlsanity.com/paper/1605.01710/) (2016)
- [Hyperspectral Image Restoration via Total Variation Regularized Low-rank Tensor Decomposition](https://mlsanity.com/paper/1707.02477/) (2017)
- [Hyperspectral Image Denoising Employing a Spatial-Spectral Deep Residual Convolutional Neural Network](https://mlsanity.com/paper/1806.00183/) (2018)
- [3D Quasi-Recurrent Neural Network for Hyperspectral Image Denoising](https://mlsanity.com/paper/2003.04547/) (2020)
- [Non-local Meets Global: An Integrated Paradigm for Hyperspectral Denoising](https://mlsanity.com/paper/1812.04243/) (2018)
- [A Trainable Spectral-Spatial Sparse Coding Model for Hyperspectral Image Restoration](https://mlsanity.com/paper/2111.09708/) (2021)
- [Weighted Low-rank Tensor Recovery for Hyperspectral Image Restoration](https://mlsanity.com/paper/1709.00192/) (2017)
- [Denoising Hyperspectral Image with Non-i.i.d. Noise Structure](https://mlsanity.com/paper/1702.00098/) (2017)
- [Deep Plug-and-Play Prior for Hyperspectral Image Restoration](https://mlsanity.com/paper/2209.08240/) (2022)

## Built on by (most cited first, 8 of 8)

- [Hybrid Spectral Denoising Transformer with Guided Attention](https://mlsanity.com/paper/2303.09040/) (2023)
- [A Comparison of Image Denoising Methods](https://mlsanity.com/paper/2304.08990/) (2023)
- [HSIDMamba: Exploring Bidirectional State-Space Models for Hyperspectral Denoising](https://mlsanity.com/paper/2404.09697/) (2024)
- [Degradation-Noise-Aware Deep Unfolding Transformer for Hyperspectral Image Denoising](https://mlsanity.com/paper/2305.04047/) (2023)
- [Image Denoising Using Green Channel Prior](https://mlsanity.com/paper/2408.05923/) (2024)
- [Color Image Denoising Using The Green Channel Prior](https://mlsanity.com/paper/2402.08235/) (2024)
- [Hyperspectral Image Denoising via Self-Modulating Convolutional Neural Networks](https://mlsanity.com/paper/2309.08197/) (2023)
- [Beyond the Visible: Jointly Attending to Spectral and Spatial Dimensions with HSI-Diffusion for the FINCH Spacecraft](https://mlsanity.com/paper/2406.10724/) (2024)

## Abstract (arXiv)

Hyperspectral image denoising is unique for the highly similar and correlated spectral information that should be properly considered. However, existing methods show limitations in exploring the spectral correlations across different bands and feature interactions within each band. Besides, the low- and high-level features usually exhibit different importance for different spatial-spectral regions, which is not fully explored for current algorithms as well. In this paper, we present a Mixed Attention Network (MAN) that simultaneously considers the inter- and intra-spectral correlations as well as the interactions between low- and high-level spatial-spectral meaningful features. Specifically, we introduce a multi-head recurrent spectral attention that efficiently integrates the inter-spectral features across all the spectral bands. These features are further enhanced with a progressive spectral channel attention by exploring the intra-spectral relationships. Moreover, we propose an attentive skip-connection that adaptively controls the proportion of the low- and high-level spatial-spectral features from the encoder and decoder to better enhance the aggregated features. Extensive experiments show that our MAN outperforms existing state-of-the-art methods on simulated and real noise settings while maintaining a low cost of parameters and running time.