Beyond the Visible: Jointly Attending to Spectral and Spatial Dimensions with HSI-Diffusion for the FINCH Spacecraft
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
Satellite remote sensing missions have gained popularity over the past fifteen years due to their ability to cover large swaths of land at regular intervals, making them ideal for monitoring environmental trends. The FINCH mission, a 3U+ CubeSat equipped with a hyperspectral camera, aims to monitor crop residue cover in agricultural fields. Although hyperspectral imaging captures both spectral and spatial information, it is prone to various types of noise, including random noise, stripe noise, and dead pixels. Effective denoising of these images is crucial for downstream scientific tasks. Traditional methods, including hand-crafted techniques encoding strong priors, learned 2D image denoising methods applied across different hyperspectral bands, or diffusion generative models applied independently on bands, often struggle with varying noise strengths across spectral bands, leading to significant spectral distortion. This paper presents a novel approach to hyperspectral image denoising using latent diffusion models that integrate spatial and spectral information. We particularly do so by building a 3D diffusion model and presenting a 3-stage training approach on real and synthetically crafted datasets. The proposed method preserves image structure while reducing noise. Evaluations on both popular hyperspectral denoising datasets and synthetically crafted datasets for the FINCH mission demonstrate the effectiveness of this approach.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 29 of its 83 references that are in the map. First posted on arXiv 15 Jun 2024.
Builds on
29 of 83 references.
Closest ancestors · 4
Same direction, newest first
- 2023DiffuseRAW: End-to-End Generative RAW Image Processing for Low-Light Images13 Dec
- 2023Denoising Diffusion Models for Plug-and-Play Image Restoration15 May
- 2023SpectralDiff: A Generative Framework for Hyperspectral Image Classification with Diffusion Models12 Apr
- 2022Denoising Diffusion Restoration Models27 Jan
Other references · 25
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
- 2019Controllable Text-to-Image Generationcited by 187
- 2022SinDDM: A Single Image Denoising Diffusion Modelcited by 60
- 2018Hyperspectral Image Denoising Employing a Spatial-Spectral Deep Residual Convolutional Neural Networkcited by 51
13 more
- 2020Non-local Meets Global: An Iterative Paradigm for Hyperspectral Image Restorationcited by 43
- 2018Non-local Meets Global: An Integrated Paradigm for Hyperspectral Denoisingcited by 39
- 2021Fast Hyperspectral Image Denoising and Inpainting Based on Low-Rank and Sparse Representationscited by 39
- 2023Spectral Enhanced Rectangle Transformer for Hyperspectral Image Denoisingcited by 35
- 2021A Trainable Spectral-Spatial Sparse Coding Model for Hyperspectral Image Restorationcited by 34
- 2022Spatial-Spectral Transformer for Hyperspectral Image Denoisingcited by 34
- 2024SSUMamba: Spatial-Spectral Selective State Space Model for Hyperspectral Image Denoisingcited by 20
- 2021FastHyMix: Fast and Parameter-free Hyperspectral Image Mixed Noise Removalcited by 19
- 2023Hybrid Spectral Denoising Transformer with Guided Attentioncited by 16
- 2018Hybrid Noise Removal in Hyperspectral Imagery With a Spatial-Spectral Gradient Networkcited by 14
- 2023Mixed Attention Network for Hyperspectral Image Denoisingcited by 8
- 2023Hyperspectral Image Denoising via Spatial-Spectral Recurrent Transformercited by 6
- 2023Multi-scale Adaptive Fusion Network for Hyperspectral Image Denoisingcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Diffusion Models for Hyperspectral Image Analysis: A Comprehensive Review
- 2023TDiffDe: A Truncated Diffusion Model for Remote Sensing Hyperspectral Image Denoising
- 2026AnyBand-Diff: A Unified Remote Sensing Image Generation and Band Repair Framework with Spectral Priors
- 2023Hyperspectral and Multispectral Image Fusion Using the Conditional Denoising Diffusion Probabilistic Model
- 2025Diffusion model for gradient preconditioning in hyperspectral imaging inverse problems
- 2025Label-Efficient Hyperspectral Image Classification via Spectral FiLM Modulation of Low-Level Pretrained Diffusion Features
- 2026InfScene-SR: Seamless Super-Resolution of Arbitrarily Large Remote-Sensing Scenes via Variance-Preserving Joint Denoising
- 2023DiffusionSat: A Generative Foundation Model for Satellite Imagery