mlsanityData to 7 Oct 2026

HIR-Diff: Unsupervised Hyperspectral Image Restoration Via Improved Diffusion Models

arXiv 2402.15865 ↗First posted 24 Feb 2024cs.CV eess.IVcited by 38

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Hyperspectral image (HSI) restoration aims at recovering clean images from degraded observations and plays a vital role in downstream tasks. Existing model-based methods have limitations in accurately modeling the complex image characteristics with handcraft priors, and deep learning-based methods suffer from poor generalization ability. To alleviate these issues, this paper proposes an unsupervised HSI restoration framework with pre-trained diffusion model (HIR-Diff), which restores the clean HSIs from the product of two low-rank components, i.e., the reduced image and the coefficient matrix. Specifically, the reduced image, which has a low spectral dimension, lies in the image field and can be inferred from our improved diffusion model where a new guidance function with total variation (TV) prior is designed to ensure that the reduced image can be well sampled. The coefficient matrix can be effectively pre-estimated based on singular value decomposition (SVD) and rank-revealing QR (RRQR) factorization. Furthermore, a novel exponential noise schedule is proposed to accelerate the restoration process (about 5× acceleration for denoising) with little performance decrease. Extensive experimental results validate the superiority of our method in both performance and speed on a variety of HSI restoration tasks, including HSI denoising, noisy HSI super-resolution, and noisy HSI inpainting. The code is available at https://github.com/LiPang/HIRDiff.

Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 31 of its 54 references that are in the map. First posted on arXiv 24 Feb 2024.

Builds on

31 of 54 references.

Closest ancestors · 5

Same direction, newest first

  1. 2023Generative Diffusion Prior for Unified Image Restoration and Enhancement3 Apr
  2. 2023DDS2M: Self-Supervised Denoising Diffusion Spatio-Spectral Model for Hyperspectral Image Restoration12 Mar
  3. 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Model1 Dec
  4. 2022Diffusion Posterior Sampling for General Noisy Inverse Problems29 Sep
  5. 2022Denoising Diffusion Restoration Models27 Jan

Other references · 26

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2020Denoising Diffusion Implicit Modelscited by 9,655
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  4. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  5. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  6. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  7. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
  8. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
  9. 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
  10. 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
  11. 2023Universal Guidance for Diffusion Modelscited by 426
  12. 2022FastDiff: A Fast Conditional Diffusion Model for High-Quality Speech Synthesiscited by 136
14 more
  1. 2018Tensor Robust Principal Component Analysis with A New Tensor Nuclear Normcited by 110
  2. 2017Hyperspectral Image Restoration via Total Variation Regularized Low-rank Tensor Decompositioncited by 61
  3. 2020Learning Spatial-Spectral Prior for Super-Resolution of Hyperspectral Imagerycited by 47
  4. 2018Tensor Ring Decomposition with Rank Minimization on Latent Space: An Efficient Approach for Tensor Completioncited by 42
  5. 2018Non-local Meets Global: An Integrated Paradigm for Hyperspectral Denoisingcited by 39
  6. 2019Deep Hyperspectral Prior: Denoising, Inpainting, Super-Resolutioncited by 36
  7. 2023Spectral Enhanced Rectangle Transformer for Hyperspectral Image Denoisingcited by 35
  8. 2021A Trainable Spectral-Spatial Sparse Coding Model for Hyperspectral Image Restorationcited by 34
  9. 2022Spatial-Spectral Transformer for Hyperspectral Image Denoisingcited by 34
  10. 2021A review of machine learning in processing remote sensing data for mineral explorationcited by 16
  11. 2021Self-Supervised Nonlinear Transform-Based Tensor Nuclear Norm for Multi-Dimensional Image Recoverycited by 16
  12. 2022Fast Noise Removal in Hyperspectral Images via Representative Coefficient Total Variationcited by 13
  13. 2016Low-rank Matrix Factorization under General Mixture Noise Distributionscited by 11
  14. 2022Deep Posterior Distribution-based Embedding for Hyperspectral Image Super-resolutioncited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 6; 2025: 18; 2026: 14.

38 papers.

Sort:

By area:

  1. 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trendscited by 58
  2. 2024Diffusion Models Meet Remote Sensing: Principles, Methods, and Perspectivescited by 27
  3. 2024HSIGene: A Foundation Model For Hyperspectral Image Generationcited by 21
  4. 2025Can Generative Geospatial Diffusion Models Excel as Discriminative Geospatial Foundation Models?cited by 10
  5. 2025Real Noise Decoupling for Hyperspectral Image Denoisingcited by 7
  6. 2025MP-HSIR: A Multi-Prompt Framework for Universal Hyperspectral Image Restorationcited by 6
  7. 2025Benchmarking Self-Supervised Learning Methods for Accelerated MRI Reconstructioncited by 4
  8. 2024Hipandas: Hyperspectral Image Joint Denoising and Super-Resolution by Image Fusion with the Panchromatic Imagecited by 3
  9. 2024Reblurring-Guided Single Image Defocus Deblurring: A Learning Framework with Misaligned Training Pairscited by 2
  10. 2025COP-GEN-Beta: Unified Generative Modelling of COPernicus Imagery Thumbnailscited by 2
  11. 2025Cross-Frequency Implicit Neural Representation with Self-Evolving Parameterscited by 2
  12. 2025Diffusion Models for Hyperspectral Image Analysis: A Comprehensive Reviewcited by 2
26 more
  1. 2025Hyperspectral Anomaly Detection Fused Unified Nonconvex Tensor Ring Factors Regularizationcited by 2
  2. 2025A Comprehensive Review of Diffusion Models in Smart Agriculture: Progress, Applications, and Challengescited by 2
  3. 2024Filterless Snapshot Hyperspectral Imaging using Guided Patch Diffusioncited by 1
  4. 2025GEWDiff: Geometric Enhanced Wavelet-based Diffusion Model for Hyperspectral Image Super-resolutioncited by 1
  5. 2025Label-Efficient Hyperspectral Image Classification via Spectral FiLM Modulation of Low-Level Pretrained Diffusion Featurescited by 1
  6. 2025Degradation-Aware Metric Prompting for Hyperspectral Image Restorationcited by 1
  7. 2026SHARE: A Fully Unsupervised Framework for Single Hyperspectral Image Restorationcited by 1
  8. 2026HSI-VAR: Rethinking Hyperspectral Restoration through Spatial-Spectral Visual Autoregressioncited by 1
  9. 2026COP-GEN: Latent Diffusion Transformer for Copernicus Earth Observation Datacited by 1
  10. 2026Task-Guided Prompting for Unified Remote Sensing Image Restorationcited by 1
  11. 2026Leveraging pretrained RGB denoisers for hyperspectral image restorationcited by 1
  12. 2025From Image- to Pixel-level: Label-efficient Hyperspectral Image Reconstructioncited by 0
  13. 20253DeepRep: 3D Deep Low-rank Tensor Representation for Hyperspectral Image Inpaintingcited by 0
  14. 2025Compressive Imaging Reconstruction via Tensor Decomposed Multi-Resolution Grid Encodingcited by 0
  15. 2025RGB Pre-Training Enhanced Unobservable Feature Latent Diffusion Model for Spectral Reconstructioncited by 0
  16. 2025Tensor Completion via Monotone Inclusion: Generalized Low-Rank Priors Meet Deep Denoiserscited by 0
  17. 2025Uncertainty Quantification in HSI Reconstruction using Physics-Aware Diffusion Priors and Optics-Encoded Measurementscited by 0
  18. 2026Correcting Spectra Outside the Backbone: A Model-Agnostic Rectifier for Hyperspectral Image Super-Resolutioncited by 0
  19. 2026Voronoi-guided Bilateral 2D Gaussian Splatting for Arbitrary-Scale Hyperspectral Image Super-Resolutioncited by 0
  20. 2026Semi-Supervised Flow Matching for Mosaiced and Panchromatic Fusion Imagingcited by 0
  21. 2026HIR-ALIGN: Enhancing Hyperspectral Image Restoration via Diffusion-Based Data Generationcited by 0
  22. 2026A Non-Reference Diffusion-Based Restoration Framework for Landsat 7 ETM+ SLC-off Imagery in Antarcticacited by 0
  23. 2026USP-Mamba: Unmixing-Derived Spectral and Structural Prompting for Hyperspectral Image Super-Resolutioncited by 0
  24. 2026Dual Modality Prompted Diffusion Priors for Zero Shot Hyperspectral Pansharpeningcited by 0
  25. 2026Hyperspectral Diffusion Equivariant Imaging (HyDiff-EI): A Self-supervised Framework for Hyperspectral Image Inpaintingcited by 0
  26. 2026Pre-Trained Low-Rank Tensor Decomposition for Multi-Dimensional Image Recoverycited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023HSR-Diff:Hyperspectral Image Super-Resolution via Conditional Diffusion Models
  2. 2025Learning Spectral Diffusion Prior for Hyperspectral Image Reconstruction
  3. 2025Self-Learning Hyperspectral and Multispectral Image Fusion via Adaptive Residual Guided Subspace Diffusion Model
  4. 2023Hyperspectral and Multispectral Image Fusion Using the Conditional Denoising Diffusion Probabilistic Model
  5. 2023SpectralDiff: A Generative Framework for Hyperspectral Image Classification with Diffusion Models
  6. 2026R2H-Diff: Guided Spectral Diffusion Model for RGB-to-Hyperspectral Reconstruction
  7. 2023A Spectral Diffusion Prior for Hyperspectral Image Super-Resolution
  8. 2025Diffusion model for gradient preconditioning in hyperspectral imaging inverse problems