mlsanityData to 14 Oct 2026

HIR-ALIGN: Enhancing Hyperspectral Image Restoration via Diffusion-Based Data Generation

arXiv 2605.13581 ↗First posted 13 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Hyperspectral image (HSI) restoration is crucial for reliable analysis, as real-world HSIs suffer from noise, blur, and resolution loss. However, existing models trained on source data often fail on target domains lacking clean references, a common real-world scenario. To address this, we present HIR-ALIGN, a plug-and-play target-adaptive augmentation framework that enhances HSI restoration by augmenting limited training images with synthetic data matching the target distribution, without extra clean target-domain HSI data. It has three stages: (i) proxy generation, where off-the-shelf restoration models are applied to degraded target observations to produce semantics-preserving proxy HSIs that approximate clean target-domain images; (ii) distribution-adaptive synthesis, where a blur-robust unCLIP diffusion model generates target-aligned RGBs from proxy RGBs with prompt conditioning and embedding-space noise initialization. The warp-based spectral transfer module then synthesizes HSIs by aligning each generated RGB with its proxy RGB, estimating soft patch-wise transport weights, and applying these weights and learnable local interpolation kernels to the proxy HSI; and (iii) aligned supervised finetuning, where restoration networks pretrained on the source distribution are finetuned with proxy HSIs and synthesized target-aligned HSIs, then deployed on degraded target images. We also provide theoretical analysis showing that, under stated assumptions, the proposed augmentation-based finetuning obtains a tighter target-domain restoration-risk upper bound by jointly improving target-distribution coverage and controlling spectral bias. Experiments on simulated and real datasets across denoising, super-resolution, and other restoration tasks demonstrate that HIR-ALIGN is superior to proxy-only target-adaptation baselines and outperforms representative unsupervised methods in most cases.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 77 references that are in the map. First posted on arXiv 13 May 2026.

Builds on

40 of 77 references.

References · 40

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  7. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  9. 2022Scalable Diffusion Models with Transformerscited by 6,054
  10. 2022Classifier-Free Diffusion Guidancecited by 5,847
  11. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  12. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
28 more
  1. 2017Billion-scale similarity search with GPUscited by 2,497
  2. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  3. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
  4. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
  5. 2017Deep Image Priorcited by 1,098
  6. 2017Hyperspectral Image Restoration via Total Variation Regularized Low-rank Tensor Decompositioncited by 61
  7. 2024CRS-Diff: Controllable Remote Sensing Image Generation with Diffusion Modelcited by 55
  8. 2024HIR-Diff: Unsupervised Hyperspectral Image Restoration Via Improved Diffusion Modelscited by 39
  9. 2019Deep Hyperspectral Prior: Denoising, Inpainting, Super-Resolutioncited by 36
  10. 2023Spectral Enhanced Rectangle Transformer for Hyperspectral Image Denoisingcited by 35
  11. 2024AeroGen: Enhancing Remote Sensing Object Detection with Diffusion-Driven Data Generationcited by 35
  12. 2021A Trainable Spectral-Spatial Sparse Coding Model for Hyperspectral Image Restorationcited by 34
  13. 2023HSR-Diff:Hyperspectral Image Super-Resolution via Conditional Diffusion Modelscited by 31
  14. 2021Image Restoration for Remote Sensing: Overview and Toolboxcited by 26
  15. 2017Denoising Hyperspectral Image with Non-i.i.d. Noise Structurecited by 23
  16. 2023ESSAformer: Efficient Transformer for Hyperspectral Image Super-resolutioncited by 23
  17. 2024HSIGene: A Foundation Model For Hyperspectral Image Generationcited by 22
  18. 2024SSUMamba: Spatial-Spectral Selective State Space Model for Hyperspectral Image Denoisingcited by 20
  19. 2021FastHyMix: Fast and Parameter-free Hyperspectral Image Mixed Noise Removalcited by 19
  20. 2018Hyperspectral Image Dataset for Benchmarking on Salient Object Detectioncited by 17
  21. 2024A Dynamic Kernel Prior Model for Unsupervised Blind Image Super-Resolutioncited by 15
  22. 2022Uncertainty-Aware Unsupervised Image Deblurring with Deep Residual Priorcited by 14
  23. 2022Fast Noise Removal in Hyperspectral Images via Representative Coefficient Total Variationcited by 14
  24. 2024PromptHSI: Universal Hyperspectral Image Restoration with Vision-Language Modulated Frequency Adaptationcited by 7
  25. 2025MP-HSIR: A Multi-Prompt Framework for Universal Hyperspectral Image Restorationcited by 6
  26. 2024Equivariant Imaging for Self-supervised Hyperspectral Image Inpaintingcited by 5
  27. 2025TerraGen: A Unified Multi-Task Layout Generation Framework for Remote Sensing Data Augmentationcited by 5
  28. 2022Tuning-free Plug-and-Play Hyperspectral Image Deconvolution with Deep Priorscited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026HSI-VAR: Rethinking Hyperspectral Restoration through Spatial-Spectral Visual Autoregression
  2. 2025Hyperspectral Image Generation with Unmixing Guided Diffusion Model
  3. 2026R2H-Diff: Guided Spectral Diffusion Model for RGB-to-Hyperspectral Reconstruction
  4. 2025Self-Learning Hyperspectral and Multispectral Image Fusion via Adaptive Residual Guided Subspace Diffusion Model
  5. 2023A Spectral Diffusion Prior for Hyperspectral Image Super-Resolution
  6. 2025Uncertainty Quantification in HSI Reconstruction using Physics-Aware Diffusion Priors and Optics-Encoded Measurements
  7. 2023Hyperspectral and Multispectral Image Fusion Using the Conditional Denoising Diffusion Probabilistic Model
  8. 2025Degradation-Aware Metric Prompting for Hyperspectral Image Restoration