R2H-Diff: Guided Spectral Diffusion Model for RGB-to-Hyperspectral Reconstruction
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
RGB-to-hyperspectral image reconstruction is a highly ill-posed inverse problem, since multiple plausible spectral distributions may correspond to the same RGB observation. Existing regression-based methods usually learn a deterministic mapping, which limits their ability to model reconstruction uncertainty and often leads to over-smoothed spectral responses. Although diffusion models provide strong distribution modeling capability, their direct application to hyperspectral reconstruction remains challenging due to the high spectral dimensionality, strong inter-band correlations, and strict requirement for spectral fidelity. To this end, we propose R2H-Diff, an efficient diffusion-based framework tailored for RGB-to-HSI reconstruction. Specifically, R2H-Diff formulates spectral recovery as a conditional iterative refinement process, enabling progressive reconstruction under RGB guidance. We proposed a Guided Spectral Refinement Module for RGB-conditioned feature fusion and a Hyperspectral-Adaptive Transposed Attention module for efficient spatial--spectral dependency modeling. Furthermore, a normalization-free denoising backbone is adopted to preserve spectral amplitude consistency, while a task-adapted linear noise schedule enables high-quality reconstruction with only five denoising steps. Extensive experiments on NTIRE2022, CAVE, and Harvard demonstrate that R2H-Diff achieves a favorable balance between reconstruction quality and computational efficiency. Notably, on NTIRE2022, R2H-Diff obtains 35.37 dB PSNR with a sub-million-parameter model of 0.58M parameters and 12.25G FLOPs, achieving the lowest model complexity among the evaluated methods while maintaining strong reconstruction fidelity.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 25 of its 49 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
25 of 49 references.
Closest ancestors · 2
Same direction, newest first
- 2023Diff-Retinex: Rethinking Low-light Image Enhancement with A Generative Diffusion Model25 Aug
- 2023DDS2M: Self-Supervised Denoising Diffusion Spatio-Spectral Model for Hyperspectral Image Restoration12 Mar
Other references · 23
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2022Generative Adversarial Networkscited by 5,627
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,552
- 2021Image Super-Resolution via Iterative Refinementcited by 1,511
- 2022Diffusion Models in Vision: A Surveycited by 1,015
- 2023Simple diffusion: End-to-end diffusion for high resolution imagescited by 422
- 2020Learning Enriched Features for Real Image Restoration and Enhancementcited by 312
- 2024Diffusion Model-Based Image Editing: A Surveycited by 212
- 2024Diffusion Models in Low-Level Vision: A Surveycited by 74
11 more
- 2022MST++: Multi-stage Spectral-wise Transformer for Efficient Spectral Reconstructioncited by 72
- 2022HDNet: High-resolution Dual-domain Learning for Spectral Compressive Imagingcited by 66
- 2024Diff-Plugin: Revitalizing Details for Diffusion-based Low-level Taskscited by 48
- 2021Self-supervised Neural Networks for Spectral Snapshot Compressive Imagingcited by 35
- 2022Spatial-Spectral Transformer for Hyperspectral Image Denoisingcited by 34
- 2023ESSAformer: Efficient Transformer for Hyperspectral Image Super-resolutioncited by 23
- 2023Hyperspectral Image Reconstruction via Combinatorial Embedding of Cross-Channel Spatio-Spectral Cluescited by 10
- 2023In2SET: Intra-Inter Similarity Exploiting Transformer for Dual-Camera Compressive Hyperspectral Imagingcited by 8
- 2023Hyperspectral Image Super-Resolution via Dual-domain Network Based on Hybrid Convolutioncited by 5
- 2026IT-OSE: Exploring Optimal Sample Size for Industrial Data Augmentationcited by 4
- 2025DS-Diffusion: Data Style-Guided Diffusion Model for Time-Series Generationcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025RGB Pre-Training Enhanced Unobservable Feature Latent Diffusion Model for Spectral Reconstruction
- 2025Learning Spectral Diffusion Prior for Hyperspectral Image Reconstruction
- 2023A Spectral Diffusion Prior for Hyperspectral Image Super-Resolution
- 2024HIR-Diff: Unsupervised Hyperspectral Image Restoration Via Improved Diffusion Models
- 2026HSI-VAR: Rethinking Hyperspectral Restoration through Spatial-Spectral Visual Autoregression
- 2026HIR-ALIGN: Enhancing Hyperspectral Image Restoration via Diffusion-Based Data Generation
- 2026Beyond Reconstruction: Reconstruction-to-Vector Diffusion for Hyperspectral Anomaly Detection
- 2025Self-Learning Hyperspectral and Multispectral Image Fusion via Adaptive Residual Guided Subspace Diffusion Model