A survey on computational spectral reconstruction methods from RGB to hyperspectral imaging
Not on the map. Why?
Abstract (arXiv)
Hyperspectral imaging enables versatile applications due to its competence in capturing abundant spatial and spectral information, which are crucial for identifying substances. However, the devices for acquiring hyperspectral images are expensive and complicated. Therefore, many alternative spectral imaging methods have been proposed by directly reconstructing the hyperspectral information from lower-cost, more available RGB images. We present a thorough investigation of these state-of-the-art spectral reconstruction methods from the widespread RGB images. A systematic study and comparison of more than 25 methods has revealed that most of the data-driven deep learning methods are superior to prior-based methods in terms of reconstruction accuracy and quality despite lower speeds. This comprehensive review can serve as a fruitful reference source for peer researchers, thus further inspiring future development directions in related domains.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 38 of its 104 references that are in the map. First posted on arXiv 30 Jun 2021.
Builds on
38 of 104 references.
References · 38
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2014Conditional Generative Adversarial Netscited by 2,152
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
- 2018Dual Attention Network for Scene Segmentationcited by 1,001
- 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 902
26 more
- 2018Self-Attention Generative Adversarial Networkscited by 809
- 2018Bag of Tricks for Image Classification with Convolutional Neural Networkscited by 430
- 2018An Intriguing Failing of Convolutional Neural Networks and the CoordConv Solutioncited by 302
- 2016Learning from Simulated and Unsupervised Images through Adversarial Trainingcited by 287
- 2020Single Image Super-Resolution via a Holistic Attention Networkcited by 265
- 2016Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networkscited by 192
- 2020fastai: A Layered API for Deep Learningcited by 183
- 2018Residual Dense Network for Image Restorationcited by 181
- 2015Attention to Scale: Scale-aware Semantic Image Segmentationcited by 169
- 2018Pyramid Attention Network for Semantic Segmentationcited by 148
- 2019Mish: A Self Regularized Non-Monotonic Activation Functioncited by 141
- 2016The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentationcited by 122
- 2019Dual Residual Networks Leveraging the Potential of Paired Operations for Image Restorationcited by 73
- 2019Second-order Non-local Attention Networks for Person Re-identificationcited by 38
- 2020Hierarchical Regression Network for Spectral Reconstruction from RGB Imagescited by 29
- 2020AdaptiveWeighted Attention Network with Camera Spectral Sensitivity Prior for Spectral Reconstruction from RGB Imagescited by 29
- 2017Learned Spectral Super-Resolutioncited by 19
- 2018Validating Hyperspectral Image Segmentationcited by 18
- 2018Hyperspectral recovery from RGB images using Gaussian Processescited by 13
- 2019Pixel-aware Deep Function-mixture Network for Spectral Super-Resolutioncited by 13
- 2017Adversarial Networks for Spatial Context-Aware Spectral Image Reconstruction from RGBcited by 11
- 2018Accurate Spectral Super-resolution from Single RGB Image Using Multi-scale CNNcited by 9
- 2018Towards Spectral Estimation from a Single RGB Image in the Wildcited by 7
- 2018An efficient CNN for spectral reconstruction from RGB imagescited by 5
- 2020Light Weight Residual Dense Attention Net for Spectral Reconstruction from RGB Imagescited by 4
- 2020MXR-U-Nets for Real Time Hyperspectral Reconstructioncited by 1
Built on by
Citing papers per year: 2022: 1; 2023: 3; 2024: 6; 2025: 8; 2026: 2.
20 papers.
Sort:
By area:
- 2024Limitations of Data-Driven Spectral Reconstruction -- An Optics-Aware Analysiscited by 5
- 2025Hyperspectral vs. RGB for Pedestrian Segmentation in Urban Driving Scenes: A Comparative Studycited by 4
- 2024Deep learning-based hyperspectral image reconstruction for quality assessment of agro-productcited by 3
- 2023RDFNet: Regional Dynamic FISTA-Net for Spectral Snapshot Compressive Imagingcited by 2
- 2022Illumination-Based Color Reconstruction for the Dynamic Vision Sensorcited by 1
- 2023mHealth hyperspectral learning for instantaneous spatiospectral imaging of hemodynamicscited by 1
- 2024Comparative Analysis of Hyperspectral Image Reconstruction Using Deep Learning for Agricultural and Biological Applicationscited by 1
- 2024RGB to Hyperspectral: Spectral Reconstruction for Enhanced Surgical Imagingcited by 1
- 2025AI-Driven HSI: Multimodality, Fusion, Challenges, and the Deep Learning Revolutioncited by 1
- 2025HyperKD: Distilling Cross-Spectral Knowledge in Masked Autoencoders via Inverse Domain Shift with Spatial-Aware Masking and Specialized Losscited by 1
- 2023Learning Exhaustive Correlation for Spectral Super-Resolution: Where Spatial-Spectral Attention Meets Linear Dependencecited by 0
- 2024Empirical Analysis of Anomaly Detection on Hyperspectral Imaging Using Dimension Reduction Methodscited by 0
8 more
- 2024Hyperspectral Image Reconstruction for Predicting Chick Embryo Mortality Towards Advancing Egg and Hatchery Industrycited by 0
- 2025Generative Model-Assisted Demosaicing for Cross-multispectral Camerascited by 0
- 2025Hyperspectral Image Generation with Unmixing Guided Diffusion Modelcited by 0
- 2025MCGA: Mixture of Codebooks Hyperspectral Reconstruction via Grayscale-Aware Attentioncited by 0
- 2025RGB Pre-Training Enhanced Unobservable Feature Latent Diffusion Model for Spectral Reconstructioncited by 0
- 2025Uncertainty Quantification in HSI Reconstruction using Physics-Aware Diffusion Priors and Optics-Encoded Measurementscited by 0
- 2026Sensor-Adaptive Infrared Spectral Reconstruction with Plug-and-Play Diffusion Priorscited by 0
- 2026Compact Low-Cost Hyperspectral Imaging via Angular-to-Spectral Diversity Conversioncited by 0
- 2026Compact Low-Cost Hyperspectral Imaging via Angular-to-Spectral Diversity Conversion20 Sep 2026
- 2026Sensor-Adaptive Infrared Spectral Reconstruction with Plug-and-Play Diffusion Priors6 Jul 2026
- 2025Uncertainty Quantification in HSI Reconstruction using Physics-Aware Diffusion Priors and Optics-Encoded Measurements23 Nov 2025
- 2025Hyperspectral vs. RGB for Pedestrian Segmentation in Urban Driving Scenes: A Comparative Study15 Aug 2025
- 2025HyperKD: Distilling Cross-Spectral Knowledge in Masked Autoencoders via Inverse Domain Shift with Spatial-Aware Masking and Specialized Loss13 Aug 2025
- 2025RGB Pre-Training Enhanced Unobservable Feature Latent Diffusion Model for Spectral Reconstruction17 Jul 2025
- 2025MCGA: Mixture of Codebooks Hyperspectral Reconstruction via Grayscale-Aware Attention14 Jul 2025
- 2025Hyperspectral Image Generation with Unmixing Guided Diffusion Model3 Jun 2025
- 2025Generative Model-Assisted Demosaicing for Cross-multispectral Cameras4 Mar 2025
- 2025AI-Driven HSI: Multimodality, Fusion, Challenges, and the Deep Learning Revolution9 Feb 2025
- 2024RGB to Hyperspectral: Spectral Reconstruction for Enhanced Surgical Imaging17 Oct 2024
- 2024Hyperspectral Image Reconstruction for Predicting Chick Embryo Mortality Towards Advancing Egg and Hatchery Industry22 May 2024
8 more
- 2024Comparative Analysis of Hyperspectral Image Reconstruction Using Deep Learning for Agricultural and Biological Applications22 May 2024
- 2024Deep learning-based hyperspectral image reconstruction for quality assessment of agro-product20 May 2024
- 2024Empirical Analysis of Anomaly Detection on Hyperspectral Imaging Using Dimension Reduction Methods9 Jan 2024
- 2024Limitations of Data-Driven Spectral Reconstruction -- An Optics-Aware Analysis8 Jan 2024
- 2023Learning Exhaustive Correlation for Spectral Super-Resolution: Where Spatial-Spectral Attention Meets Linear Dependence20 Dec 2023
- 2023mHealth hyperspectral learning for instantaneous spatiospectral imaging of hemodynamics27 Mar 2023
- 2023RDFNet: Regional Dynamic FISTA-Net for Spectral Snapshot Compressive Imaging6 Feb 2023
- 2022Illumination-Based Color Reconstruction for the Dynamic Vision Sensor12 Nov 2022
- 2025Hyperspectral Image Generation with Unmixing Guided Diffusion Modelcited by 0
- 2025RGB Pre-Training Enhanced Unobservable Feature Latent Diffusion Model for Spectral Reconstructioncited by 0
- 2025Uncertainty Quantification in HSI Reconstruction using Physics-Aware Diffusion Priors and Optics-Encoded Measurementscited by 0
- 2026Sensor-Adaptive Infrared Spectral Reconstruction with Plug-and-Play Diffusion Priorscited by 0
- 2026Sensor-Adaptive Infrared Spectral Reconstruction with Plug-and-Play Diffusion Priors6 Jul 2026
- 2025Uncertainty Quantification in HSI Reconstruction using Physics-Aware Diffusion Priors and Optics-Encoded Measurements23 Nov 2025
- 2025RGB Pre-Training Enhanced Unobservable Feature Latent Diffusion Model for Spectral Reconstruction17 Jul 2025
- 2025Hyperspectral Image Generation with Unmixing Guided Diffusion Model3 Jun 2025
- 2024Limitations of Data-Driven Spectral Reconstruction -- An Optics-Aware Analysiscited by 5
- 2025Hyperspectral vs. RGB for Pedestrian Segmentation in Urban Driving Scenes: A Comparative Studycited by 4
- 2024Deep learning-based hyperspectral image reconstruction for quality assessment of agro-productcited by 3
- 2023RDFNet: Regional Dynamic FISTA-Net for Spectral Snapshot Compressive Imagingcited by 2
- 2022Illumination-Based Color Reconstruction for the Dynamic Vision Sensorcited by 1
- 2023mHealth hyperspectral learning for instantaneous spatiospectral imaging of hemodynamicscited by 1
- 2024Comparative Analysis of Hyperspectral Image Reconstruction Using Deep Learning for Agricultural and Biological Applicationscited by 1
- 2024RGB to Hyperspectral: Spectral Reconstruction for Enhanced Surgical Imagingcited by 1
- 2025AI-Driven HSI: Multimodality, Fusion, Challenges, and the Deep Learning Revolutioncited by 1
- 2025HyperKD: Distilling Cross-Spectral Knowledge in Masked Autoencoders via Inverse Domain Shift with Spatial-Aware Masking and Specialized Losscited by 1
- 2023Learning Exhaustive Correlation for Spectral Super-Resolution: Where Spatial-Spectral Attention Meets Linear Dependencecited by 0
- 2024Empirical Analysis of Anomaly Detection on Hyperspectral Imaging Using Dimension Reduction Methodscited by 0
12 most cited of 16 All 16 (JSON)
- 2026Compact Low-Cost Hyperspectral Imaging via Angular-to-Spectral Diversity Conversion20 Sep 2026
- 2025Hyperspectral vs. RGB for Pedestrian Segmentation in Urban Driving Scenes: A Comparative Study15 Aug 2025
- 2025HyperKD: Distilling Cross-Spectral Knowledge in Masked Autoencoders via Inverse Domain Shift with Spatial-Aware Masking and Specialized Loss13 Aug 2025
- 2025MCGA: Mixture of Codebooks Hyperspectral Reconstruction via Grayscale-Aware Attention14 Jul 2025
- 2025Generative Model-Assisted Demosaicing for Cross-multispectral Cameras4 Mar 2025
- 2025AI-Driven HSI: Multimodality, Fusion, Challenges, and the Deep Learning Revolution9 Feb 2025
- 2024RGB to Hyperspectral: Spectral Reconstruction for Enhanced Surgical Imaging17 Oct 2024
- 2024Hyperspectral Image Reconstruction for Predicting Chick Embryo Mortality Towards Advancing Egg and Hatchery Industry22 May 2024
- 2024Comparative Analysis of Hyperspectral Image Reconstruction Using Deep Learning for Agricultural and Biological Applications22 May 2024
- 2024Deep learning-based hyperspectral image reconstruction for quality assessment of agro-product20 May 2024
- 2024Empirical Analysis of Anomaly Detection on Hyperspectral Imaging Using Dimension Reduction Methods9 Jan 2024
- 2024Limitations of Data-Driven Spectral Reconstruction -- An Optics-Aware Analysis8 Jan 2024
12 newest of 16 All 16 (JSON)