Physics-Guided Deep Unfolding for Blind Cross-Sensor Spectral Super-Resolution via Learning the Spectral Transformation Function
Not on the map. Why?
Abstract (arXiv)
Hyperspectral imaging provides rich spectral information for quantitative remote sensing, yet hyperspectral sensors remain costly and thus unavailable in many UAV deployments. Spectral super-resolution (SSR) seeks to reconstruct hyperspectral images (HSIs) from multispectral images (MSIs). Most existing SSR methods assume a fixed and known spectral response function (SRF) and are therefore limited to single-sensor settings. In practical cross-sensor scenarios, the spectral degradation from HSI to MSI is unknown and varies with sensor characteristics and scene content, which renders HSI reconstruction ill-posed. This paper proposes a physics-guided deep unfolding network, termed PGU-Net, to address blind cross-sensor SSR by jointly estimating the HSI and a learnable spectral transformation function (STF). PGU-Net unrolls an alternating optimization procedure into an end-to-end trainable architecture with stages, where each stage sequentially updates the HSI and the STF. Both modules combine learnable proximal networks with differentiable closed-form solvers, enabling physical interpretability while retaining strong representation capacity. Experiments on benchmark datasets (CAVE and NTIRE 2022) with multiple SRFs demonstrate accurate recovery of the STF (degradation operator) and improved reconstruction performance over state-of-the-art SSR methods. Furthermore, evaluations on a real UAV cross-sensor dataset (Headwall Nano HSI and DJI P4 Multispectral MSI) verify the effectiveness and robustness of PGU-Net under truly blind conditions, and suggest that the estimated STF may exhibit land-cover-related differences.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 40 references that are in the map. First posted on arXiv 4 Jun 2026.
Builds on
11 of 40 references.
References · 11
- 2021Mask-guided Spectral-wise Transformer for Efficient Hyperspectral Image Reconstructioncited by 110
- 2022MST++: Multi-stage Spectral-wise Transformer for Efficient Spectral Reconstructioncited by 72
- 2023EDiffSR: An Efficient Diffusion Probabilistic Model for Remote Sensing Image Super-Resolutioncited by 56
- 2020AdaptiveWeighted Attention Network with Camera Spectral Sensitivity Prior for Spectral Reconstruction from RGB Imagescited by 29
- 2017Learned Spectral Super-Resolutioncited by 19
- 2018Hyperspectral recovery from RGB images using Gaussian Processescited by 13
- 2020Spectral Response Function Guided Deep Optimization-driven Network for Spectral Super-resolutioncited by 12
- 2017Adversarial Networks for Spatial Context-Aware Spectral Image Reconstruction from RGBcited by 11
- 2021Coupling Model-Driven and Data-Driven Methods for Remote Sensing Image Restoration and Fusioncited by 11
- 2024Adaptive Fusion of Multi-view Remote Sensing data for Optimal Sub-field Crop Yield Predictioncited by 8
- 2025Advancing Image Super-resolution Techniques in Remote Sensing: A Comprehensive Surveycited by 8
Built on by
Not cited yet.