mlsanityData to 14 Oct 2026

Learning Spatial-Spectral Refinement and Calibrating Complementary Observations for Hyperspectral Image Super-Resolution

arXiv 2609.05303 ↗First posted 4 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Hyperspectral and multispectral image fusion (HMIF) aims to reconstruct a high-resolution hyperspectral image (HR-HSI) by combining the fine spatial details of a high-resolution multispectral image (HR-MSI) with the rich spectral information of a low-resolution hyperspectral image (LR-HSI). Recent advances in implicit neural representations (INRs) have enabled flexible coordinate-based modeling for HMIF; however, existing INR-based approaches may not fully capture fine-grained spatial structures and rich spectral dependencies. Moreover, the LR-HSI and HR-MSI are primarily incorporated through degradation-consistency constraints, leaving their complementary information underexploited. To address these limitations, we propose Two-Stage Reconstruction with Implicit Tensor Neural Representation (TSR-ITNR), a unified self-supervised framework integrating representation refinement and observation-guided calibration. In Stage 1, TSR-ITNR learns an implicit Tucker representation and refines its low-rank spatial coefficient tensor and spectral basis to better capture fine spatial structures and interband correlations. A fixed pretrained denoiser further provides a deep prior for the preliminary reconstruction. In Stage 2, parameter-free calibration derives complementary and noninterfering corrections from both observations to recover information insufficiently captured in Stage 1. Theoretical analysis establishes the geometry-preserving property of spectral refinement and the orthogonal complementarity of calibration. Extensive experiments on multiple benchmark datasets demonstrate strong quantitative, visual, and spectral reconstruction performance without ground-truth HR-HSI supervision. Beyond conventional reconstruction metrics, we further assess the effectiveness of TSR-ITNR using downstream semantic segmentation accuracy.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 56 references that are in the map. First posted on arXiv 4 Sep 2026.

Builds on

19 of 56 references.

References · 19

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  4. 2020Plug-and-Play Image Restoration with Deep Denoiser Priorcited by 470
  5. 2021UNetFormer: A UNet-like Transformer for Efficient Semantic Segmentation of Remote Sensing Urban Scene Imagerycited by 167
  6. 2014A convex formulation for hyperspectral image superresolution via subspace-based regularizationcited by 48
  7. 2022Low-Rank Tensor Function Representation for Multi-Dimensional Data Recoverycited by 46
  8. 2013Advances in Hyperspectral Image Classification: Earth monitoring with statistical learning methodscited by 26
  9. 2018Unsupervised Sparse Dirichlet-Net for Hyperspectral Image Super-Resolutioncited by 26
  10. 2024Unsupervised Hyperspectral Image Super-Resolution via Self-Supervised Modality Decouplingcited by 26
  11. 2018Hyperspectral Super-Resolution: A Coupled Tensor Factorization Approachcited by 24
  12. 2020Recent Advances and New Guidelines on Hyperspectral and Multispectral Image Fusioncited by 21
7 more
  1. 2020Guided Deep Decoder: Unsupervised Image Pair Fusioncited by 20
  2. 2024FINER++: Building a Family of Variable-periodic Functions for Activating Implicit Neural Representationcited by 11
  3. 2024Hyperspectral and multispectral image fusion with arbitrary resolution through self-supervised representationscited by 8
  4. 2025F-INR: Functional Tensor Decomposition for Implicit Neural Representationscited by 7
  5. 2023LSwinSR: UAV Imagery Super-Resolution based on Linear Swin Transformercited by 6
  6. 2025Low-Rank Tensor Recovery via Variational Schatten-p Quasi-Norm and Jacobian Regularizationcited by 1
  7. 2026Content-Aware Frequency Encoding for Implicit Neural Representations with Fourier-Chebyshev Featurescited by 1

Built on by

Not cited yet.