PIF-Net: Ill-Posed Prior Guided Multispectral and Hyperspectral Image Fusion via Invertible Mamba and Fusion-Aware LoRA
On the map: State-space sequence models (S4, Mamba) → Hyperspectral image analysis with Mamba
Abstract (arXiv)
The goal of multispectral and hyperspectral image fusion (MHIF) is to generate high-quality images that simultaneously possess rich spectral information and fine spatial details. However, due to the inherent trade-off between spectral and spatial information and the limited availability of observations, this task is fundamentally ill-posed. Previous studies have not effectively addressed the ill-posed nature caused by data misalignment. To tackle this challenge, we propose a fusion framework named PIF-Net, which explicitly incorporates ill-posed priors to effectively fuse multispectral images and hyperspectral images. To balance global spectral modeling with computational efficiency, we design a method based on an invertible Mamba architecture that maintains information consistency during feature transformation and fusion, ensuring stable gradient flow and process reversibility. Furthermore, we introduce a novel fusion module called the Fusion-Aware Low-Rank Adaptation module, which dynamically calibrates spectral and spatial features while keeping the model lightweight. Extensive experiments on multiple benchmark datasets demonstrate that PIF-Net achieves significantly better image restoration performance than current state-of-the-art methods while maintaining model efficiency.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Hyperspectral image analysis with Mamba, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 23 of its 55 references that are in the map. First posted on arXiv 1 Aug 2025.
Builds on
23 of 55 references.
References · 23
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2016Density estimation using Real NVPcited by 2,042
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
- 2021Image Super-Resolution via Iterative Refinementcited by 1,511
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,254
- 2014NICE: Non-linear Independent Components Estimationcited by 1,058
- 2017Generative Adversarial Networks: An Overviewcited by 590
- 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 482
- 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 223
- 2020SRFlow: Learning the Super-Resolution Space with Normalizing Flowcited by 209
11 more
- 2017Large Kernel Matters -- Improve Semantic Segmentation by Global Convolutional Networkcited by 208
- 2019Guided Image Generation with Conditional Invertible Neural Networkscited by 147
- 2020Invertible Image Rescalingcited by 92
- 2019SteganoGAN: High Capacity Image Steganography with GANscited by 72
- 2021Structure-Preserving Deraining with Residue Channel Prior Guidancecited by 63
- 2014Hyperspectral and Multispectral Image Fusion based on a Sparse Representationcited by 23
- 2022U2Net: A General Framework with Spatial-Spectral-Integrated Double U-Net for Image Fusioncited by 19
- 2020Hyperspectral Image Classification with Attention Aided CNNscited by 18
- 2023Object Detection in Hyperspectral Image via Unified Spectral-Spatial Feature Aggregationcited by 10
- 2016Super-resolution reconstruction of hyperspectral images via low rank tensor modeling and total variation regularizationcited by 4
- 2025Prompt to Restore, Restore to Prompt: Cyclic Prompting for Universal Adverse Weather Removalcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026M3SR: Multi-Scale Multi-Perceptual Mamba for Efficient Spectral Reconstruction
- 2025Self-Learning Hyperspectral and Multispectral Image Fusion via Adaptive Residual Guided Subspace Diffusion Model
- 2024FusionMamba: Efficient Remote Sensing Image Fusion with State Space Model
- 2023A Spectral Diffusion Prior for Hyperspectral Image Super-Resolution
- 2025Fose: Fusion of One-Step Diffusion and End-to-End Network for Pansharpening
- 2023Hyperspectral and Multispectral Image Fusion Using the Conditional Denoising Diffusion Probabilistic Model
- 2026USP-Mamba: Unmixing-Derived Spectral and Structural Prompting for Hyperspectral Image Super-Resolution
- 2024SpectralMamba: Efficient Mamba for Hyperspectral Image Classification