# PCMamba: Physics-Informed Cross-Modal State Space Model for Dual-Camera Compressive Hyperspectral Imaging

arXiv: https://arxiv.org/abs/2505.16373 · HTML: https://mlsanity.com/paper/2505.16373/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Placed in Hyperspectral image analysis with Mamba, one of 10 directions in State-space sequence models (S4, Mamba).
- Builds on 23 of its 51 references that are in the map.
- First posted on arXiv 22 May 2025.

## Placed in

- State-space sequence models (S4, Mamba) / [Hyperspectral image analysis with Mamba](https://mlsanity.com/ssm/hyperspectral-image-analysis-with-mamba/)

## Builds on (most cited first, 23 of 23)

- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [Swin Transformer: Hierarchical Vision Transformer using Shifted Windows](https://mlsanity.com/paper/2103.14030/) (2021)
- [VMamba: Visual State Space Model](https://mlsanity.com/paper/2401.10166/) (2024)
- [Mask-guided Spectral-wise Transformer for Efficient Hyperspectral Image Reconstruction](https://mlsanity.com/paper/2111.07910/) (2021)
- [Rank Minimization for Snapshot Compressive Imaging](https://mlsanity.com/paper/1807.07837/) (2018)
- [MST++: Multi-stage Spectral-wise Transformer for Efficient Spectral Reconstruction](https://mlsanity.com/paper/2204.07908/) (2022)
- [Coarse-to-Fine Sparse Transformer for Hyperspectral Image Reconstruction](https://mlsanity.com/paper/2203.04845/) (2022)
- [HDNet: High-resolution Dual-domain Learning for Spectral Compressive Imaging](https://mlsanity.com/paper/2203.02149/) (2022)
- [Degradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive Imaging](https://mlsanity.com/paper/2205.10102/) (2022)
- [Deep Gaussian Scale Mixture Prior for Spectral Compressive Imaging](https://mlsanity.com/paper/2103.07152/) (2021)
- [Coded aperture compressive temporal imaging](https://mlsanity.com/paper/1302.2575/) (2013)
- [Hyperspectral Image Denoising Employing a Spatial-Spectral Deep Residual Convolutional Neural Network](https://mlsanity.com/paper/1806.00183/) (2018)
- [Non-local Meets Global: An Iterative Paradigm for Hyperspectral Image Restoration](https://mlsanity.com/paper/2010.12921/) (2020)
- [Samba: Semantic Segmentation of Remotely Sensed Images with State Space Model](https://mlsanity.com/paper/2404.01705/) (2024)
- [Binarized Spectral Compressive Imaging](https://mlsanity.com/paper/2305.10299/) (2023)
- [Pixel Adaptive Deep Unfolding Transformer for Hyperspectral Image Reconstruction](https://mlsanity.com/paper/2308.10820/) (2023)
- [Hi-Mamba: Hierarchical Mamba for Efficient Image Super-Resolution](https://mlsanity.com/paper/2410.10140/) (2024)
- [MambaCSR: Dual-Interleaved Scanning for Compressed Image Super-Resolution With SSMs](https://mlsanity.com/paper/2408.11758/) (2024)
- [Aerial Vehicle Tracking by Adaptive Fusion of Hyperspectral Likelihood Maps](https://mlsanity.com/paper/1707.03553/) (2017)
- [In2SET: Intra-Inter Similarity Exploiting Transformer for Dual-Camera Compressive Hyperspectral Imaging](https://mlsanity.com/paper/2312.13319/) (2023)
- [RemoteDet-Mamba: A Hybrid Mamba-CNN Network for Multi-modal Object Detection in Remote Sensing Images](https://mlsanity.com/paper/2410.13532/) (2024)
- [Remote Sensing Image Segmentation Using Vision Mamba and Multi-Scale Multi-Frequency Feature Fusion](https://mlsanity.com/paper/2410.05624/) (2024)
- [Dual camera snapshot hyperspectral imaging system via physics informed learning](https://mlsanity.com/paper/2109.02643/) (2021)

## Built on by (most cited first, 1 of 1)

- [TeX-1500: A Paired Real-World LWIR Hyperspectral Dataset and Benchmark for Temperature-Emissivity-Texture Decomposition](https://mlsanity.com/paper/2606.03806/) (2026)

## Abstract (arXiv)

Panchromatic (PAN) -assisted Dual-Camera Compressive Hyperspectral Imaging (DCCHI) is a key technology in snapshot hyperspectral imaging. Existing research primarily focuses on exploring spectral information from 2D compressive measurements and spatial information from PAN images in an explicit manner, leading to a bottleneck in HSI reconstruction. Various physical factors, such as temperature, emissivity, and multiple reflections between objects, play a critical role in the process of a sensor acquiring hyperspectral thermal signals. Inspired by this, we attempt to investigate the interrelationships between physical properties to provide deeper theoretical insights for HSI reconstruction. In this paper, we propose a Physics-Informed Cross-Modal State Space Model Network (PCMamba) for DCCHI, which incorporates the forward physical imaging process of HSI into the linear complexity of Mamba to facilitate lightweight and high-quality HSI reconstruction. Specifically, we analyze the imaging process of hyperspectral thermal signals to enable the network to disentangle the three key physical properties-temperature, emissivity, and texture. By fully exploiting the potential information embedded in 2D measurements and PAN images, the HSIs are reconstructed through a physics-driven synthesis process. Furthermore, we design a Cross-Modal Scanning Mamba Block (CSMB) that introduces inter-modal pixel-wise interaction with positional inductive bias by cross-scanning the backbone features and PAN features. Extensive experiments conducted on both real and simulated datasets demonstrate that our method significantly outperforms SOTA methods in both quantitative and qualitative metrics.