Toward Interpretable Multimodal Fusion: Heat Conduction Modeling for Hyperspectral and LiDAR Joint Classification
Not on the map. Why?
Abstract (arXiv)
The fusion of hyperspectral (HS) and Light Detection and Ranging (LiDAR) data plays a crucial role in enhancing land-cover classification by jointly exploiting spectral, spatial, and structural cues. However, existing multimodal fusion methods still struggle to model long-range dependencies and complex anisotropic interactions while maintaining computational efficiency. This paper introduces M2Heat, a physics-inspired framework that investigates multimodal fusion through the lens of heat conduction. At its core, a physics-driven visual heat conduction module (vHeat) and enhanced Frequency Value Embeddings (FVEs) simulate anisotropic information flow, enabling the capture of global dependencies with sub-quadratic complexity and physical interpretability. This mechanism, combined with a hybrid spatial-frequency fusion strategy named Cross-Frequency Fusion (CFF) module, produces highly discriminative and robust feature representations. M2Heat achieves competitive overall performance on three benchmarks, i.e., Trento, Houston2013, and Augsburg, while providing an interpretable heat-conduction-guided perspective for multimodal feature fusion. These results indicate the potential of heat-conduction-guided neural operators for efficient and interpretable RS multimodal fusion. The source code is publicly available at https: /github.com/Weikan0425/M2Heat_HSI_LiDAR.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 60 references that are in the map. First posted on arXiv 10 Sep 2026.
Builds on
20 of 60 references.
References · 20
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2021Global Filter Networks for Image Classificationcited by 257
- 2021SpectralFormer: Rethinking Hyperspectral Image Classification with Transformerscited by 168
- 2020More Diverse Means Better: Multimodal Deep Learning Meets Remote Sensing Imagery Classificationcited by 126
- 2022Multimodal Fusion Transformer for Remote Sensing Image Classificationcited by 61
- 2025MambaHSI: Spatial-Spectral Mamba for Hyperspectral Image Classificationcited by 44
- 2021Multimodal Remote Sensing Benchmark Datasets for Land Cover Classification with A Shared and Specific Feature Learning Modelcited by 43
- 2023FedDiff: Diffusion Model Driven Federated Learning for Multi-Modal and Multi-Clientscited by 23
- 2024IGroupSS-Mamba: Interval Group Spatial-Spectral Mamba for Hyperspectral Image Classificationcited by 11
- 2024RS-vHeat: Heat Conduction Guided Efficient Remote Sensing Foundation Modelcited by 11
- 2024Mask Approximation Net: A Novel Diffusion Model Approach for Remote Sensing Change Captioningcited by 10
- 2024Building Vision Models upon Heat Conductioncited by 7
8 more
- 2025Deep Unfolding Multi-modal Image Fusion Network via Attribution Analysiscited by 7
- 2025CangLing-KnowFlow: A Unified Knowledge-and-Flow-fused Agent for Comprehensive Remote Sensing Applicationscited by 7
- 2021Single-stream CNN with Learnable Architecture for Multi-source Remote Sensing Datacited by 5
- 2024Multimodal Informative ViT: Information Aggregation and Distribution for Hyperspectral and LiDAR Classificationcited by 5
- 2024UNetMamba: An Efficient UNet-Like Mamba for Semantic Segmentation of High-Resolution Remote Sensing Imagescited by 5
- 2024Spatial-Aware Conformal Prediction for Trustworthy Hyperspectral Image Classificationcited by 5
- 2025Dynamic Cross-Modal Feature Interaction Network for Hyperspectral and LiDAR Data Classificationcited by 3
- 2025FSG-Net: Frequency-Spatial Synergistic Gated Network for High-Resolution Remote Sensing Change Detectioncited by 2
Built on by
Not cited yet.