mlsanityData to 7 Oct 2026

Toward Interpretable Multimodal Fusion: Heat Conduction Modeling for Hyperspectral and LiDAR Joint Classification

arXiv 2609.11040 ↗First posted 10 Sep 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

The fusion of hyperspectral (HS) and Light Detection and Ranging (LiDAR) data plays a crucial role in enhancing land-cover classification by jointly exploiting spectral, spatial, and structural cues. However, existing multimodal fusion methods still struggle to model long-range dependencies and complex anisotropic interactions while maintaining computational efficiency. This paper introduces M2Heat, a physics-inspired framework that investigates multimodal fusion through the lens of heat conduction. At its core, a physics-driven visual heat conduction module (vHeat) and enhanced Frequency Value Embeddings (FVEs) simulate anisotropic information flow, enabling the capture of global dependencies with sub-quadratic complexity and physical interpretability. This mechanism, combined with a hybrid spatial-frequency fusion strategy named Cross-Frequency Fusion (CFF) module, produces highly discriminative and robust feature representations. M2Heat achieves competitive overall performance on three benchmarks, i.e., Trento, Houston2013, and Augsburg, while providing an interpretable heat-conduction-guided perspective for multimodal feature fusion. These results indicate the potential of heat-conduction-guided neural operators for efficient and interpretable RS multimodal fusion. The source code is publicly available at https: /github.com/Weikan0425/M2Heat_HSI_LiDAR.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 60 references that are in the map. First posted on arXiv 10 Sep 2026.

Builds on

20 of 60 references.

References · 20

  1. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  2. 2021Global Filter Networks for Image Classificationcited by 257
  3. 2021SpectralFormer: Rethinking Hyperspectral Image Classification with Transformerscited by 168
  4. 2020More Diverse Means Better: Multimodal Deep Learning Meets Remote Sensing Imagery Classificationcited by 126
  5. 2022Multimodal Fusion Transformer for Remote Sensing Image Classificationcited by 61
  6. 2025MambaHSI: Spatial-Spectral Mamba for Hyperspectral Image Classificationcited by 44
  7. 2021Multimodal Remote Sensing Benchmark Datasets for Land Cover Classification with A Shared and Specific Feature Learning Modelcited by 43
  8. 2023FedDiff: Diffusion Model Driven Federated Learning for Multi-Modal and Multi-Clientscited by 23
  9. 2024IGroupSS-Mamba: Interval Group Spatial-Spectral Mamba for Hyperspectral Image Classificationcited by 11
  10. 2024RS-vHeat: Heat Conduction Guided Efficient Remote Sensing Foundation Modelcited by 11
  11. 2024Mask Approximation Net: A Novel Diffusion Model Approach for Remote Sensing Change Captioningcited by 10
  12. 2024Building Vision Models upon Heat Conductioncited by 7
8 more
  1. 2025Deep Unfolding Multi-modal Image Fusion Network via Attribution Analysiscited by 7
  2. 2025CangLing-KnowFlow: A Unified Knowledge-and-Flow-fused Agent for Comprehensive Remote Sensing Applicationscited by 7
  3. 2021Single-stream CNN with Learnable Architecture for Multi-source Remote Sensing Datacited by 5
  4. 2024Multimodal Informative ViT: Information Aggregation and Distribution for Hyperspectral and LiDAR Classificationcited by 5
  5. 2024UNetMamba: An Efficient UNet-Like Mamba for Semantic Segmentation of High-Resolution Remote Sensing Imagescited by 5
  6. 2024Spatial-Aware Conformal Prediction for Trustworthy Hyperspectral Image Classificationcited by 5
  7. 2025Dynamic Cross-Modal Feature Interaction Network for Hyperspectral and LiDAR Data Classificationcited by 3
  8. 2025FSG-Net: Frequency-Spatial Synergistic Gated Network for High-Resolution Remote Sensing Change Detectioncited by 2

Built on by

Not cited yet.