# Learning Shared Cross-modality Representation Using Multispectral-LiDAR and Hyperspectral Data

arXiv: https://arxiv.org/abs/1912.08837 · HTML: https://mlsanity.com/paper/1912.08837/

## Key facts

- Cited by 12 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 18 Dec 2019.

## Built on by (most cited first, 12 of 12)

- [HyperSIGMA: Hyperspectral Intelligence Comprehension Foundation Model](https://mlsanity.com/paper/2406.11519/) (2024)
- [Multimodal Remote Sensing Benchmark Datasets for Land Cover Classification with A Shared and Specific Feature Learning Model](https://mlsanity.com/paper/2105.10196/) (2021)
- [Object Detection in Hyperspectral Image via Unified Spectral-Spatial Feature Aggregation](https://mlsanity.com/paper/2306.08370/) (2023)
- [Nonlocal Patch-Based Fully-Connected Tensor Network Decomposition for Remote Sensing Image Inpainting](https://mlsanity.com/paper/2109.05889/) (2021)
- [Common Practices and Taxonomy in Deep Multi-view Fusion for Remote Sensing Applications](https://mlsanity.com/paper/2301.01200/) (2022)
- [GAMUS: A Geometry-aware Multi-modal Semantic Segmentation Benchmark for Remote Sensing Data](https://mlsanity.com/paper/2305.14914/) (2023)
- [One-stage Modality Distillation for Incomplete Multimodal Learning](https://mlsanity.com/paper/2309.08204/) (2023)
- [Cross-Modal and Multimodal Data Analysis Based on Functional Mapping of Spectral Descriptors and Manifold Regularization](https://mlsanity.com/paper/2105.05631/) (2021)
- [HSLiNets: Evaluating Band Ordering Strategies in Hyperspectral and LiDAR Fusion](https://mlsanity.com/paper/2503.21072/) (2025)
- [DOD-SA: Infrared-Visible Decoupled Object Detection with Single-Modality Annotations](https://mlsanity.com/paper/2508.10445/) (2025)
- [Interpretable Hyperspectral AI: When Non-Convex Modeling meets Hyperspectral Remote Sensing](https://mlsanity.com/paper/2103.01449/) (2021)
- [Boosting Multimodal Remote Sensing Image Classification with Transformer-based Heterogeneously Salient Graph Representation](https://mlsanity.com/paper/2311.10320/) (2023)

## Abstract (arXiv)

Due to the ever-growing diversity of the data source, multi-modality feature learning has attracted more and more attention. However, most of these methods are designed by jointly learning feature representation from multi-modalities that exist in both training and test sets, yet they are less investigated in absence of certain modality in the test phase. To this end, in this letter, we propose to learn a shared feature space across multi-modalities in the training process. By this way, the out-of-sample from any of multi-modalities can be directly projected onto the learned space for a more effective cross-modality representation. More significantly, the shared space is regarded as a latent subspace in our proposed method, which connects the original multi-modal samples with label information to further improve the feature discrimination. Experiments are conducted on the multispectral-Lidar and hyperspectral dataset provided by the 2018 IEEE GRSS Data Fusion Contest to demonstrate the effectiveness and superiority of the proposed method in comparison with several popular baselines.