Transformers Fusion across Disjoint Samples for Hyperspectral Image Classification
Not on the map. Why?
Abstract (arXiv)
3D Swin Transformer (3D-ST) known for its hierarchical attention and window-based processing, excels in capturing intricate spatial relationships within images. Spatial-spectral Transformer (SST), meanwhile, specializes in modeling long-range dependencies through self-attention mechanisms. Therefore, this paper introduces a novel method: an attentional fusion of these two transformers to significantly enhance the classification performance of Hyperspectral Images (HSIs). What sets this approach apart is its emphasis on the integration of attentional mechanisms from both architectures. This integration not only refines the modeling of spatial and spectral information but also contributes to achieving more precise and accurate classification results. The experimentation and evaluation of benchmark HSI datasets underscore the importance of employing disjoint training, validation, and test samples. The results demonstrate the effectiveness of the fusion approach, showcasing its superiority over traditional methods and individual transformers. Incorporating disjoint samples enhances the robustness and reliability of the proposed methodology, emphasizing its potential for advancing hyperspectral image classification.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 12 of its 95 references that are in the map. First posted on arXiv 2 May 2024.
Builds on
12 of 95 references.
References · 12
- 2023SpectralGPT: Spectral Remote Sensing Foundation Modelcited by 252
- 2021SpectralFormer: Rethinking Hyperspectral Image Classification with Transformerscited by 169
- 2022UIU-Net: U-Net in U-Net for Infrared Small Object Detectioncited by 127
- 2020Graph Convolutional Networks for Hyperspectral Image Classificationcited by 113
- 2023Cross-City Matters: A Multimodal Remote Sensing Benchmark Dataset for Cross-City Semantic Segmentation using High-Resolution Domain Adaptation Networkscited by 55
- 2021Hyperspectral Image Classification-Traditional to Deep Models: A Survey for Future Prospectscited by 49
- 2022Decoupled-and-Coupled Networks: Self-Supervised Hyperspectral Image Super-Resolution with Subpixel Fusioncited by 18
- 2024Pyramid Hierarchical Transformer for Hyperspectral Image Classificationcited by 11
- 2023Sharpend Cosine Similarity based Neural Network for Hyperspectral Image Classificationcited by 7
- 2022Attention Mechanism Meets with Hybrid Dense Network for Hyperspectral Image Classificationcited by 6
- 2023Spatial Gated Multi-Layer Perceptron for Land Use and Land Cover Mappingcited by 6
- 2024Importance of Disjoint Sampling in Conventional and Transformer Models for Hyperspectral Image Classificationcited by 1
Built on by
Citing papers per year: 2024: 4; 2025: 1; 2026: 2.
7 papers.
- 2024WaveMamba: Spatial-Spectral Wavelet Mamba for Hyperspectral Image Classificationcited by 11
- 2024Spatial and Spatial-Spectral Morphological Mamba for Hyperspectral Image Classificationcited by 7
- 2024Transformer-Driven Active Transfer Learning for Cross-Hyperspectral Image Classificationcited by 3
- 2024DiffFormer: a Differential Spatial-Spectral Transformer for Hyperspectral Image Classificationcited by 3
- 20263D Fourier-based Global Feature Extraction for Hyperspectral Image Classificationcited by 1
- 2025Dynamic Memory Transformer for Hyperspectral Image Classificationcited by 0
- 2026Cosine-Normalized Attention for Hyperspectral Image Classificationcited by 0
- 2026Cosine-Normalized Attention for Hyperspectral Image Classification2 Apr 2026
- 20263D Fourier-based Global Feature Extraction for Hyperspectral Image Classification17 Mar 2026
- 2025Dynamic Memory Transformer for Hyperspectral Image Classification17 Apr 2025
- 2024DiffFormer: a Differential Spatial-Spectral Transformer for Hyperspectral Image Classification23 Dec 2024
- 2024Transformer-Driven Active Transfer Learning for Cross-Hyperspectral Image Classification27 Nov 2024
- 2024Spatial and Spatial-Spectral Morphological Mamba for Hyperspectral Image Classification2 Aug 2024
- 2024WaveMamba: Spatial-Spectral Wavelet Mamba for Hyperspectral Image Classification2 Aug 2024