GlobalMind: Global Multi-head Interactive Self-attention Network for Hyperspectral Change Detection
Not on the map. Why?
Abstract (arXiv)
High spectral resolution imagery of the Earth's surface enables users to monitor changes over time in fine-grained scale, playing an increasingly important role in agriculture, defense, and emergency response. However, most current algorithms are still confined to describing local features and fail to incorporate a global perspective, which limits their ability to capture interactions between global features, thus usually resulting in incomplete change regions. In this paper, we propose a Global Multi-head INteractive self-attention change Detection network (GlobalMind) to explore the implicit correlation between different surface objects and variant land cover transformations, acquiring a comprehensive understanding of the data and accurate change detection result. Firstly, a simple but effective Global Axial Segmentation (GAS) strategy is designed to expand the self-attention computation along the row space or column space of hyperspectral images, allowing the global connection with high efficiency. Secondly, with GAS, the global spatial multi-head interactive self-attention (Global-M) module is crafted to mine the abundant spatial-spectral feature involving potential correlations between the ground objects from the entire rich and complex hyperspectral space. Moreover, to acquire the accurate and complete cross-temporal changes, we devise a global temporal interactive multi-head self-attention (GlobalD) module which incorporates the relevance and variation of bi-temporal spatial-spectral features, deriving the integrate potential same kind of changes in the local and global range with the combination of GAS. We perform extensive experiments on five mostly used hyperspectral datasets, and our method outperforms the state-of-the-art algorithms with high accuracy and efficiency.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 25 of its 75 references that are in the map. First posted on arXiv 18 Apr 2023.
Builds on
25 of 75 references.
References · 25
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2017Graph Attention Networkscited by 8,923
- 2016Layer Normalizationcited by 5,669
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,611
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
- 2021Do Vision Transformers See Like Convolutional Neural Networks?cited by 675
- 2022How Do Vision Transformers Work?cited by 307
- 2021Remote Sensing Image Change Detection with Transformerscited by 306
- 2019Tackling Climate Change with Machine Learningcited by 265
13 more
- 2022Advancing Plain Vision Transformer Towards Remote Sensing Foundation Modelcited by 149
- 2021A Survey of Visual Transformerscited by 117
- 2022DynamicEarthNet: Daily Multi-Spectral Satellite Dataset for Semantic Change Segmentationcited by 78
- 2022Transformers in Remote Sensing: A Surveycited by 61
- 2022Fully Convolutional Change Detection Framework with Generative Adversarial Network for Unsupervised, Weakly Supervised and Regional Supervised Change Detectioncited by 46
- 2019GETNET: A General End-to-end Two-dimensional CNN Framework for Hyperspectral Image Change Detectioncited by 37
- 2022HyperTransformer: A Textural and Spectral Feature Fusion Transformer for Pansharpeningcited by 32
- 2021Endmember-Guided Unmixing Network (EGU-Net): A General Deep Learning Framework for Self-Supervised Hyperspectral Unmixingcited by 29
- 2022AI Security for Geoscience and Remote Sensing: Challenges and Future Trendscited by 23
- 2021Binary Change Guided Hyperspectral Multiclass Change Detectioncited by 20
- 2022HyperNet: Self-Supervised Hyperspectral Spatial-Spectral Feature Understanding Network for Hyperspectral Change Detectioncited by 9
- 2022Sketched Multi-view Subspace Learning for Hyperspectral Anomalous Change Detectioncited by 3
- 2023EMS-Net: Efficient Multi-Temporal Self-Attention For Hyperspectral Change Detectioncited by 2
Built on by
Citing papers per year: 2024: 3; 2025: 6.
9 papers.
- 2024HyperSIGMA: Hyperspectral Intelligence Comprehension Foundation Modelcited by 73
- 2025HyperFree: A Channel-adaptive and Tuning-free Foundation Model for Hyperspectral Remote Sensing Imagerycited by 17
- 2024SpecDETR: A transformer-based hyperspectral point object detection networkcited by 6
- 2024SpectralKAN: Weighted Activation Distribution Kolmogorov-Arnold Network for Hyperspectral Image Change Detectioncited by 4
- 2025FSG-Net: Frequency-Spatial Synergistic Gated Network for High-Resolution Remote Sensing Change Detectioncited by 2
- 2025Multitemporal Latent Dynamical Framework for Hyperspectral Images Unmixingcited by 1
- 2025SpecAware: A Spectral-Content Aware Foundation Model for Unifying Multi-Sensor Learning in Hyperspectral Remote Sensing Mappingcited by 1
- 2025i-WiViG: Interpretable Window Vision GNNcited by 0
- 2025A Cross-Hierarchical Difference Feature Fusion Network Based on Multiscale Encoder-Decoder for Hyperspectral Change Detectioncited by 0
- 2025SpecAware: A Spectral-Content Aware Foundation Model for Unifying Multi-Sensor Learning in Hyperspectral Remote Sensing Mapping31 Oct 2025
- 2025A Cross-Hierarchical Difference Feature Fusion Network Based on Multiscale Encoder-Decoder for Hyperspectral Change Detection21 Sep 2025
- 2025FSG-Net: Frequency-Spatial Synergistic Gated Network for High-Resolution Remote Sensing Change Detection8 Sep 2025
- 2025Multitemporal Latent Dynamical Framework for Hyperspectral Images Unmixing27 May 2025
- 2025HyperFree: A Channel-adaptive and Tuning-free Foundation Model for Hyperspectral Remote Sensing Imagery27 Mar 2025
- 2025i-WiViG: Interpretable Window Vision GNN11 Mar 2025
- 2024SpectralKAN: Weighted Activation Distribution Kolmogorov-Arnold Network for Hyperspectral Image Change Detection1 Jul 2024
- 2024HyperSIGMA: Hyperspectral Intelligence Comprehension Foundation Model17 Jun 2024
- 2024SpecDETR: A transformer-based hyperspectral point object detection network16 May 2024