# Transformer-Driven Active Transfer Learning for Cross-Hyperspectral Image Classification

arXiv: https://arxiv.org/abs/2411.18115 · HTML: https://mlsanity.com/paper/2411.18115/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 11 of its 64 references that are in the map.
- First posted on arXiv 27 Nov 2024.

## Builds on (most cited first, 11 of 11)

- [A Survey of Deep Active Learning](https://mlsanity.com/paper/2009.00236/) (2020)
- [SpectralFormer: Rethinking Hyperspectral Image Classification with Transformers](https://mlsanity.com/paper/2107.02988/) (2021)
- [A Survey: Deep Learning for Hyperspectral Image Classification with Few Labeled Samples](https://mlsanity.com/paper/2112.01800/) (2021)
- [Active Transfer Learning Network: A Unified Deep Joint Spectral-Spatial Feature Learning Model For Hyperspectral Image Classification](https://mlsanity.com/paper/1904.02454/) (2019)
- [Few-Shot Hyperspectral Image Classification With Unknown Classes Using Multitask Deep Learning](https://mlsanity.com/paper/2009.03508/) (2020)
- [Deep Learning Techniques for Hyperspectral Image Analysis in Agriculture: A Review](https://mlsanity.com/paper/2304.13880/) (2023)
- [Pyramid Hierarchical Transformer for Hyperspectral Image Classification](https://mlsanity.com/paper/2404.14945/) (2024)
- [WaveMamba: Spatial-Spectral Wavelet Mamba for Hyperspectral Image Classification](https://mlsanity.com/paper/2408.01231/) (2024)
- [S2Mamba: A Spatial-spectral State Space Model for Hyperspectral Image Classification](https://mlsanity.com/paper/2404.18213/) (2024)
- [Multi-head Spatial-Spectral Mamba for Hyperspectral Image Classification](https://mlsanity.com/paper/2408.01224/) (2024)
- [Transformers Fusion across Disjoint Samples for Hyperspectral Image Classification](https://mlsanity.com/paper/2405.01095/) (2024)

## Built on by (most cited first, 3 of 3)

- [3D Fourier-based Global Feature Extraction for Hyperspectral Image Classification](https://mlsanity.com/paper/2603.16426/) (2026)
- [Dynamic Memory Transformer for Hyperspectral Image Classification](https://mlsanity.com/paper/2504.13242/) (2025)
- [Cosine-Normalized Attention for Hyperspectral Image Classification](https://mlsanity.com/paper/2604.01763/) (2026)

## Abstract (arXiv)

Hyperspectral image (HSI) classification presents inherent challenges due to high spectral dimensionality, significant domain shifts, and limited availability of labeled data. To address these issues, we propose a novel Active Transfer Learning (ATL) framework built upon a Spatial-Spectral Transformer (SST) backbone. The framework integrates multistage transfer learning with an uncertainty-diversity-driven active learning mechanism that strategically selects highly informative and diverse samples for annotation, thereby significantly reducing labeling costs and mitigating sample redundancy. A dynamic layer freezing strategy is introduced to enhance transferability and computational efficiency, enabling selective adaptation of model layers based on domain shift characteristics. Furthermore, we incorporate a self-calibrated attention mechanism that dynamically refines spatial and spectral weights during adaptation, guided by uncertainty-aware feedback. A diversity-promoting sampling strategy ensures broad spectral coverage among selected samples, preventing overfitting to specific classes. Extensive experiments on benchmark cross-domain HSI datasets demonstrate that the proposed SST-ATL framework achieves superior classification performance compared to conventional approaches. The source code is publicly available at https://github.com/mahmad000/ATL-SST.
