# Attention Mechanism Meets with Hybrid Dense Network for Hyperspectral Image Classification

arXiv: https://arxiv.org/abs/2201.01001 · HTML: https://mlsanity.com/paper/2201.01001/

## Key facts

- Cited by 6 papers in the map (data through 14 Oct 2026).
- Builds on 20 of its 49 references that are in the map.
- First posted on arXiv 4 Jan 2022.

## Builds on (most cited first, 20 of 20)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Squeeze-and-Excitation Networks](https://mlsanity.com/paper/1709.01507/) (2017)
- [CBAM: Convolutional Block Attention Module](https://mlsanity.com/paper/1807.06521/) (2018)
- [Non-local Neural Networks](https://mlsanity.com/paper/1711.07971/) (2017)
- [ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks](https://mlsanity.com/paper/1910.03151/) (2019)
- [GCNet: Non-local Networks Meet Squeeze-Excitation Networks and Beyond](https://mlsanity.com/paper/1904.11492/) (2019)
- [SpectralFormer: Rethinking Hyperspectral Image Classification with Transformers](https://mlsanity.com/paper/2107.02988/) (2021)
- [More Diverse Means Better: Multimodal Deep Learning Meets Remote Sensing Imagery Classification](https://mlsanity.com/paper/2008.05457/) (2020)
- [Graph Convolutional Networks for Hyperspectral Image Classification](https://mlsanity.com/paper/2008.02457/) (2020)
- [HybridSN: Exploring 3D-2D CNN Feature Hierarchy for Hyperspectral Image Classification](https://mlsanity.com/paper/1902.06701/) (2019)
- [An Augmented Linear Mixing Model to Address Spectral Variability for Hyperspectral Unmixing](https://mlsanity.com/paper/1810.12000/) (2018)
- [Hyperspectral Image Classification-Traditional to Deep Models: A Survey for Future Prospects](https://mlsanity.com/paper/2101.06116/) (2021)
- [Multimodal Remote Sensing Benchmark Datasets for Land Cover Classification with A Shared and Specific Feature Learning Model](https://mlsanity.com/paper/2105.10196/) (2021)
- [Feature Extraction for Hyperspectral Imagery: The Evolution from Shallow to Deep (Overview and Toolbox)](https://mlsanity.com/paper/2003.02822/) (2020)
- [Learnable Manifold Alignment (LeMA) : A Semi-supervised Cross-modality Learning Framework for Land Cover and Land Use Classification](https://mlsanity.com/paper/1901.02838/) (2019)
- [Joint and Progressive Subspace Analysis (JPSA) with Spatial-Spectral Manifold Alignment for Semi-Supervised Hyperspectral Dimensionality Reduction](https://mlsanity.com/paper/2009.10003/) (2020)
- [Segmented and Non-Segmented Stacked Denoising Autoencoder for Hyperspectral Band Reduction](https://mlsanity.com/paper/1705.06920/) (2017)
- [Hyperspectral Image Classification: Artifacts of Dimension Reduction on Hybrid CNN](https://mlsanity.com/paper/2101.10532/) (2021)
- [Learning Hyperspectral Feature Extraction and Classification with ResNeXt Network](https://mlsanity.com/paper/2002.02585/) (2020)
- [3D/2D regularized CNN feature hierarchy for Hyperspectral image classification](https://mlsanity.com/paper/2104.12136/) (2021)

## Built on by (most cited first, 6 of 6)

- [A Comprehensive Survey for Hyperspectral Image Classification: The Evolution from Conventional to Transformers and Mamba Models](https://mlsanity.com/paper/2404.14955/) (2024)
- [Transformers Fusion across Disjoint Samples for Hyperspectral Image Classification](https://mlsanity.com/paper/2405.01095/) (2024)
- [Spatial and Spatial-Spectral Morphological Mamba for Hyperspectral Image Classification](https://mlsanity.com/paper/2408.01372/) (2024)
- [3D Fourier-based Global Feature Extraction for Hyperspectral Image Classification](https://mlsanity.com/paper/2603.16426/) (2026)
- [Dynamic Memory Transformer for Hyperspectral Image Classification](https://mlsanity.com/paper/2504.13242/) (2025)
- [Cosine-Normalized Attention for Hyperspectral Image Classification](https://mlsanity.com/paper/2604.01763/) (2026)

## Abstract (arXiv)

Convolutional Neural Networks (CNN) are more suitable, indeed. However, fixed kernel sizes make traditional CNN too specific, neither flexible nor conducive to feature learning, thus impacting on the classification accuracy. The convolution of different kernel size networks may overcome this problem by capturing more discriminating and relevant information. In light of this, the proposed solution aims at combining the core idea of 3D and 2D Inception net with the Attention mechanism to boost the HSIC CNN performance in a hybrid scenario. The resulting textitattention-fused hybrid network (AfNet) is based on three attention-fused parallel hybrid sub-nets with different kernels in each block repeatedly using high-level features to enhance the final ground-truth maps. In short, AfNet is able to selectively filter out the discriminative features critical for classification. Several tests on HSI datasets provided competitive results for AfNet compared to state-of-the-art models. The proposed pipeline achieved, indeed, an overall accuracy of 97% for the Indian Pines, 100% for Botswana, 99% for Pavia University, Pavia Center, and Salinas datasets.