mlsanityData to 7 Oct 2026

VP-Hype: A Hybrid Mamba-Transformer Framework with Visual-Textual Prompting for Hyperspectral Image Classification

arXiv 2603.01174 ↗First posted 1 Mar 2026cs.CVcited by 0

On the map: State-space sequence models (S4, Mamba) → Hyperspectral image analysis with Mamba

Abstract (arXiv)

Accurate classification of hyperspectral imagery (HSI) is often frustrated by the tension between high-dimensional spectral data and the extreme scarcity of labeled training samples. While hierarchical models like LoLA-SpecViT have demonstrated the power of local windowed attention and parameter-efficient fine-tuning, the quadratic complexity of standard Transformers remains a barrier to scaling. We introduce VP-Hype, a framework that rethinks HSI classification by unifying the linear-time efficiency of State-Space Models (SSMs) with the relational modeling of Transformers in a novel hybrid architecture. Building on a robust 3D-CNN spectral front-end, VP-Hype replaces conventional attention blocks with a Hybrid Mamba-Transformer backbone to capture long-range dependencies with significantly reduced computational overhead. Furthermore, we address the label-scarcity problem by integrating dual-modal Visual and Textual Prompts that provide context-aware guidance for the feature extraction process. Our experimental evaluation demonstrates that VP-Hype establishes a new state of the art in low-data regimes. Specifically, with a training sample distribution of only 2%, the model achieves Overall Accuracy (OA) of 99.69% on the Salinas dataset and 99.45% on the Longkou dataset. These results suggest that the convergence of hybrid sequence modeling and multi-modal prompting provides a robust path forward for high-performance, sample-efficient remote sensing.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Hyperspectral image analysis with Mamba, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 14 of its 31 references that are in the map. First posted on arXiv 1 Mar 2026.

Builds on

14 of 31 references.

References · 14

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  4. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  5. 2022Visual Prompt Tuningcited by 1,674
  6. 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,234
  7. 2021Rethinking Spatial Dimensions of Vision Transformerscited by 361
  8. 2024InstructIR: High-Quality Image Restoration Following Human Instructionscited by 139
  9. 2023PromptIR: Prompting for All-in-One Blind Image Restorationcited by 113
  10. 2019HybridSN: Exploring 3D-2D CNN Feature Hierarchy for Hyperspectral Image Classificationcited by 91
  11. 2023Prompt-In-Prompt Learning for Universal Image Restorationcited by 43
  12. 2024PromptHSI: Universal Hyperspectral Image Restoration with Vision-Language Modulated Frequency Adaptationcited by 6
2 more
  1. 2025MP-HSIR: A Multi-Prompt Framework for Universal Hyperspectral Image Restorationcited by 6
  2. 2025LoLA-SpecViT: Local Attention SwiGLU Vision Transformer with LoRA for Hyperspectral Imagingcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025MVNet: Hyperspectral Remote Sensing Image Classification Based on Hybrid Mamba-Transformer Vision Backbone Architecture
  2. 2026ConvVitMamba: Efficient Multiscale Convolution, Transformer, and Mamba-Based Sequence modelling for Hyperspectral Image Classification
  3. 2024SpectralMamba: Efficient Mamba for Hyperspectral Image Classification
  4. 2024A Comprehensive Survey for Hyperspectral Image Classification: The Evolution from Conventional to Transformers and Mamba Models
  5. 20243DSS-Mamba: 3D-Spectral-Spatial Mamba for Hyperspectral Image Classification
  6. 2025Hybrid State-Space and GRU-based Graph Tokenization Mamba for Hyperspectral Image Classification
  7. 2024DualMamba: A Lightweight Spectral-Spatial Mamba-Convolution Network for Hyperspectral Image Classification
  8. 2024WaveMamba: Spatial-Spectral Wavelet Mamba for Hyperspectral Image Classification