MBTI: A Multi-Branch Efficient Fine-Tuning Framework for Hyperspectral Image Classification with Foundation Models
Not on the map. Why?
Abstract (arXiv)
Hyperspectral foundation models learn transferable spectral-spatial representations from large-scale unlabeled data. They provide an effective paradigm for adapting to downstream hyperspectral image (HSI) classification tasks with limited labeled samples. However, spectral band configurations vary substantially across sensors, which makes direct model transfer difficult. Existing adaptation strategies often compress, select, or reshape the original spectra to match model-specific input requirements. These operations may discard useful spectral information and weaken local spectral continuity. To address this problem, we propose MBTI, a Multi-Branch efficient fine-tuning framework for Hyperspectral Image classification. MBTI adapts hyperspectral foundation models to downstream classification tasks while preserving full-band spectral information. First, we introduce a spectral-continuity-preserving multi-branch preprocessing strategy. The original HSI is divided into multiple continuous spectral subsets, and a band reuse mechanism is used when the remaining bands cannot form a complete branch. This avoids invalid padding and unnecessary spectral loss. Second, independent Low-Rank Adaptation (LoRA) modules are inserted into each branch. They enable different spectral intervals to learn task-specific discriminative features while keeping most pre-trained parameters frozen. Finally, a multi-branch channel attention fusion module adaptively recalibrates and integrates features from all spectral branches. Experiments on three public hyperspectral datasets show that MBTI achieves competitive and superior performance compared with representative classification methods. Under the final rank-8 configuration, only about 2.33%--2.36% of the parameters are trainable. The code will be available at https://github.com/Azhenmiddleblock/MBTI/tree/main.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 40 references that are in the map. First posted on arXiv 14 Jul 2026.
Builds on
14 of 40 references.
References · 14
- 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 656
- 2023Parameter-Efficient Fine-Tuning Methods for Pretrained Language Models: A Critical Review and Assessmentcited by 230
- 2021SpectralFormer: Rethinking Hyperspectral Image Classification with Transformerscited by 169
- 2019Deep Learning for Hyperspectral Image Classification: An Overviewcited by 123
- 2024HyperSIGMA: Hyperspectral Intelligence Comprehension Foundation Modelcited by 73
- 2016Going Deeper with Contextual CNN for Hyperspectral Image Classificationcited by 59
- 2024Vision Foundation Models in Remote Sensing: A Surveycited by 54
- 2019Deep Learning for Classification of Hyperspectral Data: A Comparative Reviewcited by 51
- 2024SpectralEarth: Training Hyperspectral Foundation Models at Scalecited by 42
- 2024Parameter-Efficient Fine-Tuning for Pre-Trained Vision Models: A Survey and Benchmarkcited by 23
- 2025HyperFree: A Channel-adaptive and Tuning-free Foundation Model for Hyperspectral Remote Sensing Imagerycited by 17
- 2025SpectralX: Parameter-efficient Domain Generalization for Spectral Remote Sensing Foundation Modelscited by 5
Built on by
Not cited yet.