SpecBPP: A Self-Supervised Learning Approach for Hyperspectral Representation and Soil Organic Carbon Estimation
Not on the map. Why?
Abstract (arXiv)
Self-supervised learning has revolutionized representation learning in vision and language, but remains underexplored for hyperspectral imagery (HSI), where the sequential structure of spectral bands offers unique opportunities. In this work, we propose Spectral Band Permutation Prediction (SpecBPP), a novel self-supervised learning framework that leverages the inherent spectral continuity in HSI. Instead of reconstructing masked bands, SpecBPP challenges a model to recover the correct order of shuffled spectral segments, encouraging global spectral understanding. We implement a curriculum-based training strategy that progressively increases permutation difficulty to manage the factorial complexity of the permutation space. Applied to Soil Organic Carbon (SOC) estimation using EnMAP satellite data, our method achieves state-of-the-art results, outperforming both masked autoencoder (MAE) and joint-embedding predictive (JEPA) baselines. Fine-tuned on limited labeled samples, our model yields an R2 of 0.9456, RMSE of 1.1053%, and RPD of 4.19, significantly surpassing traditional and self-supervised benchmarks. Our results demonstrate that spectral order prediction is a powerful pretext task for hyperspectral understanding, opening new avenues for scientific representation learning in remote sensing and beyond.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 20 of its 51 references that are in the map. First posted on arXiv 26 Jul 2025.
Builds on
20 of 51 references.
References · 20
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2018CBAM: Convolutional Block Attention Modulecited by 2,463
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
- 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,379
- 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,062
8 more
- 2018Dual Attention Network for Scene Segmentationcited by 1,001
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
- 2019On The Power of Curriculum Learning in Training Deep Networkscited by 285
- 2021Curriculum Learning: A Surveycited by 257
- 2021SpectralFormer: Rethinking Hyperspectral Image Classification with Transformerscited by 168
- 2020Graph Convolutional Networks for Hyperspectral Image Classificationcited by 113
- 2021Bayesian Optimization over Permutation Spacescited by 17
- 2023HyperKon: A Self-Supervised Contrastive Network for Hyperspectral Image Analysiscited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.