PSMamba: Progressive Self-supervised Vision Mamba for Plant Disease Recognition
On the map: State-space sequence models (S4, Mamba) → Mamba for medical image analysis
Abstract (arXiv)
Self-supervised Learning (SSL) has become a powerful paradigm for representation learning without manual annotations. However, most existing frameworks focus on global alignment and struggle to capture the hierarchical, multi-scale lesion patterns characteristic of plant disease imagery. To address this gap, we propose PSMamba, a progressive self-supervised framework that integrates the efficient sequence modelling of Vision Mamba (VM) with a dual-student hierarchical distillation strategy. Unlike conventional single teacher-student designs, PSMamba employs a shared global teacher and two specialised students: one processes mid-scale views to capture lesion distributions and vein structures, while the other focuses on local views to capture fine-grained cues such as texture irregularities and early-stage lesions. This multi-granular supervision facilitates the joint learning of contextual and detailed representations, with consistency losses ensuring coherent cross-scale alignment. Experiments on three benchmark datasets show that PSMamba consistently outperforms state-of-the-art SSL methods, delivering superior accuracy and robustness in both domain-shifted and fine-grained scenarios.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Mamba for medical image analysis, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 40 of its 55 references that are in the map. First posted on arXiv 16 Dec 2025.
Builds on
40 of 55 references.
References · 40
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
- 2020Exploring Simple Siamese Representation Learningcited by 2,866
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
28 more
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,375
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,591
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,153
- 2016Colorful Image Colorizationcited by 1,114
- 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,057
- 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 903
- 2021Multiscale Vision Transformerscited by 897
- 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
- 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 605
- 2015An open access repository of images on plant health to enable the development of mobile disease diagnosticscited by 135
- 2021SEED: Self-supervised Distillation For Visual Representationcited by 134
- 2021TransFG: A Transformer Architecture for Fine-grained Recognitioncited by 132
- 2024Motion Mamba: Efficient and Long Sequence Motion Generationcited by 112
- 2019PlantDoc: A Dataset for Visual Plant Disease Detectioncited by 68
- 2020CompRess: Self-Supervised Learning by Compressing Representationscited by 62
- 2024Audio Mamba: Bidirectional State Space Model for Audio Representation Learningcited by 37
- 2020ISD: Self-Supervised Learning by Iterative Similarity Distillationcited by 33
- 2021Bag of Instances Aggregation Boosts Self-supervised Distillationcited by 22
- 2022SimReg: Regression as a Simple Yet Effective Tool for Self-supervised Knowledge Distillationcited by 21
- 2024SSD-TS: Exploring the Potential of Linear State Space Models for Diffusion Models in Time Series Imputationcited by 18
- 2024Bi-Mamba+: Bidirectional Mamba for Time Series Forecastingcited by 15
- 2024HARMamba: Efficient and Lightweight Wearable Sensor Human Activity Recognition Based on Bidirectional Mambacited by 12
- 2024BiT-MamSleep: Bidirectional Temporal Mamba for EEG Sleep Stagingcited by 5
- 2024Mamba-based Decoder-Only Approach with Bidirectional Speech Modeling for Speech Recognitioncited by 5
- 2021Auxiliary Learning for Self-Supervised Video Representation via Similarity-based Knowledge Distillationcited by 3
- 2025ConMamba: Contrastive Vision Mamba for Plant Disease Detectioncited by 2
- 2024BEST-STD: Bidirectional Mamba-Enhanced Speech Tokenization for Spoken Term Detectioncited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025StateSpace-SSL: Linear-Time Self-supervised Learning for Plant Disease Detection
- 2026SAGE: Scalable Agentic Grounded Evaluation for Crop Disease Diagnosis ↗
- 2026Energy-Efficient Plant Monitoring via Knowledge Distillation
- 2026Mam-App: A Novel Parameter-Efficient Mamba Model for Apple Leaf Disease Classification
- 2026TomaMMU: A Comprehensive Multimodal Understanding Benchmark for Tomato Leaf Diseases
- 2026Cross-Architecture Knowledge Distillation from a Vision Foundation Model to a Lightweight Visual State Space Model for Tea Leaf Disease Classification
- 2026LeafNet: A Large-Scale Dataset and Comprehensive Benchmark for Foundational Vision-Language Understanding of Plant Diseases
- 2025Self-Consistency in Vision-Language Models for Precision Agriculture: Multi-Response Consensus for Crop Disease Management