Remote Sensing Image Classification with Decoupled Knowledge Distillation
On the map: Knowledge distillation → Detection and dense prediction distillation
Abstract (arXiv)
To address the challenges posed by the large number of parameters in existing remote sensing image classification models, which hinder deployment on resource-constrained devices, this paper proposes a lightweight classification method based on knowledge distillation. Specifically, G-GhostNet is adopted as the backbone network, leveraging feature reuse to reduce redundant parameters and significantly improve inference efficiency. In addition, a decoupled knowledge distillation strategy is employed, which separates target and non-target classes to effectively enhance classification accuracy. Experimental results on the RSOD and AID datasets demonstrate that, compared with the high-parameter VGG-16 model, the proposed method achieves nearly equivalent Top-1 accuracy while reducing the number of parameters by 6.24 times. This approach strikes an excellent balance between model size and classification performance, offering an efficient solution for deployment on resource-limited devices.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Detection and dense prediction distillation, one of 12 directions in Knowledge distillation. Builds on 8 of its 91 references that are in the map. First posted on arXiv 25 May 2025.
Builds on
8 of 91 references.
References · 8
- 2023Structured Pruning for Deep Convolutional Neural Networks: A surveycited by 122
- 2024RSMamba: Remote Sensing Image Classification with State Space Modelcited by 95
- 2024RS-Mamba for Large Remote Sensing Image Dense Predictioncited by 81
- 2023EDiffSR: An Efficient Diffusion Probabilistic Model for Remote Sensing Image Super-Resolutioncited by 56
- 2018Wide Compression: Tensor Ring Netscited by 50
- 2021On Representation Knowledge Distillation for Graph Neural Networkscited by 38
- 2020Variational Bayesian Monte Carlo with Noisy Likelihoodscited by 23
- 2022On the Effects of Different Types of Label Noise in Multi-Label Remote Sensing Image Classificationcited by 17
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Applications of Knowledge Distillation in Remote Sensing: A Survey
- 2024Semantic Knowledge Distillation for Onboard Satellite Earth Observation Image Classification
- 2025Dual-Stream Spectral Decoupling Distillation for Remote Sensing Object Detection
- 2026Improved Knowledge Distillation for Land-Use Image Classification
- 2025Lightweight Remote Sensing Scene Classification on Edge Devices via Knowledge Distillation and Early-exit
- 2023Knowledge Distillation for Object Detection: from generic to remote sensing datasets
- 2023Efficient Object Detection in Optical Remote Sensing Imagery via Attention-based Feature Distillation
- 2021Embedded Self-Distillation in Compact Multi-Branch Ensemble Network for Remote Sensing Scene Classification