Lightweight SAR Ship Detection via Contrastive Distillation
On the map: Knowledge distillation → Detection and dense prediction distillation
Abstract (arXiv)
Deep convolutional and transformer-based detectors achieve strong performance for SAR ship detection but are often computationally prohibitive for real-time or onboard deployment. Lightweight models offer improved efficiency yet struggle to capture the complex structural relationships inherent in SAR backscatter. Most existing SAR knowledge-distillation approaches rely on feature or logit matching, which enforces localized activation similarity while neglecting the geometric relationships among object representations. We propose a Structured Unified Relational knowledGE distillation framework for SAR Ship detection (SURGE) that transfers relational geometry from a powerful teacher detector to a compact student detector using a contrastive InfoNCE objective in a shared projection embedding space. To the best of our knowledge, this work presents the first transformer-based SAR ship detector knowledge distillation framework in SAR domain. The framework is architecture-agnostic in the sense that it provides a common region-level distillation interface for two-stage, one-stage and transformer-based detectors without modifying their deployed architectures. Experiments on the SSDD and HRSID benchmarks demonstrate that the proposed method yields substantial improvements for two-stage detectors, achieving up to 6.2 mAP and 8.0 AP75 gains over baseline student and even surpassing teacher performance
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Detection and dense prediction distillation, one of 12 directions in Knowledge distillation. Builds on 7 of its 26 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
7 of 26 references.
References · 7
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2015Fast R-CNNcited by 2,933
- 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,845
- 2019Relational Knowledge Distillationcited by 889
- 2019Contrastive Representation Distillationcited by 748
- 2019Similarity-Preserving Knowledge Distillationcited by 516
- 2020Deep Learning Meets SARcited by 60
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026DTKDP: A Dual Teacher Knowledge Distillation and Pruning Framework for Lightweight Oriented SAR Ship Detection
- 2026SARES-DEIM: Sparse Mixture-of-Experts Meets DETR for Robust SAR Ship Detection
- 2024DiffDet4SAR: Diffusion-based Aircraft Target Detection Network for SAR Images
- 2024RadarDistill: Boosting Radar-based Object Detection Performance via Knowledge Distillation from LiDAR Features
- 2022DETRDistill: A Universal Knowledge Distillation Framework for DETR-families
- 2023Dual Relation Knowledge Distillation for Object Detection
- 2023Double Reverse Regularization Network Based on Self-Knowledge Distillation for SAR Object Classification
- 2023Efficient Object Detection in Optical Remote Sensing Imagery via Attention-based Feature Distillation