mlsanityData to 14 Oct 2026

DTKDP: A Dual Teacher Knowledge Distillation and Pruning Framework for Lightweight Oriented SAR Ship Detection

arXiv 2609.24872 ↗First posted 21 Sep 2026cs.CVcited by 0

On the map: Knowledge distillation → Detection and dense prediction distillation

Abstract (arXiv)

Two-stage oriented detectors achieve high localization accuracy in synthetic aperture radar (SAR) ship detection, but their large backbones, feature pyramids, proposal modules, and heavy region of interest (RoI) heads hinder deployment. Existing lightweight SAR ship detectors typically use one-stage frameworks that lack proposal-level refinement for precise rotated localization. This paper presents a dual-teacher knowledge distillation and pruning (DTKDP) framework for lightweight oriented SAR ship detection. DTKDP introduces learnable gates into convolutional, normalization, and linear layers to prune convolutional channels and RoI-head neurons. Rotated proposal alignment (RPA) distills teacher and student predictions in a shared teacher-generated rotated proposal space, while a dual-teacher scheme combines classification and regression guidance from a homogeneous main teacher with complementary classification cues from a heterogeneous auxiliary teacher. Experiments on the SAR Ship Detection Dataset (SSDD) and Rotated Ship Detection Dataset in SAR Images (RSDD-SAR) show that DTKDP reduces the parameters of Oriented Region-based Convolutional Neural Network (Oriented R-CNN) and RoI Transformer equipped with ResNet-50 backbones by 87.5-91.8% and their floating-point operations (FLOPs) by 75.6-79.9%. In terms of average precision (AP) and mean average precision (mAP), the resulting Oriented R-CNN-slim and RoI Transformer-slim retain accuracy close to their full-scale counterparts. Relative changes across AP50, AP75, mAP50:75, and mAP50:95 range from a 2.38% decrease to a 0.65% improvement. Compared with RTMDet-tiny, they improve all four metrics on both datasets by 0.52-27.55% and consistently surpass representative distillation methods, demonstrating a favorable accuracy-efficiency trade-off.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Detection and dense prediction distillation, one of 12 directions in Knowledge distillation. Builds on 32 of its 74 references that are in the map. First posted on arXiv 21 Sep 2026.

Builds on

32 of 74 references.

Closest ancestors · 4

Same direction, newest first

  1. 2023CrossKD: Cross-Head Knowledge Distillation for Object Detection20 Jun
  2. 2022PKD: General Distillation Framework for Object Detectors via Pearson Correlation Coefficient5 Jul
  3. 2021Focal and Global Knowledge Distillation for Detectors23 Nov
  4. 2021Localization Distillation for Dense Object Detection24 Feb

Other references · 28

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  4. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  5. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  6. 2017Channel Pruning for Accelerating Very Deep Neural Networkscited by 702
  7. 2017Learning Efficient Convolutional Networks through Network Slimmingcited by 676
  8. 2016Learning Structured Sparsity in Deep Neural Networkscited by 541
  9. 2017ThiNet: A Filter Level Pruning Method for Deep Neural Network Compressioncited by 442
  10. 2021Oriented R-CNN for Object Detectioncited by 231
  11. 2021ReDet: A Rotation-equivariant Detector for Aerial Object Detectioncited by 203
  12. 2022RTMDet: An Empirical Study of Designing Real-Time Object Detectorscited by 195
16 more
  1. 2019R3Det: Refined Single-Stage Detector with Feature Refinement for Rotating Objectcited by 194
  2. 2019Distilling Object Detectors with Fine-grained Feature Imitationcited by 189
  3. 2020Align Deep Features for Oriented Object Detectioncited by 187
  4. 2020Channel-wise Knowledge Distillation for Dense Predictioncited by 163
  5. 2019Gate Decorator: Global Filter Pruning Method for Accelerating Deep Convolutional Neural Networkscited by 118
  6. 2022MMRotate: A Rotated Object Detection Benchmark using PyTorchcited by 115
  7. 2022Masked Generative Distillationcited by 107
  8. 2021Distilling Object Detectors with Feature Richnesscited by 38
  9. 2023ARS-DETR: Aspect Ratio-Sensitive Detection Transformer for Aerial Oriented Object Detectioncited by 32
  10. 2024RT-DETRv3: Real-time End-to-End Object Detection with Hierarchical Dense Positive Supervisioncited by 32
  11. 2017Light-Head R-CNN: In Defense of Two-Stage Object Detectorcited by 30
  12. 2024MTKD: Multi-Teacher Knowledge Distillation for Image Super-Resolutioncited by 17
  13. 2021FCOSR: A Simple Anchor-free Rotated Detector for Aerial Object Detectioncited by 10
  14. 2021Learning Polar Encodings for Arbitrary-Oriented Ship Detection in SAR Imagescited by 3
  15. 2025R-Sparse R-CNN: SAR Ship Detection Based on Background-Aware Sparse Learnable Proposalscited by 3
  16. 2025NASTaR: NovaSAR Automated Ship Target Recognition Datasetcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Lightweight SAR Ship Detection via Contrastive Distillation
  2. 2026SARES-DEIM: Sparse Mixture-of-Experts Meets DETR for Robust SAR Ship Detection
  3. 2023Double Reverse Regularization Network Based on Self-Knowledge Distillation for SAR Object Classification
  4. 2026Learning to Focus Synthetic Aperture Radar On-line with State-Space Models ↗
  5. 2025Knowledge-Informed Neural Network for Complex-Valued SAR Image Recognition
  6. 2025SSMRadNet : A Sample-wise State-Space Framework for Efficient and Ultra-Light Radar Segmentation and Object Detection
  7. 2023Efficient Object Detection in Optical Remote Sensing Imagery via Attention-based Feature Distillation
  8. 2026SAMBA: A Scatter-Guided Masked Bidirectional Mamba Foundation Model for SAR Target Recognition