mlsanityData to 14 Oct 2026

Task-Sensitive Geometry of Representation Transfer for Object Detection under Image Degradation

arXiv 2610.04627 ↗First posted 3 Oct 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Object detection under image degradation can benefit from clean-image supervision, but aggregate gains do not imply that transferred representation changes are uniformly useful. We study how clean task knowledge affects degraded-image representations and whether local responses to structured representation directions can be characterized geometrically. Using paired clean and Gaussian-degraded BDD100K images, we show that clean-teacher distillation improves observed detection accuracy while producing heterogeneous object-level transfer. We isolate a representation component complementary to direct clean-teacher alignment and map it into the distilled student space through an orthogonal bridge. Controlled interventions rescue 13.22% of objects lost under the distilled representation, versus 4.30% under norm-matched random perturbations, with very low harm on preserved objects. We introduce task-sensitive geometry, a gradient-derived channel-space geometry constructed from normalized detection-loss gradients. On a reserved cohort, mapped-complement orientation within this frozen geometry is positively associated with local intervention-response magnitude after controlling for intervention magnitude (partial Spearman ρ = 0.242, 95% CI [0.108, 0.359]). The relationship eplicates on independent data (ρ = 0.180) and with RT-DETR-L (ρ = 0.227), but not for the direct clean-teacher residual family, and it weakens for large interventions. Routing rules and specialized distillation objectives based on these signals do not yield statistically reliable gains over CLEANKD. These results support a local, direction-family-dependent task-sensitive geometry while showing that converting such structure into improved global training remains an open problem.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 19 references that are in the map. First posted on arXiv 3 Oct 2026.

Builds on

15 of 19 references.

References · 15

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  2. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  3. 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
  4. 2019Task2Vec: Task Embedding for Meta-Learningcited by 205
  5. 2019Distilling Object Detectors with Fine-grained Feature Imitationcited by 189
  6. 2021Focal and Global Knowledge Distillation for Detectorscited by 142
  7. 2021General Instance Distillation for Object Detectioncited by 114
  8. 2021Distilling Object Detectors via Decoupled Featurescited by 106
  9. 2023CrossKD: Cross-Head Knowledge Distillation for Object Detectioncited by 52
  10. 2025UniRestore: Unified Perceptual and Task-Oriented Image Restoration Model Using Diffusion Priorcited by 42
  11. 2024Beyond Image Super-Resolution for Image Recognition with Task-Driven Perceptual Losscited by 18
  12. 2022KD-DETR: Knowledge Distillation for Detection Transformer with Consistent Distillation Points Samplingcited by 13
3 more
  1. 2022RestoreX-AI: A Contrastive Approach towards Guiding Image Restoration via Explainable AI Systemscited by 9
  2. 2024ERUP-YOLO: Enhancing Object Detection Robustness for Adverse Weather Condition by Unified Image-Adaptive Processingcited by 8
  3. 2025Exploiting Diffusion Prior for Task-driven Image Restorationcited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2021Distilling Image Classifiers in Object Detectors
  2. 2022Towards Efficient 3D Object Detection with Knowledge Distillation
  3. 2026Enhanced Knowledge Distillation for Detection Transformer via Teacher Prediction Refinement
  4. 2021Revisiting Knowledge Distillation for Object Detection
  5. 2022Task-Balanced Distillation for Object Detection
  6. 2021Multi-Scale Aligned Distillation for Low-Resolution Detection
  7. 2024Task Integration Distillation for Object Detectors
  8. 2026Probing the 3D Object-Level Understanding of Pre-Trained Detection Transformers