Cross-Domain Dead Tree Detection via Knowledge Distillation in Aerial Imagery
On the map: Knowledge distillation → Detection and dense prediction distillation
Abstract (arXiv)
Detecting dead trees in aerial imagery is vital for assessing forest health, especially as tree mortality increases globally due to climate change, but domain variability and scarce labeled data often limit model generalization. This study advances the TreeMort-1T-UNet (Tree Mortality 1-Task U-Net) model, initially trained on Finnish aerial imagery (source domain), by applying knowledge distillation (KD) to adapt it to various target domains, including Polish, German, and Estonian datasets representing diverse forest types. We assess four KD variants: Basic, Self, Feature-level, and Ensemble, against a fine-tuning baseline, using Mean Tree IoU, Instance F1-score, Instance Precision, and Mean Centroid Error as key metrics, alongside representational analyses (e.g., cosine similarity, CKA, SSIM, t-SNE, and linear probing) for domain invariance. Feature-level KD outperforms others, yielding a Mean Tree IoU of 0.106, Instance F1-score of 0.63, Instance Precision of 0.55, and Mean Centroid Error of 3.039 on the Polish dataset, with robust precision across other target domains (e.g., 0.15 on Finnish, 0.67 on Polish, 0.60 on German, 0.59 on Estonian). It excels in low-data scenarios with fewer false positives and shows superior representational invariance (e.g., higher deep-layer CKA/SSIM, better domain mixing in t-SNE, and linear probing AUC of 0.95), making it ideal for precision-critical forestry applications. Additional ablation studies confirm that key components like feature alignment enhance its performance balance across metrics. Our findings demonstrate KD's potential to enhance transfer learning in remote sensing, offering a scalable, domain-robust tool for ecological monitoring and sustainable forest management.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Detection and dense prediction distillation, one of 12 directions in Knowledge distillation. Builds on 10 of its 34 references that are in the map. First posted on arXiv 1 Jun 2026.
Builds on
10 of 34 references.
Closest ancestors · 2
Same direction, newest first
- 2024Applications of Knowledge Distillation in Remote Sensing: A Survey18 Sep
- 2023Domain Generalization for Crop Segmentation with Standardized Ensemble Knowledge Distillation3 Apr
Other references · 8
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2014FitNets: Hints for Thin Deep Netscited by 1,653
- 2021Recent Advances in Domain Adaptation for the Classification of Remote Sensing Datacited by 70
- 2015Transfer Learning from Deep Features for Remote Sensing and Poverty Mappingcited by 37
- 2018Detecting Mammals in UAV Images: Best Practices to address a substantially Imbalanced Dataset with Deep Learningcited by 28
- 2024Objective drives the consistency of representational similarity across datasetscited by 18
- 2025Dual-Task Learning for Dead Tree Detection and Segmentation with Hybrid Self-Attention U-Nets in Aerial Imagerycited by 3
- 2025ADA-Net: Attention-Guided Domain Adaptation Network with Contrastive Learning for Standing Dead Tree Segmentation Using Aerial Imagerycited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026FSKD: Monocular Forest Structure Inference via LiDAR-to-RGBI Knowledge Distillation
- 2023Knowledge Distillation for Object Detection: from generic to remote sensing datasets
- 2026DisDop: Distillation with Domain Priors for Open-Vocabulary Aerial Object Detection
- 2026Energy-Efficient Plant Monitoring via Knowledge Distillation
- 2023Tree-GPT: Modular Large Language Model Expert System for Forest Remote Sensing Image Understanding and Interactive Analysis
- 2025BarkXAI: A Lightweight Post-Hoc Explainable Method for Tree Species Classification with Quantifiable Concepts
- 2025Improving Lightweight Weed Detection via Knowledge Distillation
- 2025JL1-CD: A New Benchmark for Remote Sensing Change Detection and a Robust Multi-Teacher Knowledge Distillation Framework