# Cross Domain Object Detection by Target-Perceived Dual Branch Distillation

arXiv: https://arxiv.org/abs/2205.01291 · HTML: https://mlsanity.com/paper/2205.01291/

## Key facts

- Cited by 46 papers in the map (data through 14 Oct 2026).
- Placed in Detection and dense prediction distillation, one of 12 directions in Knowledge distillation.
- Builds on 50 of its 59 references that are in the map.
- First posted on arXiv 3 May 2022.

## Placed in

- Knowledge distillation / [Detection and dense prediction distillation](https://mlsanity.com/distill/detection-and-dense-prediction-distillation/)

## Builds on (most cited first, 30 of 50)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks](https://mlsanity.com/paper/1506.01497/) (2015)
- [End-to-End Object Detection with Transformers](https://mlsanity.com/paper/2005.12872/) (2020)
- [Mask R-CNN](https://mlsanity.com/paper/1703.06870/) (2017)
- [You Only Look Once: Unified, Real-Time Object Detection](https://mlsanity.com/paper/1506.02640/) (2015)
- [The Cityscapes Dataset for Semantic Urban Scene Understanding](https://mlsanity.com/paper/1604.01685/) (2016)
- [Deformable DETR: Deformable Transformers for End-to-End Object Detection](https://mlsanity.com/paper/2010.04159/) (2020)
- [Fast R-CNN](https://mlsanity.com/paper/1504.08083/) (2015)
- [YOLOv3: An Incremental Improvement](https://mlsanity.com/paper/1804.02767/) (2018)
- [Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions](https://mlsanity.com/paper/2102.12122/) (2021)
- [FCOS: Fully Convolutional One-Stage Object Detection](https://mlsanity.com/paper/1904.01355/) (2019)
- [YOLO9000: Better, Faster, Stronger](https://mlsanity.com/paper/1612.08242/) (2016)
- [BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning](https://mlsanity.com/paper/1805.04687/) (2018)
- [Cascade R-CNN: Delving into High Quality Object Detection](https://mlsanity.com/paper/1712.00726/) (2017)
- [Perceiver: General Perception with Iterative Attention](https://mlsanity.com/paper/2103.03206/) (2021)
- [Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition](https://mlsanity.com/paper/1406.4729/) (2014)
- [CenterNet: Keypoint Triplets for Object Detection](https://mlsanity.com/paper/1904.08189/) (2019)
- [FDA: Fourier Domain Adaptation for Semantic Segmentation](https://mlsanity.com/paper/2004.05498/) (2020)
- [Bridging the Gap Between Anchor-based and Anchor-free Detection via Adaptive Training Sample Selection](https://mlsanity.com/paper/1912.02424/) (2019)
- [Domain Adaptive Faster R-CNN for Object Detection in the Wild](https://mlsanity.com/paper/1803.03243/) (2018)
- [Semantic Foggy Scene Understanding with Synthetic Data](https://mlsanity.com/paper/1708.07819/) (2017)
- [Unbiased Teacher for Semi-Supervised Object Detection](https://mlsanity.com/paper/2102.09480/) (2021)
- [Relation Networks for Object Detection](https://mlsanity.com/paper/1711.11575/) (2017)
- [A Simple Semi-Supervised Learning Framework for Object Detection](https://mlsanity.com/paper/2005.04757/) (2020)
- [Strong-Weak Distribution Alignment for Adaptive Object Detection](https://mlsanity.com/paper/1812.04798/) (2018)
- [RepPoints: Point Set Representation for Object Detection](https://mlsanity.com/paper/1904.11490/) (2019)
- [Driving in the Matrix: Can Virtual Worlds Replace Human-Generated Annotations for Real World Tasks?](https://mlsanity.com/paper/1610.01983/) (2016)
- [Unbiased Mean Teacher for Cross-domain Object Detection](https://mlsanity.com/paper/2003.00707/) (2020)
- [Exploring Object Relation in Mean Teacher for Cross-Domain Detection](https://mlsanity.com/paper/1904.11245/) (2019)
- [Exploring Categorical Regularization for Domain Adaptive Object Detection](https://mlsanity.com/paper/2003.09152/) (2020)

## Built on by (most cited first, 30 of 46)

- [2PCNet: Two-Phase Consistency Training for Day-to-Night Unsupervised Domain Adaptive Object Detection](https://mlsanity.com/paper/2303.13853/) (2023)
- [SSDA-YOLO: Semi-supervised Domain Adaptive YOLO for Cross-Domain Object Detection](https://mlsanity.com/paper/2211.02213/) (2022)
- [CAT: Exploiting Inter-Class Dynamics for Domain Adaptive Object Detection](https://mlsanity.com/paper/2403.19278/) (2024)
- [Efficient Teacher: Semi-Supervised Object Detection for YOLOv5](https://mlsanity.com/paper/2302.07577/) (2023)
- [STFAR: Improving Object Detection Robustness at Test-Time by Self-Training with Feature Alignment Regularization](https://mlsanity.com/paper/2303.17937/) (2023)
- [Mean Teacher DETR with Masked Feature Alignment: A Robust Domain Adaptive Detection Transformer Framework](https://mlsanity.com/paper/2310.15646/) (2023)
- [Unsupervised Domain Adaptive Detection with Network Stability Analysis](https://mlsanity.com/paper/2308.08182/) (2023)
- [Dynamic Retraining-Updating Mean Teacher for Source-Free Object Detection](https://mlsanity.com/paper/2407.16497/) (2024)
- [Large Self-Supervised Models Bridge the Gap in Domain Adaptive Object Detection](https://mlsanity.com/paper/2503.23220/) (2025)
- [Source-free Domain Adaptive Object Detection in Remote Sensing Images](https://mlsanity.com/paper/2401.17916/) (2024)
- [DA-Ada: Learning Domain-Aware Adapter for Domain Adaptive Object Detection](https://mlsanity.com/paper/2410.09004/) (2024)
- [Instance-Warp: Saliency Guided Image Warping for Unsupervised Domain Adaptation](https://mlsanity.com/paper/2403.12712/) (2024)
- [Robust Domain Adaptive Object Detection with Unified Multi-Granularity Alignment](https://mlsanity.com/paper/2301.00371/) (2023)
- [Generalized Diffusion Detector: Mining Robust Features from Diffusion Models for Domain-Generalized Detection](https://mlsanity.com/paper/2503.02101/) (2025)
- [DETR with Additional Global Aggregation for Cross-domain Weakly Supervised Object Detection](https://mlsanity.com/paper/2304.07082/) (2023)
- [DSD-DA: Distillation-based Source Debiasing for Domain Adaptive Object Detection](https://mlsanity.com/paper/2311.10437/) (2023)
- [Phrase Grounding-based Style Transfer for Single-Domain Generalized Object Detection](https://mlsanity.com/paper/2402.01304/) (2024)
- [BlenDA: Domain Adaptive Object Detection through diffusion-based blending](https://mlsanity.com/paper/2401.09921/) (2024)
- [Domain Adaptive Detection of MAVs: A Benchmark and Noise Suppression Network](https://mlsanity.com/paper/2403.16669/) (2024)
- [DALI: Domain Adaptive LiDAR Object Detection via Distribution-level and Instance-level Pseudo Label Denoising](https://mlsanity.com/paper/2412.08806/) (2024)
- [Diffusion Domain Teacher: Diffusion Guided Domain Adaptive Object Detector](https://mlsanity.com/paper/2506.04211/) (2025)
- [Style-Adaptive Detection Transformer for Single-Source Domain Generalized Object Detection](https://mlsanity.com/paper/2504.20498/) (2025)
- [Relational Representation Learning Network for Cross-Spectral Image Patch Matching](https://mlsanity.com/paper/2403.11751/) (2024)
- [Boosting Domain Generalized and Adaptive Detection with Diffusion Models: Fitness, Generalization, and Transferability](https://mlsanity.com/paper/2506.21042/) (2025)
- [TITAN: Query-Token based Domain Adaptive Adversarial Learning](https://mlsanity.com/paper/2506.21484/) (2025)
- [UTOPIA: Unconstrained Tracking Objects without Preliminary Examination via Cross-Domain Adaptation](https://mlsanity.com/paper/2306.09613/) (2023)
- [Semi-Supervised Domain Generalization for Object Detection via Language-Guided Feature Alignment](https://mlsanity.com/paper/2309.13525/) (2023)
- [Adversarial Defense Teacher for Cross-Domain Object Detection under Poor Visibility Conditions](https://mlsanity.com/paper/2403.15786/) (2024)
- [Cross Domain Object Detection via Multi-Granularity Confidence Alignment based Mean Teacher](https://mlsanity.com/paper/2407.07780/) (2024)
- [Mitigating the Impact of Prominent Position Shift in Drone-based RGBT Object Detection](https://mlsanity.com/paper/2502.09311/) (2025)

## Abstract (arXiv)

Cross domain object detection is a realistic and challenging task in the wild. It suffers from performance degradation due to large shift of data distributions and lack of instance-level annotations in the target domain. Existing approaches mainly focus on either of these two difficulties, even though they are closely coupled in cross domain object detection. To solve this problem, we propose a novel Target-perceived Dual-branch Distillation (TDD) framework. By integrating detection branches of both source and target domains in a unified teacher-student learning scheme, it can reduce domain shift and generate reliable supervision effectively. In particular, we first introduce a distinct Target Proposal Perceiver between two domains. It can adaptively enhance source detector to perceive objects in a target image, by leveraging target proposal contexts from iterative cross-attention. Afterwards, we design a concise Dual Branch Self Distillation strategy for model training, which can progressively integrate complementary object knowledge from different domains via self-distillation in two branches. Finally, we conduct extensive experiments on a number of widely-used scenarios in cross domain object detection. The results show that our TDD significantly outperforms the state-of-the-art methods on all the benchmarks. Our code and model will be available at https://github.com/Feobi1999/TDD.
