Domain generalization and synthetic data in object detection: the enabler, the probe, and the gap
Not on the map. Why?
Abstract (arXiv)
Object detection models often experience performance degradation when deployed under distribution shifts, caused by for example changes in weather type, operational environment, or object appearance. Domain Generalization (DG) aims to develop models that remain robust under such shifts and generalize well to unseen domains. DG research specifically focused on object detection models is scarce, although these models face additional challenges around localization and multi-scale representations. Synthetic data is a promising tool to support in DG, by enabling large-scale generation of diverse new samples. In this paper, we present an object detection-centric review of DG and examine the role of synthetic data from three complementary perspectives. First, synthetic data acts as an enabler of DG through diversification and alignment strategies that aim to improve robustness to distribution shifts. Second, it serves as a probe that enables controlled experimentation to identify and understand failure modes. Third, we discuss the synthetic-to-real gap, a particularly challenging form of domain shift that arises when models trained on synthetic imagery are deployed on real-world data. Through reviewing these perspectives, we identify limitations of current DG approaches for object detection and argue that future research requires representation-aware methods that explicitly address both localization and classification under domain shift.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 59 of its 84 references that are in the map. First posted on arXiv 2 Sep 2026.
Builds on
59 of 84 references.
References · 59
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2015Domain-Adversarial Training of Neural Networkscited by 3,044
- 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,269
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
- 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,850
- 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,630
38 more
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,628
- 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,577
- 2017Random Erasing Data Augmentationcited by 1,239
- 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 766
- 2021Domain Generalization: A Surveycited by 764
- 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 763
- 2022Exploring Plain Vision Transformer Backbones for Object Detectioncited by 724
- 2020Simple Copy-Paste is a Strong Data Augmentation Method for Instance Segmentationcited by 596
- 2016Virtual Worlds as Proxy for Multi-Object Tracking Analysiscited by 341
- 2018Training Deep Networks with Synthetic Data: Bridging the Reality Gap by Domain Randomizationcited by 294
- 2021Vision Transformers are Robust Learnerscited by 207
- 2021DetCo: Unsupervised Contrastive Learning for Object Detectioncited by 205
- 2021Are Transformers More Robust Than CNNs?cited by 187
- 2019Domain Generalization Using a Mixture of Multiple Latent Domainscited by 170
- 2022Understanding The Robustness in Vision Transformerscited by 144
- 2022Uncertainty Modeling for Out-of-Distribution Generalizationcited by 125
- 2020GridMask Data Augmentationcited by 123
- 2023CLIP the Gap: A Single Domain Generalization Approach for Object Detectioncited by 87
- 2021Delving Deep into the Generalization of Vision Transformers under Distribution Shiftscited by 85
- 2019Interpreting Adversarially Trained Convolutional Neural Networkscited by 75
- 2022Back to the Source: Diffusion-Driven Test-Time Adaptationcited by 71
- 2021MixStyle Neural Networks for Domain Generalization and Adaptationcited by 64
- 2020Permuted AdaIN: Reducing the Bias Towards Global Statistics in Image Classificationcited by 63
- 2022PODA: Prompt-driven Zero-shot Domain Adaptationcited by 60
- 2019Towards Adversarially Robust Object Detectioncited by 55
- 2019Bag of Freebies for Training Object Detection Neural Networkscited by 47
- 2021Robust and Accurate Object Detection via Adversarial Learningcited by 42
- 2022PASTA: Proportional Amplitude Spectrum Training Augmentation for Syn-to-Real Domain Generalizationcited by 39
- 2023COCO-O: A Benchmark for Object Detectors under Natural Distribution Shiftscited by 34
- 2023Can You Rely on Your Model Evaluation? Improving Model Evaluation with Synthetic Test Datacited by 32
- 2024Improving Single Domain-Generalized Object Detection: A Focus on Diversification and Alignmentcited by 29
- 2023RadEdit: stress-testing biomedical vision models via diffusion image editingcited by 28
- 2025The Reality Gap in Robotics: Challenges, Solutions, and Best Practicescited by 24
- 2024RadSimReal: Bridging the Gap Between Synthetic and Real Data in Radar Object Detection With Simulationcited by 14
- 2023SYNAuG: Exploiting Synthetic Data for Data Imbalance Problemscited by 13
- 2021Achieving Domain Generalization in Underwater Object Detection by Domain Mixup and Contrastive Learningcited by 12
- 2025Style Evolving along Chain-of-Thought for Unknown-Domain Object Detectioncited by 6
- 2025Domain Randomization for Object Detection in Manufacturing Applications using Synthetic Data: A Comprehensive Studycited by 6
50 most cited of 59 All 59 (JSON)
Built on by
Not cited yet.