Do Generative Metrics Predict YOLO Performance? An Evaluation Across Models, Augmentation Ratios, and Dataset Complexity
Not on the map. Why?
Abstract (arXiv)
Synthetic images are increasingly used to augment object-detection training sets, but reliably evaluating a synthetic dataset before training remains difficult: standard global generative metrics (e.g., FID) often do not predict downstream detection mAP. We present a controlled evaluation of synthetic augmentation for YOLOv11 across three single-class detection regimes -- Traffic Signs (sparse/near-saturated), Cityscapes Pedestrian (dense/occlusion-heavy), and COCO PottedPlant (multi-instance/high-variability). We benchmark six GAN-, diffusion-, and hybrid-based generators over augmentation ratios from 10% to 150% of the real training split, and train YOLOv11 both from scratch and with COCO-pretrained initialization, evaluating on held-out real test splits ([email protected]:0.95). For each dataset-generator-augmentation configuration, we compute pre-training dataset metrics under a matched-size bootstrap protocol, including (i) global feature-space metrics in both Inception-v3 and DINOv2 embeddings and (ii) object-centric distribution distances over bounding-box statistics. Synthetic augmentation yields substantial gains in the more challenging regimes (up to +7.6% and +30.6% relative mAP in Pedestrian and PottedPlant, respectively) but is marginal in Traffic Signs and under pretrained fine-tuning. To separate metric signal from augmentation quantity, we report both raw and augmentation-controlled (residualized) correlations with multiple-testing correction, showing that metric-performance alignment is strongly regime-dependent and that many apparent raw associations weaken after controlling for augmentation level.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 52 of its 78 references that are in the map. First posted on arXiv 20 Feb 2026.
Builds on
52 of 78 references.
References · 52
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2016Improved Techniques for Training GANscited by 2,938
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
- 2018YOLOv3: An Incremental Improvementcited by 2,652
- 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,624
38 more
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
- 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 978
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
- 2017Revisiting Unreasonable Effectiveness of Data in Deep Learning Eracited by 916
- 2020Reliable Fidelity and Diversity Metrics for Generative Modelscited by 425
- 2018Assessing Generative Models via Precision and Recallcited by 401
- 2017The Effectiveness of Data Augmentation in Image Classification using Deep Learningcited by 368
- 2021End-to-End Semi-Supervised Object Detection with Soft Teachercited by 315
- 2021Unbiased Teacher for Semi-Supervised Object Detectioncited by 305
- 2023Rethinking FID: Towards a Better Evaluation Metric for Image Generationcited by 303
- 2018Training Deep Networks with Synthetic Data: Bridging the Reality Gap by Domain Randomizationcited by 292
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 258
- 2017Cut, Paste and Learn: Surprisingly Easy Synthesis for Instance Detectioncited by 209
- 2021Projected GANs Converge Fastercited by 204
- 2023Exposing flaws of generative model evaluation metrics and their unfair treatment of diffusion modelscited by 199
- 2021How Faithful is your Synthetic Data? Sample-level Metrics for Evaluating and Auditing Generative Modelscited by 193
- 2019Effectively Unbiased FID and Inception Score and where to find themcited by 161
- 2019Learning Data Augmentation Strategies for Object Detectioncited by 139
- 2019Meta-Sim: Learning to Generate Synthetic Datasetscited by 128
- 2018Generative Modeling using the Sliced Wasserstein Distancecited by 108
- 2019Sliced Wasserstein Generative Modelscited by 61
- 2022Detecting tiny objects in aerial images: A normalized Wasserstein distance and a new benchmarkcited by 56
- 2020A Non-Parametric Test to Detect Data-Copying in Generative Modelscited by 52
- 2023Explore the Power of Synthetic Data on Few-shot Object Detectioncited by 38
- 2020Deflating Dataset Bias Using Synthetic Data Augmentationcited by 37
- 2020Large-Scale Object Detection in the Wild from Imbalanced Multi-Labelscited by 35
- 2024DetDiffusion: Synergizing Generative and Perceptive Models for Enhanced Data Generation and Perceptioncited by 32
- 2023Feature Likelihood Divergence: Evaluating the Generalization of Generative Models Using Samplescited by 25
- 2024ODGEN: Domain-specific Object Detection Data Generation with Diffusion Modelscited by 17
- 2020Iterative Bounding Box Annotation for Object Detectioncited by 15
- 2019Wasserstein Distance Based Domain Adaptation for Object Detectioncited by 10
- 2017Learning Intelligent Dialogs for Bounding Box Annotationcited by 9
- 2018Improving Face Detection Performance with 3D-Rendered Synthetic Datacited by 6
- 2025Neptune-X: Active X-to-Maritime Generation for Universal Maritime Object Detectioncited by 6
- 2023Generalized Few-Shot Continual Learning with Contrastive Mixture of Adapterscited by 5
- 2023Assessing Domain Gap for Continual Domain Adaptation in Object Detectioncited by 3
50 most cited of 52 All 52 (JSON)
Built on by
Not cited yet.