mlsanityData to 7 Oct 2026

Do Generative Metrics Predict YOLO Performance? An Evaluation Across Models, Augmentation Ratios, and Dataset Complexity

arXiv 2602.18525 ↗First posted 20 Feb 2026cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Synthetic images are increasingly used to augment object-detection training sets, but reliably evaluating a synthetic dataset before training remains difficult: standard global generative metrics (e.g., FID) often do not predict downstream detection mAP. We present a controlled evaluation of synthetic augmentation for YOLOv11 across three single-class detection regimes -- Traffic Signs (sparse/near-saturated), Cityscapes Pedestrian (dense/occlusion-heavy), and COCO PottedPlant (multi-instance/high-variability). We benchmark six GAN-, diffusion-, and hybrid-based generators over augmentation ratios from 10% to 150% of the real training split, and train YOLOv11 both from scratch and with COCO-pretrained initialization, evaluating on held-out real test splits ([email protected]:0.95). For each dataset-generator-augmentation configuration, we compute pre-training dataset metrics under a matched-size bootstrap protocol, including (i) global feature-space metrics in both Inception-v3 and DINOv2 embeddings and (ii) object-centric distribution distances over bounding-box statistics. Synthetic augmentation yields substantial gains in the more challenging regimes (up to +7.6% and +30.6% relative mAP in Pedestrian and PottedPlant, respectively) but is marginal in Traffic Signs and under pretrained fine-tuning. To separate metric signal from augmentation quantity, we report both raw and augmentation-controlled (residualized) correlations with multiple-testing correction, showing that metric-performance alignment is strongly regime-dependent and that many apparent raw associations weaken after controlling for augmentation level.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 52 of its 78 references that are in the map. First posted on arXiv 20 Feb 2026.

Builds on

52 of 78 references.

References · 52

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  4. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  5. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  6. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
  7. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
  8. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  9. 2016Improved Techniques for Training GANscited by 2,938
  10. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
  11. 2018YOLOv3: An Incremental Improvementcited by 2,652
  12. 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,624
38 more
  1. 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
  2. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
  3. 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
  4. 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 978
  5. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
  6. 2017Revisiting Unreasonable Effectiveness of Data in Deep Learning Eracited by 916
  7. 2020Reliable Fidelity and Diversity Metrics for Generative Modelscited by 425
  8. 2018Assessing Generative Models via Precision and Recallcited by 401
  9. 2017The Effectiveness of Data Augmentation in Image Classification using Deep Learningcited by 368
  10. 2021End-to-End Semi-Supervised Object Detection with Soft Teachercited by 315
  11. 2021Unbiased Teacher for Semi-Supervised Object Detectioncited by 305
  12. 2023Rethinking FID: Towards a Better Evaluation Metric for Image Generationcited by 303
  13. 2018Training Deep Networks with Synthetic Data: Bridging the Reality Gap by Domain Randomizationcited by 292
  14. 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 258
  15. 2017Cut, Paste and Learn: Surprisingly Easy Synthesis for Instance Detectioncited by 209
  16. 2021Projected GANs Converge Fastercited by 204
  17. 2023Exposing flaws of generative model evaluation metrics and their unfair treatment of diffusion modelscited by 199
  18. 2021How Faithful is your Synthetic Data? Sample-level Metrics for Evaluating and Auditing Generative Modelscited by 193
  19. 2019Effectively Unbiased FID and Inception Score and where to find themcited by 161
  20. 2019Learning Data Augmentation Strategies for Object Detectioncited by 139
  21. 2019Meta-Sim: Learning to Generate Synthetic Datasetscited by 128
  22. 2018Generative Modeling using the Sliced Wasserstein Distancecited by 108
  23. 2019Sliced Wasserstein Generative Modelscited by 61
  24. 2022Detecting tiny objects in aerial images: A normalized Wasserstein distance and a new benchmarkcited by 56
  25. 2020A Non-Parametric Test to Detect Data-Copying in Generative Modelscited by 52
  26. 2023Explore the Power of Synthetic Data on Few-shot Object Detectioncited by 38
  27. 2020Deflating Dataset Bias Using Synthetic Data Augmentationcited by 37
  28. 2020Large-Scale Object Detection in the Wild from Imbalanced Multi-Labelscited by 35
  29. 2024DetDiffusion: Synergizing Generative and Perceptive Models for Enhanced Data Generation and Perceptioncited by 32
  30. 2023Feature Likelihood Divergence: Evaluating the Generalization of Generative Models Using Samplescited by 25
  31. 2024ODGEN: Domain-specific Object Detection Data Generation with Diffusion Modelscited by 17
  32. 2020Iterative Bounding Box Annotation for Object Detectioncited by 15
  33. 2019Wasserstein Distance Based Domain Adaptation for Object Detectioncited by 10
  34. 2017Learning Intelligent Dialogs for Bounding Box Annotationcited by 9
  35. 2018Improving Face Detection Performance with 3D-Rendered Synthetic Datacited by 6
  36. 2025Neptune-X: Active X-to-Maritime Generation for Universal Maritime Object Detectioncited by 6
  37. 2023Generalized Few-Shot Continual Learning with Contrastive Mixture of Adapterscited by 5
  38. 2023Assessing Domain Gap for Continual Domain Adaptation in Object Detectioncited by 3

50 most cited of 52 All 52 (JSON)

Built on by

Not cited yet.