mlsanityData to 7 Oct 2026

A Real-Calibrated Synthetic-First Data Engine

arXiv 2605.09699 ↗First posted 10 May 2026eess.IV cs.CV cs.GRcited by 0

Not on the map. Why?

Abstract (arXiv)

Modern computer vision systems increasingly encounter performance limitations in data-scarce domains, where collecting large-scale, high-quality labeled data is costly or impractical. While controllable diffusion models enable scalable synthetic image generation, directly applying synthetic augmentation often leads to unstable performance gains due to dataset-level quality issues and insufficient feedback mechanisms. In this work, we present a Real-Calibrated Synthetic-First Data Engine, a modular data engineering framework that combines controllable diffusion generation and multi-stage curation/filtering within a unified pipeline, with optional support for uncertainty-driven selection and human verification. Instead of introducing new generative algorithms, our approach focuses on systematic dataset construction for improving the practical reliability of synthetic augmentation in low-data regimes. The framework is implemented as a modular CLI-based pipeline, where generation, filtering, selection, and validation components can be independently configured and replaced. This design emphasizes reproducibility, flexibility, and practical deployment in real-world data workflows. Through empirical evaluation centered on human pose estimation, we show that synthetic data improves a real-data baseline when used as near-zero-human-annotation-cost augmentation alongside real anchors, while synthetic-only training remains substantially below real-only performance. Supplementary segmentation diagnostics show the same domain-gap pattern. These results highlight the practical value of data-centric orchestration for low-data augmentation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 27 references that are in the map. First posted on arXiv 10 May 2026.

Builds on

20 of 27 references.

References · 20

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2022Generative Adversarial Networkscited by 5,603
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  6. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
  7. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
  8. 2016Playing for Data: Ground Truth from Computer Gamescited by 816
  9. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 593
  10. 2020A Survey of Deep Active Learningcited by 547
  11. 2017Snorkel: Rapid Training Data Creation with Weak Supervisioncited by 370
  12. 2019Meta-Sim: Learning to Generate Synthetic Datasetscited by 128
8 more
  1. 2023Dataset Diffusion: Diffusion-based Synthetic Dataset Generation for Pixel-Level Semantic Segmentationcited by 112
  2. 2023Scaling Laws of Synthetic Images for Model Training ... for Nowcited by 107
  3. 2024Controllable Generation with Text-to-Image Diffusion Models: A Surveycited by 82
  4. 2024Is Synthetic Data all We Need? Benchmarking the Robustness of Models Trained with Synthetic Imagescited by 41
  5. 2025Scaling Tumor Segmentation: Best Lessons from Real and Synthetic Datacited by 13
  6. 2025A Training-free Synthetic Data Selection Method for Semantic Segmentationcited by 9
  7. 2023Knowing the Distance: Understanding the Gap Between Synthetic and Real Data For Face Parsingcited by 4
  8. 2025Active Learning Inspired ControlNet Guidance for Augmenting Semantic Segmentation Datasetscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026When Pretty Isn't Useful: Investigating Why Modern Text-to-Image Models Fail as Reliable Training Data Generators
  2. 2023Real-Fake: Effective Training Data Synthesis Through Distribution Matching
  3. 2024CIA: Controllable Image Augmentation Framework Based on Stable Diffusion
  4. 2026AC3S: Adaptive Conditioning for 3D-Aware Synthetic Data Generation
  5. 2026R&D: Balancing Reliability and Diversity in Synthetic Data Augmentation for Semantic Segmentation
  6. 2025AugGen: Synthetic Augmentation using Diffusion Models Can Improve Recognition
  7. 2025Understanding Trade offs When Conditioning Synthetic Data
  8. 2024Diffusion Models are Efficient Data Generators for Human Mesh Recovery