A Real-Calibrated Synthetic-First Data Engine
Not on the map. Why?
Abstract (arXiv)
Modern computer vision systems increasingly encounter performance limitations in data-scarce domains, where collecting large-scale, high-quality labeled data is costly or impractical. While controllable diffusion models enable scalable synthetic image generation, directly applying synthetic augmentation often leads to unstable performance gains due to dataset-level quality issues and insufficient feedback mechanisms. In this work, we present a Real-Calibrated Synthetic-First Data Engine, a modular data engineering framework that combines controllable diffusion generation and multi-stage curation/filtering within a unified pipeline, with optional support for uncertainty-driven selection and human verification. Instead of introducing new generative algorithms, our approach focuses on systematic dataset construction for improving the practical reliability of synthetic augmentation in low-data regimes. The framework is implemented as a modular CLI-based pipeline, where generation, filtering, selection, and validation components can be independently configured and replaced. This design emphasizes reproducibility, flexibility, and practical deployment in real-world data workflows. Through empirical evaluation centered on human pose estimation, we show that synthetic data improves a real-data baseline when used as near-zero-human-annotation-cost augmentation alongside real anchors, while synthetic-only training remains substantially below real-only performance. Supplementary segmentation diagnostics show the same domain-gap pattern. These results highlight the practical value of data-centric orchestration for low-data augmentation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 27 references that are in the map. First posted on arXiv 10 May 2026.
Builds on
20 of 27 references.
References · 20
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2022Generative Adversarial Networkscited by 5,603
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
- 2016Playing for Data: Ground Truth from Computer Gamescited by 816
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 593
- 2020A Survey of Deep Active Learningcited by 547
- 2017Snorkel: Rapid Training Data Creation with Weak Supervisioncited by 370
- 2019Meta-Sim: Learning to Generate Synthetic Datasetscited by 128
8 more
- 2023Dataset Diffusion: Diffusion-based Synthetic Dataset Generation for Pixel-Level Semantic Segmentationcited by 112
- 2023Scaling Laws of Synthetic Images for Model Training ... for Nowcited by 107
- 2024Controllable Generation with Text-to-Image Diffusion Models: A Surveycited by 82
- 2024Is Synthetic Data all We Need? Benchmarking the Robustness of Models Trained with Synthetic Imagescited by 41
- 2025Scaling Tumor Segmentation: Best Lessons from Real and Synthetic Datacited by 13
- 2025A Training-free Synthetic Data Selection Method for Semantic Segmentationcited by 9
- 2023Knowing the Distance: Understanding the Gap Between Synthetic and Real Data For Face Parsingcited by 4
- 2025Active Learning Inspired ControlNet Guidance for Augmenting Semantic Segmentation Datasetscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026When Pretty Isn't Useful: Investigating Why Modern Text-to-Image Models Fail as Reliable Training Data Generators
- 2023Real-Fake: Effective Training Data Synthesis Through Distribution Matching
- 2024CIA: Controllable Image Augmentation Framework Based on Stable Diffusion
- 2026AC3S: Adaptive Conditioning for 3D-Aware Synthetic Data Generation
- 2026R&D: Balancing Reliability and Diversity in Synthetic Data Augmentation for Semantic Segmentation
- 2025AugGen: Synthetic Augmentation using Diffusion Models Can Improve Recognition
- 2025Understanding Trade offs When Conditioning Synthetic Data
- 2024Diffusion Models are Efficient Data Generators for Human Mesh Recovery