ReCon: Region-Controllable Data Augmentation with Rectification and Alignment for Object Detection
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
The scale and quality of datasets are crucial for training robust perception models. However, obtaining large-scale annotated data is both costly and time-consuming. Generative models have emerged as a powerful tool for data augmentation by synthesizing samples that adhere to desired distributions. However, current generative approaches often rely on complex post-processing or extensive fine-tuning on massive datasets to achieve satisfactory results, and they remain prone to content-position mismatches and semantic leakage. To overcome these limitations, we introduce ReCon, a novel augmentation framework that enhances the capacity of structure-controllable generative models for object detection. ReCon integrates region-guided rectification into the diffusion sampling process, using feedback from a pre-trained perception model to rectify misgenerated regions within diffusion sampling process. We further propose region-aligned cross-attention to enforce spatial-semantic alignment between image regions and their textual cues, thereby improving both semantic consistency and overall image fidelity. Extensive experiments demonstrate that ReCon substantially improve the quality and trainability of generated data, achieving consistent performance gains across various datasets, backbone architectures, and data scales. Our code is available at https://github.com/haoweiz23/ReCon .
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 76 of its 84 references that are in the map. First posted on arXiv 17 Oct 2025.
Builds on
76 of 84 references.
Closest ancestors · 17
Same direction, newest first
- 2024Erase, then Redraw: A Novel Data Augmentation Approach for Free Space Detection Using Diffusion Model30 Sep
- 2024A Simple Background Augmentation Method for Object Detection with Diffusion Model1 Aug
- 2024Dataset Enhancement with Instance-Level Augmentations12 Jun
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction3 Apr
- 2024InstanceDiffusion: Instance-level Control for Image Generation5 Feb
- 2023ControlNet-XS: Rethinking the Control of Text-to-Image Diffusion Models as Feedback-Control Systems11 Dec
- 2023Diverse Data Augmentation with Diffusions for Effective Test-time Prompt Tuning11 Aug
- 2023GeoDiffusion: Text-Prompted Geometric Control for Object Detection Data Generation7 Jun
- 2023Differential Diffusion: Giving Each Pixel Its Strength1 Jun
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generation30 Mar
- 2023Freestyle Layout-to-Image Synthesis25 Mar
- 2023LayoutDiffuse: Adapting Foundational Diffusion Models for Layout-to-Image Generation16 Feb
5 more
- 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generation17 Jan
- 2022DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Models8 Feb
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec
- 2021Palette: Image-to-Image Diffusion Models10 Nov
Other references · 59
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2022Generative Adversarial Networkscited by 5,627
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
38 more
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,269
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,630
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,628
- 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,577
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
- 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,385
- 2017Random Erasing Data Augmentationcited by 1,239
- 2022Reproducible scaling laws for contrastive language-image learningcited by 1,173
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
- 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,071
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
- 2018AutoAugment: Learning Augmentation Policies from Datacited by 730
- 2019Bridging the Gap Between Anchor-based and Anchor-free Detection via Adaptive Training Sample Selectioncited by 540
- 2023DeepCache: Accelerating Diffusion Models for Freecited by 359
- 2022Is synthetic data from generative models ready for image recognition?cited by 320
- 2020Frustratingly Simple Few-Shot Object Detectioncited by 282
- 2017Data Augmentation Generative Adversarial Networkscited by 278
- 2021DatasetGAN: Efficient Labeled Data Factory with Minimal Human Effortcited by 264
- 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 252
- 2021Improving Robustness using Generated Datacited by 234
- 2023EfficientSAM: Leveraged Masked Image Pretraining for Efficient Segment Anythingcited by 188
- 2022ReCo: Region-Controlled Text-to-Image Generationcited by 179
- 2019Classification Accuracy Score for Conditional Generative Modelscited by 136
- 2023Social Biases through the Text-to-Image Generation Lenscited by 127
- 2020GridMask Data Augmentationcited by 123
- 2018Modeling Visual Context is Key to Augmenting Object Detection Datasetscited by 106
- 2022BigDatasetGAN: Synthesizing ImageNet with Pixel-wise Annotationscited by 99
- 2023Leaving Reality to Imagination: Robust Classification via Generated Datasetscited by 91
- 2018BAGAN: Data Augmentation with Balancing GANcited by 90
- 2017DeLiGAN : Generative Adversarial Networks for Diverse and Limited Datacited by 77
- 2022Synthesizing Informative Training Samples with GANcited by 77
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Visual Generation in the New Era: An Evolution from Atomic Mapping to Agentic World Modelingcited by 5
- 2026DiffSparse: Accelerating Diffusion Transformers with Learned Token Sparsitycited by 2
- 2026DiffBench Meets DiffAgent: End-to-End LLM-Driven Diffusion Acceleration Code Generationcited by 1
- 2026Beyond Task-Driven Features for Object Detectioncited by 0
- 2026Preserve the Hard, Regenerate the Rest: Uncertainty-Guided Synthetic Training Data Augmentation with Diffusion Modelscited by 0
- 2026Representation Learning in Diffusion and Flow-based Model: An Application Aspectcited by 0
- 2026Representation Learning in Diffusion and Flow-based Model: An Application Aspect25 Aug 2026
- 2026Preserve the Hard, Regenerate the Rest: Uncertainty-Guided Synthetic Training Data Augmentation with Diffusion Models30 Jun 2026
- 2026Visual Generation in the New Era: An Evolution from Atomic Mapping to Agentic World Modeling30 Apr 2026
- 2026Beyond Task-Driven Features for Object Detection4 Apr 2026
- 2026DiffSparse: Accelerating Diffusion Transformers with Learned Token Sparsity4 Apr 2026
- 2026DiffBench Meets DiffAgent: End-to-End LLM-Driven Diffusion Acceleration Code Generation6 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2024Diverse Generation while Maintaining Semantic Coordination: A Diffusion-Based Data Augmentation Method for Object Detection
- 2025Image compositing is all you need for data augmentation
- 2025Context-guided Responsible Data Augmentation with Diffusion Models
- 2026From Unity Simulation to Diffusion-Based Augmentation: Quantifying Dataset Balance for Robust Object Detection
- 2025HRR: Hierarchical Retrospection Refinement for Generated Image Detection
- 2024CIA: Controllable Image Augmentation Framework Based on Stable Diffusion
- 2025PAT++: a cautionary tale about generative visual augmentation for Object Re-identification
- 2025Decompositional Neural Scene Reconstruction with Generative Diffusion Prior