mlsanityData to 14 Oct 2026

ReCon: Region-Controllable Data Augmentation with Rectification and Alignment for Object Detection

arXiv 2510.15783 ↗First posted 17 Oct 2025cs.CVcited by 6

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

The scale and quality of datasets are crucial for training robust perception models. However, obtaining large-scale annotated data is both costly and time-consuming. Generative models have emerged as a powerful tool for data augmentation by synthesizing samples that adhere to desired distributions. However, current generative approaches often rely on complex post-processing or extensive fine-tuning on massive datasets to achieve satisfactory results, and they remain prone to content-position mismatches and semantic leakage. To overcome these limitations, we introduce ReCon, a novel augmentation framework that enhances the capacity of structure-controllable generative models for object detection. ReCon integrates region-guided rectification into the diffusion sampling process, using feedback from a pre-trained perception model to rectify misgenerated regions within diffusion sampling process. We further propose region-aligned cross-attention to enforce spatial-semantic alignment between image regions and their textual cues, thereby improving both semantic consistency and overall image fidelity. Extensive experiments demonstrate that ReCon substantially improve the quality and trainability of generated data, achieving consistent performance gains across various datasets, backbone architectures, and data scales. Our code is available at https://github.com/haoweiz23/ReCon .

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 76 of its 84 references that are in the map. First posted on arXiv 17 Oct 2025.

Builds on

76 of 84 references.

Closest ancestors · 17

Same direction, newest first

  1. 2024Erase, then Redraw: A Novel Data Augmentation Approach for Free Space Detection Using Diffusion Model30 Sep
  2. 2024A Simple Background Augmentation Method for Object Detection with Diffusion Model1 Aug
  3. 2024Dataset Enhancement with Instance-Level Augmentations12 Jun
  4. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction3 Apr
  5. 2024InstanceDiffusion: Instance-level Control for Image Generation5 Feb
  6. 2023ControlNet-XS: Rethinking the Control of Text-to-Image Diffusion Models as Feedback-Control Systems11 Dec
  7. 2023Diverse Data Augmentation with Diffusions for Effective Test-time Prompt Tuning11 Aug
  8. 2023GeoDiffusion: Text-Prompted Geometric Control for Object Detection Data Generation7 Jun
  9. 2023Differential Diffusion: Giving Each Pixel Its Strength1 Jun
  10. 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generation30 Mar
  11. 2023Freestyle Layout-to-Image Synthesis25 Mar
  12. 2023LayoutDiffuse: Adapting Foundational Diffusion Models for Layout-to-Image Generation16 Feb
5 more
  1. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
  2. 2023GLIGEN: Open-Set Grounded Text-to-Image Generation17 Jan
  3. 2022DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Models8 Feb
  4. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec
  5. 2021Palette: Image-to-Image Diffusion Models10 Nov

Other references · 59

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  5. 2020Denoising Diffusion Implicit Modelscited by 9,781
  6. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  7. 2020End-to-End Object Detection with Transformerscited by 7,414
  8. 2022Generative Adversarial Networkscited by 5,627
  9. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  10. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  11. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  12. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
38 more
  1. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
  2. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  3. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  4. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
  5. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  6. 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,269
  7. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  8. 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,630
  9. 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,628
  10. 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,577
  11. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
  12. 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,385
  13. 2017Random Erasing Data Augmentationcited by 1,239
  14. 2022Reproducible scaling laws for contrastive language-image learningcited by 1,173
  15. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
  16. 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,071
  17. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
  18. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
  19. 2018AutoAugment: Learning Augmentation Policies from Datacited by 730
  20. 2019Bridging the Gap Between Anchor-based and Anchor-free Detection via Adaptive Training Sample Selectioncited by 540
  21. 2023DeepCache: Accelerating Diffusion Models for Freecited by 359
  22. 2022Is synthetic data from generative models ready for image recognition?cited by 320
  23. 2020Frustratingly Simple Few-Shot Object Detectioncited by 282
  24. 2017Data Augmentation Generative Adversarial Networkscited by 278
  25. 2021DatasetGAN: Efficient Labeled Data Factory with Minimal Human Effortcited by 264
  26. 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 252
  27. 2021Improving Robustness using Generated Datacited by 234
  28. 2023EfficientSAM: Leveraged Masked Image Pretraining for Efficient Segment Anythingcited by 188
  29. 2022ReCo: Region-Controlled Text-to-Image Generationcited by 179
  30. 2019Classification Accuracy Score for Conditional Generative Modelscited by 136
  31. 2023Social Biases through the Text-to-Image Generation Lenscited by 127
  32. 2020GridMask Data Augmentationcited by 123
  33. 2018Modeling Visual Context is Key to Augmenting Object Detection Datasetscited by 106
  34. 2022BigDatasetGAN: Synthesizing ImageNet with Pixel-wise Annotationscited by 99
  35. 2023Leaving Reality to Imagination: Robust Classification via Generated Datasetscited by 91
  36. 2018BAGAN: Data Augmentation with Balancing GANcited by 90
  37. 2017DeLiGAN : Generative Adversarial Networks for Diverse and Limited Datacited by 77
  38. 2022Synthesizing Informative Training Samples with GANcited by 77

50 most cited of 59 All 59 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Diverse Generation while Maintaining Semantic Coordination: A Diffusion-Based Data Augmentation Method for Object Detection
  2. 2025Image compositing is all you need for data augmentation
  3. 2025Context-guided Responsible Data Augmentation with Diffusion Models
  4. 2026From Unity Simulation to Diffusion-Based Augmentation: Quantifying Dataset Balance for Robust Object Detection
  5. 2025HRR: Hierarchical Retrospection Refinement for Generated Image Detection
  6. 2024CIA: Controllable Image Augmentation Framework Based on Stable Diffusion
  7. 2025PAT++: a cautionary tale about generative visual augmentation for Object Re-identification
  8. 2025Decompositional Neural Scene Reconstruction with Generative Diffusion Prior