mlsanityData to 14 Oct 2026

AtteConDA: Attention-Based Conflict Suppression in Multi-Condition Diffusion Models and Synthetic Data Augmentation

arXiv 2605.09425 ↗First posted 10 May 2026cs.CV cs.AIcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Recent conditional image generation methods can improve controllability by generating images that are faithful to conditions such as sketches, human poses, segmentation maps, and depth. By applying these techniques to image augmentation while preserving annotations, generated images can be used as additional training data and can improve recognition performance. However, for high-level driving tasks such as traffic-rule extraction and driving-behavior understanding, simply using annotations as conditions is insufficient. Instead, images must be augmented while preserving the detailed high-level structure of the original scene. One possible solution is to use multiple conditions so that generated images retain diverse structural cues after generation. However, when multiple conditions are used, conflicts among conditions can prevent reliable structure preservation. In this work, we input semantic segmentation, depth, and edges extracted from the original image into a multi-condition image generation model, thereby providing rich structural information as conditions. We further propose a modeling approach for handling conflicts among multiple conditions and show that it enables image generation with stronger structural preservation. We also build a generation framework and evaluation protocol for driving tasks, establishing a basis for comparison with prior and future models. As a result, this work contributes to image generation research by addressing condition conflicts in multi-condition generation and provides an important step toward mitigating data scarcity in high-level autonomous-driving tasks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 87 of its 103 references that are in the map. First posted on arXiv 10 May 2026.

Builds on

87 of 103 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025PixelPonder: Dynamic Patch Adaptation for Enhanced Multi-Conditional Text-to-Image Generation9 Mar
  2. 2024AnyControl: Create Your Artwork with Versatile Control on Text-to-Image Generation27 Jun
  3. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
  4. 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Models25 May
  5. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models16 Feb
  6. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generation16 Feb
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
  8. 2023GLIGEN: Open-Set Grounded Text-to-Image Generation17 Jan
  9. 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
  10. 2021Palette: Image-to-Image Diffusion Models10 Nov

Other references · 77

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  6. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  7. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  8. 2020Denoising Diffusion Implicit Modelscited by 9,781
  9. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  10. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  11. 2023Visual Instruction Tuningcited by 7,869
  12. 2020End-to-End Object Detection with Transformerscited by 7,414
38 more
  1. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  2. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  3. 2022Classifier-Free Diffusion Guidancecited by 5,847
  4. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
  5. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
  6. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  7. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  8. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  9. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  10. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  11. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
  12. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
  13. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
  14. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  15. 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
  16. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  17. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  18. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
  19. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  20. 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,269
  21. 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,079
  22. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  23. 2021Vision Transformers for Dense Predictioncited by 1,803
  24. 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,628
  25. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
  26. 2024Depth Anything V2cited by 1,422
  27. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  28. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,299
  29. 2018Demystifying MMD GANscited by 1,293
  30. 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
  31. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
  32. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 944
  33. 2019AugMix: A Simple Data Processing Method to Improve Robustness and Uncertaintycited by 901
  34. 2016Playing for Data: Ground Truth from Computer Gamescited by 818
  35. 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
  36. 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
  37. 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
  38. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657

50 most cited of 77 All 77 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026DrivePTS: A Progressive Learning Framework with Textual and Structural Enhancement for Driving Scene Generation
  2. 2024A Simple Approach to Unifying Diffusion-based Conditional Generation
  3. 2025Context-Aware Autoregressive Models for Multi-Conditional Image Generation
  4. 2023Steered Diffusion: A Generalized Framework for Plug-and-Play Conditional Image Synthesis
  5. 2025Augmented Conditioning Is Enough For Effective Training Image Generation
  6. 2024CtrLoRA: An Extensible and Efficient Framework for Controllable Image Generation
  7. 2025Towards Generating Realistic 3D Semantic Training Data for Autonomous Driving
  8. 2025DualDiff+: Dual-Branch Diffusion for High-Fidelity Video Generation with Reward Guidance