AtteConDA: Attention-Based Conflict Suppression in Multi-Condition Diffusion Models and Synthetic Data Augmentation
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Recent conditional image generation methods can improve controllability by generating images that are faithful to conditions such as sketches, human poses, segmentation maps, and depth. By applying these techniques to image augmentation while preserving annotations, generated images can be used as additional training data and can improve recognition performance. However, for high-level driving tasks such as traffic-rule extraction and driving-behavior understanding, simply using annotations as conditions is insufficient. Instead, images must be augmented while preserving the detailed high-level structure of the original scene. One possible solution is to use multiple conditions so that generated images retain diverse structural cues after generation. However, when multiple conditions are used, conflicts among conditions can prevent reliable structure preservation. In this work, we input semantic segmentation, depth, and edges extracted from the original image into a multi-condition image generation model, thereby providing rich structural information as conditions. We further propose a modeling approach for handling conflicts among multiple conditions and show that it enables image generation with stronger structural preservation. We also build a generation framework and evaluation protocol for driving tasks, establishing a basis for comparison with prior and future models. As a result, this work contributes to image generation research by addressing condition conflicts in multi-condition generation and provides an important step toward mitigating data scarcity in high-level autonomous-driving tasks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 87 of its 103 references that are in the map. First posted on arXiv 10 May 2026.
Builds on
87 of 103 references.
Closest ancestors · 10
Same direction, newest first
- 2025PixelPonder: Dynamic Patch Adaptation for Enhanced Multi-Conditional Text-to-Image Generation9 Mar
- 2024AnyControl: Create Your Artwork with Versatile Control on Text-to-Image Generation27 Jun
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
- 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Models25 May
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models16 Feb
- 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generation16 Feb
- 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generation17 Jan
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
- 2021Palette: Image-to-Image Diffusion Models10 Nov
Other references · 77
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2023Visual Instruction Tuningcited by 7,869
- 2020End-to-End Object Detection with Transformerscited by 7,414
38 more
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,269
- 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,079
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,628
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2024Depth Anything V2cited by 1,422
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,299
- 2018Demystifying MMD GANscited by 1,293
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 944
- 2019AugMix: A Simple Data Processing Method to Improve Robustness and Uncertaintycited by 901
- 2016Playing for Data: Ground Truth from Computer Gamescited by 818
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
- 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
50 most cited of 77 All 77 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026DrivePTS: A Progressive Learning Framework with Textual and Structural Enhancement for Driving Scene Generation
- 2024A Simple Approach to Unifying Diffusion-based Conditional Generation
- 2025Context-Aware Autoregressive Models for Multi-Conditional Image Generation
- 2023Steered Diffusion: A Generalized Framework for Plug-and-Play Conditional Image Synthesis
- 2025Augmented Conditioning Is Enough For Effective Training Image Generation
- 2024CtrLoRA: An Extensible and Efficient Framework for Controllable Image Generation
- 2025Towards Generating Realistic 3D Semantic Training Data for Autonomous Driving
- 2025DualDiff+: Dual-Branch Diffusion for High-Fidelity Video Generation with Reward Guidance