Image Generation from Contextually-Contradictory Prompts
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Text-to-image diffusion models excel at generating high-quality, diverse images from natural language prompts. However, they often fail to produce semantically accurate results when the prompt contains concept combinations that contradict their learned priors. We define this failure mode as contextual contradiction, where one concept implicitly negates another due to entangled associations learned during training. To address this, we propose a stage-aware prompt decomposition framework that guides the denoising process using a sequence of proxy prompts. Each proxy prompt is constructed to match the semantic content expected to emerge at a specific stage of denoising, while ensuring contextual coherence. To construct these proxy prompts, we leverage a large language model (LLM) to analyze the target prompt, identify contradictions, and generate alternative expressions that preserve the original intent while resolving contextual conflicts. By aligning prompt information with the denoising progression, our method enables fine-grained semantic control and accurate image generation in the presence of contextual contradictions. Experiments across a variety of challenging prompts show substantial improvements in alignment to the textual prompt.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 29 of its 34 references that are in the map. First posted on arXiv 2 Jun 2025.
Builds on
29 of 34 references.
Closest ancestors · 15
Same direction, newest first
- 2024Rare-to-Frequent: Unlocking Compositional Generation Power of Diffusion Models on Rare Concepts with LLM Guidance29 Oct
- 2024Be Yourself: Bounded Attention for Multi-Subject Text-to-Image Generation25 Mar
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignment8 Mar
- 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMs22 Jan
- 2023CONFORM: Contrast is All You Need For High-Fidelity Text-to-Image Diffusion Models11 Dec
- 2023Multi-Concept T2I-Zero: Tweaking Only The Text Embeddings and Nothing Else11 Oct
- 2023A-STAR: Test-time Attention Segregation and Retention for Text-to-image Synthesis26 Jun
- 2023Linguistic Binding in Diffusion Models: Enhancing Attribute Correspondence through Attention Map Alignment15 Jun
- 2023Localizing Object-level Shape Variations with Text-to-Image Diffusion Models20 Mar
- 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generation16 Feb
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models31 Jan
- 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesis9 Dec
3 more
Other references · 14
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2020Shortcut Learning in Deep Neural Networkscited by 1,969
- 2019Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inferencecited by 876
- 2020Noise or Signal: The Role of Image Backgrounds in Object Recognitioncited by 343
- 2023P+: Extended Textual Conditioning in Text-to-Image Generationcited by 242
- 2023A Neural Space-Time Representation for Text-to-Image Personalizationcited by 123
- 2020Don't Judge an Object by Its Context: Learning to Overcome Contextual Biascited by 91
Built on by
Citing papers per year: 2025: 2; 2026: 7.
9 papers.
- 2025Generating an Image From 1,000 Words: Enhancing Text-to-Image With Structured Captionscited by 14
- 2025SAEdit: Token-level control for continuous image editing via Sparse AutoEncodercited by 9
- 2026On-the-fly Repulsion in the Contextual Space for Rich Diversity in Diffusion Transformerscited by 3
- 2026LooseRoPE: Content-aware Attention Manipulation for Semantic Harmonizationcited by 1
- 2026Delta-Adapter: Scalable Exemplar-Based Image Editing with Single-Pair Supervisioncited by 1
- 2026Learning Sampling Parameters for Diffusion Modelscited by 1
- 2026The Attention Triangle in Audio-Video Modelscited by 1
- 2026Token-to-Token Alignment of Text Embeddings for Semantic Blendingcited by 0
- 2026Intermediate Text Representation Guided Text-to-Image Generation for Enhancing One-and-Only Alignmentcited by 0
- 2026The Attention Triangle in Audio-Video Models3 Sep 2026
- 2026Learning Sampling Parameters for Diffusion Models26 Jul 2026
- 2026Intermediate Text Representation Guided Text-to-Image Generation for Enhancing One-and-Only Alignment29 Jun 2026
- 2026Token-to-Token Alignment of Text Embeddings for Semantic Blending22 Jun 2026
- 2026Delta-Adapter: Scalable Exemplar-Based Image Editing with Single-Pair Supervision8 May 2026
- 2026On-the-fly Repulsion in the Contextual Space for Rich Diversity in Diffusion Transformers30 Mar 2026
- 2026LooseRoPE: Content-aware Attention Manipulation for Semantic Harmonization8 Jan 2026
- 2025Generating an Image From 1,000 Words: Enhancing Text-to-Image With Structured Captions10 Nov 2025
- 2025SAEdit: Token-level control for continuous image editing via Sparse AutoEncoder6 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2024Prompt-Consistency Image Generation (PCIG): A Unified Framework Integrating LLMs, Knowledge Graphs, and Controllable Diffusion Models
- 2024Words Worth a Thousand Pictures: Measuring and Understanding Perceptual Variability in Text-to-Image Generation
- 2025Diversifying Long Prompt Image Generation through Structured Prompt Embedding Space Sampling
- 2026Scaling Properties of Text Conditioning in Visual Generation
- 2026Prompt Reinjection: Alleviating Prompt Forgetting in Multimodal Diffusion Transformers for Text-to-Image Generation
- 2025ConceptMix++: Leveling the Playing Field in Text-to-Image Benchmarking via Iterative Prompt Optimization
- 2025Reusing Computation in Text-to-Image Diffusion for Efficient Generation of Image Sets
- 2025Steer Away From Mode Collisions: Improving Composition In Diffusion Models