mlsanityData to 14 Oct 2026

Image Generation from Contextually-Contradictory Prompts

arXiv 2506.01929 ↗First posted 2 Jun 2025cs.GR cs.AI cs.CVcited by 9

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Text-to-image diffusion models excel at generating high-quality, diverse images from natural language prompts. However, they often fail to produce semantically accurate results when the prompt contains concept combinations that contradict their learned priors. We define this failure mode as contextual contradiction, where one concept implicitly negates another due to entangled associations learned during training. To address this, we propose a stage-aware prompt decomposition framework that guides the denoising process using a sequence of proxy prompts. Each proxy prompt is constructed to match the semantic content expected to emerge at a specific stage of denoising, while ensuring contextual coherence. To construct these proxy prompts, we leverage a large language model (LLM) to analyze the target prompt, identify contradictions, and generate alternative expressions that preserve the original intent while resolving contextual conflicts. By aligning prompt information with the denoising progression, our method enables fine-grained semantic control and accurate image generation in the presence of contextual contradictions. Experiments across a variety of challenging prompts show substantial improvements in alignment to the textual prompt.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 29 of its 34 references that are in the map. First posted on arXiv 2 Jun 2025.

Builds on

29 of 34 references.

Closest ancestors · 15

Same direction, newest first

  1. 2024Rare-to-Frequent: Unlocking Compositional Generation Power of Diffusion Models on Rare Concepts with LLM Guidance29 Oct
  2. 2024Be Yourself: Bounded Attention for Multi-Subject Text-to-Image Generation25 Mar
  3. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignment8 Mar
  4. 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMs22 Jan
  5. 2023CONFORM: Contrast is All You Need For High-Fidelity Text-to-Image Diffusion Models11 Dec
  6. 2023Multi-Concept T2I-Zero: Tweaking Only The Text Embeddings and Nothing Else11 Oct
  7. 2023A-STAR: Test-time Attention Segregation and Retention for Text-to-image Synthesis26 Jun
  8. 2023Linguistic Binding in Diffusion Models: Enhancing Attribute Correspondence through Attention Map Alignment15 Jun
  9. 2023Localizing Object-level Shape Variations with Text-to-Image Diffusion Models20 Mar
  10. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generation16 Feb
  11. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models31 Jan
  12. 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesis9 Dec
3 more
  1. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoisers2 Nov
  2. 2022MagicMix: Semantic Mixing with Diffusion Models28 Oct
  3. 2022Compositional Visual Generation with Composable Diffusion Models3 Jun

Other references · 14

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  5. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  6. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  7. 2020Shortcut Learning in Deep Neural Networkscited by 1,969
  8. 2019Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inferencecited by 876
  9. 2020Noise or Signal: The Role of Image Backgrounds in Object Recognitioncited by 343
  10. 2023P+: Extended Textual Conditioning in Text-to-Image Generationcited by 242
  11. 2023A Neural Space-Time Representation for Text-to-Image Personalizationcited by 123
  12. 2020Don't Judge an Object by Its Context: Learning to Overcome Contextual Biascited by 91
2 more
  1. 2023Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Imagescited by 80
  2. 2022DALLE-2 is Seeing Double: Flaws in Word-to-Concept Mapping in Text2Image Modelscited by 51

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 7.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Prompt-Consistency Image Generation (PCIG): A Unified Framework Integrating LLMs, Knowledge Graphs, and Controllable Diffusion Models
  2. 2024Words Worth a Thousand Pictures: Measuring and Understanding Perceptual Variability in Text-to-Image Generation
  3. 2025Diversifying Long Prompt Image Generation through Structured Prompt Embedding Space Sampling
  4. 2026Scaling Properties of Text Conditioning in Visual Generation
  5. 2026Prompt Reinjection: Alleviating Prompt Forgetting in Multimodal Diffusion Transformers for Text-to-Image Generation
  6. 2025ConceptMix++: Leveling the Playing Field in Text-to-Image Benchmarking via Iterative Prompt Optimization
  7. 2025Reusing Computation in Text-to-Image Diffusion for Efficient Generation of Image Sets
  8. 2025Steer Away From Mode Collisions: Improving Composition In Diffusion Models