mlsanityData to 7 Oct 2026

Attention Dynamics in Diffusion Models: A Visual Analytics Framework for Human-AI Collaboration

arXiv 2607.02563 ↗First posted 28 Jun 2026cs.CV cs.AI cs.HCcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Diffusion-based text-to-image models can synthesize complex and highly structured visual content, yet the emergence and evolution of semantic structure remain difficult to interpret. Many existing workflows rely on aggregated attention or scalar summaries that separate temporal change from image-space evidence. To address this gap, we present a visual analytics framework for exploring attention dynamics in diffusion models: the step-indexed evolution of token-level cross-attention maps, their temporal concentration, and their spatial relationships. Our approach enables structured analysis of attention behavior across generation steps by integrating quantitative measures with data-driven stage identification in an interactive workflow. Case studies on a structured 60-prompt Stable-Diffusion-class benchmark illustrate recurring, interpretable patterns within this setting and show how linked temporal and spatial views facilitate the observation and discussion of generative processes, supporting more effective human-AI collaboration.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 27 of its 33 references that are in the map. First posted on arXiv 28 Jun 2026.

Builds on

27 of 33 references.

Closest ancestors · 12

Same direction, newest first

  1. 2024Dynamic Prompt Optimizing for Text-to-Image Generation5 Apr
  2. 2024Towards Understanding Cross and Self-Attention in Stable Diffusion for Text-Guided Image Editing6 Mar
  3. 2023TokenCompose: Text-to-Image Diffusion with Token-level Supervision6 Dec
  4. 2023VGDiffZero: Text-to-image Diffusion Models Can Be Zero-shot Visual Grounders3 Sep
  5. 2023Compositional Text-to-Image Synthesis with Attention Map Control of Diffusion Models23 May
  6. 2023Diffusion Explainer: Visual Explanation for Text-to-image Stable Diffusion4 May
  7. 2023Text-to-image Diffusion Models in Generative AI: A Survey14 Mar
  8. 2023Unleashing Text-to-Image Diffusion Models for Visual Perception3 Mar
  9. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models31 Jan
  10. 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesis9 Dec
  11. 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Models26 Oct
  12. 2022What the DAAM: Interpreting Stable Diffusion Using Cross Attention10 Oct

Other references · 15

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2022Scalable Diffusion Models with Transformerscited by 5,931
  5. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  6. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  7. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  8. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 924
  9. 2024textitRevelio: Interpreting and leveraging semantic information in diffusion modelscited by 29
  10. 2024Diffusion-Based Visual Art Creation: A Survey and New Perspectivescited by 17
  11. 2024Explaining generative diffusion models via visual analysis for interpretable decision-making processcited by 15
  12. 2024Exploring Phrase-Level Grounding with Text-to-Image Diffusion Modelcited by 13
3 more
  1. 2024PrompTHis: Visualizing the Process and Influence of Prompt Editing during Text-to-Image Creationcited by 11
  2. 2025Enhancing XAI Interpretation through a Reverse Mapping from Insights to Visualizationscited by 2
  3. 2026Selective Aggregation of Attention Maps Improves Diffusion-Based Visual Interpretationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Diffusion Trajectory Modeling for Semantic Correspondence
  2. 2025Attention in Diffusion Model: A Survey
  3. 2025SliderSpace: Decomposing the Visual Capabilities of Diffusion Models
  4. 2024Interactive Visual Learning for Stable Diffusion
  5. 2024Faster Diffusion via Temporal Attention Decomposition
  6. 2024Enhancing Semantic Fidelity in Text-to-Image Synthesis: Attention Regulation in Diffusion Models
  7. 2025Attention of a Kiss: Exploring Attention Maps in Video Diffusion for XAIxArts
  8. 2025Diffusion Explorer: Interactive Exploration of Diffusion Models