mlsanityData to 14 Oct 2026

AttentionBender: Manipulating Cross-Attention in Video Diffusion Transformers as a Creative Probe

arXiv 2604.20936 ↗First posted 22 Apr 2026cs.MM cs.CV cs.HCcited by 1

On the map: Diffusion models → Video generation

Abstract (arXiv)

We present AttentionBender, a tool that manipulates cross-attention in Video Diffusion Transformers to help artists probe the internal mechanics of black-box video generation. While generative outputs are increasingly realistic, prompt-only control limits artists' ability to build intuition for the model's material process or to work beyond its default tendencies. Using an autobiographical research-through-design approach, we built on Network Bending to design AttentionBender, which applies 2D transforms (rotation, scaling, translation, etc.) to cross-attention maps to modulate generation. We assess AttentionBender by visualizing 4,500+ video generations across prompts, operations, and layer targets. Our results suggest that cross-attention is highly entangled: targeted manipulations often resist clean, localized control, producing distributed distortions and glitch aesthetics over linear edits. AttentionBender contributes a tool that functions both as an Explainable AI style probe of transformer attention mechanisms, and as a creative technique for producing novel aesthetics beyond the model's learned representational space.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 33 of its 81 references that are in the map. First posted on arXiv 22 Apr 2026.

Builds on

33 of 81 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  2. 2023VDT: General-purpose Video Diffusion Transformers via Mask Modeling22 May

Other references · 31

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  8. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  9. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  10. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  11. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  12. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
19 more
  1. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  2. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,552
  3. 2020Transformer Interpretability Beyond Attention Visualizationcited by 627
  4. 2022What the DAAM: Interpreting Stable Diffusion Using Cross Attentioncited by 236
  5. 2021Design Guidelines for Prompt Engineering Text-to-Image Generative Modelscited by 218
  6. 2025Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200kcited by 163
  7. 2021RAVE: A variational autoencoder for fast and high-quality neural audio synthesiscited by 73
  8. 2021Understanding and Creating Art with AI: Review and Outlookcited by 60
  9. 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Directioncited by 46
  10. 2023Prompting AI Art: An Investigation into the Creative Skill of Prompt Engineeringcited by 43
  11. 2024Explainable Generative AI (GenXAI): A Survey, Conceptualization, and Research Agendacited by 22
  12. 2023Scale Alone Does not Improve Mechanistic Interpretability in Vision Modelscited by 18
  13. 2023Exploring XAI for the Arts: Explaining Latent Space in Generative Musiccited by 8
  14. 2024Towards A Diffractive Analysis of Prompt-Based Generative AIcited by 7
  15. 2025XAIxArts Manifesto: Explainable AI for the Artscited by 7
  16. 2023Hacking Generative Models with Differentiable Network Bendingcited by 3
  17. 2023The role of interface design on prompt-mediated creativity in Generative AIcited by 3
  18. 2024A Preliminary Exploration of YouTubers' Use of Generative-AI in Content Creationcited by 3
  19. 2024Network Bending of Diffusion Models for Audio-Visual Generationcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Attention of a Kiss: Exploring Attention Maps in Video Diffusion for XAIxArts
  2. 2025Attention Surgery: An Efficient Recipe to Linearize Your Video Diffusion Transformer
  3. 2025FramePainter: Endowing Interactive Image Editing with Video Diffusion Priors
  4. 2024DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generation
  5. 2025Analysis of Attention in Video Diffusion Transformers
  6. 2025UltraViCo: Breaking Extrapolation Limits in Video Diffusion Transformers
  7. 2025Understanding Attention Mechanism in Video Diffusion Models
  8. 2024MotionFlow: Attention-Driven Motion Transfer in Video Diffusion Models