mlsanityData to 14 Oct 2026

Explainability-in-Action: Enabling Expressive Manipulation and Tacit Understanding by Bending Diffusion Models in ComfyUI

arXiv 2508.07183 ↗First posted 10 Aug 2025cs.HC cs.AI cs.LGcited by 1

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Explainable AI (XAI) in creative contexts can go beyond transparency to support artistic engagement, modifiability, and sustained practice. While curated datasets and training human-scale models can offer artists greater agency and control, large-scale generative models like text-to-image diffusion systems often obscure these possibilities. We suggest that even large models can be treated as creative materials if their internal structure is exposed and manipulable. We propose a craft-based approach to explainability rooted in long-term, hands-on engagement akin to Sch"on's "reflection-in-action" and demonstrate its application through a model-bending and inspection plugin integrated into the node-based interface of ComfyUI. We demonstrate that by interactively manipulating different parts of a generative model, artists can develop an intuition about how each component influences the output.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 6 of its 24 references that are in the map. First posted on arXiv 10 Aug 2025.

Builds on

6 of 24 references.

References · 6

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2021Active Divergence with Generative Deep Learning -- A Survey and Taxonomycited by 12
  3. 2025XAIxArts Manifesto: Explainable AI for the Artscited by 7
  4. 2023Towards Directive Explanations: Crafting Explainable AI Systems for Actionable Human-AI Interactionscited by 6
  5. 2024Explainability Paths for Sustained Artistic Practice with AIcited by 4
  6. 2024Network Bending of Diffusion Models for Audio-Visual Generationcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Unboxing Diffusion Models for the Arts: Interactive Model Bending and Practice-Based Explainability
  2. 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Models
  3. 2024Equivalence: An analysis of artists' roles with Image Generative AI from Conceptual Art perspective through an interactive installation design practice
  4. 2026AttentionBender: Manipulating Cross-Attention in Video Diffusion Transformers as a Creative Probe
  5. 2025Latent Diffusion : Multi-Dimension Stable Diffusion Latent Space Explorer
  6. 2025The Cow of Rembrandt - Analyzing Artistic Prompt Interpretation in Text-to-Image Models
  7. 2024Draw Like an Artist: Complex Scene Generation with Diffusion Model via Composition, Painting, and Retouching
  8. 2026An Embodied Companion for Visual Storytelling