Where to Look Is Not How to Fix: Pre-Denoising Diagnostics and Modality-Dependent Control in Diffusion Composition
On the map: Diffusion models → Medical imaging and segmentation also fits: Image generation, text-to-image and editing
Abstract (arXiv)
Understanding compositional failures in text-to-image diffusion requires identifying both where stress is detectable and how intervention changes the output. We study these questions through a controlled anchor--stress protocol that jointly evaluates text-encoder diagnostics and denoiser interventions. We introduce a text-only Compositional Stress Index (CSI), which separates common from rare compositions across SD1.5, SDXL, and the SD3 text path and provides an upstream diagnostic coordinate. A matched six-prompt localization study links intervention location to distinct outcomes: residual-minimizing embedding adapters improve representation fit, while downstream cross-attention intervention increases color hit rate (CHR) by 0.0272. Across SD1.5 and SDXL denoiser blocks, the largest positive signed diagnostic-accessibility mean occurs at the deep encoder, whereas selective boost has its largest positive mean CHR response at decoder blocks. Selective subtraction and broad ablation reveal further modality- and architecture-dependent responses, including a substantial CHR decrease when SDXL decoder cross-attention is broadly ablated. We find a diagnosis-control dissociation under our controlled attribute-object composition setting: compositional defects are diagnosable before denoising, but the representation coordinate that exposes risk is not necessarily the coordinate or modality that improves generation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. First posted on arXiv 2 Oct 2026.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026A Decomposable Probe for Few-Step Diffusion Models: Prompt, Latent, and Score Selectivity across Backbone Families and Distillation Paradigms
- 2023Faster Diffusion: Rethinking the Role of the Encoder for Diffusion Model Inference
- 2026Diffusion Probe: Generated Image Result Prediction Using CNN Probes
- 2026Text Template Tokens Are Implicit Semantic Registers in Diffusion Transformers
- 2026PAST: Prompt-Adaptive Sampling Termination for Efficient Diffusion Model
- 2026ORCA: Hunting Compositional Failures in Text-to-Image Diffusion
- 2026Toward Early Quality Assessment of Text-to-Image Diffusion Models
- 2026PixelControl: Fine-Grained Condition Fidelity in Text-to-Image Diffusion