mlsanityData to 7 Oct 2026

DCR: Counterfactual Attractor Guidance for Rare Compositional Generation

arXiv 2605.06512 ↗First posted 7 May 2026cs.CVcited by 1

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Diffusion models generate realistic visual content, yet often fail to produce rare but plausible compositions. When prompted with combinations that are valid but underrepresented in training data, such as a snowy beach or a rainbow at night, the generation process frequently collapses toward more common alternatives. We identify this failure mode as default completion bias, where denoising trajectories are implicitly attracted toward high-frequency semantic configurations. Existing guidance mechanisms do not explicitly model this competing tendency and therefore struggle to prevent such collapse. We introduce Default Completion Repulsion (DCR), a training-free framework that explicitly models and suppresses default completion behavior. DCR constructs a counterfactual attractor by relaxing the rare compositional factor while preserving surrounding semantics, inducing an alternative denoising trajectory reflecting the model's preferred completion. We define the discrepancy between target and attractor trajectories as a counterfactual drift, and propose a projection-based repulsion mechanism that removes guidance components aligned with this drift direction. This suppresses undesired frequent completions while preserving other semantic components. DCR operates entirely within the standard diffusion sampling process without retraining or architectural modification. Experiments on rare compositional prompts show that DCR improves compositional fidelity while maintaining visual quality. Our analysis further shows that the framework exposes and counteracts intrinsic model biases, offering a new perspective on controllable generation beyond explicit constraint enforcement.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 43 of its 44 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

43 of 44 references.

Closest ancestors · 6

Same direction, newest first

  1. 2024CFG++: Manifold-constrained Classifier Free Guidance for Diffusion Models12 Jun
  2. 2023FreeU: Free Lunch in Diffusion U-Net20 Sep
  3. 2023Universal Guidance for Diffusion Models14 Feb
  4. 2022Classifier-Free Diffusion Guidance26 Jul
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  6. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 37

  1. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  2. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  3. 2022Video Diffusion Modelscited by 2,280
  4. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  5. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  6. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  7. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  8. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  9. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  10. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 696
  11. 2023ModelScope Text-to-Video Technical Reportcited by 651
  12. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 619
25 more
  1. 2022When and why vision-language models behave like bags-of-words, and what to do about it?cited by 603
  2. 2023Erasing Concepts from Diffusion Modelscited by 530
  3. 2022Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionalitycited by 523
  4. 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 475
  5. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 450
  6. 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesiscited by 386
  7. 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 385
  8. 2023Unified Concept Editing in Diffusion Modelscited by 377
  9. 2023Preserve Your Own Correlation: A Noise Prior for Video Diffusion Modelscited by 284
  10. 2023Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioningcited by 254
  11. 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Textcited by 242
  12. 2023SugarCrepe: Fixing Hackable Benchmarks for Vision-Language Compositionalitycited by 238
  13. 2023FreeNoise: Tuning-Free Longer Video Diffusion via Noise Reschedulingcited by 173
  14. 2023Linguistic Binding in Diffusion Models: Enhancing Attribute Correspondence through Attention Map Alignmentcited by 169
  15. 2025HunyuanVideo 1.5 Technical Reportcited by 148
  16. 2023Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoisingcited by 135
  17. 2023LLM-grounded Video Diffusion Modelscited by 83
  18. 2025Vision-Language Models Do Not Understand Negationcited by 69
  19. 2024Learn "No" to Say "Yes" Better: Improving Vision-Language Models via Negationscited by 45
  20. 2024DyMO: Training-Free Diffusion Model Alignment with Dynamic Multi-Objective Schedulingcited by 27
  21. 2025Training-Free Constrained Generation With Stable Diffusion Modelscited by 20
  22. 2025NegVQA: Can Vision Language Models Understand Negation?cited by 12
  23. 2025Constrained Diffusers for Safe Planning and Controlcited by 9
  24. 2026Not Just What's There: Enabling CLIP to Comprehend Negated Visual Descriptions Without Fine-tuningcited by 5
  25. 2026NEGATE: Constrained Semantic Guidance for Linguistic Negation in Text-to-Video Diffusioncited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Determinism of Randomness: Prompt-Residual Seed Shaping for Diffusion Generation
  2. 2023Diffusion Models Generate Images Like Painters: an Analytical Theory of Outline First, Details Later
  3. 2023Compositional Abilities Emerge Multiplicatively: Exploring Diffusion Models on a Synthetic Task
  4. 2025SliderSpace: Decomposing the Visual Capabilities of Diffusion Models
  5. 2026TILT: Improving Compositional Generation in Diffusion Models with a Model-Intrinsic Reward
  6. 2026Coarse-to-Fine Compositional Diffusion for Long-Horizon Planning
  7. 2026On-the-fly Repulsion in the Contextual Space for Rich Diversity in Diffusion Transformers
  8. 2026The Geometry of Phase Transitions in Generative Dynamics via Projection Caustics