mlsanityData to 7 Oct 2026

Guiding Diffusion Models with Semantically Degraded Conditions

arXiv 2603.10780 ↗First posted 11 Mar 2026cs.CVcited by 0

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Classifier-Free Guidance (CFG) is a cornerstone of modern text-to-image models, yet its reliance on a semantically vacuous null prompt (varnothing) generates a guidance signal prone to geometric entanglement. This is a key factor limiting its precision, leading to well-documented failures in complex compositional tasks. We propose Condition-Degradation Guidance (CDG), a novel paradigm that replaces the null prompt with a strategically degraded condition, boldsymbolcdeg. This reframes guidance from a coarse "good vs. null" contrast to a more refined "good vs. almost good" discrimination, thereby compelling the model to capture fine-grained semantic distinctions. We find that tokens in transformer text encoders split into two functional roles: content tokens encoding object semantics, and context-aggregating tokens capturing global context. By selectively degrading only the former, CDG constructs boldsymbolcdeg without external models or training. Validated across diverse architectures including Stable Diffusion 3, FLUX, and Qwen-Image, CDG markedly improves compositional accuracy and text-image alignment. As a lightweight, plug-and-play module, it achieves this with negligible computational overhead. Our work challenges the reliance on static, information-sparse negative samples and establishes a new principle for diffusion guidance: the construction of adaptive, semantically-aware negative samples is critical to achieving precise semantic control. Code is available at https://github.com/Ming-321/Classifier-Degradation-Guidance.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 38 of its 45 references that are in the map. First posted on arXiv 11 Mar 2026.

Builds on

38 of 45 references.

Closest ancestors · 20

Same direction, newest first

  1. 2025Rethinking Oversaturation in Classifier-Free Guidance via Low Frequency26 Jun
  2. 2025Guidance in the Frequency Domain Enables High-Fidelity Sampling at Low CFG Scales24 Jun
  3. 2025Token Perturbation Guidance for Diffusion Models10 Jun
  4. 2025TCFG: Tangential Damping Classifier-free Guidance23 Mar
  5. 2025Weak-to-Strong Diffusion with Reflection1 Feb
  6. 2024Eliminating Oversaturation and Artifacts of High Guidance Scales in Diffusion Models3 Oct
  7. 2024Smoothed Energy Guidance: Guiding Diffusion Models with Reduced Energy Curvature of Attention1 Aug
  8. 2024No Training, No Problem: Rethinking Classifier-Free Guidance for Diffusion Models2 Jul
  9. 2024Guiding a Diffusion Model with a Bad Version of Itself4 Jun
  10. 2024Segmentation-Free Guidance for Text-to-Image Diffusion Models3 Jun
  11. 2024Self-Rectifying Diffusion Sampling with Perturbed-Attention Guidance26 Mar
  12. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesis5 Mar
8 more
  1. 2023CADS: Unleashing the Diversity of Diffusion Models through Condition-Annealed Sampling26 Oct
  2. 2022Scalable Diffusion Models with Transformers19 Dec
  3. 2022Classifier-Free Diffusion Guidance26 Jul
  4. 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  7. 2020Denoising Diffusion Implicit Models6 Oct
  8. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 18

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  4. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  5. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  6. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  7. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  8. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
  9. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  10. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
  11. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
  12. 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Modelscited by 358
6 more
  1. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 321
  2. 2023Composer: Creative and Controllable Image Synthesis with Composable Conditionscited by 303
  3. 2023Emu: Enhancing Image Generation Models Using Photogenic Needles in a Haystackcited by 278
  4. 2024GenAI-Bench: Evaluating and Improving Compositional Text-to-Visual Generationcited by 130
  5. 2023Zero-TPrune: Zero-Shot Token Pruning through Leveraging of the Attention Graph in Pre-Trained Transformerscited by 61
  6. 2024Improving image synthesis with diffusion-negative samplingcited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Semantic Guidance Tuning for Text-To-Image Diffusion Models
  2. 2024Rethinking the Spatial Inconsistency in Classifier-Free Diffusion Guidance
  3. 2023Adaptive Guidance: Training-free Acceleration of Conditional Diffusion Models
  4. 2025Towards a Golden Classifier-Free Guidance Path via Foresight Fixed Point Iterations
  5. 2021More Control for Free! Image Synthesis with Semantic Diffusion Guidance
  6. 2026Guiding Token-Sparse Diffusion Models
  7. 2026Guiding a Diffusion Model by Swapping Its Tokens
  8. 2026Guidance Matters: Rethinking the Evaluation Pitfall for Text-to-Image Generation