Normalized Attention Guidance: Universal Negative Guidance for Diffusion Models
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Negative guidance -- explicitly suppressing unwanted attributes -- remains a fundamental challenge in diffusion models, particularly in few-step sampling regimes. While Classifier-Free Guidance (CFG) works well in standard settings, it fails under aggressive sampling step compression due to divergent predictions between positive and negative branches. We present Normalized Attention Guidance (NAG), an efficient, training-free mechanism that applies extrapolation in attention space with L1-based normalization and refinement. NAG restores effective negative guidance where CFG collapses while maintaining fidelity. Unlike existing approaches, NAG generalizes across architectures (UNet, DiT), sampling regimes (few-step, multi-step), and modalities (image, video), functioning as a textituniversal plug-in with minimal computational overhead. Through extensive experimentation, we demonstrate consistent improvements in text alignment (CLIP Score), fidelity (FID, PFID), and human-perceived quality (ImageReward). Our ablation studies validate each design component, while user studies confirm significant preference for NAG-guided outputs. As a model-agnostic inference-time approach requiring no retraining, NAG provides effortless negative guidance for all modern diffusion frameworks -- pseudocode in the Appendix!
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 57 of its 66 references that are in the map. First posted on arXiv 27 May 2025.
Builds on
57 of 66 references.
Closest ancestors · 31
Same direction, newest first
- 2025CFG-Zero*: Improved Classifier-Free Guidance for Flow Matching Models24 Mar
- 2025PLADIS: Pushing the Limits of Attention in Diffusion Models at Inference Time by Leveraging Sparsity10 Mar
- 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformer30 Jan
- 2024Rectified Diffusion Guidance for Conditional Generation24 Oct
- 2024Scaling Laws For Diffusion Transformers10 Oct
- 2024Eliminating Oversaturation and Artifacts of High Guidance Scales in Diffusion Models3 Oct
- 2024SwiftBrush v2: Make Your One-step Diffusion Model Better Than Its Teacher26 Aug
- 2024CFG++: Manifold-constrained Classifier Free Guidance for Diffusion Models12 Jun
- 2024Lumina-Next: Making Lumina-T2X Stronger and Faster with Next-DiT5 Jun
- 2024Improved Distribution Matching Distillation for Fast Image Synthesis23 May
- 2024Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesis21 Apr
- 2024Analysis of Classifier-Free Guidance Weight Schedulers19 Apr
19 more
- 2024Self-Rectifying Diffusion Sampling with Perturbed-Attention Guidance26 Mar
- 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillation18 Mar
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesis5 Mar
- 2024Trajectory Consistency Distillation: Improved Latent Consistency Distillation by Semi-Linear Consistency Function with Trajectory Mapping29 Feb
- 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillation21 Feb
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformers16 Jan
- 2023Characteristic Guidance: Non-linear Correction for Diffusion Model at Large Guidance Scale11 Dec
- 2023One-step Diffusion with Distribution Matching Distillation30 Nov
- 2023Adversarial Diffusion Distillation28 Nov
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference6 Oct
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis4 Jul
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2022Improving Sample Quality of Diffusion Models Using Self-Attention Guidance3 Oct
- 2022Classifier-Free Diffusion Guidance26 Jul
- 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
- 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
- 2021Diffusion Models Beat GANs on Image Synthesis11 May
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 26
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
- 2021Scaling Vision Transformerscited by 993
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
14 more
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 921
- 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 835
- 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 589
- 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 387
- 2023Photorealistic Video Generation with Diffusion Modelscited by 304
- 2023Multisample Flow Matching: Straightening Flows with Minibatch Couplingscited by 267
- 2024Playground v2.5: Three Insights towards Enhancing Aesthetic Quality in Text-to-Image Generationcited by 249
- 2023Flow Matching in Latent Spacecited by 155
- 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 142
- 2024Playground v3: Improving Text-to-Image Alignment with Deep-Fusion Large Language Modelscited by 113
- 2025SANA-Sprint: One-Step Diffusion with Continuous-Time Consistency Distillationcited by 85
- 2024NitroFusion: High-Fidelity Single-Step Diffusion through Dynamic Adversarial Trainingcited by 16
- 2025Lumina-Video: Efficient and Flexible Video Generation with Multi-scale Next-DiTcited by 16
Built on by
Citing papers per year: 2025: 4; 2026: 8.
12 papers.
- 2025Temporal Concept Dynamics in Diffusion Models via Prompt-Conditioned Interventionscited by 7
- 2026Layer-wise Instance Binding for Regional and Occlusion Control in Text-to-Image Diffusion Transformerscited by 5
- 2025VSF: Simple, Efficient, and Effective Negative Guidance in Few-Step Image Generation Models By Value Sign Flipcited by 3
- 2025Noise-Level Diffusion Guidance: Well Begun is Half Donecited by 2
- 2026GuidedBridge: Training-freely Improving Bridge Models with Prior Guidancecited by 1
- 2025CADE 2.5 - ZeResFDG: Frequency-Decoupled, Rescaled and Zero-Projected Guidance for SD/SDXL Latent Diffusion Modelscited by 0
- 2026Rethinking Global Text Conditioning in Diffusion Transformerscited by 0
- 2026Geometry-Aware Attention Guidance for Diffusion Models via Modern Hopfield Dynamicscited by 0
- 2026Not all tokens contribute equally to diffusion learningcited by 0
- 2026Orthogonal Negative Guidance in Attention Feature Space for Text-to-Image Generationcited by 0
- 2026Not All Prediction Targets Keep Training-Free Diffusion Guidance on the Manifoldcited by 0
- 2026World in World: Explore the World with World Modelscited by 0
- 2026World in World: Explore the World with World Models10 Sep 2026
- 2026Not All Prediction Targets Keep Training-Free Diffusion Guidance on the Manifold1 Jul 2026
- 2026GuidedBridge: Training-freely Improving Bridge Models with Prior Guidance2 Jun 2026
- 2026Orthogonal Negative Guidance in Attention Feature Space for Text-to-Image Generation28 May 2026
- 2026Not all tokens contribute equally to diffusion learning8 Apr 2026
- 2026Layer-wise Instance Binding for Regional and Occlusion Control in Text-to-Image Diffusion Transformers6 Mar 2026
- 2026Geometry-Aware Attention Guidance for Diffusion Models via Modern Hopfield Dynamics3 Mar 2026
- 2026Rethinking Global Text Conditioning in Diffusion Transformers9 Feb 2026
- 2025Temporal Concept Dynamics in Diffusion Models via Prompt-Conditioned Interventions9 Dec 2025
- 2025CADE 2.5 - ZeResFDG: Frequency-Decoupled, Rescaled and Zero-Projected Guidance for SD/SDXL Latent Diffusion Models14 Oct 2025
- 2025Noise-Level Diffusion Guidance: Well Begun is Half Done17 Sep 2025
- 2025VSF: Simple, Efficient, and Effective Negative Guidance in Few-Step Image Generation Models By Value Sign Flip11 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2026Revisiting Classifier-Free Guidance Methods in Latent Diffusion Models
- 2025EMAG: Self-Rectifying Diffusion Sampling with Exponential Moving Average Guidance
- 2025Feedback Guidance of Diffusion Models
- 2024Dynamic Negative Guidance of Diffusion Models
- 2025Entropy Rectifying Guidance for Diffusion and Flow Models
- 2026Guiding a Diffusion Model by Swapping Its Tokens
- 2023Adaptive Guidance: Training-free Acceleration of Conditional Diffusion Models
- 2025Diffusion Models with Adaptive Negative Sampling Without External Resources