Delta Score Matters! Spatial Adaptive Multi Guidance in Diffusion Models
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Diffusion models have achieved remarkable success in synthesizing complex static and temporal visuals, a breakthrough largely driven by Classifier-Free Guidance (CFG). However, despite its pivotal role in aligning generated content with textual prompts, standard CFG relies on a globally uniform scalar. This homogeneous amplification traps models in a well-documented "detail-artifact dilemma": low guidance scales fail to inject intricate semantics, while high scales inevitably cause structural degradation, color over-saturation, and temporal inconsistencies in videos. In this paper, we expose the physical root of this flaw through the lens of differential geometry. By analyzing Tweedie's Formula, we reveal that CFG intrinsically performs a tangential linear extrapolation. Because the natural data manifold is highly curved, this uniform linear step introduces a severe orthogonal deviation. To keep the generation trajectory safely bounded, we formulate a theoretical upper bound for spatial and adaptive guidance. Based on these geometric insights, we propose Spatial Adaptive Multi Guidance (SAMG), a training-free and virtually zero-cost sampling algorithm. SAMG dynamically computes point-wise conditional guidance energy, applying a conservative minimum scale to high-energy boundary regions to preserve delicate micro-textures, while deploying an aggressive maximum scale in low-energy regions to maximize semantic injection. Extensive experiments across diverse image (SD 1.5, SDXL, SD3.5 Medium) and video (CogVideoX, ModelScope) architectures demonstrate that SAMG effectively resolves the detail-artifact dilemma, achieving superior semantic alignment, structural integrity, and temporal smoothness without any computational overhead.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 29 of its 34 references that are in the map. First posted on arXiv 29 Apr 2026.
Builds on
29 of 34 references.
Closest ancestors · 14
Same direction, newest first
- 2025CFG-Zero*: Improved Classifier-Free Guidance for Flow Matching Models24 Mar
- 2024CFG++: Manifold-constrained Classifier Free Guidance for Diffusion Models12 Jun
- 2024Rethinking the Spatial Inconsistency in Classifier-Free Diffusion Guidance8 Apr
- 2024Self-Rectifying Diffusion Sampling with Perturbed-Attention Guidance26 Mar
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesis5 Mar
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis4 Jul
- 2023Common Diffusion Noise Schedules and Sample Steps are Flawed15 May
- 2022Classifier-Free Diffusion Guidance26 Jul
- 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
- 2022Analytic-DPM: an Analytic Estimate of the Optimal Reverse Variance in Diffusion Probabilistic Models17 Jan
- 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
2 more
- 2020Denoising Diffusion Implicit Models6 Oct
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 15
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
- 2023ModelScope Text-to-Video Technical Reportcited by 651
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Feedback Guidance of Diffusion Models
- 2024Eliminating Oversaturation and Artifacts of High Guidance Scales in Diffusion Models
- 2025How Much To Guide: Revisiting Adaptive Guidance in Classifier-Free Guidance Text-to-Vision Diffusion Models
- 2025Dynamic Classifier-Free Diffusion Guidance via Online Feedback
- 2025Classifier-free Guidance with Adaptive Scaling
- 2026Improving Diffusion Generalization with Weak-to-Strong Segmented Guidance
- 2024Spatiotemporal Skip Guidance for Enhanced Video Diffusion Sampling
- 2025Towards a Golden Classifier-Free Guidance Path via Foresight Fixed Point Iterations