mlsanityData to 7 Oct 2026

Delta Score Matters! Spatial Adaptive Multi Guidance in Diffusion Models

arXiv 2604.26503 ↗First posted 29 Apr 2026cs.CVcited by 3

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Diffusion models have achieved remarkable success in synthesizing complex static and temporal visuals, a breakthrough largely driven by Classifier-Free Guidance (CFG). However, despite its pivotal role in aligning generated content with textual prompts, standard CFG relies on a globally uniform scalar. This homogeneous amplification traps models in a well-documented "detail-artifact dilemma": low guidance scales fail to inject intricate semantics, while high scales inevitably cause structural degradation, color over-saturation, and temporal inconsistencies in videos. In this paper, we expose the physical root of this flaw through the lens of differential geometry. By analyzing Tweedie's Formula, we reveal that CFG intrinsically performs a tangential linear extrapolation. Because the natural data manifold is highly curved, this uniform linear step introduces a severe orthogonal deviation. To keep the generation trajectory safely bounded, we formulate a theoretical upper bound for spatial and adaptive guidance. Based on these geometric insights, we propose Spatial Adaptive Multi Guidance (SAMG), a training-free and virtually zero-cost sampling algorithm. SAMG dynamically computes point-wise conditional guidance energy, applying a conservative minimum scale to high-energy boundary regions to preserve delicate micro-textures, while deploying an aggressive maximum scale in low-energy regions to maximize semantic injection. Extensive experiments across diverse image (SD 1.5, SDXL, SD3.5 Medium) and video (CogVideoX, ModelScope) architectures demonstrate that SAMG effectively resolves the detail-artifact dilemma, achieving superior semantic alignment, structural integrity, and temporal smoothness without any computational overhead.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 29 of its 34 references that are in the map. First posted on arXiv 29 Apr 2026.

Builds on

29 of 34 references.

Closest ancestors · 14

Same direction, newest first

  1. 2025CFG-Zero*: Improved Classifier-Free Guidance for Flow Matching Models24 Mar
  2. 2024CFG++: Manifold-constrained Classifier Free Guidance for Diffusion Models12 Jun
  3. 2024Rethinking the Spatial Inconsistency in Classifier-Free Diffusion Guidance8 Apr
  4. 2024Self-Rectifying Diffusion Sampling with Perturbed-Attention Guidance26 Mar
  5. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesis5 Mar
  6. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis4 Jul
  7. 2023Common Diffusion Noise Schedules and Sample Steps are Flawed15 May
  8. 2022Classifier-Free Diffusion Guidance26 Jul
  9. 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
  10. 2022Analytic-DPM: an Analytic Estimate of the Optimal Reverse Variance in Diffusion Probabilistic Models17 Jan
  11. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  12. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
2 more
  1. 2020Denoising Diffusion Implicit Models6 Oct
  2. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 15

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  5. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  6. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  7. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  8. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
  9. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
  10. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
  11. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
  12. 2023ModelScope Text-to-Video Technical Reportcited by 651
3 more
  1. 2019Sliced Score Matching: A Scalable Approach to Density and Score Estimationcited by 381
  2. 2021The Intrinsic Dimension of Images and Its Impact on Learningcited by 307
  3. 2024ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generationcited by 74

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Feedback Guidance of Diffusion Models
  2. 2024Eliminating Oversaturation and Artifacts of High Guidance Scales in Diffusion Models
  3. 2025How Much To Guide: Revisiting Adaptive Guidance in Classifier-Free Guidance Text-to-Vision Diffusion Models
  4. 2025Dynamic Classifier-Free Diffusion Guidance via Online Feedback
  5. 2025Classifier-free Guidance with Adaptive Scaling
  6. 2026Improving Diffusion Generalization with Weak-to-Strong Segmented Guidance
  7. 2024Spatiotemporal Skip Guidance for Enhanced Video Diffusion Sampling
  8. 2025Towards a Golden Classifier-Free Guidance Path via Foresight Fixed Point Iterations