mlsanityData to 7 Oct 2026

Z2-Sampling: Zero-Cost Zigzag Trajectories for Semantic Alignment in Diffusion Models

arXiv 2604.23536 ↗First posted 26 Apr 2026cs.CVcited by 1

On the map: Diffusion models → Discrete and text diffusion

also in 1 more
Abstract (arXiv)

Diffusion models have achieved unprecedented success in text-aligned generation, largely driven by Classifier-Free Guidance (CFG). However, standard CFG operates strictly on instantaneous gradients, omitting the intrinsic curvature of the data manifold. Recent methods like Zigzag-sampling (Z-Sampling) explicitly traverse multi-step forward-backward trajectories to probe this curvature, significantly improving semantic alignment. Yet, these explicit traversals triple the Neural Function Evaluation (NFE) cost and introduce unconstrained truncation errors from off-manifold evaluations, causing cumulative drift from the true marginal distribution. In this paper, we theoretically demonstrate that the explicit zigzag sequence is topologically reducible. We propose Implicit Z-Sampling, rigorously proving that intermediate states can be algebraically annihilated via operator dualities, physically eliminating off-manifold approximation errors. To push sampling efficiency to its theoretical lower bound, we introduce Z2-Sampling (Zero-cost Zigzag Sampling). Exploiting the Probability Flow ODE's temporal coherence, Z2-Sampling couples implicit algebraic collapse with a dynamically cached Temporal Semantic Surrogate. This restores the standard 2-NFE baseline without sacrificing semantic exploration. We formally prove via Backward Error Analysis that this discrete collapse inherently synthesizes a directional derivative curvature penalty. Finally, extensive evaluations demonstrate that Z2-Sampling structurally shatters the performance-efficiency Pareto frontier. We validate its universal applicability across diverse architectures (U-Nets, DiTs) and modalities (image/video), establishing seamless orthogonality with advanced alignment frameworks (AYS, Diffusion-DPO).

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Discrete and text diffusion, one of 14 directions in Diffusion models. Builds on 50 of its 53 references that are in the map. First posted on arXiv 26 Apr 2026.

Builds on

50 of 53 references.

References · 50

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  7. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  8. 2022Classifier-Free Diffusion Guidancecited by 5,717
  9. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  10. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  11. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  12. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
38 more
  1. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  2. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  3. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  4. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  5. 2021Variational Diffusion Modelscited by 1,145
  6. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
  7. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
  8. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
  9. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
  10. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 924
  11. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
  12. 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 767
  13. 2023ModelScope Text-to-Video Technical Reportcited by 651
  14. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 619
  15. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
  16. 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 441
  17. 2023Common Diffusion Noise Schedules and Sample Steps are Flawedcited by 308
  18. 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 294
  19. 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Codecited by 145
  20. 2024CFG++: Manifold-constrained Classifier Free Guidance for Diffusion Modelscited by 138
  21. 2024Align Your Steps: Optimizing Sampling Schedules in Diffusion Modelscited by 91
  22. 2024Golden Noise for Diffusion Models: A Learning Frameworkcited by 91
  23. 2023Restart Sampling for Improving Generative Processescited by 81
  24. 2023Generating images of rare concepts using pre-trained diffusion modelscited by 78
  25. 2024ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generationcited by 74
  26. 2024Rethinking the Spatial Inconsistency in Classifier-Free Diffusion Guidancecited by 58
  27. 2024Smoothed Energy Guidance: Guiding Diffusion Models with Reduced Energy Curvature of Attentioncited by 55
  28. 2024Good Seed Makes a Good Crop: Discovering Secret Seeds in Text-to-Image Diffusion Modelscited by 47
  29. 2024Text-to-Image Rectified Flow as Plug-and-Play Priorscited by 38
  30. 2024Zigzag Diffusion Sampling: Diffusion Models Can Self-Improve via Self-Reflectioncited by 38
  31. 2024DCTdiff: Intriguing Properties of Image Generative Modeling in the DCT Spacecited by 32
  32. 2023The Lottery Ticket Hypothesis in Denoising: Towards Semantic-Driven Initializationcited by 22
  33. 2024SATO: Stable Text-to-Motion Frameworkcited by 20
  34. 2025Physics-Informed Representation Alignment for Sparse Radio-Map Reconstructioncited by 11
  35. 2023Synthetic Shifts to Initial Seed Vector Exposes the Brittle Nature of Latent-Based Diffusion Modelscited by 9
  36. 2025ANT: Adaptive Neural Temporal-Aware Text-to-Motion Modelcited by 9
  37. 2025CoEmoGen: Towards Semantically-Coherent and Scalable Emotional Image Content Generationcited by 9
  38. 2025POLARIS: Projection-Orthogonal Least Squares for Robust and Adaptive Inversion in Diffusion Modelscited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Breaking AR's Sampling Bottleneck: Provable Acceleration via Diffusion Language Models
  2. 2026Time-Annealed Perturbation Sampling: Diverse Generation for Diffusion Language Models
  3. 2023Non-Cross Diffusion for Semantic Consistency
  4. 2023Semantic Guidance Tuning for Text-To-Image Diffusion Models
  5. 2026Semantic DLM+: Improving Diffusion Language Models through Bias-variance Trade-off in Transition Kernel Design
  6. 2025The Diffusion Duality
  7. 2026Oracle Noise: Faster Semantic Spherical Alignment for Interpretable Latent Optimization
  8. 2024Alignment of Diffusion Models: Fundamentals, Challenges, and Future