Z2-Sampling: Zero-Cost Zigzag Trajectories for Semantic Alignment in Diffusion Models
On the map: Diffusion models → Discrete and text diffusion
also in 1 more
Abstract (arXiv)
Diffusion models have achieved unprecedented success in text-aligned generation, largely driven by Classifier-Free Guidance (CFG). However, standard CFG operates strictly on instantaneous gradients, omitting the intrinsic curvature of the data manifold. Recent methods like Zigzag-sampling (Z-Sampling) explicitly traverse multi-step forward-backward trajectories to probe this curvature, significantly improving semantic alignment. Yet, these explicit traversals triple the Neural Function Evaluation (NFE) cost and introduce unconstrained truncation errors from off-manifold evaluations, causing cumulative drift from the true marginal distribution. In this paper, we theoretically demonstrate that the explicit zigzag sequence is topologically reducible. We propose Implicit Z-Sampling, rigorously proving that intermediate states can be algebraically annihilated via operator dualities, physically eliminating off-manifold approximation errors. To push sampling efficiency to its theoretical lower bound, we introduce Z2-Sampling (Zero-cost Zigzag Sampling). Exploiting the Probability Flow ODE's temporal coherence, Z2-Sampling couples implicit algebraic collapse with a dynamically cached Temporal Semantic Surrogate. This restores the standard 2-NFE baseline without sacrificing semantic exploration. We formally prove via Backward Error Analysis that this discrete collapse inherently synthesizes a directional derivative curvature penalty. Finally, extensive evaluations demonstrate that Z2-Sampling structurally shatters the performance-efficiency Pareto frontier. We validate its universal applicability across diverse architectures (U-Nets, DiTs) and modalities (image/video), establishing seamless orthogonality with advanced alignment frameworks (AYS, Diffusion-DPO).
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Discrete and text diffusion, one of 14 directions in Diffusion models. Builds on 50 of its 53 references that are in the map. First posted on arXiv 26 Apr 2026.
Builds on
50 of 53 references.
References · 50
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
38 more
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2021Variational Diffusion Modelscited by 1,145
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 924
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
- 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 767
- 2023ModelScope Text-to-Video Technical Reportcited by 651
- 2022Compositional Visual Generation with Composable Diffusion Modelscited by 619
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
- 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 441
- 2023Common Diffusion Noise Schedules and Sample Steps are Flawedcited by 308
- 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 294
- 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Codecited by 145
- 2024CFG++: Manifold-constrained Classifier Free Guidance for Diffusion Modelscited by 138
- 2024Align Your Steps: Optimizing Sampling Schedules in Diffusion Modelscited by 91
- 2024Golden Noise for Diffusion Models: A Learning Frameworkcited by 91
- 2023Restart Sampling for Improving Generative Processescited by 81
- 2023Generating images of rare concepts using pre-trained diffusion modelscited by 78
- 2024ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generationcited by 74
- 2024Rethinking the Spatial Inconsistency in Classifier-Free Diffusion Guidancecited by 58
- 2024Smoothed Energy Guidance: Guiding Diffusion Models with Reduced Energy Curvature of Attentioncited by 55
- 2024Good Seed Makes a Good Crop: Discovering Secret Seeds in Text-to-Image Diffusion Modelscited by 47
- 2024Text-to-Image Rectified Flow as Plug-and-Play Priorscited by 38
- 2024Zigzag Diffusion Sampling: Diffusion Models Can Self-Improve via Self-Reflectioncited by 38
- 2024DCTdiff: Intriguing Properties of Image Generative Modeling in the DCT Spacecited by 32
- 2023The Lottery Ticket Hypothesis in Denoising: Towards Semantic-Driven Initializationcited by 22
- 2024SATO: Stable Text-to-Motion Frameworkcited by 20
- 2025Physics-Informed Representation Alignment for Sparse Radio-Map Reconstructioncited by 11
- 2023Synthetic Shifts to Initial Seed Vector Exposes the Brittle Nature of Latent-Based Diffusion Modelscited by 9
- 2025ANT: Adaptive Neural Temporal-Aware Text-to-Motion Modelcited by 9
- 2025CoEmoGen: Towards Semantically-Coherent and Scalable Emotional Image Content Generationcited by 9
- 2025POLARIS: Projection-Orthogonal Least Squares for Robust and Adaptive Inversion in Diffusion Modelscited by 8
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Breaking AR's Sampling Bottleneck: Provable Acceleration via Diffusion Language Models
- 2026Time-Annealed Perturbation Sampling: Diverse Generation for Diffusion Language Models
- 2023Non-Cross Diffusion for Semantic Consistency
- 2023Semantic Guidance Tuning for Text-To-Image Diffusion Models
- 2026Semantic DLM+: Improving Diffusion Language Models through Bias-variance Trade-off in Transition Kernel Design
- 2025The Diffusion Duality
- 2026Oracle Noise: Faster Semantic Spherical Alignment for Interpretable Latent Optimization
- 2024Alignment of Diffusion Models: Fundamentals, Challenges, and Future