mlsanityData to 14 Oct 2026

Are We Overthinking One-Step Generation?

arXiv 2610.20331 ↗First posted 14 Oct 2026cs.LGcited by 0

On the map: LLM reasoning → Diffusion reasoning and test-time scaling

also in 1 more
Abstract (arXiv)

Diffusion and flow matching are now dominant frameworks for generative modeling in continuous domains, but they typically require multiple network evaluations at inference. This has motivated extensive research on one-step generative modeling primarily built on diffusion and flow, though existing approaches often rely on complex training machinery. In this work, we introduce Priming Models, a simple two-stage framework for training one-step generators. Motivated by the difficulty of distributional training from scratch, Priming Models are first trained on a reconstruction objective, e.g., pixel-space denoising at a fixed noise level, before undergoing feature-space distributional post-training. Our central scientific finding is that this simple reconstruction stage is already enough to entirely alleviate the difficulty of distributional training. Empirically, across class-conditional image generation, text-to-image generation, and world modeling, Priming Models significantly advance the Pareto frontier of training compute vs. generation quality. On ImageNet at 256 × 256 resolution, we achieve a state-of-the-art FID of 1.19 among one-step generators using approximately one-tenth the training compute of prior methods with comparable FID. We open-source our codebase at https://github.com/JaeyeonKim01/priming.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Diffusion reasoning and test-time scaling, one of 17 directions in LLM reasoning. Builds on 62 of its 78 references that are in the map. First posted on arXiv 14 Oct 2026.

Builds on

62 of 78 references.

References · 62

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  7. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  8. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  9. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  10. 2022Flow Matching for Generative Modelingcited by 5,702
  11. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
  12. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
38 more
  1. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  2. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  3. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  4. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  5. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  6. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
  7. 2017Improved Training of Wasserstein GANscited by 2,235
  8. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  9. 2023Consistency Modelscited by 1,822
  10. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  11. 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,216
  12. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  13. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
  14. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
  15. 2023Adversarial Diffusion Distillationcited by 759
  16. 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 712
  17. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
  18. 2018Which Training Methods for GANs do actually Converge?cited by 679
  19. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
  20. 2025Mean Flows for One-step Generative Modelingcited by 561
  21. 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 492
  22. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 475
  23. 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 459
  24. 2023Improved Techniques for Training Consistency Modelscited by 439
  25. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 395
  26. 2024One Step Diffusion via Shortcut Modelscited by 391
  27. 2017Learning Generative Models with Sinkhorn Divergencescited by 314
  28. 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 283
  29. 2015Generative Moment Matching Networkscited by 257
  30. 2017MMD GAN: Towards Deeper Understanding of Moment Matching Networkcited by 254
  31. 2023Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Modelscited by 236
  32. 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generationcited by 214
  33. 2024Consistency Models Made Easycited by 144
  34. 2026Generative Modeling via Driftingcited by 116
  35. 2025Inductive Moment Matchingcited by 113
  36. 2025Improved Mean Flows: On the Challenges of Fastforward Generative Modelscited by 110
  37. 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency modelscited by 109
  38. 2026One-step Latent-free Image Generation with Pixel Mean Flowscited by 53

50 most cited of 62 All 62 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Setting-Matched and Semantics-Scaled Benchmarking of One-Step Generative Models Against Multistep Diffusion and Flow Models
  2. 2023AdaDiff: Adaptive Step Selection for Fast Diffusion Models
  3. 2025Dimathtt[M]O: Distilling Masked Diffusion Models into One-step Generator
  4. 2023Conditional Image Generation with Pretrained Generative Model
  5. 2024On Improved Conditioning Mechanisms and Pre-training Strategies for Diffusion Models
  6. 2024Diffusion Models Are Innate One-Step Generators
  7. 2022Elucidating the Design Space of Diffusion-Based Generative Models
  8. 2023Conditional Generation from Unconditional Diffusion Models using Denoiser Representations