Are We Overthinking One-Step Generation?
On the map: LLM reasoning → Diffusion reasoning and test-time scaling
also in 1 more
Abstract (arXiv)
Diffusion and flow matching are now dominant frameworks for generative modeling in continuous domains, but they typically require multiple network evaluations at inference. This has motivated extensive research on one-step generative modeling primarily built on diffusion and flow, though existing approaches often rely on complex training machinery. In this work, we introduce Priming Models, a simple two-stage framework for training one-step generators. Motivated by the difficulty of distributional training from scratch, Priming Models are first trained on a reconstruction objective, e.g., pixel-space denoising at a fixed noise level, before undergoing feature-space distributional post-training. Our central scientific finding is that this simple reconstruction stage is already enough to entirely alleviate the difficulty of distributional training. Empirically, across class-conditional image generation, text-to-image generation, and world modeling, Priming Models significantly advance the Pareto frontier of training compute vs. generation quality. On ImageNet at 256 × 256 resolution, we achieve a state-of-the-art FID of 1.19 among one-step generators using approximately one-tenth the training compute of prior methods with comparable FID. We open-source our codebase at https://github.com/JaeyeonKim01/priming.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Diffusion reasoning and test-time scaling, one of 17 directions in LLM reasoning. Builds on 62 of its 78 references that are in the map. First posted on arXiv 14 Oct 2026.
Builds on
62 of 78 references.
References · 62
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
38 more
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
- 2017Improved Training of Wasserstein GANscited by 2,235
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2023Consistency Modelscited by 1,822
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,216
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
- 2023Adversarial Diffusion Distillationcited by 759
- 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 712
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2018Which Training Methods for GANs do actually Converge?cited by 679
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
- 2025Mean Flows for One-step Generative Modelingcited by 561
- 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 492
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 475
- 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 459
- 2023Improved Techniques for Training Consistency Modelscited by 439
- 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 395
- 2024One Step Diffusion via Shortcut Modelscited by 391
- 2017Learning Generative Models with Sinkhorn Divergencescited by 314
- 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 283
- 2015Generative Moment Matching Networkscited by 257
- 2017MMD GAN: Towards Deeper Understanding of Moment Matching Networkcited by 254
- 2023Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Modelscited by 236
- 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generationcited by 214
- 2024Consistency Models Made Easycited by 144
- 2026Generative Modeling via Driftingcited by 116
- 2025Inductive Moment Matchingcited by 113
- 2025Improved Mean Flows: On the Challenges of Fastforward Generative Modelscited by 110
- 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency modelscited by 109
- 2026One-step Latent-free Image Generation with Pixel Mean Flowscited by 53
50 most cited of 62 All 62 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Setting-Matched and Semantics-Scaled Benchmarking of One-Step Generative Models Against Multistep Diffusion and Flow Models
- 2023AdaDiff: Adaptive Step Selection for Fast Diffusion Models
- 2025Dimathtt[M]O: Distilling Masked Diffusion Models into One-step Generator
- 2023Conditional Image Generation with Pretrained Generative Model
- 2024On Improved Conditioning Mechanisms and Pre-training Strategies for Diffusion Models
- 2024Diffusion Models Are Innate One-Step Generators
- 2022Elucidating the Design Space of Diffusion-Based Generative Models
- 2023Conditional Generation from Unconditional Diffusion Models using Denoiser Representations