pi-Flow: Policy-Based Few-Step Generation via Imitation Distillation
Not on the map. Why?
Abstract (arXiv)
Few-step diffusion or flow-based generative models typically distill a velocity-predicting teacher into a student that predicts a shortcut towards denoised data. This format mismatch has led to complex distillation procedures that often suffer from a quality-diversity trade-off. To address this, we propose policy-based flow models (π-Flow). π-Flow modifies the output layer of a student flow model to predict a network-free policy at one timestep. The policy then produces dynamic flow velocities at future substeps with negligible overhead, enabling fast and accurate ODE integration on these substeps without extra network evaluations. To match the policy's ODE trajectory to the teacher's, we introduce a novel imitation distillation approach, which matches the policy's velocity to the teacher's along the policy's trajectory using a standard ℓ2 flow matching loss. By simply mimicking the teacher's behavior, π-Flow enables stable and scalable training and avoids the quality-diversity trade-off. On ImageNet 2562, it attains a 1-NFE FID of 2.85, outperforming previous 1-NFE models of the same DiT architecture. On FLUX.1-12B and Qwen-Image-20B at 4 NFEs, π-Flow achieves substantially better diversity than state-of-the-art DMD models, while maintaining teacher-level quality.
Key facts. Cited by 29 papers in the map (data through 14 Oct 2026). Builds on 56 of its 66 references that are in the map. First posted on arXiv 16 Oct 2025.
Builds on
56 of 66 references.
References · 56
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
38 more
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
- 2023Consistency Modelscited by 1,822
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 944
- 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 938
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
- 2015Scheduled Sampling for Sequence Prediction with Recurrent Neural Networkscited by 803
- 2023Adversarial Diffusion Distillationcited by 759
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2025Mean Flows for One-step Generative Modelingcited by 561
- 2022Fast Sampling of Diffusion Models with Exponential Integratorcited by 532
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
- 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 459
- 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 450
- 2023Improved Techniques for Training Consistency Modelscited by 439
- 20218-bit Optimizers via Block-wise Quantizationcited by 403
- 2023Analyzing and Improving the Training Dynamics of Diffusion Modelscited by 402
- 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 395
- 2024One Step Diffusion via Shortcut Modelscited by 391
- 2018Quantifying Generalization in Reinforcement Learningcited by 352
- 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speedcited by 348
- 2022Rectified Flow: A Marginal Preserving Approach to Optimal Transportcited by 283
- 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 279
- 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 266
- 2024Applying Guidance in a Limited Interval Improves Sample and Distribution Quality in Diffusion Modelscited by 254
- 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generationcited by 214
- 2024Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesiscited by 156
- 2025Inductive Moment Matchingcited by 113
- 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency modelscited by 109
- 2023BOOT: Data-free Distillation of Denoising Diffusion Models with Bootstrappingcited by 98
- 2025OneIG-Bench: Omni-dimensional Nuanced Evaluation for Image Generationcited by 87
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2025: 6; 2026: 23.
29 papers.
Sort:
By area:
- 2025Improved Mean Flows: On the Challenges of Fastforward Generative Modelscited by 110
- 2025Distribution Matching Distillation Meets Reinforcement Learningcited by 50
- 2026Filter, Then Reweight: Rethinking Optimization Granularity in On-Policy Distillationcited by 32
- 2026Transition Matching Distillation for Fast Video Generationcited by 30
- 2026Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Modelscited by 25
- 2026D-OPSD: On-Policy Self-Distillation for Continuously Tuning Step-Distilled Diffusion Modelscited by 22
- 2025TwinFlow: Realizing One-step Generation on Large Models with Self-adversarial Flowscited by 17
- 2025Flow Map Distillation Without Datacited by 14
- 2026Parallel Decoding Distillation for Fast Image and Video Generationcited by 10
- 2025Bidirectional Normalizing Flow: From Data to Noise and Backcited by 7
- 2026DA-VAE: Plug-in Latent Compression for Diffusion via Detail Alignmentcited by 6
- 2026SubFlow: Sub-mode Conditioned Flow Matching for Diverse One-Step Generationcited by 4
17 more
- 2026Bi-Anchor Interpolation Solver for Accelerating Generative Modelingcited by 3
- 2026Duality Models: An Embarrassingly Simple One-step Generation Paradigmcited by 3
- 2026Distilling Drifting Transformers with Representation Autoencoderscited by 3
- 2025Glance: Accelerating Diffusion Models with 1 Samplecited by 2
- 2026Multi-Resolution Flow Matching: Training-Free Diffusion Acceleration via Staged Samplingcited by 2
- 2026Stabilizing, Scaling & Enhancing MeanFlow for Large-scale Diffusion Distillationcited by 1
- 2026FourTune: Towards Fully 4-Bit Efficient Post-Training for Diffusion Modelscited by 1
- 2026FlowConsist: Make Your Flow Consistent with Real Trajectorycited by 0
- 2026SODA: Sensitivity-Oriented Dynamic Acceleration for Diffusion Transformercited by 0
- 2026IB-Flow: Information Bottleneck-Guided CFG Distillation for Few-Step Text-to-Image Generationcited by 0
- 2026A Latent Distribution Perspective on Evaluating and Improving Latent Generative Modelscited by 0
- 2026WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizoncited by 0
- 2026TACD: Distilling Efficient Text-to-Motion Models via Terminal Amplification Controlcited by 0
- 2026Kandinsky 6.0 Video: Foundation Models for Synchronized Video and Audio Generationcited by 0
- 2026Consistent Distribution Matching for Data-Free Diffusion Distillationcited by 0
- 2026Parametric Trajectory Distillation for Few-Step Video Generationcited by 0
- 2026Kandinsky S2V 1.0: Audio-Driven Avatar Video Generationcited by 0
- 2026Kandinsky S2V 1.0: Audio-Driven Avatar Video Generation13 Oct 2026
- 2026Parametric Trajectory Distillation for Few-Step Video Generation8 Oct 2026
- 2026Consistent Distribution Matching for Data-Free Diffusion Distillation6 Oct 2026
- 2026Kandinsky 6.0 Video: Foundation Models for Synchronized Video and Audio Generation4 Oct 2026
- 2026TACD: Distilling Efficient Text-to-Motion Models via Terminal Amplification Control2 Oct 2026
- 2026WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizon28 Sep 2026
- 2026A Latent Distribution Perspective on Evaluating and Improving Latent Generative Models21 Sep 2026
- 2026Parallel Decoding Distillation for Fast Image and Video Generation28 Jul 2026
- 2026IB-Flow: Information Bottleneck-Guided CFG Distillation for Few-Step Text-to-Image Generation10 Jul 2026
- 2026FourTune: Towards Fully 4-Bit Efficient Post-Training for Diffusion Models7 Jul 2026
- 2026Multi-Resolution Flow Matching: Training-Free Diffusion Acceleration via Staged Sampling2 Jul 2026
- 2026Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Models24 Jun 2026
17 more
- 2026Distilling Drifting Transformers with Representation Autoencoders14 Jun 2026
- 2026Filter, Then Reweight: Rethinking Optimization Granularity in On-Policy Distillation1 Jun 2026
- 2026Stabilizing, Scaling & Enhancing MeanFlow for Large-scale Diffusion Distillation18 May 2026
- 2026D-OPSD: On-Policy Self-Distillation for Continuously Tuning Step-Distilled Diffusion Models6 May 2026
- 2026SubFlow: Sub-mode Conditioned Flow Matching for Diverse One-Step Generation14 Apr 2026
- 2026DA-VAE: Plug-in Latent Compression for Diffusion via Detail Alignment23 Mar 2026
- 2026SODA: Sensitivity-Oriented Dynamic Acceleration for Diffusion Transformer7 Mar 2026
- 2026FlowConsist: Make Your Flow Consistent with Real Trajectory6 Feb 2026
- 2026Duality Models: An Embarrassingly Simple One-step Generation Paradigm4 Feb 2026
- 2026Bi-Anchor Interpolation Solver for Accelerating Generative Modeling29 Jan 2026
- 2026Transition Matching Distillation for Fast Video Generation14 Jan 2026
- 2025Bidirectional Normalizing Flow: From Data to Noise and Back11 Dec 2025
- 2025TwinFlow: Realizing One-step Generation on Large Models with Self-adversarial Flows3 Dec 2025
- 2025Glance: Accelerating Diffusion Models with 1 Sample2 Dec 2025
- 2025Improved Mean Flows: On the Challenges of Fastforward Generative Models1 Dec 2025
- 2025Flow Map Distillation Without Data24 Nov 2025
- 2025Distribution Matching Distillation Meets Reinforcement Learning17 Nov 2025
- 2025Distribution Matching Distillation Meets Reinforcement Learningcited by 50
- 2026Transition Matching Distillation for Fast Video Generationcited by 30
- 2026D-OPSD: On-Policy Self-Distillation for Continuously Tuning Step-Distilled Diffusion Modelscited by 22
- 2026Parallel Decoding Distillation for Fast Image and Video Generationcited by 10
- 2026DA-VAE: Plug-in Latent Compression for Diffusion via Detail Alignmentcited by 6
- 2026SubFlow: Sub-mode Conditioned Flow Matching for Diverse One-Step Generationcited by 4
- 2026Bi-Anchor Interpolation Solver for Accelerating Generative Modelingcited by 3
- 2025Glance: Accelerating Diffusion Models with 1 Samplecited by 2
- 2026Multi-Resolution Flow Matching: Training-Free Diffusion Acceleration via Staged Samplingcited by 2
- 2026Stabilizing, Scaling & Enhancing MeanFlow for Large-scale Diffusion Distillationcited by 1
- 2026FourTune: Towards Fully 4-Bit Efficient Post-Training for Diffusion Modelscited by 1
- 2026SODA: Sensitivity-Oriented Dynamic Acceleration for Diffusion Transformercited by 0
12 most cited of 15 All 15 (JSON)
- 2026Parametric Trajectory Distillation for Few-Step Video Generation8 Oct 2026
- 2026Consistent Distribution Matching for Data-Free Diffusion Distillation6 Oct 2026
- 2026Kandinsky 6.0 Video: Foundation Models for Synchronized Video and Audio Generation4 Oct 2026
- 2026Parallel Decoding Distillation for Fast Image and Video Generation28 Jul 2026
- 2026FourTune: Towards Fully 4-Bit Efficient Post-Training for Diffusion Models7 Jul 2026
- 2026Multi-Resolution Flow Matching: Training-Free Diffusion Acceleration via Staged Sampling2 Jul 2026
- 2026Stabilizing, Scaling & Enhancing MeanFlow for Large-scale Diffusion Distillation18 May 2026
- 2026D-OPSD: On-Policy Self-Distillation for Continuously Tuning Step-Distilled Diffusion Models6 May 2026
- 2026SubFlow: Sub-mode Conditioned Flow Matching for Diverse One-Step Generation14 Apr 2026
- 2026DA-VAE: Plug-in Latent Compression for Diffusion via Detail Alignment23 Mar 2026
- 2026SODA: Sensitivity-Oriented Dynamic Acceleration for Diffusion Transformer7 Mar 2026
- 2026Bi-Anchor Interpolation Solver for Accelerating Generative Modeling29 Jan 2026
12 newest of 15 All 15 (JSON)
- 2025Improved Mean Flows: On the Challenges of Fastforward Generative Modelscited by 110
- 2025TwinFlow: Realizing One-step Generation on Large Models with Self-adversarial Flowscited by 17
- 2025Flow Map Distillation Without Datacited by 14
- 2025Bidirectional Normalizing Flow: From Data to Noise and Backcited by 7
- 2026Duality Models: An Embarrassingly Simple One-step Generation Paradigmcited by 3
- 2026Distilling Drifting Transformers with Representation Autoencoderscited by 3
- 2026FlowConsist: Make Your Flow Consistent with Real Trajectorycited by 0
- 2026IB-Flow: Information Bottleneck-Guided CFG Distillation for Few-Step Text-to-Image Generationcited by 0
- 2026A Latent Distribution Perspective on Evaluating and Improving Latent Generative Modelscited by 0
- 2026TACD: Distilling Efficient Text-to-Motion Models via Terminal Amplification Controlcited by 0
- 2026Kandinsky S2V 1.0: Audio-Driven Avatar Video Generationcited by 0
- 2026Kandinsky S2V 1.0: Audio-Driven Avatar Video Generation13 Oct 2026
- 2026TACD: Distilling Efficient Text-to-Motion Models via Terminal Amplification Control2 Oct 2026
- 2026A Latent Distribution Perspective on Evaluating and Improving Latent Generative Models21 Sep 2026
- 2026IB-Flow: Information Bottleneck-Guided CFG Distillation for Few-Step Text-to-Image Generation10 Jul 2026
- 2026Distilling Drifting Transformers with Representation Autoencoders14 Jun 2026
- 2026FlowConsist: Make Your Flow Consistent with Real Trajectory6 Feb 2026
- 2026Duality Models: An Embarrassingly Simple One-step Generation Paradigm4 Feb 2026
- 2025Bidirectional Normalizing Flow: From Data to Noise and Back11 Dec 2025
- 2025TwinFlow: Realizing One-step Generation on Large Models with Self-adversarial Flows3 Dec 2025
- 2025Improved Mean Flows: On the Challenges of Fastforward Generative Models1 Dec 2025
- 2025Flow Map Distillation Without Data24 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2026Simplifying and Improving On-Policy Distillation for Few-Step Diffusion
- 2024Local Flow Matching Generative Models
- 2026Path-independent Flow Matching for Multi-parameter Generative Dynamics
- 2026Self-OPD: On-Policy Distillation for Flow Matching Models without Teacher
- 2026STEP-OPD: Rethinking Output Targets and Internal Dynamics in On-Policy Distillation for Diffusion Models
- 2024AdaFlow: Imitation Learning with Variance-Adaptive Flow-Based Policies
- 2026DreOPD: Degraded-Reference Extrapolative On-Policy Distillation for Flow-matching Models
- 2024SlimFlow: Training Smaller One-Step Diffusion Models with Rectified Flow