mlsanityData to 14 Oct 2026

pi-Flow: Policy-Based Few-Step Generation via Imitation Distillation

arXiv 2510.14974 ↗First posted 16 Oct 2025cs.LG cs.AI cs.CVcited by 29

Not on the map. Why?

Abstract (arXiv)

Few-step diffusion or flow-based generative models typically distill a velocity-predicting teacher into a student that predicts a shortcut towards denoised data. This format mismatch has led to complex distillation procedures that often suffer from a quality-diversity trade-off. To address this, we propose policy-based flow models (π-Flow). π-Flow modifies the output layer of a student flow model to predict a network-free policy at one timestep. The policy then produces dynamic flow velocities at future substeps with negligible overhead, enabling fast and accurate ODE integration on these substeps without extra network evaluations. To match the policy's ODE trajectory to the teacher's, we introduce a novel imitation distillation approach, which matches the policy's velocity to the teacher's along the policy's trajectory using a standard ℓ2 flow matching loss. By simply mimicking the teacher's behavior, π-Flow enables stable and scalable training and avoids the quality-diversity trade-off. On ImageNet 2562, it attains a 1-NFE FID of 2.85, outperforming previous 1-NFE models of the same DiT architecture. On FLUX.1-12B and Qwen-Image-20B at 4 NFEs, π-Flow achieves substantially better diversity than state-of-the-art DMD models, while maintaining teacher-level quality.

Key facts. Cited by 29 papers in the map (data through 14 Oct 2026). Builds on 56 of its 66 references that are in the map. First posted on arXiv 16 Oct 2025.

Builds on

56 of 66 references.

References · 56

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  7. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  8. 2022Scalable Diffusion Models with Transformerscited by 6,054
  9. 2022Classifier-Free Diffusion Guidancecited by 5,847
  10. 2022Flow Matching for Generative Modelingcited by 5,702
  11. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  12. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
38 more
  1. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  2. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  3. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
  4. 2023Consistency Modelscited by 1,822
  5. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  6. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
  7. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  8. 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
  9. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 944
  10. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 938
  11. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
  12. 2015Scheduled Sampling for Sequence Prediction with Recurrent Neural Networkscited by 803
  13. 2023Adversarial Diffusion Distillationcited by 759
  14. 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
  15. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
  16. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
  17. 2025Mean Flows for One-step Generative Modelingcited by 561
  18. 2022Fast Sampling of Diffusion Models with Exponential Integratorcited by 532
  19. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
  20. 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 459
  21. 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 450
  22. 2023Improved Techniques for Training Consistency Modelscited by 439
  23. 20218-bit Optimizers via Block-wise Quantizationcited by 403
  24. 2023Analyzing and Improving the Training Dynamics of Diffusion Modelscited by 402
  25. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 395
  26. 2024One Step Diffusion via Shortcut Modelscited by 391
  27. 2018Quantifying Generalization in Reinforcement Learningcited by 352
  28. 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speedcited by 348
  29. 2022Rectified Flow: A Marginal Preserving Approach to Optimal Transportcited by 283
  30. 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 279
  31. 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 266
  32. 2024Applying Guidance in a Limited Interval Improves Sample and Distribution Quality in Diffusion Modelscited by 254
  33. 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generationcited by 214
  34. 2024Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesiscited by 156
  35. 2025Inductive Moment Matchingcited by 113
  36. 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency modelscited by 109
  37. 2023BOOT: Data-free Distillation of Denoising Diffusion Models with Bootstrappingcited by 98
  38. 2025OneIG-Bench: Omni-dimensional Nuanced Evaluation for Image Generationcited by 87

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 6; 2026: 23.

29 papers.

Sort:

By area:

  1. 2025Improved Mean Flows: On the Challenges of Fastforward Generative Modelscited by 110
  2. 2025Distribution Matching Distillation Meets Reinforcement Learningcited by 50
  3. 2026Filter, Then Reweight: Rethinking Optimization Granularity in On-Policy Distillationcited by 32
  4. 2026Transition Matching Distillation for Fast Video Generationcited by 30
  5. 2026Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Modelscited by 25
  6. 2026D-OPSD: On-Policy Self-Distillation for Continuously Tuning Step-Distilled Diffusion Modelscited by 22
  7. 2025TwinFlow: Realizing One-step Generation on Large Models with Self-adversarial Flowscited by 17
  8. 2025Flow Map Distillation Without Datacited by 14
  9. 2026Parallel Decoding Distillation for Fast Image and Video Generationcited by 10
  10. 2025Bidirectional Normalizing Flow: From Data to Noise and Backcited by 7
  11. 2026DA-VAE: Plug-in Latent Compression for Diffusion via Detail Alignmentcited by 6
  12. 2026SubFlow: Sub-mode Conditioned Flow Matching for Diverse One-Step Generationcited by 4
17 more
  1. 2026Bi-Anchor Interpolation Solver for Accelerating Generative Modelingcited by 3
  2. 2026Duality Models: An Embarrassingly Simple One-step Generation Paradigmcited by 3
  3. 2026Distilling Drifting Transformers with Representation Autoencoderscited by 3
  4. 2025Glance: Accelerating Diffusion Models with 1 Samplecited by 2
  5. 2026Multi-Resolution Flow Matching: Training-Free Diffusion Acceleration via Staged Samplingcited by 2
  6. 2026Stabilizing, Scaling & Enhancing MeanFlow for Large-scale Diffusion Distillationcited by 1
  7. 2026FourTune: Towards Fully 4-Bit Efficient Post-Training for Diffusion Modelscited by 1
  8. 2026FlowConsist: Make Your Flow Consistent with Real Trajectorycited by 0
  9. 2026SODA: Sensitivity-Oriented Dynamic Acceleration for Diffusion Transformercited by 0
  10. 2026IB-Flow: Information Bottleneck-Guided CFG Distillation for Few-Step Text-to-Image Generationcited by 0
  11. 2026A Latent Distribution Perspective on Evaluating and Improving Latent Generative Modelscited by 0
  12. 2026WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizoncited by 0
  13. 2026TACD: Distilling Efficient Text-to-Motion Models via Terminal Amplification Controlcited by 0
  14. 2026Kandinsky 6.0 Video: Foundation Models for Synchronized Video and Audio Generationcited by 0
  15. 2026Consistent Distribution Matching for Data-Free Diffusion Distillationcited by 0
  16. 2026Parametric Trajectory Distillation for Few-Step Video Generationcited by 0
  17. 2026Kandinsky S2V 1.0: Audio-Driven Avatar Video Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Simplifying and Improving On-Policy Distillation for Few-Step Diffusion
  2. 2024Local Flow Matching Generative Models
  3. 2026Path-independent Flow Matching for Multi-parameter Generative Dynamics
  4. 2026Self-OPD: On-Policy Distillation for Flow Matching Models without Teacher
  5. 2026STEP-OPD: Rethinking Output Targets and Internal Dynamics in On-Policy Distillation for Diffusion Models
  6. 2024AdaFlow: Imitation Learning with Variance-Adaptive Flow-Based Policies
  7. 2026DreOPD: Degraded-Reference Extrapolative On-Policy Distillation for Flow-matching Models
  8. 2024SlimFlow: Training Smaller One-Step Diffusion Models with Rectified Flow