FlowMap-OPD: Rollout--Kernel Separation for On-Policy Distillation of Few-Step Flow-Map Generators
On the map: Diffusion models → Diffusion and flow policies for robotics
Abstract (arXiv)
Few-step flow-map generators, including MeanFlow and consistency models, enable efficient sampling through long-range transport, yet their on-policy distillation remains underexplored. We introduce FlowMap-OPD, an on-policy distillation framework that separates student-state acquisition from teacher--student distribution comparison. A formulation based on state marginals establishes this separation, while flow--velocity consistency connects local supervision to the deployed long-range map. Within this framework, we develop flow-map, induced-velocity, and instantaneous-velocity distribution supervision, each paired with a separately specified native flow-map rollout. Cross-capacity ImageNet experiments across three teacher rewards identify instantaneous-velocity distribution supervision with independently tunable student consistency as the most effective choice. In text-to-image experiments, FlowMap-OPD demonstrates strong multi-specialist consolidation capabilities and surpasses multi-reward Flow-Map GRPO in task performance and convergence speed.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 19 of its 20 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
19 of 20 references.
Closest ancestors · 5
Same direction, newest first
- 2026Any-OPD: Heterogeneous On-Policy Distillation for Flow-Matching Models via Representation-Space Bridging4 Aug
- 2026Flow-Map GRPO: Reinforcement Learning for Few-Step Flow-Map Generators via Anchored Stochastic Composition1 Jul
- 2026DiffusionOPD: A Unified Perspective of On-Policy Distillation in Diffusion Models14 May
- 2026Flow-OPD: On-Policy Distillation for Flow Matching Models8 May
- 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Process19 Sep
Other references · 14
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2023Consistency Modelscited by 1,778
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 840
- 2025Mean Flows for One-step Generative Modelingcited by 524
- 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 276
- 2024DistiLLM: Towards Streamlined Distillation for Large Language Modelscited by 145
- 2023MiniLLM: On-Policy Distillation of Large Language Modelscited by 129
- 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency modelscited by 99
- 2019Distilling Policy Distillationcited by 81
2 more
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026DreOPD: Degraded-Reference Extrapolative On-Policy Distillation for Flow-matching Models
- 2026STEP-OPD: Rethinking Output Targets and Internal Dynamics in On-Policy Distillation for Diffusion Models
- 2026Dense Supervision, Sparse Updates: On the Sparsity and Geometry of On-Policy Distillation
- 2026Interpolated Policy Distillation: A Controllable Continuum Between Off-Policy and On-Policy Distillation
- 2026Self-OPD: On-Policy Distillation for Flow Matching Models without Teacher
- 2026From Static to Dynamic: On-Policy Distillation from Image to Video Diffusion Models
- 2026Stabilizing Consistency Training: A Flow Map Analysis and Self-Distillation
- 2026On-Policy Adversarial Flow Distillation for Autoregressive Video Generation