DanceOPD: On-Policy Generative Field Distillation
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
Modern image generation demands a single model that unifies diverse capabilities, including text-to-image (T2I), local editing, and global editing. However, these capabilities are rarely naturally aligned and often conflict. For instance, editing tends to degrade T2I performance, while global and local editing interfere with each other. Consequently, effectively composing these capabilities has become a central challenge for image generation model training. To tackle this, we introduce DanceOPD, an on-policy generative field distillation framework for flow-matching models that routes each sample to one capability field, queries one low-noise student-induced state, and trains with a simple velocity MSE objective. With each capability source defined as a velocity field over the shared flow state space, the student learns from fields queried on its own rollout states to compose expert capabilities. This formulation also absorbs operator-defined fields such as classifier-free guidance. Comprehensive experiments on T2I, editing, realism-field absorption, and CFG absorption show that our approach improves multi-capability composition, strengthening target capabilities while preserving anchor generation quality. We believe this work establishes a practical route for generative field distillation in flow-matching models.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 100 of its 109 references that are in the map. First posted on arXiv 25 Jun 2026.
Builds on
100 of 109 references.
Closest ancestors · 4
Same direction, newest first
- 2023Flow Matching in Latent Space17 Jul
- 2023Improving and generalizing flow-based generative models with minibatch optimal transport1 Feb
- 2022Flow Matching for Generative Modeling6 Oct
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep
Other references · 96
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
38 more
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2023Consistency Modelscited by 1,822
- 2014FitNets: Hints for Thin Deep Netscited by 1,653
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
- 2020Gradient Surgery for Multi-Task Learningcited by 1,256
- 2022Editing Models with Task Arithmeticcited by 1,120
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
- 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,077
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2023Training Diffusion Models with Reinforcement Learningcited by 982
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
- 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 939
- 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 938
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
- 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 834
- 2018Multi-Task Learning as Multi-Objective Optimizationcited by 821
- 2023TIES-Merging: Resolving Interference When Merging Modelscited by 818
- 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 790
- 2020AdapterFusion: Non-Destructive Task Composition for Transfer Learningcited by 788
- 2023Adversarial Diffusion Distillationcited by 759
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
- 2022Compositional Visual Generation with Composable Diffusion Modelscited by 624
- 2021Merging Models with Fisher-Weighted Averagingcited by 621
50 most cited of 96 All 96 (JSON)
Built on by
Citing papers per year: 2026: 14.
14 papers.
Sort:
By area:
- 2026SenseNova-U1.5: Towards Native Unified Visual Intelligencecited by 7
- 2026Rethinking Classifier-Free Guidance in On-Policy Diffusion Distillationcited by 4
- 2026Learning When to Trust via Selective Context Preference Optimizationcited by 3
- 2026DreOPD: Degraded-Reference Extrapolative On-Policy Distillation for Flow-matching Modelscited by 2
- 2026Exploring the Performance Frontier of Compact Unified Image Generation Modelscited by 2
- 2026FlowCTS: On-policy Continuous Trajectory Supervision of Flow Modelscited by 1
- 2026HPSD: Hybrid-Policy Self-Distillation for Text-Image-to-Video Diffusion Modelscited by 1
- 2026Self-OPD: On-Policy Distillation for Flow Matching Models without Teachercited by 1
- 2026On-Policy Self-Distillation for Multi-Turn Image Editingcited by 1
- 2026ChemOPD: Multi-Teacher On-Policy Distillation for Multi-Task Chemical Reasoningcited by 0
- 2026CapField-OPD: Learning Continuous Capability Fields via Joint-Anchored Multi-Teacher On-Policy Distillation for Flow Modelscited by 0
- 2026LIFT: Layout-In-Future Video Generation under Large Viewpoint Change via On-Policy Self-Distillationcited by 0
2 more
- 2026VITAL: From Visual Motion to Precise Action14 Oct 2026
- 2026InstantFusion: A Shared Latent Interface for Heterogeneous Image Generators9 Oct 2026
- 2026LIFT: Layout-In-Future Video Generation under Large Viewpoint Change via On-Policy Self-Distillation29 Sep 2026
- 2026On-Policy Self-Distillation for Multi-Turn Image Editing28 Sep 2026
- 2026CapField-OPD: Learning Continuous Capability Fields via Joint-Anchored Multi-Teacher On-Policy Distillation for Flow Models28 Sep 2026
- 2026ChemOPD: Multi-Teacher On-Policy Distillation for Multi-Task Chemical Reasoning27 Sep 2026
- 2026SenseNova-U1.5: Towards Native Unified Visual Intelligence10 Sep 2026
- 2026Self-OPD: On-Policy Distillation for Flow Matching Models without Teacher27 Aug 2026
- 2026Exploring the Performance Frontier of Compact Unified Image Generation Models20 Aug 2026
- 2026HPSD: Hybrid-Policy Self-Distillation for Text-Image-to-Video Diffusion Models13 Aug 2026
- 2026DreOPD: Degraded-Reference Extrapolative On-Policy Distillation for Flow-matching Models10 Aug 2026
- 2026Learning When to Trust via Selective Context Preference Optimization6 Aug 2026
2 more
- 2026SenseNova-U1.5: Towards Native Unified Visual Intelligencecited by 7
- 2026FlowCTS: On-policy Continuous Trajectory Supervision of Flow Modelscited by 1
- 2026On-Policy Self-Distillation for Multi-Turn Image Editingcited by 1
- 2026CapField-OPD: Learning Continuous Capability Fields via Joint-Anchored Multi-Teacher On-Policy Distillation for Flow Modelscited by 0
- 2026LIFT: Layout-In-Future Video Generation under Large Viewpoint Change via On-Policy Self-Distillationcited by 0
- 2026LIFT: Layout-In-Future Video Generation under Large Viewpoint Change via On-Policy Self-Distillation29 Sep 2026
- 2026On-Policy Self-Distillation for Multi-Turn Image Editing28 Sep 2026
- 2026CapField-OPD: Learning Continuous Capability Fields via Joint-Anchored Multi-Teacher On-Policy Distillation for Flow Models28 Sep 2026
- 2026SenseNova-U1.5: Towards Native Unified Visual Intelligence10 Sep 2026
- 2026FlowCTS: On-policy Continuous Trajectory Supervision of Flow Models27 Jul 2026
- 2026Rethinking Classifier-Free Guidance in On-Policy Diffusion Distillationcited by 4
- 2026DreOPD: Degraded-Reference Extrapolative On-Policy Distillation for Flow-matching Modelscited by 2
- 2026HPSD: Hybrid-Policy Self-Distillation for Text-Image-to-Video Diffusion Modelscited by 1
- 2026Self-OPD: On-Policy Distillation for Flow Matching Models without Teachercited by 1
- 2026Self-OPD: On-Policy Distillation for Flow Matching Models without Teacher27 Aug 2026
- 2026HPSD: Hybrid-Policy Self-Distillation for Text-Image-to-Video Diffusion Models13 Aug 2026
- 2026DreOPD: Degraded-Reference Extrapolative On-Policy Distillation for Flow-matching Models10 Aug 2026
- 2026Rethinking Classifier-Free Guidance in On-Policy Diffusion Distillation27 Jul 2026
- 2026VITAL: From Visual Motion to Precise Actioncited by 0
- 2026VITAL: From Visual Motion to Precise Action14 Oct 2026
Similar, not cited
Close in wording, no citation either way
- 2024Self-Corrected Flow Distillation for Consistent One-Step and Few-Step Text-to-Image Generation
- 2026PE-OPSD: Internalizing Prompt Enhancement into Flow-matching Models via On-Policy Self-Distillation
- 2026Mage-Flow: An Efficient Native-Resolution Foundation Model for Image Generation and Editing
- 2026STEP-OPD: Rethinking Output Targets and Internal Dynamics in On-Policy Distillation for Diffusion Models
- 2026Steering Fields: Adaptive Vector Fields for Safe Image Generation and Beyond
- 2025SD3.5-Flash: Distribution-Guided Distillation of Generative Flows
- 2023Guided Flows for Generative Modeling and Decision Making
- 2026Bootstrap Your Generator: Unpaired Visual Editing with Flow Matching