mlsanityData to 14 Oct 2026

DanceOPD: On-Policy Generative Field Distillation

arXiv 2606.27377 ↗First posted 25 Jun 2026cs.CV cs.CL cs.LGcited by 14

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Modern image generation demands a single model that unifies diverse capabilities, including text-to-image (T2I), local editing, and global editing. However, these capabilities are rarely naturally aligned and often conflict. For instance, editing tends to degrade T2I performance, while global and local editing interfere with each other. Consequently, effectively composing these capabilities has become a central challenge for image generation model training. To tackle this, we introduce DanceOPD, an on-policy generative field distillation framework for flow-matching models that routes each sample to one capability field, queries one low-noise student-induced state, and trains with a simple velocity MSE objective. With each capability source defined as a velocity field over the shared flow state space, the student learns from fields queried on its own rollout states to compose expert capabilities. This formulation also absorbs operator-defined fields such as classifier-free guidance. Comprehensive experiments on T2I, editing, realism-field absorption, and CFG absorption show that our approach improves multi-capability composition, strengthening target capabilities while preserving anchor generation quality. We believe this work establishes a practical route for generative field distillation in flow-matching models.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 100 of its 109 references that are in the map. First posted on arXiv 25 Jun 2026.

Builds on

100 of 109 references.

Closest ancestors · 4

Same direction, newest first

  1. 2023Flow Matching in Latent Space17 Jul
  2. 2023Improving and generalizing flow-based generative models with minibatch optimal transport1 Feb
  3. 2022Flow Matching for Generative Modeling6 Oct
  4. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep

Other references · 96

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2017Proximal Policy Optimization Algorithmscited by 15,215
  4. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  5. 2020Denoising Diffusion Implicit Modelscited by 9,781
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  8. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  9. 2022Scalable Diffusion Models with Transformerscited by 6,054
  10. 2022Classifier-Free Diffusion Guidancecited by 5,847
  11. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  12. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
38 more
  1. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  2. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  3. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  4. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  5. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  6. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  7. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  8. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  9. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  10. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  11. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
  12. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  13. 2023Consistency Modelscited by 1,822
  14. 2014FitNets: Hints for Thin Deep Netscited by 1,653
  15. 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
  16. 2020Gradient Surgery for Multi-Task Learningcited by 1,256
  17. 2022Editing Models with Task Arithmeticcited by 1,120
  18. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
  19. 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,077
  20. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
  21. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  22. 2023Training Diffusion Models with Reinforcement Learningcited by 982
  23. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
  24. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
  25. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
  26. 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 939
  27. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 938
  28. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
  29. 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 834
  30. 2018Multi-Task Learning as Multi-Objective Optimizationcited by 821
  31. 2023TIES-Merging: Resolving Interference When Merging Modelscited by 818
  32. 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 790
  33. 2020AdapterFusion: Non-Destructive Task Composition for Transfer Learningcited by 788
  34. 2023Adversarial Diffusion Distillationcited by 759
  35. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
  36. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
  37. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 624
  38. 2021Merging Models with Fisher-Weighted Averagingcited by 621

50 most cited of 96 All 96 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 14.

14 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2024Self-Corrected Flow Distillation for Consistent One-Step and Few-Step Text-to-Image Generation
  2. 2026PE-OPSD: Internalizing Prompt Enhancement into Flow-matching Models via On-Policy Self-Distillation
  3. 2026Mage-Flow: An Efficient Native-Resolution Foundation Model for Image Generation and Editing
  4. 2026STEP-OPD: Rethinking Output Targets and Internal Dynamics in On-Policy Distillation for Diffusion Models
  5. 2026Steering Fields: Adaptive Vector Fields for Safe Image Generation and Beyond
  6. 2025SD3.5-Flash: Distribution-Guided Distillation of Generative Flows
  7. 2023Guided Flows for Generative Modeling and Decision Making
  8. 2026Bootstrap Your Generator: Unpaired Visual Editing with Flow Matching