mlsanityData to 7 Oct 2026

PE-OPSD: Internalizing Prompt Enhancement into Flow-matching Models via On-Policy Self-Distillation

arXiv 2609.36638 ↗First posted 29 Sep 2026cs.LG cs.CVcited by 0

On the map: Diffusion models → Diffusion and flow policies for robotics also fits: Image generation, text-to-image and editing

Abstract (arXiv)

Text-to-image users often provide concise and underspecified prompts, whereas generative models benefit from detailed textual conditions for reliable instruction following. Existing systems bridge this gap with Prompt Enhancers (PEs) that rewrite raw prompts at inference time, introducing additional latency and leaving prompt elaboration external to the generator. We instead view enhanced prompts as privileged training information and ask whether their benefits can be internalized. We propose Prompt-Enhanced On-Policy Self-Distillation (PE-OPSD) for text-to-image flow-matching models. During training, a raw-prompt student follows its own generation trajectory, while an enhanced-prompt teacher provides vector-field targets at the states visited by the student. This on-policy supervision distills the behavior induced by enhanced prompts into the raw-prompt student without requiring additional text--image pairs. At inference, both the PE and teacher are removed, and the student generates directly from raw prompts. Across multiple model families, PEs, and benchmarks, PE-OPSD achieves the strongest aggregate prompt fidelity among the evaluated baselines, yields positive aggregate visual appeal gains, and retains the base-model inference efficiency.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 34 of its 41 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

34 of 41 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026DreOPD: Degraded-Reference Extrapolative On-Policy Distillation for Flow-matching Models10 Aug
  2. 2026Flow-DPPO: Divergence Proximal Policy Optimization for Flow Matching Models9 Jun
  3. 2026DiffusionOPD: A Unified Perspective of On-Policy Distillation in Diffusion Models14 May
  4. 2025Distribution Matching Distillation Meets Reinforcement Learning17 Nov
  5. 2025Flow-GRPO: Training Flow Matching Models via Online RL8 May

Other references · 29

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  2. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  3. 2022Flow Matching for Generative Modelingcited by 5,426
  4. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  5. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  6. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
  7. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
  8. 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 840
  9. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  10. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
  11. 2026Self-Distilled Reasoner: On-Policy Self-Distillation for Large Language Modelscited by 386
  12. 2021Knowledge distillation: A good teacher is patient and consistentcited by 255
17 more
  1. 2023T2I-CompBench++: An Enhanced and Comprehensive Benchmark for Compositional Text-to-image Generationcited by 253
  2. 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
  3. 2022Optimizing Prompts for Text-to-Image Generationcited by 204
  4. 2024Improving Text-to-Image Consistency via Automatic Prompt Optimizationcited by 88
  5. 2026Vision-OPD: Learning to See Fine Details for Multimodal LLMs via On-Policy Self-Distillationcited by 71
  6. 2024Exponential Moving Average of Weights in Deep Learning: Dynamics and Benefitscited by 65
  7. 2023RePrompt: Automatic Prompt Editing to Refine AI-Generative Art Towards Precise Expressionscited by 43
  8. 2025GenEval 2: Addressing Benchmark Drift in Text-to-Image Evaluationcited by 42
  9. 2025PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewritingcited by 38
  10. 2025Decoupled DMD: CFG Augmentation as the Spear, Distribution Matching as the Shieldcited by 38
  11. 2026Qwen-Image-2.0 Technical Reportcited by 28
  12. 2023A Prompt Log Analysis of Text-to-Image Generation Systemscited by 24
  13. 2024Proactive Agents for Multi-Turn Text-to-Image Generation Under Uncertaintycited by 23
  14. 2026D-OPSD: On-Policy Self-Distillation for Continuously Tuning Step-Distilled Diffusion Modelscited by 17
  15. 2026OPSD-V: On-Policy Self-Distillation for Post-Training Few-Step Autoregressive Video Generatorscited by 12
  16. 2026OPD-V: Visual On-Policy Self-Distillation with Modality Balancecited by 7
  17. 2026APE: Agentic Prompt Enhancer for Image Generation and Editingcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026PromptRL: Prompt Matters in RL for Flow-Based Image Generation
  2. 2026CapField-OPD: Learning Continuous Capability Fields via Joint-Anchored Multi-Teacher On-Policy Distillation for Flow Models
  3. 2026Any-OPD: Heterogeneous On-Policy Distillation for Flow-Matching Models via Representation-Space Bridging
  4. 2026Flow-OPD: On-Policy Distillation for Flow Matching Models
  5. 2025Learning to Sample Effective and Diverse Prompts for Text-to-Image Generation
  6. 2026Self-OPD: On-Policy Distillation for Flow Matching Models without Teacher
  7. 2026DanceOPD: On-Policy Generative Field Distillation
  8. 2024Batch-Instructed Gradient for Prompt Evolution:Systematic Prompt Optimization for Enhanced Text-to-Image Synthesis