mlsanityData to 14 Oct 2026

On-Policy Self-Distillation for Multi-Turn Image Editing

arXiv 2609.35611 ↗First posted 28 Sep 2026cs.CV cs.LGcited by 1

On the map: Knowledge distillation → On-policy and self-distillation for LLMs also fits: Multimodal distillation

Abstract (arXiv)

Instruction-based image editing has achieved strong performance in single-turn settings, yet practical editing is often iterative, with each instruction applied to the output of the previous turn. We find that existing editing models degrade rapidly under recursive editing and attribute this failure to a train-test mismatch in the conditioning distribution: models are trained on clean source images but must repeatedly condition on their own imperfect outputs at inference time. To address this, we propose MT-OPSD, an on-policy self-distillation framework that trains the model on self-generated conditioning states with editing supervision from a clean-conditioned teacher, without requiring multi-turn annotations. We further introduce LME-Bench, a benchmark of 100 ten-turn editing sessions for evaluating long-horizon robustness. Experiments across three editing backbones show that MT-OPSD substantially improves long-horizon editing success and reduces multi-turn collapse while largely preserving single-turn editing quality.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in On-policy and self-distillation for LLMs, one of 12 directions in Knowledge distillation. Builds on 38 of its 55 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

38 of 55 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026Flow-OPD: On-Policy Distillation for Flow Matching Models8 May
  2. 2026Privileged Information Distillation for Language Models4 Feb
  3. 2026Self-Distilled Reasoner: On-Policy Self-Distillation for Large Language Models26 Jan

Other references · 35

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2022Flow Matching for Generative Modelingcited by 5,702
  4. 2022Generative Adversarial Networkscited by 5,627
  5. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  6. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  7. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
  8. 2025Qwen-Image Technical Reportcited by 1,044
  9. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  10. 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 939
  11. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  12. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
23 more
  1. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
  2. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
  3. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
  4. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
  5. 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 277
  6. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
  7. 2024OmniEdit: Building Image Editing Generalist Models Through Specialist Supervisioncited by 145
  8. 2025From Reflection to Perfection: Scaling Inference-Time Optimization for Text-to-Image Diffusion Models via Reflection Tuningcited by 56
  9. 2026DiffusionOPD: A Unified Perspective of On-Policy Distillation in Diffusion Modelscited by 40
  10. 2026FireRed-Image-Edit-1.0 Technical Reportcited by 36
  11. 2026D-OPSD: On-Policy Self-Distillation for Continuously Tuning Step-Distilled Diffusion Modelscited by 22
  12. 2025Multi-turn Consistent Image Editingcited by 18
  13. 2025VINCIE: Unlocking In-context Image Editing from Videocited by 17
  14. 2026DanceOPD: On-Policy Generative Field Distillationcited by 14
  15. 2026OPSD-V: On-Policy Self-Distillation for Post-Training Few-Step Autoregressive Video Generatorscited by 14
  16. 2026On-Policy Self-Distillation in Diffusion Modelscited by 7
  17. 2025FreqEdit: Preserving High-Frequency Features for Robust Multi-Turn Image Editingcited by 6
  18. 2023ToddlerDiffusion: Interactive Structured Image Generation with Cascaded Schr"odinger Bridgecited by 4
  19. 2026From Statics to Dynamics: Physics-Aware Image Editing with Latent Transition Priorscited by 3
  20. 2026Why Do DiT Editors Drift? Plug-and-Play Low Frequency Alignment in VAE Latent Spacecited by 3
  21. 2026AnchorEdit: Maintaining Temporal Consistency in Multi-turn Image Editing via Causal Memorycited by 2
  22. 2026MT-EditFlow: Reinforcement Learning for Multi-Turn Image Editing with Flow Matchingcited by 1
  23. 2026Edit-R2: Context-Aware Reinforcement Learning for Multi-Turn Image Editingcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Scalable Minimal-Change Learning for Controllable Image Editing
  2. 2026IMAGAgent: Orchestrating Multi-Turn Image Editing via Constraint-Aware Planning and Reflection
  3. 2025textttComplex-Edit: CoT-Like Instruction Generation for Complexity-Controllable Image Editing Benchmark
  4. 2026FASTER: Fast Adjoint Stochastic Transport for Endpoint Refinement in Reward-Guided Image Editing
  5. 2025EdiVal-Agent: An Object-Centric Framework for Automated, Fine-Grained Evaluation of Multi-Turn Editing
  6. 2025EditThinker: Unlocking Iterative Reasoning for Any Image Editor
  7. 2025Lego-Edit: A General Image Editing Framework with Model-Level Bricks and MLLM Builder
  8. 2026Making Image Editing Easier via Adaptive Task Reformulation with Agentic Executions