mlsanityData to 7 Oct 2026

UniEvo-VL: An On-policy Self-Distillation Training Recipe for Multimodal Model Self-improvement

arXiv 2609.38721 ↗First posted 30 Sep 2026cs.AI cs.CVcited by 0

On the map: Synthetic data and self-improvement for LLMs → Self-improving MLLMs and synthetic data

Abstract (arXiv)

Modern multimodal models bring generation and understanding into a single unified system, which enables them to provide and learn from their own feedback. Motivated by this unified capacity, we introduce UniEvo-VL, a self-evolving framework for multimodal models to learn from this constructive self-correction feedback during test-time compute. Instead of relying on a separate, often larger, teacher, we leverage their self-critiques as privileged information and ask a single multimodal model to act as both teacher and student with different contexts. The student only sees the vanilla question, while the teacher conditions on the privileged critique. Then training minimizes the per-state divergence between their denoising diffusion distributions over the student's own sampling trajectories. Experiments demonstrate that UniEvo-VL improves the image generation capabilities of multimodal models, while maintaining their sensitivity to additional reflection information. Specifically, we build on top of the open-source Qwen-image-2512 and observe a significant performance gain from 0.747 to 0.808 on GenEval and from 32.97 to 35.53 on GenEval2 Soft-TIFA. Moreover, attempts with more powerful external critics (e.g., GPT5.6-Luna) show that multimodal models with strong judge capabilities can anticipate a higher self-evolving ceiling. Last but not least, mixed text-rendering outcomes show that our self-improvements may not be uniform across different tasks. Our study aims to shed light on the current hot recursive self-improvement research line to enhance the user experience when using multimodal models without external supervision or guidance.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Self-improving MLLMs and synthetic data, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 22 of its 26 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

22 of 26 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025SRUM: Fine-Grained Self-Rewarding for Unified Multimodal Models14 Oct

Other references · 21

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2025Qwen3-VL Technical Reportcited by 2,534
  4. 2025Qwen-Image Technical Reportcited by 973
  5. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
  6. 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 840
  7. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
  8. 2026Self-Distilled Reasoner: On-Policy Self-Distillation for Large Language Modelscited by 386
  9. 2026Reinforcement Learning via Self-Distillationcited by 285
  10. 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 204
  11. 2025From Reflection to Perfection: Scaling Inference-Time Optimization for Text-to-Image Diffusion Models via Reflection Tuningcited by 53
  12. 2025GenEval 2: Addressing Benchmark Drift in Text-to-Image Evaluationcited by 42
9 more
  1. 2026DiffusionOPD: A Unified Perspective of On-Policy Distillation in Diffusion Modelscited by 35
  2. 2026Flow-OPD: On-Policy Distillation for Flow Matching Modelscited by 29
  3. 2026UniCorn: Towards Self-Improving Unified Multimodal Models through Self-Generated Supervisioncited by 23
  4. 2026D-OPSD: On-Policy Self-Distillation for Continuously Tuning Step-Distilled Diffusion Modelscited by 17
  5. 2026UniReason 1.0: A Unified Reasoning Framework for World Knowledge Aligned Image Generation and Editingcited by 11
  6. 2025Turning Internal Gap into Self-Improvement: Promoting the Generation-Understanding Unification in MLLMscited by 8
  7. 2026Meta-TTRL: A Metacognitive Framework for Self-Improving Test-Time Reinforcement Learning in Unified Multimodal Modelscited by 4
  8. 2026On-Policy Self-Distillation in Diffusion Modelscited by 4
  9. 2026Dreaming in Flow: Generative Grounding Feedback for Self-Evolving Unified Multimodal Modelscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Ask, Solve, Generate: Self-Evolving Unified Multimodal Understanding and Generation via Self-Consistency Rewards
  2. 2026MMPostTrainBench: Benchmarking Autonomous Research for Multimodal Post-Training
  3. 2026HPSD: Hybrid-Policy Self-Distillation for Text-Image-to-Video Diffusion Models
  4. 2026Training-Free Self-Correction for Multimodal Masked Diffusion Models
  5. 2025UniRL: Self-Improving Unified Multimodal Models via Supervised and Reinforcement Learning
  6. 2025Understanding and Harnessing Sparsity in Unified Multimodal Models
  7. 2023Modulating Pretrained Diffusion Models for Multimodal Image Synthesis
  8. 2026Visual-OPSD: Cross-Modal On-Policy Self-Distillation for Efficient Unified Multimodal Reasoning