UniCorn: Towards Self-Improving Unified Multimodal Models through Self-Generated Supervision
Not on the map. Why?
Abstract (arXiv)
While Unified Multimodal Models (UMMs) have achieved remarkable success in cross-modal comprehension, a significant gap persists in their ability to leverage such internal knowledge for high-quality generation. We formalize this discrepancy as Conduction Aphasia, a phenomenon where models accurately interpret multimodal inputs but struggle to translate that understanding into faithful and controllable synthesis. To address this, we propose UniCorn, a simple yet elegant self-improvement framework that eliminates the need for external data or teacher supervision. By partitioning a single UMM into three collaborative roles: Proposer, Solver, and Judge, UniCorn generates high-quality interactions via self-play and employs cognitive pattern reconstruction to distill latent understanding into explicit generative signals. To validate the restoration of multimodal coherence, we introduce UniCycle, a cycle-consistency benchmark based on a Text to Image to Text reconstruction loop. Extensive experiments demonstrate that UniCorn achieves comprehensive and substantial improvements over the base model across six general image generation benchmarks. Notably, it achieves SOTA performance on TIIF(73.8), DPG(86.8), CompBench(88.5), and UniCycle while further delivering substantial gains of +5.0 on WISE and +6.5 on OneIG. These results highlight that our method significantly enhances T2I generation while maintaining robust comprehension, demonstrating the scalability of fully self-supervised refinement for unified multimodal intelligence.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). Builds on 51 of its 76 references that are in the map. First posted on arXiv 6 Jan 2026.
Builds on
51 of 76 references.
References · 51
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 719
38 more
- 2022A Survey on In-context Learningcited by 717
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2023Prometheus: Inducing Fine-grained Evaluation Capability in Language Modelscited by 558
- 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 480
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
- 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methodscited by 451
- 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
- 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 323
- 2025Inference-Time Scaling for Generalist Reward Modelingcited by 233
- 2025R-Zero: Self-Evolving Reasoning LLM from Zero Datacited by 210
- 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 205
- 2024Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judgescited by 197
- 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 196
- 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 162
- 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 151
- 2024Lumina-Next: Making Lumina-T2X Stronger and Faster with Next-DiTcited by 130
- 2024LMFusion: Adapting Pretrained Language Models for Multimodal Generationcited by 120
- 2024Is LLM-as-a-Judge Robust? Investigating Universal Adversarial Attacks on Zero-shot LLM Assessmentcited by 117
- 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 97
- 2025OneIG-Bench: Omni-dimensional Nuanced Evaluation for Image Generationcited by 81
- 2024MALT: Improving Reasoning with Multi-Agent LLM Trainingcited by 71
- 2025VRAG-RL: Empower Vision-Perception-Based RAG for Visually Rich Information Understanding via Iterative Reasoning with Reinforcement Learningcited by 68
- 2024ILLUME: Illuminating Your LLMs to See, Draw, and Self-Enhancecited by 64
- 2025TIIF-Bench: How Does Your T2I Model Follow Your Instructions?cited by 64
- 2025Multi-Agent Evolve: LLM Self-Improve through Co-evolutioncited by 58
- 2025Reconstruction Alignment Improves Unified Multimodal Modelscited by 48
- 2024MonoFormer: One Transformer for Both Diffusion and Autoregressioncited by 45
- 2025VCR-Bench: A Comprehensive Evaluation Framework for Video Chain-of-Thought Reasoningcited by 41
- 2025Guided Self-Evolving LLMs with Minimal Human Supervisioncited by 33
- 2024MLLM-CompBench: A Comparative Reasoning Benchmark for Multimodal LLMscited by 32
- 2025UniGen: Enhanced Training & Test-Time Strategies for Unified Multimodal Understanding and Generationcited by 32
- 2025T2I-Copilot: A Training-Free Multi-Agent Text-to-Image System for Enhanced Prompt Interpretation and Interactive Generationcited by 31
- 2025Are We on the Right Way to Assessing LLM-as-a-Judge?cited by 23
- 2024Self-Improving Robust Preference Optimizationcited by 19
- 2025CRITICTOOL: Evaluating Self-Critique Capabilities of Large Language Models in Tool-Calling Error Scenarioscited by 19
- 2025Thinking-while-Generating: Interleaving Textual Reasoning throughout Visual Generationcited by 17
- 2025Omni-Reward: Towards Generalist Omni-Modal Reward Modeling with Free-Form Preferencescited by 11
- 2025DualVLA: Building a Generalizable Embodied Agent via Partial Decoupling of Reasoning and Actioncited by 11
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2026: 23.
23 papers.
Sort:
By area:
- 2026Vision-DeepResearch Benchmark: Rethinking Visual and Textual Search for Multimodal Large Language Modelscited by 30
- 2026Flow-OPD: On-Policy Distillation for Flow Matching Modelscited by 29
- 2026ExpSeek: Self-Triggered Experience Seeking for Web Agentscited by 23
- 2026Generation Enhances Understanding in Unified Multimodal Models via Multi-Representation Generationcited by 19
- 2026SkillFlow:Benchmarking Lifelong Skill Discovery and Evolution for Autonomous Agentscited by 19
- 2026Mem2Evolve: Towards Self-Evolving Agents via Co-Evolutionary Capability Expansion and Experience Distillationcited by 10
- 2026ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratchcited by 8
- 2026LatentUM: Unleashing the Potential of Interleaved Cross-Modal Reasoning via a Latent-Space Unified Modelcited by 7
- 2026CoCo: Code as CoT for Text-to-Image Preview and Rare Concept Generationcited by 6
- 2026Collaborative Multi-Agent Scripts Generation for Enhancing Imperfect-Information Reasoning in Murder Mystery Gamescited by 6
- 2026SCOPE: Structured Decomposition and Conditional Skill Orchestration for Complex Image Generationcited by 6
- 2026Recursive Self-Evolving Agents via Held-Out Selectioncited by 6
11 more
- 2026Ask, Solve, Generate: Self-Evolving Unified Multimodal Understanding and Generation via Self-Consistency Rewardscited by 5
- 2026What's Missing in Screen-to-Action? Towards a UI-in-the-Loop Paradigm for Multimodal GUI Reasoningcited by 4
- 2026Breaking Dual Bottlenecks: Evolving Unified Multimodal Models into Self-Adaptive Interleaved Visual Reasonerscited by 3
- 2026TorchUMM: A Unified Multimodal Model Codebase for Evaluation, Analysis, and Post-trainingcited by 2
- 2026Latent Action Control for Reasoning-Guided Unified Image Generationcited by 1
- 2026Dreaming in Flow: Generative Grounding Feedback for Self-Evolving Unified Multimodal Modelscited by 1
- 2026UniCanvas: A Diffusion-base Unified Model for Text-in-Image Joint Generationcited by 0
- 2026Model Guides You How to Draw: Adaptive Visual Gating for Unified Multimodal Reasoningcited by 0
- 2026Mutually Adversarial Self-Training with Evolving Data for Unified Multimodal Modelscited by 0
- 2026UniEvo-VL: An On-policy Self-Distillation Training Recipe for Multimodal Model Self-improvementcited by 0
- 2026Rubric-CEPR: Self-Evolving Image Editing via Reward-Verified Self-Distillationcited by 0
- 2026Rubric-CEPR: Self-Evolving Image Editing via Reward-Verified Self-Distillation8 Oct 2026
- 2026UniEvo-VL: An On-policy Self-Distillation Training Recipe for Multimodal Model Self-improvement30 Sep 2026
- 2026Mutually Adversarial Self-Training with Evolving Data for Unified Multimodal Models28 Sep 2026
- 2026Dreaming in Flow: Generative Grounding Feedback for Self-Evolving Unified Multimodal Models8 Sep 2026
- 2026Model Guides You How to Draw: Adaptive Visual Gating for Unified Multimodal Reasoning10 Jul 2026
- 2026Ask, Solve, Generate: Self-Evolving Unified Multimodal Understanding and Generation via Self-Consistency Rewards25 Jun 2026
- 2026Recursive Self-Evolving Agents via Held-Out Selection17 Jun 2026
- 2026UniCanvas: A Diffusion-base Unified Model for Text-in-Image Joint Generation2 Jun 2026
- 2026Latent Action Control for Reasoning-Guided Unified Image Generation16 May 2026
- 2026Breaking Dual Bottlenecks: Evolving Unified Multimodal Models into Self-Adaptive Interleaved Visual Reasoners14 May 2026
- 2026Flow-OPD: On-Policy Distillation for Flow Matching Models8 May 2026
- 2026SCOPE: Structured Decomposition and Conditional Skill Orchestration for Complex Image Generation8 May 2026
11 more
- 2026SkillFlow:Benchmarking Lifelong Skill Discovery and Evolution for Autonomous Agents19 Apr 2026
- 2026Collaborative Multi-Agent Scripts Generation for Enhancing Imperfect-Information Reasoning in Murder Mystery Games13 Apr 2026
- 2026Mem2Evolve: Towards Self-Evolving Agents via Co-Evolutionary Capability Expansion and Experience Distillation13 Apr 2026
- 2026TorchUMM: A Unified Multimodal Model Codebase for Evaluation, Analysis, and Post-training12 Apr 2026
- 2026What's Missing in Screen-to-Action? Towards a UI-in-the-Loop Paradigm for Multimodal GUI Reasoning8 Apr 2026
- 2026LatentUM: Unleashing the Potential of Interleaved Cross-Modal Reasoning via a Latent-Space Unified Model2 Apr 2026
- 2026CoCo: Code as CoT for Text-to-Image Preview and Rare Concept Generation9 Mar 2026
- 2026Vision-DeepResearch Benchmark: Rethinking Visual and Textual Search for Multimodal Large Language Models2 Feb 2026
- 2026Generation Enhances Understanding in Unified Multimodal Models via Multi-Representation Generation29 Jan 2026
- 2026ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratch20 Jan 2026
- 2026ExpSeek: Self-Triggered Experience Seeking for Web Agents13 Jan 2026
- 2026Vision-DeepResearch Benchmark: Rethinking Visual and Textual Search for Multimodal Large Language Modelscited by 30
- 2026ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratchcited by 8
- 2026CoCo: Code as CoT for Text-to-Image Preview and Rare Concept Generationcited by 6
- 2026Collaborative Multi-Agent Scripts Generation for Enhancing Imperfect-Information Reasoning in Murder Mystery Gamescited by 6
- 2026Ask, Solve, Generate: Self-Evolving Unified Multimodal Understanding and Generation via Self-Consistency Rewardscited by 5
- 2026What's Missing in Screen-to-Action? Towards a UI-in-the-Loop Paradigm for Multimodal GUI Reasoningcited by 4
- 2026Model Guides You How to Draw: Adaptive Visual Gating for Unified Multimodal Reasoningcited by 0
- 2026Model Guides You How to Draw: Adaptive Visual Gating for Unified Multimodal Reasoning10 Jul 2026
- 2026Ask, Solve, Generate: Self-Evolving Unified Multimodal Understanding and Generation via Self-Consistency Rewards25 Jun 2026
- 2026Collaborative Multi-Agent Scripts Generation for Enhancing Imperfect-Information Reasoning in Murder Mystery Games13 Apr 2026
- 2026What's Missing in Screen-to-Action? Towards a UI-in-the-Loop Paradigm for Multimodal GUI Reasoning8 Apr 2026
- 2026CoCo: Code as CoT for Text-to-Image Preview and Rare Concept Generation9 Mar 2026
- 2026Vision-DeepResearch Benchmark: Rethinking Visual and Textual Search for Multimodal Large Language Models2 Feb 2026
- 2026ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratch20 Jan 2026
- 2026Flow-OPD: On-Policy Distillation for Flow Matching Modelscited by 29
- 2026Generation Enhances Understanding in Unified Multimodal Models via Multi-Representation Generationcited by 19
- 2026SkillFlow:Benchmarking Lifelong Skill Discovery and Evolution for Autonomous Agentscited by 19
- 2026LatentUM: Unleashing the Potential of Interleaved Cross-Modal Reasoning via a Latent-Space Unified Modelcited by 7
- 2026SCOPE: Structured Decomposition and Conditional Skill Orchestration for Complex Image Generationcited by 6
- 2026Breaking Dual Bottlenecks: Evolving Unified Multimodal Models into Self-Adaptive Interleaved Visual Reasonerscited by 3
- 2026TorchUMM: A Unified Multimodal Model Codebase for Evaluation, Analysis, and Post-trainingcited by 2
- 2026Latent Action Control for Reasoning-Guided Unified Image Generationcited by 1
- 2026Dreaming in Flow: Generative Grounding Feedback for Self-Evolving Unified Multimodal Modelscited by 1
- 2026Mutually Adversarial Self-Training with Evolving Data for Unified Multimodal Modelscited by 0
- 2026Rubric-CEPR: Self-Evolving Image Editing via Reward-Verified Self-Distillationcited by 0
- 2026Rubric-CEPR: Self-Evolving Image Editing via Reward-Verified Self-Distillation8 Oct 2026
- 2026Mutually Adversarial Self-Training with Evolving Data for Unified Multimodal Models28 Sep 2026
- 2026Dreaming in Flow: Generative Grounding Feedback for Self-Evolving Unified Multimodal Models8 Sep 2026
- 2026Latent Action Control for Reasoning-Guided Unified Image Generation16 May 2026
- 2026Breaking Dual Bottlenecks: Evolving Unified Multimodal Models into Self-Adaptive Interleaved Visual Reasoners14 May 2026
- 2026SCOPE: Structured Decomposition and Conditional Skill Orchestration for Complex Image Generation8 May 2026
- 2026SkillFlow:Benchmarking Lifelong Skill Discovery and Evolution for Autonomous Agents19 Apr 2026
- 2026TorchUMM: A Unified Multimodal Model Codebase for Evaluation, Analysis, and Post-training12 Apr 2026
- 2026LatentUM: Unleashing the Potential of Interleaved Cross-Modal Reasoning via a Latent-Space Unified Model2 Apr 2026
- 2026Generation Enhances Understanding in Unified Multimodal Models via Multi-Representation Generation29 Jan 2026