mlsanityData to 7 Oct 2026

UniCorn: Towards Self-Improving Unified Multimodal Models through Self-Generated Supervision

arXiv 2601.03193 ↗First posted 6 Jan 2026cs.CV cs.AIcited by 23

Not on the map. Why?

Abstract (arXiv)

While Unified Multimodal Models (UMMs) have achieved remarkable success in cross-modal comprehension, a significant gap persists in their ability to leverage such internal knowledge for high-quality generation. We formalize this discrepancy as Conduction Aphasia, a phenomenon where models accurately interpret multimodal inputs but struggle to translate that understanding into faithful and controllable synthesis. To address this, we propose UniCorn, a simple yet elegant self-improvement framework that eliminates the need for external data or teacher supervision. By partitioning a single UMM into three collaborative roles: Proposer, Solver, and Judge, UniCorn generates high-quality interactions via self-play and employs cognitive pattern reconstruction to distill latent understanding into explicit generative signals. To validate the restoration of multimodal coherence, we introduce UniCycle, a cycle-consistency benchmark based on a Text to Image to Text reconstruction loop. Extensive experiments demonstrate that UniCorn achieves comprehensive and substantial improvements over the base model across six general image generation benchmarks. Notably, it achieves SOTA performance on TIIF(73.8), DPG(86.8), CompBench(88.5), and UniCycle while further delivering substantial gains of +5.0 on WISE and +6.5 on OneIG. These results highlight that our method significantly enhances T2I generation while maintaining robust comprehension, demonstrating the scalability of fully self-supervised refinement for unified multimodal intelligence.

Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). Builds on 51 of its 76 references that are in the map. First posted on arXiv 6 Jan 2026.

Builds on

51 of 76 references.

References · 51

  1. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  2. 2020Scaling Laws for Neural Language Modelscited by 6,411
  3. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  4. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  5. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  6. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  7. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
  8. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
  9. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
  10. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  11. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
  12. 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 719
38 more
  1. 2022A Survey on In-context Learningcited by 717
  2. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
  3. 2023Prometheus: Inducing Fine-grained Evaluation Capability in Language Modelscited by 558
  4. 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 480
  5. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
  6. 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methodscited by 451
  7. 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
  8. 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 323
  9. 2025Inference-Time Scaling for Generalist Reward Modelingcited by 233
  10. 2025R-Zero: Self-Evolving Reasoning LLM from Zero Datacited by 210
  11. 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 205
  12. 2024Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judgescited by 197
  13. 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 196
  14. 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 162
  15. 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 151
  16. 2024Lumina-Next: Making Lumina-T2X Stronger and Faster with Next-DiTcited by 130
  17. 2024LMFusion: Adapting Pretrained Language Models for Multimodal Generationcited by 120
  18. 2024Is LLM-as-a-Judge Robust? Investigating Universal Adversarial Attacks on Zero-shot LLM Assessmentcited by 117
  19. 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 97
  20. 2025OneIG-Bench: Omni-dimensional Nuanced Evaluation for Image Generationcited by 81
  21. 2024MALT: Improving Reasoning with Multi-Agent LLM Trainingcited by 71
  22. 2025VRAG-RL: Empower Vision-Perception-Based RAG for Visually Rich Information Understanding via Iterative Reasoning with Reinforcement Learningcited by 68
  23. 2024ILLUME: Illuminating Your LLMs to See, Draw, and Self-Enhancecited by 64
  24. 2025TIIF-Bench: How Does Your T2I Model Follow Your Instructions?cited by 64
  25. 2025Multi-Agent Evolve: LLM Self-Improve through Co-evolutioncited by 58
  26. 2025Reconstruction Alignment Improves Unified Multimodal Modelscited by 48
  27. 2024MonoFormer: One Transformer for Both Diffusion and Autoregressioncited by 45
  28. 2025VCR-Bench: A Comprehensive Evaluation Framework for Video Chain-of-Thought Reasoningcited by 41
  29. 2025Guided Self-Evolving LLMs with Minimal Human Supervisioncited by 33
  30. 2024MLLM-CompBench: A Comparative Reasoning Benchmark for Multimodal LLMscited by 32
  31. 2025UniGen: Enhanced Training & Test-Time Strategies for Unified Multimodal Understanding and Generationcited by 32
  32. 2025T2I-Copilot: A Training-Free Multi-Agent Text-to-Image System for Enhanced Prompt Interpretation and Interactive Generationcited by 31
  33. 2025Are We on the Right Way to Assessing LLM-as-a-Judge?cited by 23
  34. 2024Self-Improving Robust Preference Optimizationcited by 19
  35. 2025CRITICTOOL: Evaluating Self-Critique Capabilities of Large Language Models in Tool-Calling Error Scenarioscited by 19
  36. 2025Thinking-while-Generating: Interleaving Textual Reasoning throughout Visual Generationcited by 17
  37. 2025Omni-Reward: Towards Generalist Omni-Modal Reward Modeling with Free-Form Preferencescited by 11
  38. 2025DualVLA: Building a Generalizable Embodied Agent via Partial Decoupling of Reasoning and Actioncited by 11

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 23.

23 papers.

Sort:

By area:

  1. 2026Vision-DeepResearch Benchmark: Rethinking Visual and Textual Search for Multimodal Large Language Modelscited by 30
  2. 2026Flow-OPD: On-Policy Distillation for Flow Matching Modelscited by 29
  3. 2026ExpSeek: Self-Triggered Experience Seeking for Web Agentscited by 23
  4. 2026Generation Enhances Understanding in Unified Multimodal Models via Multi-Representation Generationcited by 19
  5. 2026SkillFlow:Benchmarking Lifelong Skill Discovery and Evolution for Autonomous Agentscited by 19
  6. 2026Mem2Evolve: Towards Self-Evolving Agents via Co-Evolutionary Capability Expansion and Experience Distillationcited by 10
  7. 2026ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratchcited by 8
  8. 2026LatentUM: Unleashing the Potential of Interleaved Cross-Modal Reasoning via a Latent-Space Unified Modelcited by 7
  9. 2026CoCo: Code as CoT for Text-to-Image Preview and Rare Concept Generationcited by 6
  10. 2026Collaborative Multi-Agent Scripts Generation for Enhancing Imperfect-Information Reasoning in Murder Mystery Gamescited by 6
  11. 2026SCOPE: Structured Decomposition and Conditional Skill Orchestration for Complex Image Generationcited by 6
  12. 2026Recursive Self-Evolving Agents via Held-Out Selectioncited by 6
11 more
  1. 2026Ask, Solve, Generate: Self-Evolving Unified Multimodal Understanding and Generation via Self-Consistency Rewardscited by 5
  2. 2026What's Missing in Screen-to-Action? Towards a UI-in-the-Loop Paradigm for Multimodal GUI Reasoningcited by 4
  3. 2026Breaking Dual Bottlenecks: Evolving Unified Multimodal Models into Self-Adaptive Interleaved Visual Reasonerscited by 3
  4. 2026TorchUMM: A Unified Multimodal Model Codebase for Evaluation, Analysis, and Post-trainingcited by 2
  5. 2026Latent Action Control for Reasoning-Guided Unified Image Generationcited by 1
  6. 2026Dreaming in Flow: Generative Grounding Feedback for Self-Evolving Unified Multimodal Modelscited by 1
  7. 2026UniCanvas: A Diffusion-base Unified Model for Text-in-Image Joint Generationcited by 0
  8. 2026Model Guides You How to Draw: Adaptive Visual Gating for Unified Multimodal Reasoningcited by 0
  9. 2026Mutually Adversarial Self-Training with Evolving Data for Unified Multimodal Modelscited by 0
  10. 2026UniEvo-VL: An On-policy Self-Distillation Training Recipe for Multimodal Model Self-improvementcited by 0
  11. 2026Rubric-CEPR: Self-Evolving Image Editing via Reward-Verified Self-Distillationcited by 0