mlsanityData to 14 Oct 2026

Recursive Self-Improvement in Unified Multimodal Models

arXiv 2610.03002 ↗First posted 2 Oct 2026cs.CL cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Unified multimodal models (UMMs) understand and generate both text and images, which lets a model produce its own training data. Existing self-improvement in UMMs keeps supervision on the visual side, where image understanding judges image generation. We propose recursive cross-capability self-improvement (RSI), a training loop in which the text and visual abilities of a UMM supply training data for one another. In each round, the model generates images and reads them to find where it falls short. It then writes programs aimed at these shortcomings, and execution verifies every result against its specification. Verified renders train image generation, while labeled renders and the model's own correct programs train visual understanding and program writing. Program execution thus acts as a source of truth outside the model, so errors do not accumulate across rounds. We study RSI on charts and build BasicChartBench to evaluate open models early in training. On requests worded differently from training, four rounds of RSI raise the score from 45.7% to 60.2%, while continued training stays at 46.3%. Verified construction carries most of the gain, and targeting the model's failures adds 3.5%. Along the way, the share of verified programs rises from 48.9% to 95.2%, and the reader's accuracy on edited renders rises from 55.6% to 87.4%.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 25 references that are in the map. First posted on arXiv 2 Oct 2026.

Builds on

23 of 25 references.

References · 23

  1. 2022STaR: Bootstrapping Reasoning With Reasoningcited by 940
  2. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
  3. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  4. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
  5. 2024Self-Rewarding Language Modelscited by 681
  6. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
  7. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
  8. 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 344
  9. 2025Zebra-CoT: A Dataset for Interleaved Vision Language Reasoningcited by 84
  10. 2025Scaling Text-Rich Image Understanding via Code-Guided Synthetic Multimodal Data Generationcited by 58
  11. 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Visioncited by 56
  12. 2026UniCorn: Towards Self-Improving Unified Multimodal Models through Self-Generated Supervisioncited by 26
11 more
  1. 2024DataEnvGym: Data Generation Agents in Teacher Environments with Student Feedbackcited by 25
  2. 2025UniRL: Self-Improving Unified Multimodal Models via Supervised and Reinforcement Learningcited by 24
  3. 2025SRUM: Fine-Grained Self-Rewarding for Unified Multimodal Modelscited by 22
  4. 2025Factuality Matters: When Image Generation and Editing Meet Structured Visualscited by 20
  5. 2026BizGenEval: A Systematic Benchmark for Commercial Visual Content Generationcited by 11
  6. 2024EvolveDirector: Approaching Advanced Text-to-Image Generation with Large Vision-Language Modelscited by 9
  7. 2025SUDER: Self-Improving Unified Large Multimodal Models for Understanding and Generation with Dual Self-Rewardscited by 8
  8. 2026Ask, Solve, Generate: Self-Evolving Unified Multimodal Understanding and Generation via Self-Consistency Rewardscited by 7
  9. 2026EVE: Verifiable Self-Evolution of MLLMs via Executable Visual Transformationscited by 4
  10. 2026DataEvolver: Self-Evolving Multi-Agent Data Construction for Text-Rich Image Generationcited by 3
  11. 2026Dreaming in Flow: Generative Grounding Feedback for Self-Evolving Unified Multimodal Modelscited by 3

Built on by

Not cited yet.