Endogenous Reprompting: Self-Evolving Cognitive Alignment for Unified Multimodal Models
Not on the map. Why?
Abstract (arXiv)
Unified Multimodal Models (UMMs) exhibit strong understanding, yet this capability often fails to effectively guide generation. We identify this as a Cognitive Gap: the model lacks the understanding of how to enhance its own generation process. To bridge this gap, we propose Endogenous Reprompting, a mechanism that transforms the model's understanding from a passive encoding process into an explicit generative reasoning step by generating self-aligned descriptors during generation. To achieve this, we introduce SEER (Self-Evolving Evaluator and Reprompter), a training framework that establishes a two-stage endogenous loop using only 300 samples from a compact proxy task, Visual Instruction Elaboration. First, Reinforcement Learning with Verifiable Rewards (RLVR) activates the model's latent evaluation ability via curriculum learning, producing a high-fidelity endogenous reward signal. Second, Reinforcement Learning with Model-rewarded Thinking (RLMT) leverages this signal to optimize the generative reasoning policy. Experiments show that SEER consistently outperforms state-of-the-art baselines in evaluation accuracy, reprompting efficiency, and generation quality, without sacrificing general multimodal capabilities.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 35 of its 42 references that are in the map. First posted on arXiv 28 Jan 2026.
Builds on
35 of 42 references.
References · 35
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,150
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,729
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
- 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehensioncited by 940
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
- 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 790
- 2024Emu3: Next-Token Prediction is All You Needcited by 781
23 more
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
- 2024Autoregressive Image Generation without Vector Quantizationcited by 651
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 475
- 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
- 2023DreamLLM: Synergistic Multimodal Comprehension and Creationcited by 297
- 2025Reinforcement Learning with Verifiable Rewards Implicitly Incentivizes Correct Reasoning in Base LLMscited by 289
- 2025Show-o2: Improved Native Unified Multimodal Modelscited by 250
- 2025Transfer between Modalities with MetaQueriescited by 236
- 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editingcited by 133
- 2023Self-correcting LLM-controlled Diffusion Modelscited by 113
- 2025Pref-GRPO: Pairwise Preference Reward-based GRPO for Stable Text-to-Image Reinforcement Learningcited by 92
- 2025Harmonizing Visual Representations for Unified Multimodal Understanding and Generationcited by 74
- 2025RewardDance: Reward Scaling in Visual Generationcited by 68
- 2025Reconstruction Alignment Improves Unified Multimodal Modelscited by 49
- 2024MonoFormer: One Transformer for Both Diffusion and Autoregressioncited by 46
- 2025PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewritingcited by 43
- 2025Language Models that Think, Chat Bettercited by 24
- 2025OneReward: Unified Mask-Guided Image Generation via Multi-Task Human Preference Learningcited by 23
- 2023BeautifulPrompt: Towards Automatic Prompt Engineering for Text-to-Image Synthesiscited by 18
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Ask, Solve, Generate: Self-Evolving Unified Multimodal Understanding and Generation via Self-Consistency Rewardscited by 7
- 2026Dreaming in Flow: Generative Grounding Feedback for Self-Evolving Unified Multimodal Modelscited by 3
- 2026Advances in GRPO for Generation Models: A Surveycited by 2
- 2026Pseudo-Unification: Entropy Probing Reveals Divergent Information Patterns in Unified Multimodal Modelscited by 1
- 2026VGIF-Score: Interpretable and Diagnostic Evaluation of Spatio-Temporal Instruction Following in Video Generationcited by 1
- 2026An Evolutionary Agentic Approach for Open-ended Image Quality Perceptioncited by 1
- 2026RSIgen: Reciprocal Self-Improvement for Agentic Visual Generationcited by 0
- 2026RSIgen: Reciprocal Self-Improvement for Agentic Visual Generation13 Oct 2026
- 2026An Evolutionary Agentic Approach for Open-ended Image Quality Perception19 Sep 2026
- 2026Dreaming in Flow: Generative Grounding Feedback for Self-Evolving Unified Multimodal Models8 Sep 2026
- 2026VGIF-Score: Interpretable and Diagnostic Evaluation of Spatio-Temporal Instruction Following in Video Generation15 Jul 2026
- 2026Ask, Solve, Generate: Self-Evolving Unified Multimodal Understanding and Generation via Self-Consistency Rewards25 Jun 2026
- 2026Pseudo-Unification: Entropy Probing Reveals Divergent Information Patterns in Unified Multimodal Models13 Apr 2026
- 2026Advances in GRPO for Generation Models: A Survey21 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026Learning to Generate via Understanding: Understanding-Driven Intrinsic Rewarding for Unified Multimodal Models
- 2026Reversing the Flow: Generation-to-Understanding Synergy in Large Multimodal Models
- 2026UniRect-CoT: Enhancing Generation in Unified Multimodal Models via Reflective Rectification with Inherent Understanding
- 2024Diving into Self-Evolving Training for Multimodal Reasoning
- 2026GenAgent: Scaling Text-to-Image Generation via Agentic Multimodal Reasoning
- 2025RePrompt: Reasoning-Augmented Reprompting for Text-to-Image Generation via Reinforcement Learning
- 2025ThinkGen: Generalized Thinking for Visual Generation
- 2026Uni-Synergy: Bridging Understanding and Generation for Personalized Reasoning via Co-operative Reinforcement Learning