UniRect-CoT: Enhancing Generation in Unified Multimodal Models via Reflective Rectification with Inherent Understanding
Not on the map. Why?
Abstract (arXiv)
Unified Multimodal Models (UMMs) aim to integrate visual understanding and generation within a single structure. However, these models exhibit a notable capability mismatch, where their understanding capability often outperforms their generation capability. This mismatch suggests that the model's rich internal knowledge, while effective for understanding tasks, is not fully utilized during generation. To address this, we draw inspiration from the human ``Thinking-While-Drawing'' paradigm, where humans continuously reflect on intermediate results and revise them according to their understanding of the intended target. In this paper, we propose UniRect-CoT, a training-free unified rectification chain-of-thought framework. We regard the multi-step denoising process in UMMs as an intrinsic visual reasoning process, whose intermediate states provide opportunities for continuous reflection and rectification. By leveraging the UMM's inherent understanding to reflect on intermediate results in light of the target instruction and rectify them accordingly, our framework forms a reflective chain of thought within a single denoising trajectory, enabling the model's internal knowledge to guide generation throughout the process. Specifically, the UMM generates a state-conditioned reflection, whose autoregressive negative log-likelihood under the same model defines a model-native differentiable semantic loss that translates textual reflection into gradients for latent rectification. Extensive experiments demonstrate that UniRect-CoT generalizes across existing flow-based UMMs, consistently enhancing overall text-to-image generation performance.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 30 references that are in the map. First posted on arXiv 15 Apr 2026.
Builds on
26 of 30 references.
References · 26
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
- 2025Qwen-Image Technical Reportcited by 1,044
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
- 2024Autoregressive Image Generation without Vector Quantizationcited by 651
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 475
14 more
- 2023Universal Guidance for Diffusion Modelscited by 437
- 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 294
- 2025Show-o2: Improved Native Unified Multimodal Modelscited by 250
- 2021More Control for Free! Image Synthesis with Semantic Diffusion Guidancecited by 212
- 2024TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generationcited by 202
- 2024LMFusion: Adapting Pretrained Language Models for Multimodal Generationcited by 120
- 2025Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunitiescited by 85
- 2025Harmonizing Visual Representations for Unified Multimodal Understanding and Generationcited by 74
- 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Visioncited by 56
- 2025Reconstruction Alignment Improves Unified Multimodal Modelscited by 49
- 2025Test-time Prompt Refinement for Text-to-Image Modelscited by 16
- 2025Understanding-in-Generation: Reinforcing Generative Capability of Unified Model via Infusing Understanding into Generationcited by 11
- 2025LightFusion: A Light-weighted, Double Fusion Framework for Unified Multimodal Understanding and Generationcited by 9
- 2025Improving Chain-of-Thought Efficiency for Autoregressive Image Generationcited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026UniG2U-Bench: Do Unified Models Advance Multimodal Understanding?
- 2025Uni-MMMU: A Massive Multi-discipline Multimodal Unified Benchmark
- 2026When Does Visual Generation Help Visual Understanding in Unified Multimodal Models?
- 2026Reversing the Flow: Generation-to-Understanding Synergy in Large Multimodal Models
- 2026A Model-Internal Protocol for Assessing Multimodal Models as Integrated Systems
- 2025UniModel: A Visual-Only Framework for Unified Multimodal Understanding and Generation
- 2025Thinking with Generated Images
- 2025Does Understanding Inform Generation in Unified Multimodal Models? From Analysis to Path Forward