Interleaving Reasoning for Better Text-to-Image Generation
Not on the map. Why?
Abstract (arXiv)
Unified multimodal understanding and generation models recently have achieve significant improvement in image generation capability, yet a large gap remains in instruction following and detail preservation compared to systems that tightly couple comprehension with generation such as GPT-4o. Motivated by recent advances in interleaving reasoning, we explore whether such reasoning can further improve Text-to-Image (T2I) generation. We introduce Interleaving Reasoning Generation (IRG), a framework that alternates between text-based thinking and image synthesis: the model first produces a text-based thinking to guide an initial image, then reflects on the result to refine fine-grained details, visual quality, and aesthetics while preserving semantics. To train IRG effectively, we propose Interleaving Reasoning Generation Learning (IRGL), which targets two sub-goals: (1) strengthening the initial think-and-generate stage to establish core content and base quality, and (2) enabling high-quality textual reflection and faithful implementation of those refinements in a subsequent image. We curate IRGL-300K, a dataset organized into six decomposed learning modes that jointly cover learning text-based thinking, and full thinking-image trajectories. Starting from a unified foundation model that natively emits interleaved text-image outputs, our two-stage training first builds robust thinking and reflection, then efficiently tunes the IRG pipeline in the full thinking-image trajectory data. Extensive experiments show SoTA performance, yielding absolute gains of 5-10 points on GenEval, WISE, TIIF, GenAI-Bench, and OneIG-EN, alongside substantial improvements in visual quality and fine-grained fidelity. The code, model weights and datasets will be released in: https://github.com/Osilly/Interleaving-Reasoning-Generation .
Key facts. Cited by 41 papers in the map (data through 14 Oct 2026). Builds on 54 of its 65 references that are in the map. First posted on arXiv 8 Sep 2025.
Builds on
54 of 65 references.
References · 54
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2025Qwen3 Technical Reportcited by 8,820
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
38 more
- 2024Emu3: Next-Token Prediction is All You Needcited by 781
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
- 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 615
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
- 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 454
- 2024OmniGen: Unified Image Generationcited by 394
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
- 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 331
- 2024Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesiscited by 304
- 2023Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision, Language, Audio, and Actioncited by 302
- 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 298
- 2023DreamLLM: Synergistic Multimodal Comprehension and Creationcited by 297
- 2024VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationcited by 295
- 2024Playground v2.5: Three Insights towards Enhancing Aesthetic Quality in Text-to-Image Generationcited by 256
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 253
- 2025Show-o2: Improved Native Unified Multimodal Modelscited by 250
- 2025Transfer between Modalities with MetaQueriescited by 236
- 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 206
- 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 204
- 2024TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generationcited by 202
- 2025Unified Reward Model for Multimodal Understanding and Generationcited by 199
- 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 166
- 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformercited by 165
- 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 163
- 2024JanusFlow: Harmonizing Autoregression and Rectified Flow for Unified Multimodal Understanding and Generationcited by 163
- 2025UniTok: A Unified Tokenizer for Visual Generation and Understandingcited by 153
- 2024GenAI-Bench: Evaluating and Improving Compositional Text-to-Visual Generationcited by 135
- 2024Lumina-Next: Making Lumina-T2X Stronger and Faster with Next-DiTcited by 132
- 2024LMFusion: Adapting Pretrained Language Models for Multimodal Generationcited by 120
- 2025Mogao: An Omni Foundation Model for Interleaved Multi-Modal Generationcited by 109
- 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 104
- 2025Lumina-Image 2.0: A Unified and Efficient Image Generative Frameworkcited by 96
- 2025OneIG-Bench: Omni-dimensional Nuanced Evaluation for Image Generationcited by 87
- 2025Thinking with Generated Imagescited by 73
- 2025TIIF-Bench: How Does Your T2I Model Follow Your Instructions?cited by 69
- 2024ILLUME: Illuminating Your LLMs to See, Draw, and Self-Enhancecited by 64
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2025: 11; 2026: 30.
41 papers.
Sort:
By area:
- 2025ThinkMorph: Emergent Properties in Multimodal Interleaved Chain-of-Thought Reasoningcited by 56
- 2026Vision-DeepResearch Benchmark: Rethinking Visual and Textual Search for Multimodal Large Language Modelscited by 34
- 2026Flow-OPD: On-Policy Distillation for Flow Matching Modelscited by 34
- 2025ReasonEdit: Towards Reasoning-Enhanced Image Editing Modelscited by 25
- 2025Thinking-while-Generating: Interleaving Textual Reasoning throughout Visual Generationcited by 18
- 2026Unify-Agent: A Unified Multimodal Agent for World-Grounded Image Synthesiscited by 17
- 2026UniGRPO: Unified Policy Optimization for Reasoning-Driven Visual Generationcited by 13
- 2025DualVLA: Building a Generalizable Embodied Agent via Partial Decoupling of Reasoning and Actioncited by 12
- 2026UniReason 1.0: A Unified Reasoning Framework for World Knowledge Aligned Image Generation and Editingcited by 12
- 2025Agentic Jigsaw Interaction Learning for Enhancing Visual Perception and Reasoning in Vision-Language Modelscited by 11
- 2025MMaDA-Parallel: Multimodal Large Diffusion Language Models for Thinking-Aware Editing and Generationcited by 8
- 2025UniGen-1.5: Enhancing Image Generation and Editing through Reward Unification in Reinforcement Learningcited by 8
29 more
- 2026Show, Don't Tell: Morphing Latent Reasoning into Image Generationcited by 8
- 2026UniT: Unified Multimodal Chain-of-Thought Test-time Scalingcited by 8
- 2025IRG-MotionLLM: Interleaving Motion Generation, Assessment and Refinement for Text-to-Motion Generationcited by 6
- 2026M3: High-fidelity Text-to-Image Generation via Multi-Modal, Multi-Agent and Multi-Round Visual Reasoningcited by 6
- 2026CoCo: Code as CoT for Text-to-Image Preview and Rare Concept Generationcited by 6
- 2026Chain of Event-Centric Causal Thought for Physically Plausible Video Generationcited by 6
- 2025ShowTable: Unlocking Creative Table Visualization with Collaborative Reflection and Refinementcited by 5
- 2026AlphaGRPO: Unlocking Self-Reflective Multimodal Generation in UMMs via Decompositional Verifiable Rewardcited by 4
- 2026StruVis: Enhancing Reasoning-based Text-to-Image Generation via Thinking with Structured Visioncited by 3
- 2026Meta-CoT: Enhancing Granularity and Generalization in Image Editingcited by 3
- 2026Breaking Dual Bottlenecks: Evolving Unified Multimodal Models into Self-Adaptive Interleaved Visual Reasonerscited by 3
- 2026Generation Navigator: A State-Aware Agentic Framework for Image Generationcited by 3
- 2026Unified Text-Image Generation with Weakness-Targeted Post-Trainingcited by 2
- 2026How RL Unlocks the Aha Moment in Geometric Interleaved Reasoningcited by 2
- 2026TorchUMM: A Unified Multimodal Model Codebase for Evaluation, Analysis, and Post-trainingcited by 2
- 2026OmniVerifier-M1: Multimodal Meta-Verifier with Explicit Structured Recalibrationcited by 2
- 2026Reason, Then Re-reason: Cross-view Revisiting Improves Spatial Reasoningcited by 2
- 2026IV-CoT: Implicit Visual Chain-of-Thought for Structure-Aware Text-to-Image Generationcited by 2
- 2026Refinement via Regeneration: Enlarging Modification Space Boosts Image Refinement in Unified Multimodal Modelscited by 1
- 2026Unlocking Complex Visual Generation via Closed-Loop Verified Reasoningcited by 1
- 2026LatentUMM: Dual Latent Alignment for Unified Multimodal Modelscited by 1
- 2026Benchmarking and Evolving Reason-Reflect-Rectify for Reflective Visual Generationcited by 1
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 1
- 2025BatonVoice: An Operationalist Framework for Enhancing Controllable Speech Synthesis with Linguistic Intelligence from LLMscited by 0
- 2025PromptLoop: Plug-and-Play Prompt Refinement via Latent Feedback for Diffusion Model Alignmentcited by 0
- 2026InterCoG: Towards Spatially Precise Image Editing with Interleaved Chain-of-Grounding Reasoningcited by 0
- 2026Physically Plausible Video Generation via Visual-Semantic Chain-of-Events Conditioningcited by 0
- 2026Learning Native Reflection in Unified Models with Interleaved Reinforcement Learningcited by 0
- 2026Personalized Image Generation with Reasoning and Reflectioncited by 0
- 2026Personalized Image Generation with Reasoning and Reflection30 Sep 2026
- 2026Learning Native Reflection in Unified Models with Interleaved Reinforcement Learning28 Sep 2026
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026Physically Plausible Video Generation via Visual-Semantic Chain-of-Events Conditioning1 Sep 2026
- 2026IV-CoT: Implicit Visual Chain-of-Thought for Structure-Aware Text-to-Image Generation23 Jun 2026
- 2026Reason, Then Re-reason: Cross-view Revisiting Improves Spatial Reasoning10 Jun 2026
- 2026OmniVerifier-M1: Multimodal Meta-Verifier with Explicit Structured Recalibration27 May 2026
- 2026Benchmarking and Evolving Reason-Reflect-Rectify for Reflective Visual Generation19 May 2026
- 2026Generation Navigator: A State-Aware Agentic Framework for Image Generation18 May 2026
- 2026LatentUMM: Dual Latent Alignment for Unified Multimodal Models18 May 2026
- 2026Unlocking Complex Visual Generation via Closed-Loop Verified Reasoning14 May 2026
- 2026Breaking Dual Bottlenecks: Evolving Unified Multimodal Models into Self-Adaptive Interleaved Visual Reasoners14 May 2026
29 more
- 2026AlphaGRPO: Unlocking Self-Reflective Multimodal Generation in UMMs via Decompositional Verifiable Reward12 May 2026
- 2026Flow-OPD: On-Policy Distillation for Flow Matching Models8 May 2026
- 2026Refinement via Regeneration: Enlarging Modification Space Boosts Image Refinement in Unified Multimodal Models28 Apr 2026
- 2026Meta-CoT: Enhancing Granularity and Generalization in Image Editing27 Apr 2026
- 2026TorchUMM: A Unified Multimodal Model Codebase for Evaluation, Analysis, and Post-training12 Apr 2026
- 2026Unify-Agent: A Unified Multimodal Agent for World-Grounded Image Synthesis31 Mar 2026
- 2026UniGRPO: Unified Policy Optimization for Reasoning-Driven Visual Generation24 Mar 2026
- 2026Chain of Event-Centric Causal Thought for Physically Plausible Video Generation10 Mar 2026
- 2026CoCo: Code as CoT for Text-to-Image Preview and Rare Concept Generation9 Mar 2026
- 2026StruVis: Enhancing Reasoning-based Text-to-Image Generation via Thinking with Structured Vision6 Mar 2026
- 2026InterCoG: Towards Spatially Precise Image Editing with Interleaved Chain-of-Grounding Reasoning2 Mar 2026
- 2026How RL Unlocks the Aha Moment in Geometric Interleaved Reasoning1 Mar 2026
- 2026UniT: Unified Multimodal Chain-of-Thought Test-time Scaling12 Feb 2026
- 2026M3: High-fidelity Text-to-Image Generation via Multi-Modal, Multi-Agent and Multi-Round Visual Reasoning5 Feb 2026
- 2026UniReason 1.0: A Unified Reasoning Framework for World Knowledge Aligned Image Generation and Editing2 Feb 2026
- 2026Show, Don't Tell: Morphing Latent Reasoning into Image Generation2 Feb 2026
- 2026Vision-DeepResearch Benchmark: Rethinking Visual and Textual Search for Multimodal Large Language Models2 Feb 2026
- 2026Unified Text-Image Generation with Weakness-Targeted Post-Training7 Jan 2026
- 2025ShowTable: Unlocking Creative Table Visualization with Collaborative Reflection and Refinement15 Dec 2025
- 2025IRG-MotionLLM: Interleaving Motion Generation, Assessment and Refinement for Text-to-Motion Generation11 Dec 2025
- 2025ReasonEdit: Towards Reasoning-Enhanced Image Editing Models27 Nov 2025
- 2025DualVLA: Building a Generalizable Embodied Agent via Partial Decoupling of Reasoning and Action27 Nov 2025
- 2025Thinking-while-Generating: Interleaving Textual Reasoning throughout Visual Generation20 Nov 2025
- 2025UniGen-1.5: Enhancing Image Generation and Editing through Reward Unification in Reinforcement Learning18 Nov 2025
- 2025MMaDA-Parallel: Multimodal Large Diffusion Language Models for Thinking-Aware Editing and Generation12 Nov 2025
- 2025ThinkMorph: Emergent Properties in Multimodal Interleaved Chain-of-Thought Reasoning30 Oct 2025
- 2025Agentic Jigsaw Interaction Learning for Enhancing Visual Perception and Reasoning in Vision-Language Models1 Oct 2025
- 2025PromptLoop: Plug-and-Play Prompt Refinement via Latent Feedback for Diffusion Model Alignment1 Oct 2025
- 2025BatonVoice: An Operationalist Framework for Enhancing Controllable Speech Synthesis with Linguistic Intelligence from LLMs30 Sep 2025
- 2025ThinkMorph: Emergent Properties in Multimodal Interleaved Chain-of-Thought Reasoningcited by 56
- 2026Vision-DeepResearch Benchmark: Rethinking Visual and Textual Search for Multimodal Large Language Modelscited by 34
- 2025ReasonEdit: Towards Reasoning-Enhanced Image Editing Modelscited by 25
- 2025Thinking-while-Generating: Interleaving Textual Reasoning throughout Visual Generationcited by 18
- 2025DualVLA: Building a Generalizable Embodied Agent via Partial Decoupling of Reasoning and Actioncited by 12
- 2026UniReason 1.0: A Unified Reasoning Framework for World Knowledge Aligned Image Generation and Editingcited by 12
- 2025Agentic Jigsaw Interaction Learning for Enhancing Visual Perception and Reasoning in Vision-Language Modelscited by 11
- 2026UniT: Unified Multimodal Chain-of-Thought Test-time Scalingcited by 8
- 2026M3: High-fidelity Text-to-Image Generation via Multi-Modal, Multi-Agent and Multi-Round Visual Reasoningcited by 6
- 2026CoCo: Code as CoT for Text-to-Image Preview and Rare Concept Generationcited by 6
- 2026Chain of Event-Centric Causal Thought for Physically Plausible Video Generationcited by 6
- 2026AlphaGRPO: Unlocking Self-Reflective Multimodal Generation in UMMs via Decompositional Verifiable Rewardcited by 4
12 most cited of 18 All 18 (JSON)
- 2026IV-CoT: Implicit Visual Chain-of-Thought for Structure-Aware Text-to-Image Generation23 Jun 2026
- 2026Reason, Then Re-reason: Cross-view Revisiting Improves Spatial Reasoning10 Jun 2026
- 2026Benchmarking and Evolving Reason-Reflect-Rectify for Reflective Visual Generation19 May 2026
- 2026AlphaGRPO: Unlocking Self-Reflective Multimodal Generation in UMMs via Decompositional Verifiable Reward12 May 2026
- 2026Meta-CoT: Enhancing Granularity and Generalization in Image Editing27 Apr 2026
- 2026Chain of Event-Centric Causal Thought for Physically Plausible Video Generation10 Mar 2026
- 2026CoCo: Code as CoT for Text-to-Image Preview and Rare Concept Generation9 Mar 2026
- 2026StruVis: Enhancing Reasoning-based Text-to-Image Generation via Thinking with Structured Vision6 Mar 2026
- 2026How RL Unlocks the Aha Moment in Geometric Interleaved Reasoning1 Mar 2026
- 2026UniT: Unified Multimodal Chain-of-Thought Test-time Scaling12 Feb 2026
- 2026M3: High-fidelity Text-to-Image Generation via Multi-Modal, Multi-Agent and Multi-Round Visual Reasoning5 Feb 2026
- 2026UniReason 1.0: A Unified Reasoning Framework for World Knowledge Aligned Image Generation and Editing2 Feb 2026
12 newest of 18 All 18 (JSON)
- 2026Flow-OPD: On-Policy Distillation for Flow Matching Modelscited by 34
- 2026UniGRPO: Unified Policy Optimization for Reasoning-Driven Visual Generationcited by 13
- 2025MMaDA-Parallel: Multimodal Large Diffusion Language Models for Thinking-Aware Editing and Generationcited by 8
- 2025PromptLoop: Plug-and-Play Prompt Refinement via Latent Feedback for Diffusion Model Alignmentcited by 0
- 2026Flow-OPD: On-Policy Distillation for Flow Matching Models8 May 2026
- 2026UniGRPO: Unified Policy Optimization for Reasoning-Driven Visual Generation24 Mar 2026
- 2025MMaDA-Parallel: Multimodal Large Diffusion Language Models for Thinking-Aware Editing and Generation12 Nov 2025
- 2025PromptLoop: Plug-and-Play Prompt Refinement via Latent Feedback for Diffusion Model Alignment1 Oct 2025
- 2026Show, Don't Tell: Morphing Latent Reasoning into Image Generationcited by 8
- 2025IRG-MotionLLM: Interleaving Motion Generation, Assessment and Refinement for Text-to-Motion Generationcited by 6
- 2025ShowTable: Unlocking Creative Table Visualization with Collaborative Reflection and Refinementcited by 5
- 2026Breaking Dual Bottlenecks: Evolving Unified Multimodal Models into Self-Adaptive Interleaved Visual Reasonerscited by 3
- 2026Unified Text-Image Generation with Weakness-Targeted Post-Trainingcited by 2
- 2026TorchUMM: A Unified Multimodal Model Codebase for Evaluation, Analysis, and Post-trainingcited by 2
- 2026Refinement via Regeneration: Enlarging Modification Space Boosts Image Refinement in Unified Multimodal Modelscited by 1
- 2026Unlocking Complex Visual Generation via Closed-Loop Verified Reasoningcited by 1
- 2025BatonVoice: An Operationalist Framework for Enhancing Controllable Speech Synthesis with Linguistic Intelligence from LLMscited by 0
- 2026InterCoG: Towards Spatially Precise Image Editing with Interleaved Chain-of-Grounding Reasoningcited by 0
- 2026Physically Plausible Video Generation via Visual-Semantic Chain-of-Events Conditioningcited by 0
- 2026Learning Native Reflection in Unified Models with Interleaved Reinforcement Learningcited by 0
12 most cited of 13 All 13 (JSON)
- 2026Personalized Image Generation with Reasoning and Reflection30 Sep 2026
- 2026Learning Native Reflection in Unified Models with Interleaved Reinforcement Learning28 Sep 2026
- 2026Physically Plausible Video Generation via Visual-Semantic Chain-of-Events Conditioning1 Sep 2026
- 2026Unlocking Complex Visual Generation via Closed-Loop Verified Reasoning14 May 2026
- 2026Breaking Dual Bottlenecks: Evolving Unified Multimodal Models into Self-Adaptive Interleaved Visual Reasoners14 May 2026
- 2026Refinement via Regeneration: Enlarging Modification Space Boosts Image Refinement in Unified Multimodal Models28 Apr 2026
- 2026TorchUMM: A Unified Multimodal Model Codebase for Evaluation, Analysis, and Post-training12 Apr 2026
- 2026InterCoG: Towards Spatially Precise Image Editing with Interleaved Chain-of-Grounding Reasoning2 Mar 2026
- 2026Show, Don't Tell: Morphing Latent Reasoning into Image Generation2 Feb 2026
- 2026Unified Text-Image Generation with Weakness-Targeted Post-Training7 Jan 2026
- 2025ShowTable: Unlocking Creative Table Visualization with Collaborative Reflection and Refinement15 Dec 2025
- 2025IRG-MotionLLM: Interleaving Motion Generation, Assessment and Refinement for Text-to-Motion Generation11 Dec 2025
12 newest of 13 All 13 (JSON)