Think in Strokes, Not Pixels: Process-Driven Image Generation via Interleaved Reasoning
Not on the map. Why?
Abstract (arXiv)
Humans paint images incrementally: they plan a global layout, sketch a coarse draft, inspect, and refine details, and most importantly, each step is grounded in the evolving visual states. However, can unified multimodal models trained on text-image interleaved datasets also imagine the chain of intermediate states? In this paper, we introduce process-driven image generation, a multi-step paradigm that decomposes synthesis into an interleaved reasoning trajectory of thoughts and actions. Rather than generating images in a single step, our approach unfolds across multiple iterations, each consisting of 4 stages: textual planning, visual drafting, textual reflection, and visual refinement. The textual reasoning explicitly conditions how the visual state should evolve, while the generated visual intermediate in turn constrains and grounds the next round of textual reasoning. A core challenge of process-driven generation stems from the ambiguity of intermediate states: how can models evaluate each partially-complete image? We address this through dense, step-wise supervision that maintains two complementary constraints: for the visual intermediate states, we enforce the spatial and semantic consistency; for the textual intermediate states, we preserve the prior visual knowledge while enabling the model to identify and correct prompt-violating elements. This makes the generation process explicit, interpretable, and directly supervisable. To validate proposed method, we conduct experiments under various text-to-image generation benchmarks.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 36 of its 52 references that are in the map. First posted on arXiv 6 Apr 2026.
Builds on
36 of 52 references.
References · 36
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2017Neural Discrete Representation Learningcited by 4,650
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2024Emu3: Next-Token Prediction is All You Needcited by 761
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 653
- 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 610
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 468
24 more
- 2022Selection-Inference: Exploiting Large Language Models for Interpretable Logical Reasoningcited by 331
- 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
- 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generationcited by 326
- 2024VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationcited by 290
- 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Modelscited by 260
- 2024Playground v2.5: Three Insights towards Enhancing Aesthetic Quality in Text-to-Image Generationcited by 249
- 2025Show-o2: Improved Native Unified Multimodal Modelscited by 242
- 2025Transfer between Modalities with MetaQueriescited by 231
- 2024Chain-of-Thought Reasoning Without Promptingcited by 208
- 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thoughtcited by 204
- 2024World Model on Million-Length Video And Language With Blockwise RingAttentioncited by 196
- 2025When More is Less: Understanding Chain-of-Thought Length in LLMscited by 182
- 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 162
- 2023Compositional Chain-of-Thought Prompting for Large Multimodal Modelscited by 160
- 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Stepcited by 130
- 2023DDCoT: Duty-Distinct Chain-of-Thought Prompting for Multimodal Reasoning in Language Modelscited by 124
- 2020Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answeringcited by 122
- 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 103
- 2024Image-of-Thought Prompting for Visual Reasoning Refinement in Multimodal Large Language Modelscited by 64
- 2025From Reflection to Perfection: Scaling Inference-Time Optimization for Text-to-Image Diffusion Models via Reflection Tuningcited by 53
- 2025ImageGen-CoT: Enhancing Text-to-Image In-context Learning with Chain-of-Thought Reasoningcited by 37
- 2025ReasonGen-R1: CoT for Autoregressive Image generation models through SFT and RLcited by 30
- 2025Unfolding Spatial Cognition: Evaluating Multimodal Models on Visual Simulationscited by 21
- 2024Is 'Right' Right? Enhancing Object Orientation Understanding in Multimodal Large Language Models through Egocentric Instruction Tuningcited by 7
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Masking Stale Observations Helps Search Agents -- Until It Doesn't: A Regime Map and Its Mechanismcited by 4
- 2026Unlocking Complex Visual Generation via Closed-Loop Verified Reasoningcited by 1
- 2026Apple-π: Benchmarking Thinking with Video Towards Law-Grounded Physical Intelligencecited by 1
- 2026Efficient Reinforcement for Visual-Textual Thinking with Discrete Diffusion Modelcited by 0
- 2026The Plan, Not the Decoder: Diagnosing and Repairing Compositional Failure in Reasoning-Augmented Text-to-Image Generationcited by 0
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 0
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026The Plan, Not the Decoder: Diagnosing and Repairing Compositional Failure in Reasoning-Augmented Text-to-Image Generation22 Aug 2026
- 2026Apple-π: Benchmarking Thinking with Video Towards Law-Grounded Physical Intelligence17 Jul 2026
- 2026Efficient Reinforcement for Visual-Textual Thinking with Discrete Diffusion Model11 Jun 2026
- 2026Masking Stale Observations Helps Search Agents -- Until It Doesn't: A Regime Map and Its Mechanism29 May 2026
- 2026Unlocking Complex Visual Generation via Closed-Loop Verified Reasoning14 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025Thinking with Generated Images
- 2025Thinking-while-Generating: Interleaving Textual Reasoning throughout Visual Generation
- 2025CRAFT: Continuous Reasoning and Agentic Feedback Tuning for Multimodal Text-to-Image Generation
- 2026See2Think: Do Multimodal Models Really Use Intermediate Visual States?
- 2025ThinkMorph: Emergent Properties in Multimodal Interleaved Chain-of-Thought Reasoning
- 2025MMGR: Multi-Modal Generative Reasoning Benchmark and Evaluation
- 2026UniReason 1.0: A Unified Reasoning Framework for World Knowledge Aligned Image Generation and Editing
- 2026Large Language Models are Universal Reasoners for Visual Generation