mlsanityData to 7 Oct 2026

Think in Strokes, Not Pixels: Process-Driven Image Generation via Interleaved Reasoning

arXiv 2604.04746 ↗First posted 6 Apr 2026cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

Humans paint images incrementally: they plan a global layout, sketch a coarse draft, inspect, and refine details, and most importantly, each step is grounded in the evolving visual states. However, can unified multimodal models trained on text-image interleaved datasets also imagine the chain of intermediate states? In this paper, we introduce process-driven image generation, a multi-step paradigm that decomposes synthesis into an interleaved reasoning trajectory of thoughts and actions. Rather than generating images in a single step, our approach unfolds across multiple iterations, each consisting of 4 stages: textual planning, visual drafting, textual reflection, and visual refinement. The textual reasoning explicitly conditions how the visual state should evolve, while the generated visual intermediate in turn constrains and grounds the next round of textual reasoning. A core challenge of process-driven generation stems from the ambiguity of intermediate states: how can models evaluate each partially-complete image? We address this through dense, step-wise supervision that maintains two complementary constraints: for the visual intermediate states, we enforce the spatial and semantic consistency; for the textual intermediate states, we preserve the prior visual knowledge while enabling the model to identify and correct prompt-violating elements. This makes the generation process explicit, interpretable, and directly supervisable. To validate proposed method, we conduct experiments under various text-to-image generation benchmarks.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 36 of its 52 references that are in the map. First posted on arXiv 6 Apr 2026.

Builds on

36 of 52 references.

References · 36

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  4. 2017Neural Discrete Representation Learningcited by 4,650
  5. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  6. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  7. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
  8. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  9. 2024Emu3: Next-Token Prediction is All You Needcited by 761
  10. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 653
  11. 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 610
  12. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 468
24 more
  1. 2022Selection-Inference: Exploiting Large Language Models for Interpretable Logical Reasoningcited by 331
  2. 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
  3. 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generationcited by 326
  4. 2024VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationcited by 290
  5. 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Modelscited by 260
  6. 2024Playground v2.5: Three Insights towards Enhancing Aesthetic Quality in Text-to-Image Generationcited by 249
  7. 2025Show-o2: Improved Native Unified Multimodal Modelscited by 242
  8. 2025Transfer between Modalities with MetaQueriescited by 231
  9. 2024Chain-of-Thought Reasoning Without Promptingcited by 208
  10. 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thoughtcited by 204
  11. 2024World Model on Million-Length Video And Language With Blockwise RingAttentioncited by 196
  12. 2025When More is Less: Understanding Chain-of-Thought Length in LLMscited by 182
  13. 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 162
  14. 2023Compositional Chain-of-Thought Prompting for Large Multimodal Modelscited by 160
  15. 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Stepcited by 130
  16. 2023DDCoT: Duty-Distinct Chain-of-Thought Prompting for Multimodal Reasoning in Language Modelscited by 124
  17. 2020Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answeringcited by 122
  18. 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 103
  19. 2024Image-of-Thought Prompting for Visual Reasoning Refinement in Multimodal Large Language Modelscited by 64
  20. 2025From Reflection to Perfection: Scaling Inference-Time Optimization for Text-to-Image Diffusion Models via Reflection Tuningcited by 53
  21. 2025ImageGen-CoT: Enhancing Text-to-Image In-context Learning with Chain-of-Thought Reasoningcited by 37
  22. 2025ReasonGen-R1: CoT for Autoregressive Image generation models through SFT and RLcited by 30
  23. 2025Unfolding Spatial Cognition: Evaluating Multimodal Models on Visual Simulationscited by 21
  24. 2024Is 'Right' Right? Enhancing Object Orientation Understanding in Multimodal Large Language Models through Egocentric Instruction Tuningcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Thinking with Generated Images
  2. 2025Thinking-while-Generating: Interleaving Textual Reasoning throughout Visual Generation
  3. 2025CRAFT: Continuous Reasoning and Agentic Feedback Tuning for Multimodal Text-to-Image Generation
  4. 2026See2Think: Do Multimodal Models Really Use Intermediate Visual States?
  5. 2025ThinkMorph: Emergent Properties in Multimodal Interleaved Chain-of-Thought Reasoning
  6. 2025MMGR: Multi-Modal Generative Reasoning Benchmark and Evaluation
  7. 2026UniReason 1.0: A Unified Reasoning Framework for World Knowledge Aligned Image Generation and Editing
  8. 2026Large Language Models are Universal Reasoners for Visual Generation