ThinkGen: Generalized Thinking for Visual Generation
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Recent progress in Multimodal Large Language Models (MLLMs) demonstrates that Chain-of-Thought (CoT) reasoning enables systematic solutions to complex understanding tasks. However, its extension to generation tasks remains nascent and limited by scenario-specific mechanisms that hinder generalization and adaptation. In this work, we present ThinkGen, the first think-driven visual generation framework that explicitly leverages MLLM's CoT reasoning in various generation scenarios. ThinkGen employs a decoupled architecture comprising a pretrained MLLM and a Diffusion Transformer (DiT), wherein the MLLM generates tailored instructions based on user intent, and DiT produces high-quality images guided by these instructions. We further propose a separable GRPO-based training paradigm (SepGRPO), alternating reinforcement learning between the MLLM and DiT modules. This flexible design enables joint training across diverse datasets, facilitating effective CoT reasoning for a wide range of generative scenarios. Extensive experiments demonstrate that ThinkGen achieves robust, state-of-the-art performance across multiple generation benchmarks. Code is available: https://github.com/jiaosiyuu/ThinkGen
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 45 of its 74 references that are in the map. First posted on arXiv 29 Dec 2025.
Builds on
45 of 74 references.
Closest ancestors · 5
Same direction, newest first
- 2025FLUX-Reason-6M & PRISM-Bench: A Million-Scale Text-to-Image Reasoning Dataset and Comprehensive Benchmark11 Sep
- 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Vision7 Aug
- 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoT1 May
- 2025Towards Enhanced Image Generation Via Multi-modal Chain of Thought in Unified Generative Models3 Mar
- 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Step23 Jan
Other references · 40
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2024OpenAI o1 System Cardcited by 1,220
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
- 2025Qwen-Image Technical Reportcited by 973
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 810
28 more
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2024Emu3: Next-Token Prediction is All You Needcited by 761
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 388
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
- 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 331
- 2024VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationcited by 290
- 2025Chain of Draft: Thinking Faster by Writing Lesscited by 290
- 2025Show-o2: Improved Native Unified Multimodal Modelscited by 242
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
- 2025Transfer between Modalities with MetaQueriescited by 231
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 199
- 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 196
- 2025PaddleOCR 3.0 Technical Reportcited by 136
- 2025MiMo: Unlocking the Reasoning Potential of Language Model -- From Pretraining to Posttrainingcited by 117
- 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 97
- 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 95
- 2025ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generationcited by 94
- 2025GPT-IMAGE-EDIT-1.5M: A Million-Scale, GPT-Generated Image Datasetcited by 68
- 2025UniWorld-V1: High-Resolution Semantic Encoders for Unified Visual Understanding and Generationcited by 64
- 2025EditScore: Unlocking Online RL for Image Editing via High-Fidelity Reward Modelingcited by 61
- 2025ILLUME+: Illuminating Unified MLLM with Dual Visual Tokenization and Diffusion Refinementcited by 53
- 2025NoHumansRequired: Autonomous High-Quality Image Editing Triplet Miningcited by 33
- 2025OmniConsistency: Learning Style-Agnostic Consistency from Paired Stylization Datacited by 32
- 2025Investigating Text Insulation and Attention Mechanisms for Complex Visual Text Generationcited by 22
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026GEMS: Agent-Native Multimodal Generation with Memory and Skillscited by 16
- 2026UniGRPO: Unified Policy Optimization for Reasoning-Driven Visual Generationcited by 11
- 2026Audio-Omni: Extending Multi-modal Understanding to Versatile Audio Generation and Editingcited by 10
- 2026EndoCoT: Scaling Endogenous Chain-of-Thought Reasoning in Diffusion Modelscited by 6
- 2026DDA-Thinker: Decoupled Dual-Atomic Reinforcement Learning for Reasoning-Driven Image Editingcited by 2
- 2026Advances in GRPO for Generation Models: A Surveycited by 1
- 2026TextSculptor: Training and Benchmarking Scene Text Editingcited by 1
- 2026PhyEditBench: A Real-World Multi-Stage Benchmark for Physics-Aware Image Editingcited by 1
- 2026ExpertVerse: A General-Purpose Benchmark for Expert-Level Reasoning in Knowledge-Intensive Visual Synthesiscited by 1
- 2026Benchmarking and Evolving Reason-Reflect-Rectify for Reflective Visual Generationcited by 0
- 2026Hallo4D: Multi-Modal Hallucination Mitigation for Consistent Spatio-Temporal Generationcited by 0
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 0
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026ExpertVerse: A General-Purpose Benchmark for Expert-Level Reasoning in Knowledge-Intensive Visual Synthesis21 Jul 2026
- 2026Hallo4D: Multi-Modal Hallucination Mitigation for Consistent Spatio-Temporal Generation14 Jul 2026
- 2026PhyEditBench: A Real-World Multi-Stage Benchmark for Physics-Aware Image Editing25 Jun 2026
- 2026TextSculptor: Training and Benchmarking Scene Text Editing20 May 2026
- 2026Benchmarking and Evolving Reason-Reflect-Rectify for Reflective Visual Generation19 May 2026
- 2026DDA-Thinker: Decoupled Dual-Atomic Reinforcement Learning for Reasoning-Driven Image Editing28 Apr 2026
- 2026Audio-Omni: Extending Multi-modal Understanding to Versatile Audio Generation and Editing12 Apr 2026
- 2026GEMS: Agent-Native Multimodal Generation with Memory and Skills30 Mar 2026
- 2026UniGRPO: Unified Policy Optimization for Reasoning-Driven Visual Generation24 Mar 2026
- 2026EndoCoT: Scaling Endogenous Chain-of-Thought Reasoning in Diffusion Models12 Mar 2026
- 2026Advances in GRPO for Generation Models: A Survey21 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025Thinking-while-Generating: Interleaving Textual Reasoning throughout Visual Generation
- 2025GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learning
- 2025Improving Chain-of-Thought Efficiency for Autoregressive Image Generation
- 2025Thinking with Generated Images
- 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing
- 2025MindOmni: Unleashing Reasoning Generation in Vision Language Models with RGPO
- 2025Janus-Pro-R1: Advancing Collaborative Visual Comprehension and Generation via Reinforcement Learning
- 2026Reversing the Flow: Generation-to-Understanding Synergy in Large Multimodal Models