Visual-CoG: Stage-Aware Reinforcement Learning with Chain of Guidance for Text-to-Image Generation
On the map: Deep reinforcement learning methods → RL training of language and agent models
Abstract (arXiv)
Despite the promising progress of recent autoregressive models in text-to-image (T2I) generation, their ability to handle multi-attribute and ambiguous prompts remains limited. To address these limitations, existing works have applied chain-of-thought (CoT) to enable stage-aware visual synthesis and employed reinforcement learning (RL) to improve reasoning capabilities. However, most models provide reward signals only at the end of the generation stage. This monolithic final-only guidance makes it difficult to identify which stages contribute positively to the final outcome and may lead to suboptimal policies. To tackle this issue, we propose a Visual-Chain of Guidance (Visual-CoG) paradigm consisting of three stages: semantic reasoning, process refining, and outcome evaluation, with stage-aware rewards providing immediate guidance throughout the image generation pipeline. We further construct a visual cognition benchmark, VisCog-Bench, which comprises four subtasks to evaluate the effectiveness of semantic reasoning. Comprehensive evaluations on GenEval, T2I-CompBench, and the proposed VisCog-Bench show improvements of 15%, 5%, and 19%, respectively, demonstrating the superior performance of the proposed Visual-CoG. We will release all the resources soon.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in RL training of language and agent models, one of 15 directions in Deep reinforcement learning methods. Builds on 21 of its 36 references that are in the map. First posted on arXiv 25 Aug 2025.
Builds on
21 of 36 references.
References · 21
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
- 2022Compositional Visual Generation with Composable Diffusion Modelscited by 624
- 2023Generative Multimodal Models are In-Context Learnerscited by 446
- 2017Deep Reinforcement Learning: An Overviewcited by 333
- 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 331
9 more
- 2023Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision, Language, Audio, and Actioncited by 302
- 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 206
- 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 166
- 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Stepcited by 131
- 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 104
- 2025SimpleAR: Pushing the Frontier of Autoregressive Visual Generation through Pretraining, SFT, and RLcited by 86
- 2025GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learningcited by 52
- 2024Orthus: Autoregressive Interleaved Image-Text Generation with Modality-Specific Headscited by 44
- 2025ImageGen-CoT: Enhancing Text-to-Image In-context Learning with Chain-of-Thought Reasoningcited by 37
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2026From Broad Exploration to Stable Synthesis: Entropy-Guided Optimization for Autoregressive Image Generationcited by 7
- 2026Chain of Event-Centric Causal Thought for Physically Plausible Video Generationcited by 6
- 2026StruVis: Enhancing Reasoning-based Text-to-Image Generation via Thinking with Structured Visioncited by 3
- 2026Latent Action Control for Reasoning-Guided Unified Image Generationcited by 1
- 2025PromptLoop: Plug-and-Play Prompt Refinement via Latent Feedback for Diffusion Model Alignmentcited by 0
- 2026Latent Action Control for Reasoning-Guided Unified Image Generation16 May 2026
- 2026From Broad Exploration to Stable Synthesis: Entropy-Guided Optimization for Autoregressive Image Generation12 Mar 2026
- 2026Chain of Event-Centric Causal Thought for Physically Plausible Video Generation10 Mar 2026
- 2026StruVis: Enhancing Reasoning-based Text-to-Image Generation via Thinking with Structured Vision6 Mar 2026
- 2025PromptLoop: Plug-and-Play Prompt Refinement via Latent Feedback for Diffusion Model Alignment1 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026Unlocking Complex Visual Generation via Closed-Loop Verified Reasoning
- 2025Improving Chain-of-Thought Efficiency for Autoregressive Image Generation
- 2026CoF-T2I: Video Models as Pure Visual Reasoners for Text-to-Image Generation
- 2025Visual Planning: Let's Think Only with Images
- 2025Janus-Pro-R1: Advancing Collaborative Visual Comprehension and Generation via Reinforcement Learning
- 2025Thinking-while-Generating: Interleaving Textual Reasoning throughout Visual Generation
- 2025Unveiling Chain of Step Reasoning for Vision-Language Models with Fine-grained Rewards
- 2026Thinking with Images as Continuous Actions: Numerical Visual Chain-of-Thought