mlsanityData to 14 Oct 2026

Visual-CoG: Stage-Aware Reinforcement Learning with Chain of Guidance for Text-to-Image Generation

arXiv 2508.18032 ↗First posted 25 Aug 2025cs.CVcited by 5

On the map: Deep reinforcement learning methods → RL training of language and agent models

Abstract (arXiv)

Despite the promising progress of recent autoregressive models in text-to-image (T2I) generation, their ability to handle multi-attribute and ambiguous prompts remains limited. To address these limitations, existing works have applied chain-of-thought (CoT) to enable stage-aware visual synthesis and employed reinforcement learning (RL) to improve reasoning capabilities. However, most models provide reward signals only at the end of the generation stage. This monolithic final-only guidance makes it difficult to identify which stages contribute positively to the final outcome and may lead to suboptimal policies. To tackle this issue, we propose a Visual-Chain of Guidance (Visual-CoG) paradigm consisting of three stages: semantic reasoning, process refining, and outcome evaluation, with stage-aware rewards providing immediate guidance throughout the image generation pipeline. We further construct a visual cognition benchmark, VisCog-Bench, which comprises four subtasks to evaluate the effectiveness of semantic reasoning. Comprehensive evaluations on GenEval, T2I-CompBench, and the proposed VisCog-Bench show improvements of 15%, 5%, and 19%, respectively, demonstrating the superior performance of the proposed Visual-CoG. We will release all the resources soon.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in RL training of language and agent models, one of 15 directions in Deep reinforcement learning methods. Builds on 21 of its 36 references that are in the map. First posted on arXiv 25 Aug 2025.

Builds on

21 of 36 references.

References · 21

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  4. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  5. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  6. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
  7. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
  8. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  9. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 624
  10. 2023Generative Multimodal Models are In-Context Learnerscited by 446
  11. 2017Deep Reinforcement Learning: An Overviewcited by 333
  12. 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 331
9 more
  1. 2023Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision, Language, Audio, and Actioncited by 302
  2. 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 206
  3. 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 166
  4. 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Stepcited by 131
  5. 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 104
  6. 2025SimpleAR: Pushing the Frontier of Autoregressive Visual Generation through Pretraining, SFT, and RLcited by 86
  7. 2025GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learningcited by 52
  8. 2024Orthus: Autoregressive Interleaved Image-Text Generation with Modality-Specific Headscited by 44
  9. 2025ImageGen-CoT: Enhancing Text-to-Image In-context Learning with Chain-of-Thought Reasoningcited by 37

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Unlocking Complex Visual Generation via Closed-Loop Verified Reasoning
  2. 2025Improving Chain-of-Thought Efficiency for Autoregressive Image Generation
  3. 2026CoF-T2I: Video Models as Pure Visual Reasoners for Text-to-Image Generation
  4. 2025Visual Planning: Let's Think Only with Images
  5. 2025Janus-Pro-R1: Advancing Collaborative Visual Comprehension and Generation via Reinforcement Learning
  6. 2025Thinking-while-Generating: Interleaving Textual Reasoning throughout Visual Generation
  7. 2025Unveiling Chain of Step Reasoning for Vision-Language Models with Fine-grained Rewards
  8. 2026Thinking with Images as Continuous Actions: Numerical Visual Chain-of-Thought