mlsanityData to 14 Oct 2026

Improving Chain-of-Thought Efficiency for Autoregressive Image Generation

arXiv 2510.05593 ↗First posted 7 Oct 2025cs.CV cs.AI cs.CLcited by 7

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Autoregressive multimodal large language models have recently gained popularity for image generation, driven by advances in foundation models. To enhance alignment and detail, newer approaches employ chain-of-thought (CoT) reasoning, expanding user inputs into elaborated prompts prior to image synthesis. However, this strategy can introduce unnecessary redundancy -- a phenomenon we call visual overthinking -- which increases computational costs and can introduce details that contradict the original prompt. In this work, we explore how to generate more concise CoT sequences for more efficient image generation. We introduce ShortCoTI, a lightweight optimization framework that encourages more concise CoT while preserving output image quality. ShortCoTI rewards more concise prompts with an adaptive function that scales according to an estimated difficulty for each task. Incorporating this reward into a reinforcement learning paradigm reduces prompt reasoning length by 54% while maintaining or slightly improving quality metrics across multiple benchmarks (T2I-CompBench, GenEval). Qualitative analysis shows that our method eliminates verbose explanations and repetitive refinements, producing reasoning prompts that are both concise and semantically rich. As a result, ShortCoTI improves computational efficiency without compromising the fidelity or visual appeal of generated images.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 26 of its 28 references that are in the map. First posted on arXiv 7 Oct 2025.

Builds on

26 of 28 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025ReasonGen-R1: CoT for Autoregressive Image generation models through SFT and RL30 May
  2. 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoT1 May
  3. 2025ImageGen-CoT: Enhancing Text-to-Image In-context Learning with Chain-of-Thought Reasoning25 Mar
  4. 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Step23 Jan

Other references · 22

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  5. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  6. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  7. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
  8. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  9. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
  10. 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 682
  11. 2022GIT: A Generative Image-to-text Transformer for Vision and Languagecited by 537
  12. 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Modelscited by 464
10 more
  1. 2023Emu: Enhancing Image Generation Models Using Photogenic Needles in a Haystackcited by 279
  2. 2025TokenSkip: Controllable Chain-of-Thought Compression in LLMscited by 249
  3. 2024Token-Budget-Aware LLM Reasoningcited by 247
  4. 2025Training Language Models to Reason Efficientlycited by 247
  5. 2025ShorterBetter: Guiding Reasoning Models to Find Optimal Inference Length for Efficient Reasoningcited by 72
  6. 2025Efficient Inference for Large Reasoning Models: A Surveycited by 61
  7. 2025AdaCtrl: Towards Adaptive and Controllable Reasoning via Difficulty-Aware Budgetingcited by 50
  8. 2025SelfBudgeter: Adaptive Token Allocation for Efficient LLM Reasoningcited by 48
  9. 2025ARM: Adaptive Reasoning Modelcited by 39
  10. 2025AALC: Large Language Model Efficient Reasoning via Adaptive Accuracy-Length Controlcited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 6.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Delving into RL for Image Generation with CoT: A Study on DPO vs. GRPO
  2. 2025ThinkGen: Generalized Thinking for Visual Generation
  3. 2026Thinking with Images as Continuous Actions: Numerical Visual Chain-of-Thought
  4. 2025MindOmni: Unleashing Reasoning Generation in Vision Language Models with RGPO
  5. 2026Iterative Refinement Improves Compositional Image Generation
  6. 2026FiRe: Fine-grained Multimodal Reasoning for Enhanced Image Generation
  7. 2025CRAFT: Continuous Reasoning and Agentic Feedback Tuning for Multimodal Text-to-Image Generation
  8. 2026From "What" to "How": Constrained Reasoning for Autoregressive Image Generation