mlsanityData to 14 Oct 2026

RePrompt: Reasoning-Augmented Reprompting for Text-to-Image Generation via Reinforcement Learning

arXiv 2505.17540 ↗First posted 23 May 2025cs.CV cs.AIcited by 23

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Despite recent progress in text-to-image (T2I) generation, existing models often struggle to faithfully capture user intentions from short and under-specified prompts. While prior work has attempted to enhance prompts using large language models (LLMs), these methods frequently generate stylistic or unrealistic content due to insufficient grounding in visual semantics and real-world composition. Inspired by recent advances in reasoning for language model, we propose RePrompt, a novel reprompting framework that introduces explicit reasoning into the prompt enhancement process via reinforcement learning. Instead of relying on handcrafted rules or stylistic rewrites, our method trains a language model to generate structured, self-reflective prompts by optimizing for image-level outcomes. The tailored reward models assesse the generated images in terms of human preference, semantic alignment, and visual composition, providing indirect supervision to refine prompt generation. Our approach enables end-to-end training without human-annotated data. Experiments on GenEval and T2I-Compbench show that RePrompt significantly boosts spatial layout fidelity and compositional generalization across diverse T2I backbones, establishing new state-of-the-art results.

Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 42 of its 63 references that are in the map. First posted on arXiv 23 May 2025.

Builds on

42 of 63 references.

Closest ancestors · 13

Same direction, newest first

  1. 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoT1 May
  2. 2025Perception-R1: Pioneering Perception Policy with Reinforcement Learning10 Apr
  3. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
  4. 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
  5. 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
  6. 2025UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learning27 Mar
  7. 2025LayerCraft: Enhancing Text-to-Image Generation with CoT Reasoning and Layered Object Integration25 Mar
  8. 2025KARL: Knowledge-Aware Reasoning and Reinforcement Learning for Knowledge-Intensive Visual Grounding17 Mar
  9. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
  10. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
  11. 2025Towards Enhanced Image Generation Via Multi-modal Chain of Thought in Unified Generative Models3 Mar
  12. 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Step23 Jan
1 more
  1. 2024FairCoT: Enhancing Fairness in Text-to-Image Generation via Chain of Thought Reasoning with Multimodal Large Language Models13 Jun

Other references · 29

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2024Qwen2.5 Technical Reportcited by 4,942
  4. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  5. 2024OpenAI o1 System Cardcited by 1,244
  6. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
  7. 2023Training Diffusion Models with Reinforcement Learningcited by 982
  8. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  9. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
  10. 2023Aligning Text-to-Image Models using Human Feedbackcited by 422
  11. 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 413
  12. 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 301
17 more
  1. 2025Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Stepscited by 234
  2. 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformercited by 165
  3. 2024Playground v3: Improving Text-to-Image Alignment with Deep-Fusion Large Language Modelscited by 116
  4. 2024Improving Text-to-Image Consistency via Automatic Prompt Optimizationcited by 90
  5. 2025SimpleAR: Pushing the Frontier of Autoregressive Visual Generation through Pretraining, SFT, and RLcited by 86
  6. 2024A Dense Reward View on Aligning Text-to-Image Diffusion with Preferencecited by 55
  7. 2024IterComp: Iterative Composition-Aware Feedback Learning from Model Gallery for Text-to-Image Generationcited by 33
  8. 2025Boosting MLLM Reasoning with Text-Debiased Hint-GRPOcited by 32
  9. 2025A Simple and Effective Reinforcement Learning Method for Text-to-Image Diffusion Fine-tuningcited by 30
  10. 2024DiffusionAgent: Navigating Expert Models for Agentic Image Generationcited by 28
  11. 2024Training-free Regional Prompting for Diffusion Transformerscited by 27
  12. 2024Scores as Actions: a framework of fine-tuning diffusion models by continuous-time reinforcement learningcited by 19
  13. 2023BeautifulPrompt: Towards Automatic Prompt Engineering for Text-to-Image Synthesiscited by 18
  14. 2024VersaT2I: Improving Text-to-Image Models with Versatile Rewardcited by 17
  15. 2025Learning to Sample Effective and Diverse Prompts for Text-to-Image Generationcited by 17
  16. 2024Preference Adaptive and Sequential Text-to-Image Generationcited by 8
  17. 2024TIPO: Text to Image with Text Presampling for Prompt Optimizationcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 9; 2026: 14.

23 papers.

Sort:

By area:

  1. 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 205
  2. 2025A Survey of Reinforcement Learning for Large Reasoning Modelscited by 180
  3. 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 165
  4. 2025PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewritingcited by 43
  5. 2026Flow caching for autoregressive video generationcited by 25
  6. 2026GenAgent: Scaling Text-to-Image Generation via Agentic Multimodal Reasoningcited by 24
  7. 2025RAPO++: Cross-Stage Prompt Optimization for Text-to-Video Generation via Data Alignment and Test-Time Scalingcited by 10
  8. 2025Reinforcement Learning for Large Model: A Surveycited by 9
  9. 2025MILR: Improving Multimodal Image Generation via Test-Time Latent Reasoningcited by 8
  10. 2026Agentic Retoucher for Text-To-Image Generationcited by 7
  11. 2025Expand and Prune: Maximizing Trajectory Diversity for Effective GRPO in Generative Modelscited by 6
  12. 2026M3: High-fidelity Text-to-Image Generation via Multi-Modal, Multi-Agent and Multi-Round Visual Reasoningcited by 6
11 more
  1. 2026SOAR: Self-Correction for Optimal Alignment and Refinement in Diffusion Modelscited by 6
  2. 2026MICON-Bench: Benchmarking and Enhancing Multi-Image Context Image Generation in Unified Multimodal Modelscited by 5
  3. 2026A Systematic Post-Train Framework for Video Generationcited by 5
  4. 2025POET: Preference Optimization for Enhanced Text-to-Image Generationcited by 4
  5. 2026MiLDEdit: Reasoning-Based Multi-Layer Design Document Editingcited by 3
  6. 2026BrandFusion: A Multi-Agent Framework for Seamless Brand Integration in Text-to-Video Generationcited by 3
  7. 2026EruDiff: Refactoring Knowledge in Diffusion Models for Advanced Text-to-Image Synthesiscited by 1
  8. 2025PromptLoop: Plug-and-Play Prompt Refinement via Latent Feedback for Diffusion Model Alignmentcited by 0
  9. 2026Seeing is Believing: Aligning Prompt Rewriting with Visual Anchors for Text-to-Image Generationcited by 0
  10. 2026Panoptic Scene Program Diffusion Transformercited by 0
  11. 2026EvoGen-Harness: Learning Where and How to Evolve Image-Generation Harnessescited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Self-Rewarding Large Vision-Language Models for Optimizing Prompts in Text-to-Image Generation
  2. 2022Optimizing Prompts for Text-to-Image Generation
  3. 2024Multimodal Large Language Model is a Human-Aligned Annotator for Text-to-Image Generation
  4. 2024Batch-Instructed Gradient for Prompt Evolution:Systematic Prompt Optimization for Enhanced Text-to-Image Synthesis
  5. 2026PRISM: Prompt Refinement via Image-grounded Self-rewarding Mechanism for Text-to-Image Generation
  6. 2025CRAFT: Continuous Reasoning and Agentic Feedback Tuning for Multimodal Text-to-Image Generation
  7. 2026PromptRL: Prompt Matters in RL for Flow-Based Image Generation
  8. 2025Test-time Prompt Refinement for Text-to-Image Models