RePrompt: Reasoning-Augmented Reprompting for Text-to-Image Generation via Reinforcement Learning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Despite recent progress in text-to-image (T2I) generation, existing models often struggle to faithfully capture user intentions from short and under-specified prompts. While prior work has attempted to enhance prompts using large language models (LLMs), these methods frequently generate stylistic or unrealistic content due to insufficient grounding in visual semantics and real-world composition. Inspired by recent advances in reasoning for language model, we propose RePrompt, a novel reprompting framework that introduces explicit reasoning into the prompt enhancement process via reinforcement learning. Instead of relying on handcrafted rules or stylistic rewrites, our method trains a language model to generate structured, self-reflective prompts by optimizing for image-level outcomes. The tailored reward models assesse the generated images in terms of human preference, semantic alignment, and visual composition, providing indirect supervision to refine prompt generation. Our approach enables end-to-end training without human-annotated data. Experiments on GenEval and T2I-Compbench show that RePrompt significantly boosts spatial layout fidelity and compositional generalization across diverse T2I backbones, establishing new state-of-the-art results.
Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 42 of its 63 references that are in the map. First posted on arXiv 23 May 2025.
Builds on
42 of 63 references.
Closest ancestors · 13
Same direction, newest first
- 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoT1 May
- 2025Perception-R1: Pioneering Perception Policy with Reinforcement Learning10 Apr
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
- 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
- 2025UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learning27 Mar
- 2025LayerCraft: Enhancing Text-to-Image Generation with CoT Reasoning and Layered Object Integration25 Mar
- 2025KARL: Knowledge-Aware Reasoning and Reinforcement Learning for Knowledge-Intensive Visual Grounding17 Mar
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2025Towards Enhanced Image Generation Via Multi-modal Chain of Thought in Unified Generative Models3 Mar
- 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Step23 Jan
1 more
Other references · 29
- 2023GPT-4 Technical Reportcited by 18,396
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024OpenAI o1 System Cardcited by 1,244
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
- 2023Training Diffusion Models with Reinforcement Learningcited by 982
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
- 2023Aligning Text-to-Image Models using Human Feedbackcited by 422
- 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 413
- 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 301
17 more
- 2025Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Stepscited by 234
- 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformercited by 165
- 2024Playground v3: Improving Text-to-Image Alignment with Deep-Fusion Large Language Modelscited by 116
- 2024Improving Text-to-Image Consistency via Automatic Prompt Optimizationcited by 90
- 2025SimpleAR: Pushing the Frontier of Autoregressive Visual Generation through Pretraining, SFT, and RLcited by 86
- 2024A Dense Reward View on Aligning Text-to-Image Diffusion with Preferencecited by 55
- 2024IterComp: Iterative Composition-Aware Feedback Learning from Model Gallery for Text-to-Image Generationcited by 33
- 2025Boosting MLLM Reasoning with Text-Debiased Hint-GRPOcited by 32
- 2025A Simple and Effective Reinforcement Learning Method for Text-to-Image Diffusion Fine-tuningcited by 30
- 2024DiffusionAgent: Navigating Expert Models for Agentic Image Generationcited by 28
- 2024Training-free Regional Prompting for Diffusion Transformerscited by 27
- 2024Scores as Actions: a framework of fine-tuning diffusion models by continuous-time reinforcement learningcited by 19
- 2023BeautifulPrompt: Towards Automatic Prompt Engineering for Text-to-Image Synthesiscited by 18
- 2024VersaT2I: Improving Text-to-Image Models with Versatile Rewardcited by 17
- 2025Learning to Sample Effective and Diverse Prompts for Text-to-Image Generationcited by 17
- 2024Preference Adaptive and Sequential Text-to-Image Generationcited by 8
- 2024TIPO: Text to Image with Text Presampling for Prompt Optimizationcited by 6
Built on by
Citing papers per year: 2025: 9; 2026: 14.
23 papers.
Sort:
By area:
- 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 205
- 2025A Survey of Reinforcement Learning for Large Reasoning Modelscited by 180
- 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 165
- 2025PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewritingcited by 43
- 2026Flow caching for autoregressive video generationcited by 25
- 2026GenAgent: Scaling Text-to-Image Generation via Agentic Multimodal Reasoningcited by 24
- 2025RAPO++: Cross-Stage Prompt Optimization for Text-to-Video Generation via Data Alignment and Test-Time Scalingcited by 10
- 2025Reinforcement Learning for Large Model: A Surveycited by 9
- 2025MILR: Improving Multimodal Image Generation via Test-Time Latent Reasoningcited by 8
- 2026Agentic Retoucher for Text-To-Image Generationcited by 7
- 2025Expand and Prune: Maximizing Trajectory Diversity for Effective GRPO in Generative Modelscited by 6
- 2026M3: High-fidelity Text-to-Image Generation via Multi-Modal, Multi-Agent and Multi-Round Visual Reasoningcited by 6
11 more
- 2026SOAR: Self-Correction for Optimal Alignment and Refinement in Diffusion Modelscited by 6
- 2026MICON-Bench: Benchmarking and Enhancing Multi-Image Context Image Generation in Unified Multimodal Modelscited by 5
- 2026A Systematic Post-Train Framework for Video Generationcited by 5
- 2025POET: Preference Optimization for Enhanced Text-to-Image Generationcited by 4
- 2026MiLDEdit: Reasoning-Based Multi-Layer Design Document Editingcited by 3
- 2026BrandFusion: A Multi-Agent Framework for Seamless Brand Integration in Text-to-Video Generationcited by 3
- 2026EruDiff: Refactoring Knowledge in Diffusion Models for Advanced Text-to-Image Synthesiscited by 1
- 2025PromptLoop: Plug-and-Play Prompt Refinement via Latent Feedback for Diffusion Model Alignmentcited by 0
- 2026Seeing is Believing: Aligning Prompt Rewriting with Visual Anchors for Text-to-Image Generationcited by 0
- 2026Panoptic Scene Program Diffusion Transformercited by 0
- 2026EvoGen-Harness: Learning Where and How to Evolve Image-Generation Harnessescited by 0
- 2026EvoGen-Harness: Learning Where and How to Evolve Image-Generation Harnesses30 Sep 2026
- 2026Panoptic Scene Program Diffusion Transformer24 Sep 2026
- 2026Seeing is Believing: Aligning Prompt Rewriting with Visual Anchors for Text-to-Image Generation7 Jun 2026
- 2026Cosmos 3: Omnimodal World Models for Physical AI1 Jun 2026
- 2026A Systematic Post-Train Framework for Video Generation28 Apr 2026
- 2026SOAR: Self-Correction for Optimal Alignment and Refinement in Diffusion Models14 Apr 2026
- 2026EruDiff: Refactoring Knowledge in Diffusion Models for Advanced Text-to-Image Synthesis21 Mar 2026
- 2026BrandFusion: A Multi-Agent Framework for Seamless Brand Integration in Text-to-Video Generation3 Mar 2026
- 2026MICON-Bench: Benchmarking and Enhancing Multi-Image Context Image Generation in Unified Multimodal Models23 Feb 2026
- 2026Flow caching for autoregressive video generation11 Feb 2026
- 2026M3: High-fidelity Text-to-Image Generation via Multi-Modal, Multi-Agent and Multi-Round Visual Reasoning5 Feb 2026
- 2026GenAgent: Scaling Text-to-Image Generation via Agentic Multimodal Reasoning26 Jan 2026
11 more
- 2026MiLDEdit: Reasoning-Based Multi-Layer Design Document Editing8 Jan 2026
- 2026Agentic Retoucher for Text-To-Image Generation5 Jan 2026
- 2025Expand and Prune: Maximizing Trajectory Diversity for Effective GRPO in Generative Models17 Dec 2025
- 2025RAPO++: Cross-Stage Prompt Optimization for Text-to-Video Generation via Data Alignment and Test-Time Scaling23 Oct 2025
- 2025POET: Preference Optimization for Enhanced Text-to-Image Generation14 Oct 2025
- 2025PromptLoop: Plug-and-Play Prompt Refinement via Latent Feedback for Diffusion Model Alignment1 Oct 2025
- 2025MILR: Improving Multimodal Image Generation via Test-Time Latent Reasoning26 Sep 2025
- 2025A Survey of Reinforcement Learning for Large Reasoning Models10 Sep 2025
- 2025PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewriting4 Sep 2025
- 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Survey2 Sep 2025
- 2025Reinforcement Learning for Large Model: A Survey11 Aug 2025
- 2026Agentic Retoucher for Text-To-Image Generationcited by 7
- 2026SOAR: Self-Correction for Optimal Alignment and Refinement in Diffusion Modelscited by 6
- 2026A Systematic Post-Train Framework for Video Generationcited by 5
- 2026EruDiff: Refactoring Knowledge in Diffusion Models for Advanced Text-to-Image Synthesiscited by 1
- 2025PromptLoop: Plug-and-Play Prompt Refinement via Latent Feedback for Diffusion Model Alignmentcited by 0
- 2026Panoptic Scene Program Diffusion Transformercited by 0
- 2026Panoptic Scene Program Diffusion Transformer24 Sep 2026
- 2026A Systematic Post-Train Framework for Video Generation28 Apr 2026
- 2026SOAR: Self-Correction for Optimal Alignment and Refinement in Diffusion Models14 Apr 2026
- 2026EruDiff: Refactoring Knowledge in Diffusion Models for Advanced Text-to-Image Synthesis21 Mar 2026
- 2026Agentic Retoucher for Text-To-Image Generation5 Jan 2026
- 2025PromptLoop: Plug-and-Play Prompt Refinement via Latent Feedback for Diffusion Model Alignment1 Oct 2025
- 2025A Survey of Reinforcement Learning for Large Reasoning Modelscited by 180
- 2025PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewritingcited by 43
- 2026GenAgent: Scaling Text-to-Image Generation via Agentic Multimodal Reasoningcited by 24
- 2025RAPO++: Cross-Stage Prompt Optimization for Text-to-Video Generation via Data Alignment and Test-Time Scalingcited by 10
- 2025Expand and Prune: Maximizing Trajectory Diversity for Effective GRPO in Generative Modelscited by 6
- 2026M3: High-fidelity Text-to-Image Generation via Multi-Modal, Multi-Agent and Multi-Round Visual Reasoningcited by 6
- 2026M3: High-fidelity Text-to-Image Generation via Multi-Modal, Multi-Agent and Multi-Round Visual Reasoning5 Feb 2026
- 2026GenAgent: Scaling Text-to-Image Generation via Agentic Multimodal Reasoning26 Jan 2026
- 2025Expand and Prune: Maximizing Trajectory Diversity for Effective GRPO in Generative Models17 Dec 2025
- 2025RAPO++: Cross-Stage Prompt Optimization for Text-to-Video Generation via Data Alignment and Test-Time Scaling23 Oct 2025
- 2025A Survey of Reinforcement Learning for Large Reasoning Models10 Sep 2025
- 2025PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewriting4 Sep 2025
- 2025Reinforcement Learning for Large Model: A Surveycited by 9
- 2025Reinforcement Learning for Large Model: A Survey11 Aug 2025
- 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 165
- 2026Cosmos 3: Omnimodal World Models for Physical AI1 Jun 2026
- 2026Flow caching for autoregressive video generationcited by 25
- 2025MILR: Improving Multimodal Image Generation via Test-Time Latent Reasoningcited by 8
- 2026MICON-Bench: Benchmarking and Enhancing Multi-Image Context Image Generation in Unified Multimodal Modelscited by 5
- 2025POET: Preference Optimization for Enhanced Text-to-Image Generationcited by 4
- 2026MiLDEdit: Reasoning-Based Multi-Layer Design Document Editingcited by 3
- 2026BrandFusion: A Multi-Agent Framework for Seamless Brand Integration in Text-to-Video Generationcited by 3
- 2026Seeing is Believing: Aligning Prompt Rewriting with Visual Anchors for Text-to-Image Generationcited by 0
- 2026EvoGen-Harness: Learning Where and How to Evolve Image-Generation Harnessescited by 0
- 2026EvoGen-Harness: Learning Where and How to Evolve Image-Generation Harnesses30 Sep 2026
- 2026Seeing is Believing: Aligning Prompt Rewriting with Visual Anchors for Text-to-Image Generation7 Jun 2026
- 2026BrandFusion: A Multi-Agent Framework for Seamless Brand Integration in Text-to-Video Generation3 Mar 2026
- 2026MICON-Bench: Benchmarking and Enhancing Multi-Image Context Image Generation in Unified Multimodal Models23 Feb 2026
- 2026Flow caching for autoregressive video generation11 Feb 2026
- 2026MiLDEdit: Reasoning-Based Multi-Layer Design Document Editing8 Jan 2026
- 2025POET: Preference Optimization for Enhanced Text-to-Image Generation14 Oct 2025
- 2025MILR: Improving Multimodal Image Generation via Test-Time Latent Reasoning26 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2025Self-Rewarding Large Vision-Language Models for Optimizing Prompts in Text-to-Image Generation
- 2022Optimizing Prompts for Text-to-Image Generation
- 2024Multimodal Large Language Model is a Human-Aligned Annotator for Text-to-Image Generation
- 2024Batch-Instructed Gradient for Prompt Evolution:Systematic Prompt Optimization for Enhanced Text-to-Image Synthesis
- 2026PRISM: Prompt Refinement via Image-grounded Self-rewarding Mechanism for Text-to-Image Generation
- 2025CRAFT: Continuous Reasoning and Agentic Feedback Tuning for Multimodal Text-to-Image Generation
- 2026PromptRL: Prompt Matters in RL for Flow-Based Image Generation
- 2025Test-time Prompt Refinement for Text-to-Image Models