PromptSculptor: Multi-Agent Based Text-to-Image Prompt Optimization
Not on the map. Why?
Abstract (arXiv)
The rapid advancement of generative AI has democratized access to powerful tools such as Text-to-Image models. However, to generate high-quality images, users must still craft detailed prompts specifying scene, style, and context-often through multiple rounds of refinement. We propose PromptSculptor, a novel multi-agent framework that automates this iterative prompt optimization process. Our system decomposes the task into four specialized agents that work collaboratively to transform a short, vague user prompt into a comprehensive, refined prompt. By leveraging Chain-of-Thought reasoning, our framework effectively infers hidden context and enriches scene and background details. To iteratively refine the prompt, a self-evaluation agent aligns the modified prompt with the original input, while a feedback-tuning agent incorporates user feedback for further refinement. Experimental results demonstrate that PromptSculptor significantly enhances output quality and reduces the number of iterations needed for user satisfaction. Moreover, its model-agnostic design allows seamless integration with various T2I models, paving the way for industrial applications.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 30 of its 59 references that are in the map. First posted on arXiv 15 Sep 2025.
Builds on
30 of 59 references.
References · 30
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
- 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 653
- 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 551
- 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesiscited by 388
- 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
- 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 287
18 more
- 2023Text-to-image Diffusion Models in Generative AI: A Surveycited by 265
- 2023LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Modelscited by 243
- 2023PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimizationcited by 233
- 2025FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Drivingcited by 166
- 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Stepcited by 131
- 2024Improving Text-to-Image Consistency via Automatic Prompt Optimizationcited by 90
- 2022Black-box Prompt Learning for Pre-trained Language Modelscited by 70
- 2023PromptMagician: Interactive Prompt Engineering for Text-to-Image Creationcited by 58
- 2023DreamSync: Aligning Text-to-Image Generation with Image Understanding Feedbackcited by 58
- 2022Toward Human Readable Prompt Tuning: Kubrick's The Shining is a good movie, and a good prompt too?cited by 49
- 2023If at First You Don't Succeed, Try, Try Again: Faithful Diffusion-based Text-to-Image Generation by Selectioncited by 40
- 2023Use Your INSTINCT: INSTruction optimization for LLMs usIng Neural bandits Coupled with Transformerscited by 30
- 2025Bridging the Editing Gap in LLMs: FineEdit for Precise and Targeted Text Modificationscited by 21
- 2025Selective KV-Cache Sharing to Mitigate Timing Side-Channels in LLM Inferencecited by 18
- 2022SLIC: Self-Supervised Learning with Iterative Clustering for Human Action Videoscited by 17
- 2024Revisiting OPRO: The Limitations of Small-Scale LLMs as Optimizerscited by 15
- 2025From LLM-anation to LLM-orchestrator: Coordinating Small Models for Data Labelingcited by 8
- 2025Learning Explainable Stock Predictions with Tweets Using Mixture of Expertscited by 3
Built on by
Citing papers per year: 2025: 5; 2026: 14.
19 papers.
Sort:
By area:
- 2025JanusVLN: Decoupling Semantics and Spatiality with Dual Implicit Memory for Vision-Language Navigationcited by 89
- 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Viewscited by 65
- 2025HUD: Hierarchical Uncertainty-Aware Disambiguation Network for Composed Video Retrievalcited by 32
- 2026Mind-Brush: Integrating Agentic Cognitive Search and Reasoning into Image Generationcited by 23
- 2026Think-Then-Generate: Reasoning-Aware Text-to-Image Diffusion with LLM Encoderscited by 15
- 2026SCOPE: Structured Decomposition and Conditional Skill Orchestration for Complex Image Generationcited by 7
- 2026RoboRouter: Training-Free Policy Routing for Robotic Manipulationcited by 6
- 2026AnimeAgent: Is the Multi-Agent via Image-to-Video models a Good Disney Storytelling Artist?cited by 5
- 2026GenRouter: Unified Workflow Routing for Agentic Image Generationcited by 5
- 2025HyperEdit: Unlocking Instruction-based Text Editing in LLMs via Hypernetworkscited by 4
- 2026BrandFusion: A Multi-Agent Framework for Seamless Brand Integration in Text-to-Video Generationcited by 3
- 2026MUSE: Resolving Manifold Misalignment in Visual Tokenization via Topological Orthogonalitycited by 3
7 more
- 2026SIDiffAgent: Self-Improving Diffusion Agentcited by 1
- 2026PRISM: Prompt Refinement via Image-grounded Self-rewarding Mechanism for Text-to-Image Generationcited by 1
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 1
- 2025One Tool Is Enough: Reinforcement Learning for Repository-Level LLM Agentscited by 0
- 2026Position: Vector Prompt Interfaces Should Be Exposed to Enable Customization of Large Language Modelscited by 0
- 2026P-Flow: Prompting Visual Effects Generationcited by 0
- 2026Semantic Browsing: Controllable Diversity for Image Generationcited by 0
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026GenRouter: Unified Workflow Routing for Agentic Image Generation17 Aug 2026
- 2026PRISM: Prompt Refinement via Image-grounded Self-rewarding Mechanism for Text-to-Image Generation27 Jul 2026
- 2026Semantic Browsing: Controllable Diversity for Image Generation22 Jun 2026
- 2026SCOPE: Structured Decomposition and Conditional Skill Orchestration for Complex Image Generation8 May 2026
- 2026MUSE: Resolving Manifold Misalignment in Visual Tokenization via Topological Orthogonality7 May 2026
- 2026P-Flow: Prompting Visual Effects Generation23 Mar 2026
- 2026RoboRouter: Training-Free Policy Routing for Robotic Manipulation9 Mar 2026
- 2026Position: Vector Prompt Interfaces Should Be Exposed to Enable Customization of Large Language Models4 Mar 2026
- 2026BrandFusion: A Multi-Agent Framework for Seamless Brand Integration in Text-to-Video Generation3 Mar 2026
- 2026AnimeAgent: Is the Multi-Agent via Image-to-Video models a Good Disney Storytelling Artist?24 Feb 2026
- 2026SIDiffAgent: Self-Improving Diffusion Agent2 Feb 2026
7 more
- 2026Mind-Brush: Integrating Agentic Cognitive Search and Reasoning into Image Generation2 Feb 2026
- 2026Think-Then-Generate: Reasoning-Aware Text-to-Image Diffusion with LLM Encoders15 Jan 2026
- 2025One Tool Is Enough: Reinforcement Learning for Repository-Level LLM Agents24 Dec 2025
- 2025HyperEdit: Unlocking Instruction-based Text Editing in LLMs via Hypernetworks14 Dec 2025
- 2025HUD: Hierarchical Uncertainty-Aware Disambiguation Network for Composed Video Retrieval2 Dec 2025
- 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views21 Oct 2025
- 2025JanusVLN: Decoupling Semantics and Spatiality with Dual Implicit Memory for Vision-Language Navigation26 Sep 2025
- 2026Mind-Brush: Integrating Agentic Cognitive Search and Reasoning into Image Generationcited by 23
- 2026GenRouter: Unified Workflow Routing for Agentic Image Generationcited by 5
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 1
- 2025One Tool Is Enough: Reinforcement Learning for Repository-Level LLM Agentscited by 0
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026GenRouter: Unified Workflow Routing for Agentic Image Generation17 Aug 2026
- 2026Mind-Brush: Integrating Agentic Cognitive Search and Reasoning into Image Generation2 Feb 2026
- 2025One Tool Is Enough: Reinforcement Learning for Repository-Level LLM Agents24 Dec 2025
- 2026SIDiffAgent: Self-Improving Diffusion Agentcited by 1
- 2026SIDiffAgent: Self-Improving Diffusion Agent2 Feb 2026
- 2025JanusVLN: Decoupling Semantics and Spatiality with Dual Implicit Memory for Vision-Language Navigationcited by 89
- 2025HUD: Hierarchical Uncertainty-Aware Disambiguation Network for Composed Video Retrievalcited by 32
- 2026SCOPE: Structured Decomposition and Conditional Skill Orchestration for Complex Image Generationcited by 7
- 2026AnimeAgent: Is the Multi-Agent via Image-to-Video models a Good Disney Storytelling Artist?cited by 5
- 2025HyperEdit: Unlocking Instruction-based Text Editing in LLMs via Hypernetworkscited by 4
- 2026BrandFusion: A Multi-Agent Framework for Seamless Brand Integration in Text-to-Video Generationcited by 3
- 2026MUSE: Resolving Manifold Misalignment in Visual Tokenization via Topological Orthogonalitycited by 3
- 2026Position: Vector Prompt Interfaces Should Be Exposed to Enable Customization of Large Language Modelscited by 0
- 2026P-Flow: Prompting Visual Effects Generationcited by 0
- 2026Semantic Browsing: Controllable Diversity for Image Generationcited by 0
- 2026Semantic Browsing: Controllable Diversity for Image Generation22 Jun 2026
- 2026SCOPE: Structured Decomposition and Conditional Skill Orchestration for Complex Image Generation8 May 2026
- 2026MUSE: Resolving Manifold Misalignment in Visual Tokenization via Topological Orthogonality7 May 2026
- 2026P-Flow: Prompting Visual Effects Generation23 Mar 2026
- 2026Position: Vector Prompt Interfaces Should Be Exposed to Enable Customization of Large Language Models4 Mar 2026
- 2026BrandFusion: A Multi-Agent Framework for Seamless Brand Integration in Text-to-Video Generation3 Mar 2026
- 2026AnimeAgent: Is the Multi-Agent via Image-to-Video models a Good Disney Storytelling Artist?24 Feb 2026
- 2025HyperEdit: Unlocking Instruction-based Text Editing in LLMs via Hypernetworks14 Dec 2025
- 2025HUD: Hierarchical Uncertainty-Aware Disambiguation Network for Composed Video Retrieval2 Dec 2025
- 2025JanusVLN: Decoupling Semantics and Spatiality with Dual Implicit Memory for Vision-Language Navigation26 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2024Batch-Instructed Gradient for Prompt Evolution:Systematic Prompt Optimization for Enhanced Text-to-Image Synthesis
- 2025T2I-Copilot: A Training-Free Multi-Agent Text-to-Image System for Enhanced Prompt Interpretation and Interactive Generation
- 2025GenPilot: A Multi-Agent System for Test-Time Prompt Optimization in Image Generation
- 2024PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinement
- 2025Maestro: Self-Improving Text-to-Image Generation via Agent Orchestration
- 2025PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewriting
- 2022Optimizing Prompts for Text-to-Image Generation
- 2026APE: Agentic Prompt Enhancer for Image Generation and Editing