mlsanityData to 7 Oct 2026

Promptify: Text-to-Image Generation through Interactive Prompt Exploration with Large Language Models

arXiv 2304.09337 ↗First posted 18 Apr 2023cs.HC cs.AI cs.MMcited by 67

Not on the map. Why?

Abstract (arXiv)

Text-to-image generative models have demonstrated remarkable capabilities in generating high-quality images based on textual prompts. However, crafting prompts that accurately capture the user's creative intent remains challenging. It often involves laborious trial-and-error procedures to ensure that the model interprets the prompts in alignment with the user's intention. To address the challenges, we present Promptify, an interactive system that supports prompt exploration and refinement for text-to-image generative models. Promptify utilizes a suggestion engine powered by large language models to help users quickly explore and craft diverse prompts. Our interface allows users to organize the generated images flexibly, and based on their preferences, Promptify suggests potential changes to the original prompt. This feedback loop enables users to iteratively refine their prompts and enhance desired features while avoiding unwanted ones. Our user study shows that Promptify effectively facilitates the text-to-image workflow and outperforms an existing baseline tool widely used for text-to-image generation.

Key facts. Cited by 67 papers in the map (data through 7 Oct 2026). Builds on 29 of its 60 references that are in the map. First posted on arXiv 18 Apr 2023.

Builds on

29 of 60 references.

References · 29

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  6. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  8. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  9. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  10. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  11. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
  12. 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,371
17 more
  1. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
  2. 2016Generative Adversarial Text to Image Synthesiscited by 735
  3. 2016StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 575
  4. 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 376
  5. 2023Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and Discoverycited by 329
  6. 2021Design Guidelines for Prompt Engineering Text-to-Image Generative Modelscited by 216
  7. 2015Generating Images from Captions with Attentioncited by 135
  8. 2016Learning What and Where to Drawcited by 105
  9. 2022Large-scale Text-to-Image Generation Models for Visual Artists' Creative Workscited by 60
  10. 2022Investigating Prompt Engineering in Diffusion Modelscited by 58
  11. 2022A Taxonomy of Prompt Modifiers for Text-To-Image Generationcited by 54
  12. 2023RePrompt: Automatic Prompt Editing to Refine AI-Generative Art Towards Precise Expressionscited by 43
  13. 20223DALL-E: Integrating Text-to-Image AI in 3D Design Workflowscited by 41
  14. 2022Opal: Multimodal Image Generation for News Illustrationcited by 36
  15. 2018An intuitive control space for material appearancecited by 10
  16. 2022GANzilla: User-Driven Direction Discovery in Generative Adversarial Networkscited by 7
  17. 2023GANravel: User-Driven Direction Disentanglement in Generative Adversarial Networkscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 5; 2024: 16; 2025: 27; 2026: 19.

67 papers.

Sort:

By area:

  1. 2023ChainForge: A Visual Toolkit for Prompt Engineering and LLM Hypothesis Testingcited by 88
  2. 2024PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinementcited by 61
  3. 2025Algorithm Discovery With LLMs: Evolutionary Search Meets Reinforcement Learningcited by 39
  4. 2023ConstitutionMaker: Interactively Critiquing Large Language Models by Converting Feedback into Principlescited by 33
  5. 2024MagicQuill: An Intelligent Interactive Image Editing Systemcited by 30
  6. 2024Language-Driven Interactive Traffic Trajectory Generationcited by 19
  7. 2025ImAgent: A Unified Multimodal Agent Framework for Test-Time Scalable Image Generationcited by 14
  8. 2025Inkspire: Supporting Design Exploration with Generative AI through Analogical Sketchingcited by 13
  9. 2024Chaining text-to-image and large language model: A novel approach for generating personalized e-commerce bannerscited by 11
  10. 2024Human-Guided Image Generation for Expanding Small-Scale Training Image Datasetscited by 10
  11. 2024PromptHive: Bringing Subject Matter Experts Back to the Forefront with Collaborative Prompt Engineering for Educational Content Creationcited by 9
  12. 2024Noise Diffusion for Enhancing Semantic Faithfulness in Text-to-Image Synthesiscited by 9
38 more
  1. 2025From Conversation to Orchestration: HCI Challenges and Opportunities in Interactive Multi-Agentic Systemscited by 9
  2. 2024Preference Adaptive and Sequential Text-to-Image Generationcited by 8
  3. 2025AI-Instruments: Embodying Prompts as Instruments to Abstract & Reflect Graphical Interface Commands as General-Purpose Toolscited by 8
  4. 2025PromptMap: An Alternative Interaction Style for AI-Based Image Generationcited by 8
  5. 2025CoBRA: Programming Cognitive Bias in Social Agents Using Classic Social Science Experimentscited by 8
  6. 2024JailbreakLens: Visual Analysis of Jailbreak Attacks Against Large Language Modelscited by 7
  7. 2024Exploring Empty Spaces: Human-in-the-Loop Data Augmentationcited by 6
  8. 2025SketchFlex: Facilitating Spatial-Semantic Coherence in Text-to-Image Generation with Region-Based Sketchescited by 6
  9. 2025DesignWeaver: Dimensional Scaffolding for Text-to-Image Product Designcited by 6
  10. 2025Intent Tagging: Exploring Micro-Prompting Interactions for Supporting Granular Human-GenAI Co-Creation Workflowscited by 6
  11. 2025POET: Supporting Prompting Creativity and Personalization with Automated Expansion of Text-to-Image Generationcited by 6
  12. 2025VisualPrompter: Semantic-Aware Prompt Optimization with Visual Feedback for Text-to-Image Synthesiscited by 6
  13. 2024Capability-aware Prompt Reformulation Learning for Text-to-Image Generationcited by 5
  14. 2025Improved IR-based Bug Localization with Intelligent Relevance Feedbackcited by 5
  15. 2025GenTune: Toward Traceable Prompts to Improve Controllability of Image Refinement in Environment Designcited by 5
  16. 2023Visual Analytics for Efficient Image Exploration and User-Guided Image Captioningcited by 4
  17. 2025Reusing Computation in Text-to-Image Diffusion for Efficient Generation of Image Setscited by 4
  18. 2024FathomGPT: A Natural Language Interface for Interactively Exploring Ocean Science Datacited by 3
  19. 2025Zero-Shot Subject-Centric Generation for Creative Application Using Entropy Fusioncited by 3
  20. 2025MapStory: Prototyping Editable Map Animations with LLM Agentscited by 3
  21. 2025POET: Preference Optimization for Enhanced Text-to-Image Generationcited by 3
  22. 2023InstructPipe: Generating Visual Blocks Pipelines with Human Instructions and LLMscited by 2
  23. 2024CUPID: Contextual Understanding of Prompt-conditioned Image Distributionscited by 2
  24. 2024Automatic Scene Generation: State-of-the-Art Techniques, Models, Datasets, Challenges, and Future Prospectscited by 2
  25. 2025StoryEnsemble: Enabling Dynamic Exploration & Iteration in the Design Process with AI and Forward-Backward Propagationcited by 2
  26. 2026Agentic Pipelines in Embedded Software Engineering: Emerging Practices and Challengescited by 2
  27. 2026Vidmento: Creating Video Stories Through Context-Aware Expansion With Generative Videocited by 2
  28. 2026Say It My Way: Exploring Control in Conversational Visual Question Answering with Blind Userscited by 2
  29. 2024Helpful or Harmful? Exploring the Efficacy of Large Language Models for Online Grooming Preventioncited by 1
  30. 2024POEM: Interactive Prompt Optimization for Enhancing Multimodal Reasoning of Large Language Modelscited by 1
  31. 2025A Review on Large Language Models for Visual Analyticscited by 1
  32. 2025Understanding Prompt Programming Tasks and Questionscited by 1
  33. 2025Structured Information for Improving Spatial Relationships in Text-to-Image Generationcited by 1
  34. 2026Bridging Gulfs in UI Generation through Semantic Guidancecited by 1
  35. 2026ScribbleSense: Generative Scribble-Based Texture Editing with Intent Predictioncited by 1
  36. 2026Beyond Text Prompts: Precise Concept Erasure through Text-Image Collaborationcited by 1
  37. 2026Efficient Multi-objective Prompt Optimization via Pure-exploration Banditscited by 1
  38. 2026EPIG: Emotion-Based Prompting for Personalised Image Generationcited by 1

50 most cited of 67 All 67 (JSON)