PromptMap: An Alternative Interaction Style for AI-Based Image Generation
Not on the map. Why?
Abstract (arXiv)
Recent technological advances popularized the use of image generation among the general public. Crafting effective prompts can, however, be difficult for novice users. To tackle this challenge, we developed PromptMap, a new interaction style for text-to-image AI that allows users to freely explore a vast collection of synthetic prompts through a map-like view with semantic zoom. PromptMap groups images visually by their semantic similarity, allowing users to discover relevant examples. We evaluated PromptMap in a between-subject online study (n=60) and a qualitative within-subject study (n=12). We found that PromptMap supported users in crafting prompts by providing them with examples. We also demonstrated the feasibility of using LLMs to create vast example collections. Our work contributes a new interaction style that supports users unfamiliar with prompting in achieving a satisfactory image output.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 37 of its 67 references that are in the map. First posted on arXiv 12 Mar 2025.
Builds on
37 of 67 references.
References · 37
- 2023GPT-4 Technical Reportcited by 18,132
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
25 more
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2019How Can We Know What Language Models Know?cited by 953
- 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 376
- 2023Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and Discoverycited by 329
- 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Modelcited by 276
- 2023Text-to-image Diffusion Models in Generative AI: A Surveycited by 264
- 2021Design Guidelines for Prompt Engineering Text-to-Image Generative Modelscited by 216
- 2024Controllable Generation with Text-to-Image Diffusion Models: A Surveycited by 82
- 2023Promptify: Text-to-Image Generation through Interactive Prompt Exploration with Large Language Modelscited by 67
- 2024SynthCLIP: Are We Ready for a Fully Synthetic CLIP Training?cited by 64
- 2023Luminate: Structured Generation and Exploration of Design Space with Large Language Models for Human-AI Co-Creationcited by 63
- 2024PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinementcited by 61
- 2022Large-scale Text-to-Image Generation Models for Visual Artists' Creative Workscited by 60
- 2023PromptMagician: Interactive Prompt Engineering for Text-to-Image Creationcited by 58
- 2021Adversarial Text-to-Image Synthesis: A Reviewcited by 52
- 2023RePrompt: Automatic Prompt Editing to Refine AI-Generative Art Towards Precise Expressionscited by 43
- 20223DALL-E: Integrating Text-to-Image AI in 3D Design Workflowscited by 41
- 2022Opal: Multimodal Image Generation for News Illustrationcited by 36
- 2022Best Prompts for Text-to-Image Models and How to Find Themcited by 35
- 2023TWIGMA: A dataset of AI-Generated Images with Metadata From Twittercited by 19
- 2023BeautifulPrompt: Towards Automatic Prompt Engineering for Text-to-Image Synthesiscited by 15
- 2023What is in a Text-to-Image Prompt: The Potential of Stable Diffusion in Visual Arts Educationcited by 14
- 2023GenQuery: Supporting Expressive Visual Search with Generative Modelscited by 14
- 2023WorldSmith: Iterative and Expressive Prompting for World Building with a Generative AIcited by 13
- 2024Patterns of Creativity: How User Input Shapes AI-Generated Visual Diversitycited by 4
Built on by
Citing papers per year: 2025: 4; 2026: 4.
8 papers.
- 2025DeepVIS: Bridging Natural Language and Data Visualization Through Step-wise Reasoningcited by 8
- 2025POET: Supporting Prompting Creativity and Personalization with Automated Expansion of Text-to-Image Generationcited by 6
- 2025GenTune: Toward Traceable Prompts to Improve Controllability of Image Refinement in Environment Designcited by 5
- 2025ThematicPlane: Bridging Tacit User Intent and Latent Spaces for Image Generationcited by 2
- 2026SceneCraft: Interactive System for Image Editing via Scene Graphcited by 1
- 2026GimmBO: Interactive Generative Image Model Merging via Bayesian Optimizationcited by 0
- 2026Adaptive Prompt Elicitation for Text-to-Image Generationcited by 0
- 2026Multi-Object Advertisement Creative Generationcited by 0
- 2026SceneCraft: Interactive System for Image Editing via Scene Graph15 Jun 2026
- 2026Multi-Object Advertisement Creative Generation14 Mar 2026
- 2026Adaptive Prompt Elicitation for Text-to-Image Generation4 Feb 2026
- 2026GimmBO: Interactive Generative Image Model Merging via Bayesian Optimization26 Jan 2026
- 2025GenTune: Toward Traceable Prompts to Improve Controllability of Image Refinement in Environment Design21 Aug 2025
- 2025ThematicPlane: Bridging Tacit User Intent and Latent Spaces for Image Generation8 Aug 2025
- 2025DeepVIS: Bridging Natural Language and Data Visualization Through Step-wise Reasoning3 Aug 2025
- 2025POET: Supporting Prompting Creativity and Personalization with Automated Expansion of Text-to-Image Generation18 Apr 2025