mlsanityData to 14 Oct 2026

DesignWeaver: Dimensional Scaffolding for Text-to-Image Product Design

arXiv 2502.09867 ↗First posted 14 Feb 2025cs.HC cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

Generative AI has enabled novice designers to quickly create professional-looking visual representations for product concepts. However, novices have limited domain knowledge that could constrain their ability to write prompts that effectively explore a product design space. To understand how experts explore and communicate about design spaces, we conducted a formative study with 12 experienced product designers and found that experts -- and their less-versed clients -- often use visual references to guide co-design discussions rather than written descriptions. These insights inspired DesignWeaver, an interface that helps novices generate prompts for a text-to-image model by surfacing key product design dimensions from generated images into a palette for quick selection. In a study with 52 novices, DesignWeaver enabled participants to craft longer prompts with more domain-specific vocabularies, resulting in more diverse, innovative product designs. However, the nuanced prompts heightened participants' expectations beyond what current text-to-image models could deliver. We discuss implications for AI-based product design support tools.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 50 of its 122 references that are in the map. First posted on arXiv 14 Feb 2025.

Builds on

50 of 122 references.

References · 50

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  7. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  9. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  10. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  11. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  12. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
38 more
  1. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
  2. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  3. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
  4. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  5. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
  6. 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 648
  7. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
  8. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
  9. 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
  10. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
  11. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  12. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
  13. 2021AI Chains: Transparent and Controllable Human-AI Interaction by Chaining Large Language Model Promptscited by 268
  14. 2023Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifoldcited by 219
  15. 2022PromptChainer: Chaining Large Language Model Prompts through Visual Programmingcited by 134
  16. 2023Bridging the Gulf of Envisioning: Cognitive Design Challenges in LLM Interfacescited by 72
  17. 2023Promptify: Text-to-Image Generation through Interactive Prompt Exploration with Large Language Modelscited by 67
  18. 2023Graphologue: Exploring Large Language Model Responses with Interactive Diagramscited by 66
  19. 2023Luminate: Structured Generation and Exploration of Design Space with Large Language Models for Human-AI Co-Creationcited by 64
  20. 2023Rehearsal: Simulating Conflict to Teach Conflict Resolutioncited by 55
  21. 2024Shaping Human-AI Collaboration: Varied Scaffolding Levels in Co-writing with Language Modelscited by 51
  22. 2023"What It Wants Me To Say": Bridging the Abstraction Gap Between End-User Programmers and Code-Generating Large Language Modelscited by 48
  23. 20223DALL-E: Integrating Text-to-Image AI in 3D Design Workflowscited by 41
  24. 2024DynaVis: Dynamically Synthesized UI Widgets for Visualization Editingcited by 37
  25. 2022Opal: Multimodal Image Generation for News Illustrationcited by 36
  26. 2023PromptPaint: Steering Text-to-Image Generation Through Paint Medium-like Interactionscited by 34
  27. 2023CreativeConnect: Supporting Reference Recombination for Graphic Design Ideation with Generative AIcited by 34
  28. 2024Understanding Nonlinear Collaboration between Human and AI Agents: A Co-design Framework for Creative Designcited by 22
  29. 2023Generative Disco: Text-to-Video Generation for Music Visualizationcited by 19
  30. 2023GenQuery: Supporting Expressive Visual Search with Generative Modelscited by 14
  31. 2025Inkspire: Supporting Design Exploration with Generative AI through Analogical Sketchingcited by 13
  32. 2023Jigsaw: Supporting Designers to Prototype Multimodal Applications by Chaining AI Foundation Modelscited by 11
  33. 2024Block and Detail: Scaffolding Sketch-to-Image Generationcited by 9
  34. 2024MemoVis: A GenAI-Powered Tool for Creating Companion Reference Images for 3D Design Feedbackcited by 7
  35. 2024Prompting for products: Investigating design space exploration strategies for text-to-image generative modelscited by 6
  36. 2023BioSpark: An End-to-End Generative System for Biological-Analogical Inspirations and Ideationcited by 4
  37. 2024CAD-Prompted Generative Models: A Pathway to Feasible and Novel Engineering Designscited by 3
  38. 2024Charting EDA: Characterizing Interactive Visualization Use in Computational Notebooks with a Mixed-Methods Formalismcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 4.

6 papers.

  1. 2025Vibe Coding in Product Teams: Reconfiguring AI-Assisted Workflows, Prototyping, and Collaborationcited by 4
  2. 2025Exploration vs. Fixation: Scaffolding Divergent and Convergent Thinking for Human-AI Co-Creation with Generative Modelscited by 2
  3. 2026Personagram: Bridging Personas and Product Design for Creative Ideation with Multimodal LLMscited by 0
  4. 2026Design Generative AI for Practitioners: Exploring Interaction Approaches Aligned with Creative Practicecited by 0
  5. 2026Brief2Design: A Multi-phased, Compositional Approach to Prompt-based Graphic Designcited by 0
  6. 2026Design Theater: Evaluating the Gap Between User-Facing Design Reasoning and Implementation in Generative UI Toolscited by 0