mlsanityData to 14 Oct 2026

Does AI Save Time on Product Design? A Randomized Controlled Experiment of AI Prompt-to-Design Workflows

arXiv 2609.26725 ↗First posted 22 Sep 2026cs.HC cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

AI tools for digital product design now offer prompt-to-design capabilities, allowing designers and their non-designer colleagues to create prototypes through conversational workflows with large language models (LLMs). While these tools promise time savings, experimental evidence in product design remains limited compared with evidence from software engineering. We conducted a randomized controlled trial with 50 product designers and 50 product managers to evaluate prospective time savings from leveraging Figma Make in design work. Participants attempted three standardized design tasks with or without access to Figma Make. Among participants who completed the study tasks, access to Figma Make was associated with approximately 20% shorter completion times, with larger gains among product managers. Our findings suggest that prompt-to-design tools may enable product managers to further contribute to design work, while the benefits for professional designers may be task dependent.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 63 references that are in the map. First posted on arXiv 22 Sep 2026.

Builds on

20 of 63 references.

References · 20

  1. 2023The Impact of AI on Developer Productivity: Evidence from GitHub Copilotcited by 274
  2. 2025Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivitycited by 101
  3. 2023The Metacognitive Demands and Opportunities of Generative AIcited by 87
  4. 2024Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent Thinkingcited by 43
  5. 2024The Effects of Generative AI on Design Fixation and Divergent Thinkingcited by 37
  6. 2025Vibe Coding in Practice: Motivations, Challenges, and a Future Outlook -- a Grey Literature Reviewcited by 30
  7. 2025Vibe coding: programming through conversation with artificial intelligencecited by 29
  8. 2025Code with Me or for Me? How Increasing AI Automation Transforms Developer Workflowscited by 28
  9. 2024Ironies of Generative AI: Understanding and mitigating productivity loss in human-AI interactionscited by 20
  10. 2024How much does AI impact development speed? An enterprise-based randomized controlled trialcited by 20
  11. 2024Prototyping with Prompts: Emerging Approaches and Challenges in Generative AI Design for Collaborative Software Teamscited by 16
  12. 2025Good Vibrations? A Qualitative Study of Co-Creation, Communication, Flow, and Trust in Vibe Codingcited by 11
8 more
  1. 2024Canvil: Designerly Adaptation for LLM-Powered User Experiencescited by 9
  2. 2025The GenUI Study: Exploring the Design of Generative UI Tools to Support UX Practitioners and Beyondcited by 9
  3. 2023Generative AI for Product Design: Getting the Right Design and the Design Rightcited by 6
  4. 2025Beyond Automation: How UI/UX Designers Perceive AI as a Creative Partner in the Divergent Thinking Stagescited by 6
  5. 2025The Impact of LLM-Assistants on Software Developer Productivity: A Systematic Review and Mapping Studycited by 4
  6. 2025Vibe Coding in Product Teams: Reconfiguring AI-Assisted Workflows, Prototyping, and Collaborationcited by 4
  7. 2025The Fast and Spurious: Developer Productivity with GenAIcited by 3
  8. 2026The Values of Value in AI Adoption: Rethinking Efficiency in UX Designers' Workplacescited by 2

Built on by

Not cited yet.