Conversational AI-Powered Design: ChatGPT as Designer, User, and Product
Not on the map. Why?
Abstract (arXiv)
The recent advancements in Large Language Models (LLMs), particularly conversational LLMs like ChatGPT, have prompted changes in a range of fields, including design. This study aims to examine the capabilities of ChatGPT in a human-centered design process. To this end, a hypothetical design project was conducted, where ChatGPT was utilized to generate personas, simulate interviews with fictional users, create new design ideas, simulate usage scenarios and conversations between an imaginary prototype and fictional users, and lastly evaluate user experience. The results show that ChatGPT effectively performed the tasks assigned to it as a designer, user, or product, providing mostly appropriate responses. The study does, however, highlight some drawbacks such as forgotten information, partial responses, and a lack of output diversity. The paper explains the potential benefits and limitations of using conversational LLMs in design, discusses its implications, and suggests directions for future research in this rapidly evolving area.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 19 of its 38 references that are in the map. First posted on arXiv 15 Feb 2023.
Builds on
19 of 38 references.
References · 19
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
- 2022Large Language Models Struggle to Learn Long-Tail Knowledgecited by 452
- 2022News Summarization and Evaluation in the Era of GPT-3cited by 324
- 2021AI Chains: Transparent and Controllable Human-AI Interaction by Chaining Large Language Model Promptscited by 265
- 2021Attention Mechanisms in Computer Vision: A Surveycited by 232
7 more
- 2022Large Language Models with Controllable Working Memorycited by 169
- 2017Ethical Challenges in Data-Driven Dialogue Systemscited by 86
- 2021Medically Aware GPT-3 as a Data Generator for Medical Dialogue Summarizationcited by 76
- 2021The future of human-AI collaboration: a taxonomy of design knowledge for hybrid intelligence systemscited by 39
- 2022"I think this is the most disruptive technology": Exploring Sentiments of ChatGPT Early Adopters using Twitter Datacited by 32
- 2022UX Research on Conversational Human-AI Interaction: A Literature Review of the ACM Digital Librarycited by 20
- 2022Exploring The Design of Prompts For Applying GPT-3 based Chatbots: A Mental Wellbeing Case Study on Mechanical Turkcited by 13
Built on by
Citing papers per year: 2023: 5; 2024: 1; 2025: 2.
8 papers.
- 2024CloChat: Understanding How People Customize, Interact, and Experience Personas in Large Language Modelscited by 19
- 2023Evaluating Task-oriented Dialogue Systems: A Systematic Review of Measures, Constructs and their Operationalisationscited by 9
- 2023Writing user personas with Large Language Models: Testing phase 6 of a Thematic Analysis of semi-structured interviewscited by 7
- 2023Humans are Still Better than ChatGPT: Case of the IEEEXtreme Competitioncited by 5
- 2023IMAD: IMage-Augmented multi-modal Dialoguecited by 4
- 2025Using AI for User Representation: An Analysis of 83 Persona Promptscited by 4
- 2023CHAI-DT: A Framework for Prompting Conversational Generative AI Agents to Actively Participate in Co-Creationcited by 0
- 2025"She was useful, but a bit too optimistic": Augmenting Design with Interactive Virtual Personascited by 0
- 2025"She was useful, but a bit too optimistic": Augmenting Design with Interactive Virtual Personas26 Aug 2025
- 2025Using AI for User Representation: An Analysis of 83 Persona Prompts18 Aug 2025
- 2024CloChat: Understanding How People Customize, Interact, and Experience Personas in Large Language Models23 Feb 2024
- 2023Evaluating Task-oriented Dialogue Systems: A Systematic Review of Measures, Constructs and their Operationalisations21 Dec 2023
- 2023Writing user personas with Large Language Models: Testing phase 6 of a Thematic Analysis of semi-structured interviews29 May 2023
- 2023IMAD: IMage-Augmented multi-modal Dialogue17 May 2023
- 2023Humans are Still Better than ChatGPT: Case of the IEEEXtreme Competition10 May 2023
- 2023CHAI-DT: A Framework for Prompting Conversational Generative AI Agents to Actively Participate in Co-Creation5 May 2023