"She was useful, but a bit too optimistic": Augmenting Design with Interactive Virtual Personas
Not on the map. Why?
Abstract (arXiv)
Personas have been widely used to understand and communicate user needs in human-centred design. Despite their utility, they may fail to meet the demands of iterative workflows due to their static nature, limited engagement, and inability to adapt to evolving design needs. Recent advances in large language models (LLMs) pave the way for more engaging and adaptive approaches to user representation. This paper introduces Interactive Virtual Personas (IVPs): multimodal, LLM-driven, conversational user simulations that designers can interview, brainstorm with, and gather feedback from in real time via voice interface. We conducted a qualitative study with eight professional UX designers, employing an IVP named "Alice" across three design activities: user research, ideation, and prototype evaluation. Our findings demonstrate the potential of IVPs to expedite information gathering, inspire design solutions, and provide rapid user-like feedback. However, designers raised concerns about biases, over-optimism, the challenge of ensuring authenticity without real stakeholder input, and the inability of the IVP to fully replicate the nuances of human interaction. Our participants emphasised that IVPs should be viewed as a complement to, not a replacement for, real user engagement. We discuss strategies for prompt engineering, human-in-the-loop integration, and ethical considerations for effective and responsible IVP use in design. Finally, our work contributes to the growing body of research on generative AI in the design process by providing insights into UX designers' experiences of LLM-powered interactive personas.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 105 references that are in the map. First posted on arXiv 26 Aug 2025.
Builds on
27 of 105 references.
References · 27
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2018Model Cards for Model Reportingcited by 1,068
- 2023Towards Understanding Sycophancy in Language Modelscited by 988
- 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 506
- 2020Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditingcited by 380
- 2023PersonaLLM: Investigating the Ability of Large Language Models to Express Personality Traitscited by 229
- 2023Marked Personas: Using Natural Language Prompts to Measure Stereotypes in Language Modelscited by 204
- 2023Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMscited by 191
- 2021Process for Adapting Language Models to Society (PALMS) with Values-Targeted Datasetscited by 179
- 2023Simple synthetic data reduces sycophancy in large language modelscited by 174
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 162
- 2023Should ChatGPT be Biased? Challenges and Risks of Bias in Large Language Modelscited by 144
15 more
- 2023CoMPosT: Characterizing and Evaluating Caricature in LLM Simulationscited by 94
- 2021Towards a Science of Human-AI Decision Making: A Survey of Empirical Studiescited by 85
- 2023Appropriate Reliance on AI Advice: Conceptualization and the Effect of Explanationscited by 80
- 2024Bias in Large Language Models: Origin, Evaluation, and Mitigationcited by 77
- 2024Design Principles for Generative AI Applicationscited by 57
- 2024Proxona: Supporting Creators' Sensemaking and Ideation with LLM-Powered Audience Personascited by 19
- 2023User Experience Design Professionals' Perceptions of Generative Artificial Intelligencecited by 16
- 2025AIdeation: Designing a Human-AI Collaborative Ideation System for Concept Designerscited by 14
- 2022Exploring The Design of Prompts For Applying GPT-3 based Chatbots: A Mental Wellbeing Case Study on Mechanical Turkcited by 13
- 2023Towards Designing a ChatGPT Conversational Companion for Elderly Peoplecited by 13
- 2024Chaos with Keywords: Exposing Large Language Models Sycophantic Hallucination to Misleading Keywords and Evaluating Defense Strategiescited by 10
- 2023Conversational AI-Powered Design: ChatGPT as Designer, User, and Productcited by 8
- 2023Can AI Serve as a Substitute for Human Subjects in Software Engineering Research?cited by 8
- 2023Writing user personas with Large Language Models: Testing phase 6 of a Thematic Analysis of semi-structured interviewscited by 7
- 2023Generative AI for Product Design: Getting the Right Design and the Design Rightcited by 6
Built on by
Not cited yet.