PersonaFlow: Designing LLM-Simulated Expert Perspectives for Enhanced Research Ideation
Not on the map. Why?
Abstract (arXiv)
Generating interdisciplinary research ideas requires diverse domain expertise, but access to timely feedback is often limited by the availability of experts. In this paper, we introduce PersonaFlow, a novel system designed to provide multiple perspectives by using LLMs to simulate domain-specific experts. Our user studies showed that the new design 1) increased the perceived relevance and creativity of ideated research directions, and 2) promoted users' critical thinking activities (e.g., interpretation, analysis, evaluation, inference, and self-regulation), without increasing their perceived cognitive load. Moreover, users' ability to customize expert profiles significantly improved their sense of agency, which can potentially mitigate their over-reliance on AI. This work contributes to the design of intelligent systems that augment creativity and collaboration, and provides design implications of using customizable AI-simulated personas in domains within and beyond research ideation.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 28 of its 123 references that are in the map. First posted on arXiv 19 Sep 2024.
Builds on
28 of 123 references.
References · 28
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
- 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
- 2023ChatDev: Communicative Agents for Software Developmentcited by 919
- 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debatecited by 742
- 2022Social Simulacra: Creating Populated Prototypes for Social Computing Systemscited by 301
- 2023Can Large Language Models Transform Computational Social Science?cited by 250
- 2023SciMON: Scientific Inspiration Machines Optimized for Noveltycited by 179
- 2023EconAgent: Large Language Model-Empowered Agents for Simulating Macroeconomic Activitiescited by 154
- 2023ExpertPrompting: Instructing Large Language Models to be Distinguished Expertscited by 142
- 2023The Semantic Scholar Open Data Platformcited by 118
16 more
- 2023Large Language Models are Diverse Role-Players for Summarization Evaluationcited by 62
- 2020Deciding Fast and Slow: The Role of Cognitive Biases in AI-assisted Decision-makingcited by 59
- 2024Shaping Human-AI Collaboration: Varied Scaffolding Levels in Co-writing with Language Modelscited by 51
- 2024AI-Augmented Brainwriting: Investigating the use of LLMs in group ideationcited by 44
- 2023Writer-Defined AI Personas for On-Demand Feedback Generationcited by 36
- 2023CoQuest: Exploring Research Question Co-Creation with an LLM-based Agentcited by 34
- 2023ConvXAI: Delivering Heterogeneous AI Explanations via Conversations to Support Human-AI Scientific Writingcited by 31
- 2023Clinfo.ai: An Open-Source Retrieval-Augmented Large Language Model System for Answering Medical Questions using Scientific Literaturecited by 29
- 2024Supporting Self-Reflection at Scale with Large Language Models: Insights from Randomized Field Experiments in Classroomscited by 20
- 2024CloChat: Understanding How People Customize, Interact, and Experience Personas in Large Language Modelscited by 19
- 2023User Experience Design Professionals' Perceptions of Generative Artificial Intelligencecited by 16
- 2024Know Your Audience: The benefits and pitfalls of generating plain language summaries beyond the "general" audiencecited by 13
- 2021Nine Potential Pitfalls when Designing Human-AI Co-Creative Systemscited by 12
- 2024Exploring the Impact of AI Value Alignment in Collaborative Ideation: Effects on Perception, Ownership, and Outputcited by 12
- 2024DiscipLink: Unfolding Interdisciplinary Information Seeking Process via Human-AI Co-Explorationcited by 10
- 2024Randomness Is All You Need: Semantic Traversal of Problem-Solution Spaces with Large Language Modelscited by 3
Built on by
Citing papers per year: 2025: 7; 2026: 9.
16 papers.
Sort:
By area:
- 2025UXAgent: A System for Simulating Usability Testing of Web Design with LLM Agentscited by 10
- 2025Boosting Relational Deep Learning with Pretrained Tabular Modelscited by 9
- 2025ScholarMate: A Mixed-Initiative Tool for Qualitative Knowledge Work and Information Sensemakingcited by 7
- 2025Do Persona-Infused LLMs Affect Performance in a Strategic Reasoning Game?cited by 4
- 2026Models Recall What They Violate: Constraint Adherence in Multi-Turn LLM Ideationcited by 3
- 2025Words as Bridges: Exploring Computational Support for Cross-Disciplinary Translation Workcited by 2
- 2026Agent-Supported Foresight for AI Systemic Risks: AI Agents for Breadth, Experts for Judgmentcited by 2
- 2026Style Wins, Substance Loses: A Diagnosis of LLM-as-Judge in Idea Generationcited by 2
- 2025IDRBench: Understanding the Capability of Large Language Models on Interdisciplinary Researchcited by 1
- 2026StreetDesignAI: Broadening Designer Perspectives Through Multi-Persona Evaluation of Cycling Infrastructurecited by 1
- 2026How to Model AI Agents as Personas?: Applying the Persona Ecosystem Playground to 41,300 Posts on Moltbook for Behavioral Insightscited by 1
- 2026Beyond the Desk: Barriers and Future Opportunities for AI to Assist Scientists in Embodied Physical Taskscited by 1
4 more
- 2025Componentization: Decomposing Monolithic LLM Responses into Manipulable Semantic Unitscited by 0
- 2026Progressive Ideation using an Agentic AI Framework for Human-AI Co-Creationcited by 0
- 2026Personagram: Bridging Personas and Product Design for Creative Ideation with Multimodal LLMscited by 0
- 2026DocuTeam: Mixed-Initiative Multi-Agent Discussions around Evolving Documentscited by 0
- 2026DocuTeam: Mixed-Initiative Multi-Agent Discussions around Evolving Documents24 Sep 2026
- 2026Style Wins, Substance Loses: A Diagnosis of LLM-as-Judge in Idea Generation3 Aug 2026
- 2026Models Recall What They Violate: Constraint Adherence in Multi-Turn LLM Ideation30 Apr 2026
- 2026Beyond the Desk: Barriers and Future Opportunities for AI to Assist Scientists in Embodied Physical Tasks19 Mar 2026
- 2026How to Model AI Agents as Personas?: Applying the Persona Ecosystem Playground to 41,300 Posts on Moltbook for Behavioral Insights3 Mar 2026
- 2026Agent-Supported Foresight for AI Systemic Risks: AI Agents for Breadth, Experts for Judgment9 Feb 2026
- 2026Personagram: Bridging Personas and Product Design for Creative Ideation with Multimodal LLMs5 Feb 2026
- 2026StreetDesignAI: Broadening Designer Perspectives Through Multi-Persona Evaluation of Cycling Infrastructure22 Jan 2026
- 2026Progressive Ideation using an Agentic AI Framework for Human-AI Co-Creation1 Jan 2026
- 2025Do Persona-Infused LLMs Affect Performance in a Strategic Reasoning Game?7 Dec 2025
- 2025Componentization: Decomposing Monolithic LLM Responses into Manipulable Semantic Units10 Sep 2025
- 2025IDRBench: Understanding the Capability of Large Language Models on Interdisciplinary Research21 Jul 2025
4 more
- 2025ScholarMate: A Mixed-Initiative Tool for Qualitative Knowledge Work and Information Sensemaking19 Apr 2025
- 2025UXAgent: A System for Simulating Usability Testing of Web Design with LLM Agents13 Apr 2025
- 2025Boosting Relational Deep Learning with Pretrained Tabular Models7 Apr 2025
- 2025Words as Bridges: Exploring Computational Support for Cross-Disciplinary Translation Work24 Mar 2025
- 2025Boosting Relational Deep Learning with Pretrained Tabular Modelscited by 9
- 2025ScholarMate: A Mixed-Initiative Tool for Qualitative Knowledge Work and Information Sensemakingcited by 7
- 2026Models Recall What They Violate: Constraint Adherence in Multi-Turn LLM Ideationcited by 3
- 2025Words as Bridges: Exploring Computational Support for Cross-Disciplinary Translation Workcited by 2
- 2026Agent-Supported Foresight for AI Systemic Risks: AI Agents for Breadth, Experts for Judgmentcited by 2
- 2026Style Wins, Substance Loses: A Diagnosis of LLM-as-Judge in Idea Generationcited by 2
- 2025IDRBench: Understanding the Capability of Large Language Models on Interdisciplinary Researchcited by 1
- 2026StreetDesignAI: Broadening Designer Perspectives Through Multi-Persona Evaluation of Cycling Infrastructurecited by 1
- 2026How to Model AI Agents as Personas?: Applying the Persona Ecosystem Playground to 41,300 Posts on Moltbook for Behavioral Insightscited by 1
- 2026Beyond the Desk: Barriers and Future Opportunities for AI to Assist Scientists in Embodied Physical Taskscited by 1
- 2025Componentization: Decomposing Monolithic LLM Responses into Manipulable Semantic Unitscited by 0
- 2026Personagram: Bridging Personas and Product Design for Creative Ideation with Multimodal LLMscited by 0
12 most cited of 13 All 13 (JSON)
- 2026DocuTeam: Mixed-Initiative Multi-Agent Discussions around Evolving Documents24 Sep 2026
- 2026Style Wins, Substance Loses: A Diagnosis of LLM-as-Judge in Idea Generation3 Aug 2026
- 2026Models Recall What They Violate: Constraint Adherence in Multi-Turn LLM Ideation30 Apr 2026
- 2026Beyond the Desk: Barriers and Future Opportunities for AI to Assist Scientists in Embodied Physical Tasks19 Mar 2026
- 2026How to Model AI Agents as Personas?: Applying the Persona Ecosystem Playground to 41,300 Posts on Moltbook for Behavioral Insights3 Mar 2026
- 2026Agent-Supported Foresight for AI Systemic Risks: AI Agents for Breadth, Experts for Judgment9 Feb 2026
- 2026Personagram: Bridging Personas and Product Design for Creative Ideation with Multimodal LLMs5 Feb 2026
- 2026StreetDesignAI: Broadening Designer Perspectives Through Multi-Persona Evaluation of Cycling Infrastructure22 Jan 2026
- 2025Componentization: Decomposing Monolithic LLM Responses into Manipulable Semantic Units10 Sep 2025
- 2025IDRBench: Understanding the Capability of Large Language Models on Interdisciplinary Research21 Jul 2025
- 2025ScholarMate: A Mixed-Initiative Tool for Qualitative Knowledge Work and Information Sensemaking19 Apr 2025
- 2025Boosting Relational Deep Learning with Pretrained Tabular Models7 Apr 2025
12 newest of 13 All 13 (JSON)