Elicitron: An LLM Agent-Based Simulation Framework for Design Requirements Elicitation
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Requirements elicitation, a critical, yet time-consuming and challenging step in product development, often fails to capture the full spectrum of user needs. This may lead to products that fall short of expectations. This paper introduces a novel framework that leverages Large Language Models (LLMs) to automate and enhance the requirements elicitation process. LLMs are used to generate a vast array of simulated users (LLM agents), enabling the exploration of a much broader range of user needs and unforeseen use cases. These agents engage in product experience scenarios, through explaining their actions, observations, and challenges. Subsequent agent interviews and analysis uncover valuable user needs, including latent ones. We validate our framework with three experiments. First, we explore different methodologies for diverse agent generation, discussing their advantages and shortcomings. We measure the diversity of identified user needs and demonstrate that context-aware agent generation leads to greater diversity. Second, we show how our framework effectively mimics empathic lead user interviews, identifying a greater number of latent needs than conventional human interviews. Third, we showcase that LLMs can be used to analyze interviews, capture needs, and classify them as latent or not. Our work highlights the potential of using LLM agents to accelerate early-stage product development, reduce costs, and increase innovation.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 11 of its 53 references that are in the map. First posted on arXiv 4 Apr 2024.
Builds on
11 of 53 references.
References · 11
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022Competition-Level Code Generation with AlphaCodecited by 1,462
- 2023Role-Play with Large Language Modelscited by 294
- 2023Beyond Statistical Similarity: Rethinking Metrics for Deep Generative Models in Engineering Designcited by 23
- 2023Conceptual Design Generation Using Large Language Modelscited by 13
- 2023ShipGen: A Diffusion Model for Parametric Ship Hull Generation with Multiple Objectives and Constraintscited by 11
- 2023Toward Artificial Empathy for Human-Centered Design: A Frameworkcited by 6
- 2023DATED: Guidelines for Creating Synthetic Datasets for Engineering Design Applicationscited by 6
- 2023On the Noise Scheduling for Generating Plausible Designs with Diffusion Modelscited by 6
Built on by
Citing papers per year: 2024: 8; 2025: 9; 2026: 2.
19 papers.
Sort:
By area:
- 2024Large Language Model-Based Agents for Software Engineering: A Surveycited by 178
- 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Aheadcited by 155
- 2024From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Futurecited by 86
- 2024From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agentscited by 82
- 2024Very Large-Scale Multi-Agent Simulation in AgentScopecited by 18
- 2025An LLM-based multi-agent framework for agile effort estimationcited by 6
- 2025Requirements Elicitation Follow-Up Question Generationcited by 5
- 2024Deep Generative Model for Mechanical System Configuration Designcited by 4
- 2025Simulation Agent: A Framework for Integrating Simulation and Large Language Models for Enhanced Decision-Makingcited by 4
- 2025Requirements Development and Formalization for Reliable Code Generation: A Multi-Agent Visioncited by 4
- 2025Towards Engineering Multi-Agent LLMs: A Protocol-Driven Approachcited by 4
- 2025Issue-Oriented Agent-Based Framework for Automated Review Comment Generationcited by 4
7 more
- 2025Can LLMs Generate User Stories and Assess Their Quality?cited by 2
- 2024Getting Inspiration for Feature Elicitation: App Store- vs. LLM-based Approachcited by 1
- 2024GAI: Generative Agents for Innovationcited by 1
- 2025Risks of AI-driven product development and strategies for their mitigationcited by 1
- 2025RECALL-MM: A Multimodal Dataset of Consumer Product Recalls for Risk Analysis using Computational Methods and Large Language Modelscited by 0
- 20264D-ARE: Bridging the Attribution Gap in LLM Agent Requirements Engineeringcited by 0
- 2026On the Prospects of Dynamic LLM Conversations in Software Developmentcited by 0
- 2026On the Prospects of Dynamic LLM Conversations in Software Development31 Aug 2026
- 20264D-ARE: Bridging the Attribution Gap in LLM Agent Requirements Engineering8 Jan 2026
- 2025Issue-Oriented Agent-Based Framework for Automated Review Comment Generation1 Nov 2025
- 2025Towards Engineering Multi-Agent LLMs: A Protocol-Driven Approach14 Oct 2025
- 2025An LLM-based multi-agent framework for agile effort estimation17 Sep 2025
- 2025Requirements Development and Formalization for Reliable Code Generation: A Multi-Agent Vision26 Aug 2025
- 2025Can LLMs Generate User Stories and Assess Their Quality?20 Jul 2025
- 2025Requirements Elicitation Follow-Up Question Generation3 Jul 2025
- 2025Risks of AI-driven product development and strategies for their mitigation28 May 2025
- 2025Simulation Agent: A Framework for Integrating Simulation and Large Language Models for Enhanced Decision-Making19 May 2025
- 2025RECALL-MM: A Multimodal Dataset of Consumer Product Recalls for Risk Analysis using Computational Methods and Large Language Models29 Mar 2025
- 2024GAI: Generative Agents for Innovation25 Dec 2024
7 more
- 2024From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agents4 Dec 2024
- 2024Deep Generative Model for Mechanical System Configuration Design9 Sep 2024
- 2024Large Language Model-Based Agents for Software Engineering: A Survey4 Sep 2024
- 2024Getting Inspiration for Feature Elicitation: App Store- vs. LLM-based Approach30 Aug 2024
- 2024From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Future5 Aug 2024
- 2024Very Large-Scale Multi-Agent Simulation in AgentScope25 Jul 2024
- 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Ahead7 Apr 2024
- 2024Large Language Model-Based Agents for Software Engineering: A Surveycited by 178
- 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Aheadcited by 155
- 2024From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Futurecited by 86
- 2024From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agentscited by 82
- 2024Very Large-Scale Multi-Agent Simulation in AgentScopecited by 18
- 2025An LLM-based multi-agent framework for agile effort estimationcited by 6
- 2025Simulation Agent: A Framework for Integrating Simulation and Large Language Models for Enhanced Decision-Makingcited by 4
- 2025Requirements Development and Formalization for Reliable Code Generation: A Multi-Agent Visioncited by 4
- 2025Towards Engineering Multi-Agent LLMs: A Protocol-Driven Approachcited by 4
- 2025Issue-Oriented Agent-Based Framework for Automated Review Comment Generationcited by 4
- 2024GAI: Generative Agents for Innovationcited by 1
- 2025Issue-Oriented Agent-Based Framework for Automated Review Comment Generation1 Nov 2025
- 2025Towards Engineering Multi-Agent LLMs: A Protocol-Driven Approach14 Oct 2025
- 2025An LLM-based multi-agent framework for agile effort estimation17 Sep 2025
- 2025Requirements Development and Formalization for Reliable Code Generation: A Multi-Agent Vision26 Aug 2025
- 2025Simulation Agent: A Framework for Integrating Simulation and Large Language Models for Enhanced Decision-Making19 May 2025
- 2024GAI: Generative Agents for Innovation25 Dec 2024
- 2024From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agents4 Dec 2024
- 2024Large Language Model-Based Agents for Software Engineering: A Survey4 Sep 2024
- 2024From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Future5 Aug 2024
- 2024Very Large-Scale Multi-Agent Simulation in AgentScope25 Jul 2024
- 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Ahead7 Apr 2024
- 2025Requirements Elicitation Follow-Up Question Generationcited by 5
- 2024Deep Generative Model for Mechanical System Configuration Designcited by 4
- 2025Can LLMs Generate User Stories and Assess Their Quality?cited by 2
- 2024Getting Inspiration for Feature Elicitation: App Store- vs. LLM-based Approachcited by 1
- 2025Risks of AI-driven product development and strategies for their mitigationcited by 1
- 2025RECALL-MM: A Multimodal Dataset of Consumer Product Recalls for Risk Analysis using Computational Methods and Large Language Modelscited by 0
- 2026On the Prospects of Dynamic LLM Conversations in Software Developmentcited by 0
- 2026On the Prospects of Dynamic LLM Conversations in Software Development31 Aug 2026
- 2025Can LLMs Generate User Stories and Assess Their Quality?20 Jul 2025
- 2025Requirements Elicitation Follow-Up Question Generation3 Jul 2025
- 2025Risks of AI-driven product development and strategies for their mitigation28 May 2025
- 2025RECALL-MM: A Multimodal Dataset of Consumer Product Recalls for Risk Analysis using Computational Methods and Large Language Models29 Mar 2025
- 2024Deep Generative Model for Mechanical System Configuration Design9 Sep 2024
- 2024Getting Inspiration for Feature Elicitation: App Store- vs. LLM-based Approach30 Aug 2024
Similar, not cited
Close in wording, no citation either way
- 2026From Chat to Interview: Agentic Requirements Elicitation with an Experience Ontology
- 2026ReqElicitGym: An Evaluation Environment for Interview Competence in Conversational Requirements Elicitation
- 2026Interview-Informed Generative Agents for Product Discovery: A Validation Study
- 2026On the Viability of Requirements Generation From Code: An Experience Report ↗
- 2026LadderTeam: Dual-Agent Laddering Elicitation Framework
- 2025Multi-Agent Debate Strategies to Enhance Requirements Engineering with Large Language Models
- 2025Multi-Agent LLMs as Ethics Advocates for AI-Based Systems
- 2026Agent4RE: A Self-Refining Multi-agent Framework for End-to-End Software Requirements Engineering and Benchmarking