An Interactive Multi-Agent System for Evaluation of New Product Concepts
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Product concept evaluation is a critical stage that determines strategic resource allocation and project success in enterprises. However, traditional expert-led approaches face limitations such as subjective bias and high time and cost requirements. To support this process, this study proposes an automated approach utilizing a large language model (LLM)-based multi-agent system (MAS). Through a systematic analysis of previous research on product development and team collaboration, this study established two primary evaluation dimensions, namely technical feasibility and market feasibility. The proposed system consists of a team of eight virtual agents representing specialized domains such as R&D and marketing. These agents use retrieval-augmented generation (RAG) and real-time search tools to gather objective evidence and validate concepts through structured deliberations based on the established criteria. The agents were further fine-tuned using professional product review data to enhance their judgment accuracy. A case study involving professional display monitor concepts demonstrated that the system's evaluation rankings were consistent with those of senior industry experts. These results confirm the usability of the proposed multi-agent-based evaluation approach for supporting product development decisions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 2 of its 2 references that are in the map. First posted on arXiv 6 Mar 2026.
Builds on
2 of 2 references.
Closest ancestors · 1
Same direction, newest first
Other references · 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025MaRGen: Multi-Agent LLM Approach for Self-Directed Market Research and Analysis
- 2025From Bits to Boardrooms: A Cutting-Edge Multi-Agent LLM Framework for Business Excellence
- 2025Empowering Real-World: A Survey on the Technology, Practice, and Evaluation of LLM-driven Industry Agents
- 2026Interview-Informed Generative Agents for Product Discovery: A Validation Study
- 2025Harnessing Multi-Agent LLMs for Complex Engineering Problem-Solving: A Framework for Senior Design Projects
- 2024Elicitron: An LLM Agent-Based Simulation Framework for Design Requirements Elicitation
- 2025IM-Chat: A Multi-agent LLM Framework Integrating Tool-Calling and Diffusion Modeling for Knowledge Transfer in Injection Molding Industry
- 2024Evaluation-Driven Development and Operations of LLM Agents: A Process Model and Reference Architecture