TestAgent: An Adaptive and Intelligent Expert for Human Assessment
Not on the map. Why?
Abstract (arXiv)
Accurately assessing internal human states is key to understanding preferences, offering personalized services, and identifying challenges in real-world applications. Originating from psychometrics, adaptive testing has become the mainstream method for human measurement and has now been widely applied in education, healthcare, sports, and sociology. It customizes assessments by selecting the fewest test questions . However, current adaptive testing methods face several challenges. The mechanized nature of most algorithms leads to guessing behavior and difficulties with open-ended questions. Additionally, subjective assessments suffer from noisy response data and coarse-grained test outputs, further limiting their effectiveness. To move closer to an ideal adaptive testing process, we propose TestAgent, a large language model (LLM)-powered agent designed to enhance adaptive testing through interactive engagement. This is the first application of LLMs in adaptive testing. TestAgent supports personalized question selection, captures test-takers' responses and anomalies, and provides precise outcomes through dynamic, conversational interactions. Experiments on psychological, educational, and lifestyle assessments show our approach achieves more accurate results with 20% fewer questions than state-of-the-art baselines, and testers preferred it in speed, smoothness, and other dimensions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 59 references that are in the map. First posted on arXiv 3 Jun 2025.
Builds on
13 of 59 references.
References · 13
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
- 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debatecited by 742
- 2023Language Models can Solve Computer Taskscited by 372
- 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?cited by 327
- 2023Zhongjing: Enhancing the Chinese Medical Capabilities of Large Language Model through Expert Feedback and Real-world Multi-turn Dialoguecited by 119
- 2019EKT: Exercise-aware Knowledge Tracing for Student Performance Predictioncited by 109
- 2022Mastering the Game of No-Press Diplomacy via Human-Regularized Reinforcement Learning and Planningcited by 48
- 2024How Reliable is Your Simulator? Analysis on the Limitations of Current LLM-based User Simulators for Conversational Recommendationcited by 27
- 2021BOBCAT: Bilevel Optimization-Based Computerized Adaptive Testingcited by 22
- 2021Quality meets Diversity: A Model-Agnostic Framework for Computerized Adaptive Testingcited by 17
- 2023Math Agents: Computational Infrastructure, Mathematical Embedding, and Genomicscited by 15
- 2023Symbolic Cognitive Diagnosis via Hybrid Optimization for Intelligent Education Systemscited by 7
1 more
Built on by
Not cited yet.