mlsanityData to 14 Oct 2026

Decision-aware User Simulation Agent for Evaluating Conversational Recommender Systems

arXiv 2605.05250 ↗First posted 5 May 2026cs.IR cs.AIcited by 0

On the map: LLM agents and tool use → Social simulation and multi-agent debate

Abstract (arXiv)

Conversational recommender systems (CRS) increasingly rely on user simulators for automated evaluation of sales agents. A key requirement for such simulators is the ability to model human decision-making. However, most existing simulation frameworks do not explicitly model the internal decision process, and LLM-based simulators often exhibit unrealistically strong information-processing capabilities, rarely exhibit the hesitation or decision deferral commonly observed in real consumer behavior, resulting in overly high acceptance probabilities. To address this limitation, we propose Hesitator, a theory-grounded user simulation framework that explicitly models human decision-making under choice overload. The framework introduces a modular Decision Module that separates utility-based item selection from overload-aware commitment decisions. Experiments across multiple user simulation frameworks, domains, sales modes, and LLM backbones show that integrating our module consistently mitigates unrealistic behaviors under increasing overload conditions. Furthermore, Hesitator reproduces established behavioral patterns from psychological economics, demonstrating its ability to model human decision behavior.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 12 of its 37 references that are in the map. First posted on arXiv 5 May 2026.

Builds on

12 of 37 references.

References · 12

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  4. 2024LiveBench: A Challenging, Contamination-Limited LLM Benchmarkcited by 262
  5. 2023Chat-REC: Towards Interactive and Explainable LLMs-Augmented Recommender Systemcited by 242
  6. 2024Evaluating Large Language Models as Generative User Simulators for Conversational Recommendationcited by 48
  7. 2025PersonaLens: A Benchmark for Personalization Evaluation in Conversational AI Assistantscited by 48
  8. 2020Evaluating Conversational Recommender Systems via User Simulationcited by 47
  9. 2025PUB: An LLM-Enhanced Personality-Driven User Behaviour Simulator for Recommender System Evaluationcited by 12
  10. 2023How Far Are LLMs from Believable AI? A Benchmark for Evaluating the Believability of Human Behavior Simulationcited by 11
  11. 2022Aligning Recommendation and Conversation via Dual Imitationcited by 6
  12. 2025Towards Personalized Conversational Sales Agents: Contextual User Profiling for Strategic Actioncited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Simulated Customers Never Walk Away: Decision Fidelity of LLM User Simulators Measured Against Real Purchase Outcomes
  2. 2025RecUserSim: A Realistic and Diverse User Simulator for Evaluating Conversational Recommender Systems
  3. 2024LLM-Powered User Simulator for Recommender System
  4. 2026Beyond Offline A/B Testing: Context-Aware Agent Simulation for Recommender System Evaluation
  5. 2025Beyond Static Testbeds: An Interaction-Centric Agent Simulation Platform for Dynamic Recommender Systems
  6. 2026SimInter: Evidence-Grounded User Simulation with Interview-Based Profile Enrichment for Conversational Recommender Systems
  7. 2026LLM Consumer Behavior Theory: Foundations of a Novel Research Field
  8. 2025Mirroring Users: Towards Building Preference-aligned User Simulator with User Feedback in Recommendation