mlsanityData to 14 Oct 2026

SimInter: Evidence-Grounded User Simulation with Interview-Based Profile Enrichment for Conversational Recommender Systems

arXiv 2610.18308 ↗First posted 13 Oct 2026cs.CL cs.AI cs.IRcited by 0

Not on the map. Why?

Abstract (arXiv)

Conversational Recommender Systems (CRSs) require reliable user simulators for cost-effective evaluation. LLM-based simulators have made realistic simulation possible but typically condition on profiles derived from explicit ratings, demographics, and static sources capturing surface preferences while omitting implicit behavioral characteristics such as decision-making style, aspect-level preferences, and domain expertise. We propose SimInter, a pipeline that elicits these attributes via synthetic interviews between two LLM agents, grounded in the user's statistical profile and historical conversational evidence. Before profile enrichment, an audit agent explicitly flags potential fabrication and stereotyping at the turn level. We instantiate and evaluate SimInter on movie recommendation. We simulate 300 ReDial users and, on a matched subset of 100 users, compare SimInter with a statistics-only baseline: SimInter significantly increases the diversity of expressed preference aspects (filtered aspect entropy: 1.619 vs. 0.859; paired d = 0.96, Holm-adjusted p < 0.001). This gain persists when the simulator converses with two trained recommenders, KBRD and UniCRS, under two independent evaluation judges (+0.28 to +0.56 nats; all p < 0.001). Human evaluation finds 94.3% of enriched-attribute claims supported or partially supported, while human judgments agree with 95.2% of the auditor's binary filtering decisions on a stratified sample.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 44 references that are in the map. First posted on arXiv 13 Oct 2026.

Builds on

20 of 44 references.

References · 20

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  4. 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 212
  5. 2018Towards Deep Conversational Recommendationscited by 176
  6. 2019Towards Knowledge-Based Recommender Dialog Systemcited by 113
  7. 2020INSPIRED: Toward Sociable Recommendation Dialog Systemscited by 93
  8. 2022Towards Unified Conversational Recommender Systems via Knowledge-Enhanced Prompt Learningcited by 86
  9. 2024Evaluating Large Language Models as Generative User Simulators for Conversational Recommendationcited by 48
  10. 2020Evaluating Conversational Recommender Systems via User Simulationcited by 47
  11. 2024How Reliable is Your Simulator? Analysis on the Limitations of Current LLM-based User Simulators for Conversational Recommendationcited by 27
  12. 2022GenTUS: Simulating User Behaviour and Language in Task-oriented Dialogues with Generative Transformerscited by 23
8 more
  1. 2025User Simulation in the Era of Generative AI: User Modeling, Synthetic Data Generation, and System Evaluationcited by 17
  2. 2019Listening between the Lines: Learning Personal Attributes from Conversationscited by 16
  3. 2024Pearl: A Review-driven Persona-Knowledge Grounded Conversational Recommendation Datasetcited by 16
  4. 2025PUB: An LLM-Enhanced Personality-Driven User Behaviour Simulator for Recommender System Evaluationcited by 12
  5. 2024Identifying Breakdowns in Conversational Recommender Systems using User Simulationcited by 5
  6. 2021You Get What You Chat: Using Conversations to Personalize Search-based Recommendationscited by 4
  7. 2025Evaluating Conversational Recommender Systems via Large Language Models: A User-Centric Frameworkcited by 2
  8. 2025Limitations of Current Evaluation Practices for Conversational Recommender Systems and the Potential of User Simulationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025RecUserSim: A Realistic and Diverse User Simulator for Evaluating Conversational Recommender Systems
  2. 2025Mirroring Users: Towards Building Preference-aligned User Simulator with User Feedback in Recommendation
  3. 2025A Framework for Generating Conversational Recommendation Datasets from Behavioral Interactions
  4. 2023Rethinking the Evaluation for Conversational Recommendation in the Era of Large Language Models
  5. 2024Lusifer: LLM-based User SImulated Feedback Environment for online Recommender systems
  6. 2026When and How to Ask: Dynamic Preference Elicitation Strategies for Conversational Recommendation ↗
  7. 2024SUBER: An RL Environment with Simulated Human Behavior for Recommender Systems
  8. 2024LLM-Powered User Simulator for Recommender System