mlsanityData to 14 Oct 2026

Intent Speaks Louder: Controllable User Simulation Beyond Response Imitation

arXiv 2608.09420 ↗First posted 10 Aug 2026cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

User simulators are widely used as scalable environments for training and evaluating interactive assistants. Generating the next user turn is inherently one-to-many: the same profile and dialogue context may support multiple plausible continuations with different local interaction intents. A fluent response may therefore advance the dialogue through an inappropriate intent, such as acceptance rather than repair. Our key insight is that controllable user simulation should separate which local interaction intent the next user turn should realize from how that intent is expressed in language. We introduce UserIDA (User Intent-Directive Alignment), which exposes interaction intent as an explicit per-turn directive. UserIDA defines a six-way intent interface, learns directive-conditioned generation through supervised fine-tuning, and uses intent-calibrated policy optimization during group-based reinforcement learning. The reward preserves composite response quality while ensuring that intent-violating candidates rank below compliant alternatives in mixed groups. On LMSYS-USP, UserIDA achieves 86.6% intent accuracy, outperforming the strongest dedicated user-simulator baseline by 24.3 percentage points while improving semantic and stylistic similarity. In within-context interventions, it realizes at least four of the six target intents in 91.7% of evaluated dialogue states, compared with 22.9% for the strongest external baseline. These results establish per-turn intent control as a complementary dimension to response fidelity in user simulation.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 14 of its 26 references that are in the map. First posted on arXiv 10 Aug 2026.

Builds on

14 of 26 references.

References · 14

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  5. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
  6. 2026Mind the Sim2Real Gap in User Simulation for Agentic Taskscited by 54
  7. 2025SimulatorArena: Are User Simulators Reliable Proxies for Multi-Turn Evaluation of AI Assistants?cited by 50
  8. 2025Know You First and Be You Better: Modeling Human-Like User Simulators via Implicit Profilescited by 41
  9. 2026HumanLM: Simulating Users with State Alignment Beats Response Imitationcited by 37
  10. 2023PlatoLM: Teaching LLMs in Multi-Round Dialogue via a User Simulatorcited by 29
  11. 2025RLMR: Reinforcement Learning with Mixed Rewards for Creative Writingcited by 11
  12. 2026UserLM-R1: Modeling Human Reasoning in User Language Models with Multi-Reward Reinforcement Learningcited by 9
2 more
  1. 2026MirrorBench: A Benchmark to Evaluate Conversational User-Proxy Agents for Human-Likenesscited by 7
  2. 2026Learning User Simulators with Turing Rewardscited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026TRACER: Trajectory-Aligned Learning for Multi-Turn User Simulation
  2. 2026MUSE: Multi-Domain Chinese User Simulation via Self-Evolving Profiles and Rubric-Guided Alignment
  3. 2026Towards Better Agents for Multi-Turn User Interaction: The Next User Turn Is More Than Context
  4. 2026UserProxyBench: Evaluating LLM User Simulators for Agent Benchmarks and Training
  5. 2026Interactive Task Alignment as a POMDP
  6. 2026From Static Context to Calibrated Interactive RL: Mitigating Distribution Shift in Multi-turn Dialogue with Aligned Simulator
  7. 2025Consistently Simulating Human Personas with Multi-Turn Reinforcement Learning
  8. 2026IntentRL: Training Proactive User-intent Agents for Open-ended Deep Research via Reinforcement Learning