A Sequence-to-Sequence Model for User Simulation in Spoken Dialogue Systems
Not on the map. Why?
Abstract (arXiv)
User simulation is essential for generating enough data to train a statistical spoken dialogue system. Previous models for user simulation suffer from several drawbacks, such as the inability to take dialogue history into account, the need of rigid structure to ensure coherent user behaviour, heavy dependence on a specific domain, the inability to output several user intentions during one dialogue turn, or the requirement of a summarized action space for tractability. This paper introduces a data-driven user simulator based on an encoder-decoder recurrent neural network. The model takes as input a sequence of dialogue contexts and outputs a sequence of dialogue acts corresponding to user intentions. The dialogue contexts include information about the machine acts and the status of the user goal. We show on the Dialogue State Tracking Challenge 2 (DSTC2) dataset that the sequence-to-sequence model outperforms an agenda-based simulator and an n-gram simulator, according to F-score. Furthermore, we show how this model can be used on the original action space and thereby models user behaviour with finer granularity.
Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Jun 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 9; 2023: 6; 2024: 5; 2025: 8; 2026: 3.
39 papers.
Sort:
By area:
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2025Flipping the Dialogue: Training and Evaluating User Language Modelscited by 50
- 2025Know You First and Be You Better: Modeling Human-Like User Simulators via Implicit Profilescited by 38
- 2021Transferable Dialogue Systems and User Simulatorscited by 35
- 2022CHAI: A CHatbot AI for Task-Oriented Dialogue with Offline Reinforcement Learningcited by 33
- 2022A Survey on Recent Advances and Challenges in Reinforcement Learning Methods for Task-Oriented Dialogue Policy Learningcited by 30
- 2023User Simulation for Evaluating Information Access Systemscited by 30
- 2023PlatoLM: Teaching LLMs in Multi-Round Dialogue via a User Simulatorcited by 28
- 2024Reliable LLM-based User Simulator for Task-Oriented Dialogue Systemscited by 24
- 2021Domain-independent User Simulation with Transformers for Task-oriented Dialogue Systemscited by 23
- 2024DuetSim: Building User Simulator with Dual Large Language Models for Task-Oriented Dialoguescited by 23
- 2022Context-Aware Language Modeling for Goal-Oriented Dialogue Systemscited by 22
27 more
- 2022GenTUS: Simulating User Behaviour and Language in Task-oriented Dialogues with Generative Transformerscited by 22
- 2023In-Context Learning User Simulators for Task-Oriented Dialog Systemscited by 19
- 2025Goal Alignment in LLM-Based User Simulators for Conversational AIcited by 19
- 2021Crossing the Conversational Chasm: A Primer on Natural Language Processing for Multilingual Task-Oriented Dialogue Systemscited by 16
- 2025CONFETTI: Conversational Function-Calling Evaluation Through Turn-Level Interactionscited by 16
- 2022Report from the NSF Future Directions Workshop on Automatic Evaluation of Dialog: Research Directions and Challengescited by 13
- 2024Personality-aware Student Simulation for Conversational Intelligent Tutoring Systemscited by 11
- 2022Augmenting Multi-Turn Text-to-SQL Datasets with Self-Playcited by 9
- 2023EmoUS: Simulating User Emotions in Task-Oriented Dialoguescited by 9
- 2025Simulating Before Planning: Constructing Intrinsic User World Model for User-Tailored Dialogue Policy Planningcited by 7
- 2021Teaching Models new APIs: Domain-Agnostic Simulators for Task Oriented Dialoguecited by 6
- 2022A Generative User Simulator with GPT-based Architecture and Goal State Tracking for Reinforced Multi-Domain Dialog Systemscited by 6
- 2024Enhancing End-to-End Multi-Task Dialogue Systems: A Study on Intrinsic Motivation Reinforcement Learning Algorithms for Improved Training and Adaptabilitycited by 6
- 2024Simulating User Agents for Embodied Conversational-AIcited by 6
- 2025DIAL: Direct Iterative Adversarial Learning for Realistic Multi-Turn Dialogue Simulationcited by 5
- 2025MotiveBench: How Far Are We From Human-Like Motivational Reasoning in Large Language Models?cited by 4
- 2021Towards a Universal NLG for Dialogue Systems and Simulators with Future Bridgingcited by 2
- 2022Knowledge-Grounded Conversational Data Augmentation with Generative Conversational Networkscited by 2
- 2023Adversarial learning of neural user simulators for dialogue policy optimisationcited by 2
- 2026MUSE: Multi-Domain Chinese User Simulation via Self-Evolving Profiles and Rubric-Guided Alignmentcited by 2
- 2021Improved Goal Oriented Dialogue via Utterance Generation and Look Aheadcited by 1
- 2022BotSIM: An End-to-End Bot Simulation Framework for Commercial Task-Oriented Dialog Systemscited by 1
- 2023It HAS to be Subjective: Human Annotator Simulation via Zero-shot Density Estimationcited by 1
- 2025The Imperfect Learner: Incorporating Developmental Trajectories in Memory-based Student Simulationcited by 1
- 2026SayNext-Bench: Why Do LLMs Struggle with Next-Utterance Anticipation?cited by 1
- 2021Two Approaches to Building Collaborative, Task-Oriented Dialog Agents through Self-Playcited by 0
- 2026SimRPD: Optimizing Recruitment Proactive Dialogue Agents through Simulator-Based Data Evaluation and Selectioncited by 0
- 2026MUSE: Multi-Domain Chinese User Simulation via Self-Evolving Profiles and Rubric-Guided Alignment15 Apr 2026
- 2026SayNext-Bench: Why Do LLMs Struggle with Next-Utterance Anticipation?30 Jan 2026
- 2026SimRPD: Optimizing Recruitment Proactive Dialogue Agents through Simulator-Based Data Evaluation and Selection6 Jan 2026
- 2025DIAL: Direct Iterative Adversarial Learning for Realistic Multi-Turn Dialogue Simulation23 Dec 2025
- 2025The Imperfect Learner: Incorporating Developmental Trajectories in Memory-based Student Simulation8 Nov 2025
- 2025Flipping the Dialogue: Training and Evaluating User Language Models8 Oct 2025
- 2025Goal Alignment in LLM-Based User Simulators for Conversational AI27 Jul 2025
- 2025MotiveBench: How Far Are We From Human-Like Motivational Reasoning in Large Language Models?16 Jun 2025
- 2025CONFETTI: Conversational Function-Calling Evaluation Through Turn-Level Interactions2 Jun 2025
- 2025Simulating Before Planning: Constructing Intrinsic User World Model for User-Tailored Dialogue Policy Planning18 Apr 2025
- 2025Know You First and Be You Better: Modeling Human-Like User Simulators via Implicit Profiles26 Feb 2025
- 2024Simulating User Agents for Embodied Conversational-AI31 Oct 2024
27 more
- 2024DuetSim: Building User Simulator with Dual Large Language Models for Task-Oriented Dialogues16 May 2024
- 2024Personality-aware Student Simulation for Conversational Intelligent Tutoring Systems10 Apr 2024
- 2024Reliable LLM-based User Simulator for Task-Oriented Dialogue Systems20 Feb 2024
- 2024Enhancing End-to-End Multi-Task Dialogue Systems: A Study on Intrinsic Motivation Reinforcement Learning Algorithms for Improved Training and Adaptability31 Jan 2024
- 2023It HAS to be Subjective: Human Annotator Simulation via Zero-shot Density Estimation30 Sep 2023
- 2023PlatoLM: Teaching LLMs in Multi-Round Dialogue via a User Simulator21 Aug 2023
- 2023User Simulation for Evaluating Information Access Systems14 Jun 2023
- 2023EmoUS: Simulating User Emotions in Task-Oriented Dialogues2 Jun 2023
- 2023Adversarial learning of neural user simulators for dialogue policy optimisation1 Jun 2023
- 2023In-Context Learning User Simulators for Task-Oriented Dialog Systems1 Jun 2023
- 2022BotSIM: An End-to-End Bot Simulation Framework for Commercial Task-Oriented Dialog Systems22 Nov 2022
- 2022Augmenting Multi-Turn Text-to-SQL Datasets with Self-Play21 Oct 2022
- 2022A Generative User Simulator with GPT-based Architecture and Goal State Tracking for Reinforced Multi-Domain Dialog Systems17 Oct 2022
- 2022GenTUS: Simulating User Behaviour and Language in Task-oriented Dialogues with Generative Transformers23 Aug 2022
- 2022Knowledge-Grounded Conversational Data Augmentation with Generative Conversational Networks22 Jul 2022
- 2022Context-Aware Language Modeling for Goal-Oriented Dialogue Systems18 Apr 2022
- 2022CHAI: A CHatbot AI for Task-Oriented Dialogue with Offline Reinforcement Learning18 Apr 2022
- 2022Report from the NSF Future Directions Workshop on Automatic Evaluation of Dialog: Research Directions and Challenges18 Mar 2022
- 2022A Survey on Recent Advances and Challenges in Reinforcement Learning Methods for Task-Oriented Dialogue Policy Learning28 Feb 2022
- 2021Improved Goal Oriented Dialogue via Utterance Generation and Look Ahead24 Oct 2021
- 2021Teaching Models new APIs: Domain-Agnostic Simulators for Task Oriented Dialogue13 Oct 2021
- 2021Two Approaches to Building Collaborative, Task-Oriented Dialog Agents through Self-Play20 Sep 2021
- 2021Transferable Dialogue Systems and User Simulators25 Jul 2021
- 2021Domain-independent User Simulation with Transformers for Task-oriented Dialogue Systems16 Jun 2021
- 2021Towards a Universal NLG for Dialogue Systems and Simulators with Future Bridging21 May 2021
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Survey10 May 2021
- 2021Crossing the Conversational Chasm: A Primer on Natural Language Processing for Multilingual Task-Oriented Dialogue Systems17 Apr 2021
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2025Flipping the Dialogue: Training and Evaluating User Language Modelscited by 50
- 2025Know You First and Be You Better: Modeling Human-Like User Simulators via Implicit Profilescited by 38
- 2021Transferable Dialogue Systems and User Simulatorscited by 35
- 2022A Survey on Recent Advances and Challenges in Reinforcement Learning Methods for Task-Oriented Dialogue Policy Learningcited by 30
- 2023User Simulation for Evaluating Information Access Systemscited by 30
- 2023PlatoLM: Teaching LLMs in Multi-Round Dialogue via a User Simulatorcited by 28
- 2024Reliable LLM-based User Simulator for Task-Oriented Dialogue Systemscited by 24
- 2021Domain-independent User Simulation with Transformers for Task-oriented Dialogue Systemscited by 23
- 2024DuetSim: Building User Simulator with Dual Large Language Models for Task-Oriented Dialoguescited by 23
- 2022Context-Aware Language Modeling for Goal-Oriented Dialogue Systemscited by 22
- 2022GenTUS: Simulating User Behaviour and Language in Task-oriented Dialogues with Generative Transformerscited by 22
12 most cited of 33 All 33 (JSON)
- 2026SayNext-Bench: Why Do LLMs Struggle with Next-Utterance Anticipation?30 Jan 2026
- 2026SimRPD: Optimizing Recruitment Proactive Dialogue Agents through Simulator-Based Data Evaluation and Selection6 Jan 2026
- 2025DIAL: Direct Iterative Adversarial Learning for Realistic Multi-Turn Dialogue Simulation23 Dec 2025
- 2025The Imperfect Learner: Incorporating Developmental Trajectories in Memory-based Student Simulation8 Nov 2025
- 2025Flipping the Dialogue: Training and Evaluating User Language Models8 Oct 2025
- 2025Goal Alignment in LLM-Based User Simulators for Conversational AI27 Jul 2025
- 2025Know You First and Be You Better: Modeling Human-Like User Simulators via Implicit Profiles26 Feb 2025
- 2024DuetSim: Building User Simulator with Dual Large Language Models for Task-Oriented Dialogues16 May 2024
- 2024Personality-aware Student Simulation for Conversational Intelligent Tutoring Systems10 Apr 2024
- 2024Reliable LLM-based User Simulator for Task-Oriented Dialogue Systems20 Feb 2024
- 2024Enhancing End-to-End Multi-Task Dialogue Systems: A Study on Intrinsic Motivation Reinforcement Learning Algorithms for Improved Training and Adaptability31 Jan 2024
- 2023It HAS to be Subjective: Human Annotator Simulation via Zero-shot Density Estimation30 Sep 2023
12 newest of 33 All 33 (JSON)