Towards End-to-End Learning for Dialog State Tracking and Management using Deep Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
This paper presents an end-to-end framework for task-oriented dialog systems using a variant of Deep Recurrent Q-Networks (DRQN). The model is able to interface with a relational database and jointly learn policies for both language understanding and dialog strategy. Moreover, we propose a hybrid algorithm that combines the strength of reinforcement learning and supervised learning to achieve faster learning speed. We evaluated the proposed model on a 20 Question Game conversational game simulator. Results show that the proposed method outperforms the modular-based baseline and learns a distributed representation of the latent dialog state.
Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Jun 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 1; 2019: 0; 2020: 0; 2021: 10; 2022: 7; 2023: 5; 2024: 3; 2025: 2; 2026: 1.
29 papers.
Sort:
By area:
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2022A Survey on Recent Advances and Challenges in Reinforcement Learning Methods for Task-Oriented Dialogue Policy Learningcited by 30
- 2018Deep Dyna-Q: Integrating Planning for Task-Completion Dialogue Policy Learningcited by 21
- 2024ChatShop: Interactive Information Seeking with Language Agentscited by 21
- 2021A Survey on Deep Reinforcement Learning for Audio-Based Applicationscited by 17
- 2023End-to-end Task-oriented Dialogue: A Survey of Tasks, Methods, and Future Directionscited by 17
- 2023Long-Horizon Dialogue Understanding for Role Identification in the Game of Avalon with Large Language Modelscited by 12
- 2023Reinforcement Learning for Generative AI: A Surveycited by 11
- 2024A Survey On Enhancing Reinforcement Learning in Complex Environments: Insights from Human and LLM Feedbackcited by 9
- 2025Fast and Fluent Diffusion Language Models via Convolutional Decoding and Rejective Fine-tuningcited by 8
- 2022Post-processing Networks: Method for Optimizing Pipeline Task-oriented Dialogue Systems using Reinforcement Learningcited by 5
17 more
- 2023Using Textual Interface to Align External Knowledge for End-to-End Task-Oriented Dialogue Systemscited by 4
- 2022Are Current Task-oriented Dialogue Systems Able to Satisfy Impolite Users?cited by 3
- 2021A Deep Reinforcement Learning Approach for Traffic Signal Control Optimizationcited by 2
- 2021WeaSuL: Weakly Supervised Dialogue Policy Learning: Reward Estimation for Multi-turn Dialoguecited by 2
- 2021A Speaker-aware Parallel Hierarchical Attentive Encoder-Decoder Model for Multi-turn Dialogue Generationcited by 2
- 2022End-to-End Evaluation of a Spoken Dialogue System for Learning Basic Mathematicscited by 2
- 2021Converse, Focus and Guess -- Towards Multi-Document Driven Dialoguecited by 1
- 2021DRL: Deep Reinforcement Learning for Intelligent Robot Control -- Concept, Literature, and Futurecited by 1
- 2021Joint System-Wise Optimization for Pipeline Goal-Oriented Dialog Systemcited by 1
- 2021Multi-Task Learning for Situated Multi-Domain End-to-End Dialogue Systemscited by 1
- 2022A Spoken Drug Prescription Dataset in French for Spoken Language Understandingcited by 1
- 2021Every time I fire a conversational designer, the performance of the dialog system goes downcited by 0
- 2022Demonstrating CAT: Synthesizing Data-Aware Conversational Agents for Transactional Databasescited by 0
- 2022Reinforcement Learning of Multi-Domain Dialog Policies Via Action Embeddingscited by 0
- 2023Spoken Dialogue System for Medical Prescription Acquisition on Smartphone: Development, Corpus and Evaluationcited by 0
- 2025Optimizing Conversational Product Recommendation via Reinforcement Learningcited by 0
- 2026Dont Just Teach, Explain! A Gamified 20Q Recommender for Cybersecurity Educationcited by 0
- 2026Dont Just Teach, Explain! A Gamified 20Q Recommender for Cybersecurity Education14 Apr 2026
- 2025Fast and Fluent Diffusion Language Models via Convolutional Decoding and Rejective Fine-tuning18 Sep 2025
- 2025Optimizing Conversational Product Recommendation via Reinforcement Learning30 Jun 2025
- 2024A Survey On Enhancing Reinforcement Learning in Complex Environments: Insights from Human and LLM Feedback20 Nov 2024
- 2024ChatShop: Interactive Information Seeking with Language Agents15 Apr 2024
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systems28 Feb 2024
- 2023End-to-end Task-oriented Dialogue: A Survey of Tasks, Methods, and Future Directions15 Nov 2023
- 2023Long-Horizon Dialogue Understanding for Role Identification in the Game of Avalon with Large Language Models9 Nov 2023
- 2023Spoken Dialogue System for Medical Prescription Acquisition on Smartphone: Development, Corpus and Evaluation6 Nov 2023
- 2023Reinforcement Learning for Generative AI: A Survey28 Aug 2023
- 2023Using Textual Interface to Align External Knowledge for End-to-End Task-Oriented Dialogue Systems23 May 2023
- 2022End-to-End Evaluation of a Spoken Dialogue System for Learning Basic Mathematics7 Nov 2022
17 more
- 2022Are Current Task-oriented Dialogue Systems Able to Satisfy Impolite Users?24 Oct 2022
- 2022Post-processing Networks: Method for Optimizing Pipeline Task-oriented Dialogue Systems using Reinforcement Learning25 Jul 2022
- 2022A Spoken Drug Prescription Dataset in French for Spoken Language Understanding17 Jul 2022
- 2022Reinforcement Learning of Multi-Domain Dialog Policies Via Action Embeddings1 Jul 2022
- 2022Demonstrating CAT: Synthesizing Data-Aware Conversational Agents for Transactional Databases26 Mar 2022
- 2022A Survey on Recent Advances and Challenges in Reinforcement Learning Methods for Task-Oriented Dialogue Policy Learning28 Feb 2022
- 2021A Speaker-aware Parallel Hierarchical Attentive Encoder-Decoder Model for Multi-turn Dialogue Generation13 Oct 2021
- 2021Multi-Task Learning for Situated Multi-Domain End-to-End Dialogue Systems11 Oct 2021
- 2021Every time I fire a conversational designer, the performance of the dialog system goes down27 Sep 2021
- 2021WeaSuL: Weakly Supervised Dialogue Policy Learning: Reward Estimation for Multi-turn Dialogue1 Aug 2021
- 2021A Deep Reinforcement Learning Approach for Traffic Signal Control Optimization13 Jul 2021
- 2021Joint System-Wise Optimization for Pipeline Goal-Oriented Dialog System9 Jun 2021
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Survey10 May 2021
- 2021DRL: Deep Reinforcement Learning for Intelligent Robot Control -- Concept, Literature, and Future20 Apr 2021
- 2021Converse, Focus and Guess -- Towards Multi-Document Driven Dialogue4 Feb 2021
- 2021A Survey on Deep Reinforcement Learning for Audio-Based Applications1 Jan 2021
- 2018Deep Dyna-Q: Integrating Planning for Task-Completion Dialogue Policy Learning18 Jan 2018
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2022A Survey on Recent Advances and Challenges in Reinforcement Learning Methods for Task-Oriented Dialogue Policy Learningcited by 30
- 2021A Survey on Deep Reinforcement Learning for Audio-Based Applicationscited by 17
- 2023End-to-end Task-oriented Dialogue: A Survey of Tasks, Methods, and Future Directionscited by 17
- 2023Long-Horizon Dialogue Understanding for Role Identification in the Game of Avalon with Large Language Modelscited by 12
- 2023Reinforcement Learning for Generative AI: A Surveycited by 11
- 2024A Survey On Enhancing Reinforcement Learning in Complex Environments: Insights from Human and LLM Feedbackcited by 9
- 2022Post-processing Networks: Method for Optimizing Pipeline Task-oriented Dialogue Systems using Reinforcement Learningcited by 5
- 2023Using Textual Interface to Align External Knowledge for End-to-End Task-Oriented Dialogue Systemscited by 4
- 2022Are Current Task-oriented Dialogue Systems Able to Satisfy Impolite Users?cited by 3
- 2021A Deep Reinforcement Learning Approach for Traffic Signal Control Optimizationcited by 2
12 most cited of 26 All 26 (JSON)
- 2026Dont Just Teach, Explain! A Gamified 20Q Recommender for Cybersecurity Education14 Apr 2026
- 2025Optimizing Conversational Product Recommendation via Reinforcement Learning30 Jun 2025
- 2024A Survey On Enhancing Reinforcement Learning in Complex Environments: Insights from Human and LLM Feedback20 Nov 2024
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systems28 Feb 2024
- 2023End-to-end Task-oriented Dialogue: A Survey of Tasks, Methods, and Future Directions15 Nov 2023
- 2023Long-Horizon Dialogue Understanding for Role Identification in the Game of Avalon with Large Language Models9 Nov 2023
- 2023Spoken Dialogue System for Medical Prescription Acquisition on Smartphone: Development, Corpus and Evaluation6 Nov 2023
- 2023Reinforcement Learning for Generative AI: A Survey28 Aug 2023
- 2023Using Textual Interface to Align External Knowledge for End-to-End Task-Oriented Dialogue Systems23 May 2023
- 2022End-to-End Evaluation of a Spoken Dialogue System for Learning Basic Mathematics7 Nov 2022
- 2022Are Current Task-oriented Dialogue Systems Able to Satisfy Impolite Users?24 Oct 2022
- 2022Post-processing Networks: Method for Optimizing Pipeline Task-oriented Dialogue Systems using Reinforcement Learning25 Jul 2022
12 newest of 26 All 26 (JSON)