Hybrid Code Networks: practical and efficient end-to-end dialog control with supervised and reinforcement learning
Not on the map. Why?
Abstract (arXiv)
End-to-end learning of recurrent neural networks (RNNs) is an attractive solution for dialog systems; however, current techniques are data-intensive and require thousands of dialogs to learn simple behaviors. We introduce Hybrid Code Networks (HCNs), which combine an RNN with domain-specific knowledge encoded as software and system action templates. Compared to existing end-to-end approaches, HCNs considerably reduce the amount of training data required, while retaining the key benefit of inferring a latent representation of dialog state. In addition, HCNs can be optimized with supervised learning, reinforcement learning, or a mixture of both. HCNs attain state-of-the-art performance on the bAbI dialog dataset, and outperform two commercially deployed customer-facing dialog systems.
Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Feb 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 17; 2022: 4; 2023: 5; 2024: 2; 2025: 2.
31 papers.
Sort:
By area:
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2021Action-Based Conversations Dataset: A Corpus for Building More In-Depth Task-Oriented Dialogue Systemscited by 73
- 2023Are LLMs All You Need for Task-Oriented Dialogue?cited by 52
- 2021Multilingual Autoregressive Entity Linkingcited by 50
- 2025Process-Supervised Reinforcement Learning for Code Generationcited by 21
- 2023End-to-end Task-oriented Dialogue: A Survey of Tasks, Methods, and Future Directionscited by 17
- 2021Reference-Centric Models for Grounded Collaborative Dialoguecited by 15
- 2021Alexa Conversations: An Extensible Data-driven Approach for Building Task-oriented Dialogue Systemscited by 14
- 2023Reinforcement Learning for Generative AI: A Surveycited by 11
- 2022CGoDial: A Large-Scale Benchmark for Chinese Goal-oriented Dialog Evaluationcited by 9
- 2021A Cooperative Memory Network for Personalized Task-oriented Dialogue Systems with Incomplete User Profilescited by 8
- 2021Can I Be of Further Assistance? Using Unstructured Knowledge Access to Improve Task-oriented Conversational Modelingcited by 8
19 more
- 2021Faster Deep Reinforcement Learning with Slower Online Networkcited by 7
- 2023Conversational Tree Search: A New Hybrid Dialog Taskcited by 7
- 2021A Student-Teacher Architecture for Dialog Domain Adaptation under the Meta-Learning Settingcited by 5
- 2019A Modular Task-oriented Dialogue System Using a Neural Mixture-of-Expertscited by 4
- 2024Towards a Zero-Data, Controllable, Adaptive Dialog Systemcited by 4
- 2021Towards Zero and Few-shot Knowledge-seeking Turn Detection in Task-orientated Dialogue Systemscited by 3
- 2021SYNERGY: Building Task Bots at Scale Using Symbolic Knowledge and Machine Teachingcited by 3
- 2021Task-oriented Dialogue Systems: performance vs. quality-optima, a reviewcited by 3
- 2022Neuro-Symbolic Visual Dialogcited by 3
- 2021How to Evaluate Your Dialogue Models: A Review of Approachescited by 2
- 2021Physics-informed Evolutionary Strategy based Control for Mitigating Delayed Voltage Recoverycited by 2
- 2025Prior Lessons of Incremental Dialogue and Robot Action Management for the Age of Language Modelscited by 2
- 2021Training like Playing: A Reinforcement Learning And Knowledge Graph-based framework for building Automatic Consultation System in Medical Fieldcited by 1
- 2022Taming Continuous Posteriors for Latent Variational Dialogue Policiescited by 1
- 2021A Neural Conversation Generation Model via Equivalent Shared Memory Investigationcited by 0
- 2021Every time I fire a conversational designer, the performance of the dialog system goes downcited by 0
- 2022Reinforcement Learning of Multi-Domain Dialog Policies Via Action Embeddingscited by 0
- 2023DiQAD: A Benchmark Dataset for End-to-End Open-domain Dialogue Assessmentcited by 0
- 2024Many Hands Make Light Work: Task-Oriented Dialogue System with Module-Based Mixture-of-Expertscited by 0
- 2025Process-Supervised Reinforcement Learning for Code Generation3 Feb 2025
- 2025Prior Lessons of Incremental Dialogue and Robot Action Management for the Age of Language Models1 Jan 2025
- 2024Many Hands Make Light Work: Task-Oriented Dialogue System with Module-Based Mixture-of-Experts16 May 2024
- 2024Towards a Zero-Data, Controllable, Adaptive Dialog System26 Mar 2024
- 2023End-to-end Task-oriented Dialogue: A Survey of Tasks, Methods, and Future Directions15 Nov 2023
- 2023DiQAD: A Benchmark Dataset for End-to-End Open-domain Dialogue Assessment25 Oct 2023
- 2023Reinforcement Learning for Generative AI: A Survey28 Aug 2023
- 2023Are LLMs All You Need for Task-Oriented Dialogue?13 Apr 2023
- 2023Conversational Tree Search: A New Hybrid Dialog Task17 Mar 2023
- 2022CGoDial: A Large-Scale Benchmark for Chinese Goal-oriented Dialog Evaluation21 Nov 2022
- 2022Neuro-Symbolic Visual Dialog22 Aug 2022
- 2022Reinforcement Learning of Multi-Domain Dialog Policies Via Action Embeddings1 Jul 2022
19 more
- 2022Taming Continuous Posteriors for Latent Variational Dialogue Policies16 May 2022
- 2021Task-oriented Dialogue Systems: performance vs. quality-optima, a review21 Dec 2021
- 2021Faster Deep Reinforcement Learning with Slower Online Network10 Dec 2021
- 2021Physics-informed Evolutionary Strategy based Control for Mitigating Delayed Voltage Recovery29 Nov 2021
- 2021SYNERGY: Building Task Bots at Scale Using Symbolic Knowledge and Machine Teaching21 Oct 2021
- 2021Every time I fire a conversational designer, the performance of the dialog system goes down27 Sep 2021
- 2021Towards Zero and Few-shot Knowledge-seeking Turn Detection in Task-orientated Dialogue Systems18 Sep 2021
- 2021Reference-Centric Models for Grounded Collaborative Dialogue10 Sep 2021
- 2021A Neural Conversation Generation Model via Equivalent Shared Memory Investigation20 Aug 2021
- 2021How to Evaluate Your Dialogue Models: A Review of Approaches3 Aug 2021
- 2021Can I Be of Further Assistance? Using Unstructured Knowledge Access to Improve Task-oriented Conversational Modeling16 Jun 2021
- 2021Training like Playing: A Reinforcement Learning And Knowledge Graph-based framework for building Automatic Consultation System in Medical Field14 Jun 2021
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Survey10 May 2021
- 2021Alexa Conversations: An Extensible Data-driven Approach for Building Task-oriented Dialogue Systems19 Apr 2021
- 2021A Student-Teacher Architecture for Dialog Domain Adaptation under the Meta-Learning Setting6 Apr 2021
- 2021Action-Based Conversations Dataset: A Corpus for Building More In-Depth Task-Oriented Dialogue Systems1 Apr 2021
- 2021Multilingual Autoregressive Entity Linking23 Mar 2021
- 2021A Cooperative Memory Network for Personalized Task-oriented Dialogue Systems with Incomplete User Profiles16 Feb 2021
- 2019A Modular Task-oriented Dialogue System Using a Neural Mixture-of-Experts10 Jul 2019
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2021Action-Based Conversations Dataset: A Corpus for Building More In-Depth Task-Oriented Dialogue Systemscited by 73
- 2023Are LLMs All You Need for Task-Oriented Dialogue?cited by 52
- 2021Multilingual Autoregressive Entity Linkingcited by 50
- 2025Process-Supervised Reinforcement Learning for Code Generationcited by 21
- 2023End-to-end Task-oriented Dialogue: A Survey of Tasks, Methods, and Future Directionscited by 17
- 2021Reference-Centric Models for Grounded Collaborative Dialoguecited by 15
- 2021Alexa Conversations: An Extensible Data-driven Approach for Building Task-oriented Dialogue Systemscited by 14
- 2023Reinforcement Learning for Generative AI: A Surveycited by 11
- 2022CGoDial: A Large-Scale Benchmark for Chinese Goal-oriented Dialog Evaluationcited by 9
- 2021A Cooperative Memory Network for Personalized Task-oriented Dialogue Systems with Incomplete User Profilescited by 8
- 2021Can I Be of Further Assistance? Using Unstructured Knowledge Access to Improve Task-oriented Conversational Modelingcited by 8
12 most cited of 29 All 29 (JSON)
- 2025Process-Supervised Reinforcement Learning for Code Generation3 Feb 2025
- 2025Prior Lessons of Incremental Dialogue and Robot Action Management for the Age of Language Models1 Jan 2025
- 2024Towards a Zero-Data, Controllable, Adaptive Dialog System26 Mar 2024
- 2023End-to-end Task-oriented Dialogue: A Survey of Tasks, Methods, and Future Directions15 Nov 2023
- 2023DiQAD: A Benchmark Dataset for End-to-End Open-domain Dialogue Assessment25 Oct 2023
- 2023Reinforcement Learning for Generative AI: A Survey28 Aug 2023
- 2023Are LLMs All You Need for Task-Oriented Dialogue?13 Apr 2023
- 2023Conversational Tree Search: A New Hybrid Dialog Task17 Mar 2023
- 2022CGoDial: A Large-Scale Benchmark for Chinese Goal-oriented Dialog Evaluation21 Nov 2022
- 2022Neuro-Symbolic Visual Dialog22 Aug 2022
- 2022Reinforcement Learning of Multi-Domain Dialog Policies Via Action Embeddings1 Jul 2022
- 2022Taming Continuous Posteriors for Latent Variational Dialogue Policies16 May 2022
12 newest of 29 All 29 (JSON)