mlsanityData to 7 Oct 2026

Adaptive Natural Language Generation for Task-oriented Dialogue via Reinforcement Learning

arXiv 2209.07873 ↗First posted 16 Sep 2022cs.CL cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

When a natural language generation (NLG) component is implemented in a real-world task-oriented dialogue system, it is necessary to generate not only natural utterances as learned on training data but also utterances adapted to the dialogue environment (e.g., noise from environmental sounds) and the user (e.g., users with low levels of understanding ability). Inspired by recent advances in reinforcement learning (RL) for language generation tasks, we propose ANTOR, a method for Adaptive Natural language generation for Task-Oriented dialogue via Reinforcement learning. In ANTOR, a natural language understanding (NLU) module, which corresponds to the user's understanding of system utterances, is incorporated into the objective function of RL. If the NLG's intentions are correctly conveyed to the NLU, which understands a system's utterances, the NLG is given a positive reward. We conducted experiments on the MultiWOZ dataset, and we confirmed that ANTOR could generate adaptive utterances against speech recognition errors and the different vocabulary levels of users.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 32 of its 50 references that are in the map. First posted on arXiv 16 Sep 2022.

Builds on

32 of 50 references.

References · 32

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2017Proximal Policy Optimization Algorithmscited by 14,441
  4. 2020Learning to summarize from human feedbackcited by 2,562
  5. 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
  6. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
  7. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
  8. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
  9. 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 760
  10. 2015Sequence Level Training with Recurrent Neural Networkscited by 568
  11. 2019Way Off-Policy Batch Deep Reinforcement Learning of Implicit Human Preferences in Dialogcited by 283
  12. 2018Neural Approaches to Conversational AIcited by 164
20 more
  1. 2016An Actor-Critic Algorithm for Sequence Predictioncited by 158
  2. 2019A Survey of Reinforcement Learning Informed by Natural Languagecited by 154
  3. 2015Semantically Conditioned LSTM-based Natural Language Generation for Spoken Dialogue Systemscited by 134
  4. 2019Learning from Dialogue after Deployment: Feed Yourself, Chatbot!cited by 102
  5. 2020Few-shot Natural Language Generation for Task-Oriented Dialogcited by 89
  6. 2018Can Neural Machine Translation be Improved with User Feedback?cited by 71
  7. 2019Rethinking Action Spaces for Reinforcement Learning in End-to-end Dialog Agents with Latent Variable Modelscited by 53
  8. 2020ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systemscited by 52
  9. 2018Controllable Neural Story Plot Generation via Reward Shapingcited by 49
  10. 2018BanditSum: Extractive Summarization as a Contextual Banditcited by 46
  11. 2019Semantically Conditioned Dialog Response Generation via Hierarchical Disentangled Self-Attentioncited by 43
  12. 2019Structured Fusion Networks for Dialogcited by 40
  13. 2020Robustness Testing of Language Understanding in Task-Oriented Dialogcited by 32
  14. 2016Multi-domain Neural Network Language Generation for Spoken Dialogue Systemscited by 18
  15. 2020Data Augmentation for Training Dialog Models Robust to Speech Recognition Errorscited by 17
  16. 2016A Context-aware Natural Language Generator for Dialogue Systemscited by 13
  17. 2018Natural Language Generation by Hierarchical Decoding with Linguistic Patternscited by 11
  18. 2017Natural Language Generation for Spoken Dialogue System using RNN Encoder-Decoder Networkscited by 5
  19. 2019Investigation of Error Simulation Techniques for Learning Dialog Policies for Conversational Error Recoverycited by 5
  20. 2022Post-processing Networks: Method for Optimizing Pipeline Task-oriented Dialogue Systems using Reinforcement Learningcited by 5

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 1.

2 papers.

  1. 2024Sharing the Cost of Success: A Game for Evaluating and Learning Collaborative Multi-Agent Instruction Giving and Following Policiescited by 2
  2. 2023Empowering NLG: Offline Reinforcement Learning for Informal Summarization in Online Domainscited by 0