Semantically Conditioned LSTM-based Natural Language Generation for Spoken Dialogue Systems
Not on the map. Why?
Abstract (arXiv)
Natural language generation (NLG) is a critical component of spoken dialogue and it has a significant impact both on usability and perceived quality. Most NLG systems in common use employ rules and heuristics and tend to generate rigid and stylised responses without the natural variation of human language. They are also not easily scaled to systems covering multiple domains and languages. This paper presents a statistical language generator based on a semantically controlled Long Short-term Memory (LSTM) structure. The LSTM generator can learn from unaligned data by jointly optimising sentence planning and surface realisation using a simple cross entropy training criterion, and language variation can be easily achieved by sampling from output candidates. With fewer heuristics, an objective evaluation in two differing test domains showed the proposed method improved performance compared to previous methods. Human judges scored the LSTM system higher on informativeness and naturalness and overall preferred it to the other systems.
Key facts. Cited by 134 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Aug 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 3; 2019: 2; 2020: 0; 2021: 36; 2022: 35; 2023: 27; 2024: 21; 2025: 5; 2026: 5.
134 papers.
Sort:
By area:
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
- 2018An Algorithmic Perspective on Imitation Learningcited by 455
- 2023GPTScore: Evaluate as You Desirecited by 357
- 2022Towards a Unified Multi-Dimensional Evaluator for Text Generationcited by 264
- 2021GODIVA: Generating Open-DomaIn Videos from nAtural Descriptionscited by 254
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
- 2023X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languagescited by 127
- 2023Textually Pretrained Speech Language Modelscited by 99
- 2025A Comprehensive Survey of Mixture-of-Experts: Algorithms, Theory, and Applicationscited by 91
- 2023MEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and Taskscited by 57
- 2023Calibrating LLM-Based Evaluatorcited by 53
38 more
- 2021Shades of BLEU, Flavours of Success: The Case of MultiWOZcited by 48
- 2024Recent Advances of Foundation Language Models-based Continual Learning: A Surveycited by 46
- 2021Controlling Hallucinations at Word Level in Data-to-Text Generationcited by 41
- 2022Neural Approaches to Conversational Information Retrievalcited by 41
- 2021Automatic Text Evaluation through the Lens of Wasserstein Barycenterscited by 38
- 2024Leveraging Large Language Models for NLG Evaluation: Advances and Challengescited by 37
- 2021InfoLM: A New Metric to Evaluate Summarization & Data2Text Generationcited by 33
- 2024HD-Eval: Aligning Large Language Model Evaluators Through Hierarchical Criteria Decompositioncited by 33
- 2022Continual Sequence Generation with Adaptive Compositional Modulescited by 31
- 2021CINS: Comprehensive Instruction for Few-shot Learning in Task-oriented Dialog Systemscited by 30
- 2022Visualize Before You Write: Imagination-Guided Open-Ended Text Generationcited by 30
- 2023X-Eval: Generalizable Multi-aspect Text Evaluation via Augmented Instruction Tuning with Auxiliary Evaluation Aspectscited by 28
- 2021Focused Attention Improves Document-Grounded Generationcited by 24
- 2021Semantic Representation for Dialogue Modelingcited by 24
- 2024Reliable LLM-based User Simulator for Task-Oriented Dialogue Systemscited by 24
- 2021Better Feature Integration for Named Entity Recognitioncited by 22
- 2022GenTUS: Simulating User Behaviour and Language in Task-oriented Dialogues with Generative Transformerscited by 22
- 2022ConvLab-3: A Flexible Dialogue System Toolkit Based on a Unified Data Formatcited by 22
- 2018Deep Dyna-Q: Integrating Planning for Task-Completion Dialogue Policy Learningcited by 21
- 2021Improving Compositional Generalization with Self-Training for Data-to-Text Generationcited by 19
- 2023Fantastic Rewards and How to Tame Them: A Case Study on Reward Learning for Task-oriented Dialogue Systemscited by 19
- 2023In-Context Learning User Simulators for Task-Oriented Dialog Systemscited by 19
- 2024Themis: A Reference-free NLG Evaluation Language Model with Flexibility and Interpretabilitycited by 19
- 2021Refocusing on Relevance: Personalization in NLGcited by 18
- 2022Toward Human-Like Evaluation for Natural Language Generation with Error Analysiscited by 18
- 2021A Pseudo-Metric between Probability Distributions based on Depth-Trimmed Regionscited by 17
- 2021AUGNLG: Few-shot Natural Language Generation using Self-trained Data Augmentationcited by 17
- 2021Learning to Select External Knowledge with Multi-Scale Negative Samplingcited by 16
- 2022ASDOT: Any-Shot Data-to-Text Generation with Pretrained Language Modelscited by 14
- 2023Controlling Personality Style in Dialogue with Zero-Shot Prompt-Based Learningcited by 14
- 2018Switch-based Active Deep Dyna-Q: Efficient Adaptive Planning for Task-Completion Dialogue Policy Learningcited by 12
- 2023X-RiSAWOZ: High-Quality End-to-End Multilingual Dialogue Datasets and Few-shot Agentscited by 12
- 2021DYPLOC: Dynamic Planning of Content Using Mixed Language Models for Text Generationcited by 11
- 2021Attention Is Indeed All You Need: Semantically Attention-Guided Decoding for Data-to-Text NLGcited by 11
- 2022Parameter-Efficient Abstractive Question Answering over Tables or Textcited by 11
- 2022KETOD: Knowledge-Enriched Task-Oriented Dialoguecited by 11
- 2022Mars: Modeling Context & State Representations with Contrastive Learning for End-to-End Task-Oriented Dialogcited by 11
- 2021Style Control for Schema-Guided Natural Language Generationcited by 10
50 most cited of 134 All 134 (JSON)
- 2026VERITYGATE: A Four-Gate Schema-Level Faithfulness Framework and Paired Benchmark for Grounded LLM Narrations over Structured Evidence30 Sep 2026
- 2026Unlocking Proactivity in Task-Oriented Dialogue21 May 2026
- 2026Impact of enriched meaning representations for language generation in dialogue tasks: A comprehensive exploration of the relevance of tasks, corpora and metrics31 Mar 2026
- 2026Reinforcing Real-world Service Agents: Balancing Utility and Cost in Task-oriented Dialogue26 Feb 2026
- 2026Sparse Adapter Fusion for Continual Learning in NLP20 Jan 2026
- 2025Fine-tuning of Large Language Models for Domain-Specific Cybersecurity Knowledge25 Sep 2025
- 2025Natural Language Generation20 Mar 2025
- 2025OpeNLGauge: An Explainable Metric for NLG Evaluation with Open-Weights LLMs14 Mar 2025
- 2025A Comprehensive Survey of Mixture-of-Experts: Algorithms, Theory, and Applications10 Mar 2025
- 2025HPSS: Heuristic Prompting Strategy Search for LLM Evaluators18 Feb 2025
- 2024Large Language Models Are Active Critics in NLG Evaluation14 Oct 2024
- 2024Training Zero-Shot Generalizable End-to-End Task-Oriented Dialog System Without Turn-level Dialog Annotations21 Jul 2024
38 more
- 2024Impact of Model Size on Fine-tuned LLM Performance in Data-to-Text Generation: A State-of-the-Art Investigation19 Jul 2024
- 2024Themis: A Reference-free NLG Evaluation Language Model with Flexibility and Interpretability26 Jun 2024
- 2024Recent Advances of Foundation Language Models-based Continual Learning: A Survey28 May 2024
- 2024A System for Automatic English Text Expansion28 May 2024
- 2024Limits of Theory of Mind Modelling in Dialogue-Based Collaborative Plan Acquisition21 May 2024
- 2024Overcoming Catastrophic Forgetting by Exemplar Selection in Task-oriented Dialogue System16 May 2024
- 2024RepEval: Effective Text Evaluation with LLM Representation30 Apr 2024
- 2024Modeling Low-Resource Health Coaching Dialogues via Neuro-Symbolic Goal Summarization and Text-Units-Text Generation16 Apr 2024
- 2024Towards Enhancing Health Coaching Dialogue in Low-Resource Settings13 Apr 2024
- 2024Entertainment chatbot for the digital inclusion of elderly people without abstraction capabilities29 Mar 2024
- 2024Is Reference Necessary in the Evaluation of NLG Systems? When and Where?21 Mar 2024
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systems28 Feb 2024
- 2024HD-Eval: Aligning Large Language Model Evaluators Through Hierarchical Criteria Decomposition24 Feb 2024
- 2024GPT-HateCheck: Can LLMs Write Better Functional Tests for Hate Speech Detection?23 Feb 2024
- 2024Reliable LLM-based User Simulator for Task-Oriented Dialogue Systems20 Feb 2024
- 2024Enhancing End-to-End Multi-Task Dialogue Systems: A Study on Intrinsic Motivation Reinforcement Learning Algorithms for Improved Training and Adaptability31 Jan 2024
- 2024Imitation Learning Inputting Image Feature to Each Layer of Neural Network18 Jan 2024
- 2024Leveraging Large Language Models for NLG Evaluation: Advances and Challenges13 Jan 2024
- 2024Autocompletion of Chief Complaints in the Electronic Health Records using Large Language Models11 Jan 2024
- 2023Compositional Generalization for Data-to-Text Generation5 Dec 2023
- 2023X-Eval: Generalizable Multi-aspect Text Evaluation via Augmented Instruction Tuning with Auxiliary Evaluation Aspects15 Nov 2023
- 2023MEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and Tasks13 Nov 2023
- 2023Sequence-Level Certainty Reduces Hallucination In Knowledge-Grounded Dialogue Generation28 Oct 2023
- 2023Contextual Data Augmentation for Task-Oriented Dialog Systems16 Oct 2023
- 2023Lifelong Sequence Generation with Dynamic Module Expansion and Adaptation15 Oct 2023
- 2023Calibrating LLM-Based Evaluator23 Sep 2023
- 2023Controllable Generation of Dialogue Acts for Dialogue Systems via Few-Shot Response Generation and Ranking26 Jul 2023
- 2023Towards a Neural Era in Dialogue Management for Collaboration: A Literature Survey18 Jul 2023
- 2023DecompEval: Evaluating Generated Texts as Unsupervised Decomposed Question Answering13 Jul 2023
- 2023Advancements in Scientific Controllable Text Generation Methods8 Jul 2023
- 2023X-RiSAWOZ: High-Quality End-to-End Multilingual Dialogue Datasets and Few-shot Agents30 Jun 2023
- 2023Unsupervised Text Embedding Space Generation Using Generative Adversarial Networks for Text Synthesis19 Jun 2023
- 2023In-Context Learning User Simulators for Task-Oriented Dialog Systems1 Jun 2023
- 2023Healing Unsafe Dialogue Responses with Weak Supervision Signals25 May 2023
- 2023Textually Pretrained Speech Language Models22 May 2023
- 2023X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languages7 May 2023
- 2023Semantic Space Grounded Weighted Decoding for Multi-Attribute Controllable Dialogue Generation4 May 2023
- 2023Zero-Shot Generalizable End-to-End Task-Oriented Dialog System using Context Summarization and Domain Schema28 Mar 2023
50 newest of 134 All 134 (JSON)
- 2024Imitation Learning Inputting Image Feature to Each Layer of Neural Network18 Jan 2024
- 2019Imitation Learning of Factored Multi-agent Reactive Models12 Mar 2019
- 2018An Algorithmic Perspective on Imitation Learning16 Nov 2018
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
- 2023GPTScore: Evaluate as You Desirecited by 357
- 2022Towards a Unified Multi-Dimensional Evaluator for Text Generationcited by 264
- 2021GODIVA: Generating Open-DomaIn Videos from nAtural Descriptionscited by 254
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
- 2023Textually Pretrained Speech Language Modelscited by 99
- 2023MEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and Taskscited by 57
- 2023Calibrating LLM-Based Evaluatorcited by 53
- 2021Shades of BLEU, Flavours of Success: The Case of MultiWOZcited by 48
- 2024Recent Advances of Foundation Language Models-based Continual Learning: A Surveycited by 46
- 2021Controlling Hallucinations at Word Level in Data-to-Text Generationcited by 41
12 most cited of 123 All 123 (JSON)
- 2026VERITYGATE: A Four-Gate Schema-Level Faithfulness Framework and Paired Benchmark for Grounded LLM Narrations over Structured Evidence30 Sep 2026
- 2026Unlocking Proactivity in Task-Oriented Dialogue21 May 2026
- 2026Impact of enriched meaning representations for language generation in dialogue tasks: A comprehensive exploration of the relevance of tasks, corpora and metrics31 Mar 2026
- 2026Sparse Adapter Fusion for Continual Learning in NLP20 Jan 2026
- 2025Fine-tuning of Large Language Models for Domain-Specific Cybersecurity Knowledge25 Sep 2025
- 2025Natural Language Generation20 Mar 2025
- 2025OpeNLGauge: An Explainable Metric for NLG Evaluation with Open-Weights LLMs14 Mar 2025
- 2025HPSS: Heuristic Prompting Strategy Search for LLM Evaluators18 Feb 2025
- 2024Large Language Models Are Active Critics in NLG Evaluation14 Oct 2024
- 2024Training Zero-Shot Generalizable End-to-End Task-Oriented Dialog System Without Turn-level Dialog Annotations21 Jul 2024
- 2024Impact of Model Size on Fine-tuned LLM Performance in Data-to-Text Generation: A State-of-the-Art Investigation19 Jul 2024
- 2024Themis: A Reference-free NLG Evaluation Language Model with Flexibility and Interpretability26 Jun 2024
12 newest of 123 All 123 (JSON)