mlsanityData to 7 Oct 2026

Transforming Multi-Conditioned Generation from Meaning Representation

arXiv 2101.04257 ↗First posted 12 Jan 2021cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

In task-oriented conversation systems, natural language generation systems that generate sentences with specific information related to conversation flow are useful. Our study focuses on language generation by considering various information representing the meaning of utterances as multiple conditions of generation. NLG from meaning representations, the conditions for sentence meaning, generally goes through two steps: sentence planning and surface realization. However, we propose a simple one-stage framework to generate utterances directly from MR (Meaning Representation). Our model is based on GPT2 and generates utterances with flat conditions on slot and value pairs, which does not need to determine the structure of the sentence. We evaluate several systems in the E2E dataset with 6 automatic metrics. Our system is a simple method, but it demonstrates comparable performance to previous systems in automated metrics. In addition, using only 10% of the data set without any other techniques, our model achieves comparable performance, and shows the possibility of performing zero-shot generation and expanding to other datasets.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 15 of its 31 references that are in the map. First posted on arXiv 12 Jan 2021.

Builds on

15 of 31 references.

References · 15

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  5. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
  6. 2016Enriching Word Vectors with Subword Informationcited by 1,578
  7. 2019Evaluating the State-of-the-Art of End-to-End Natural Language Generation: The E2E NLG Challengecited by 86
  8. 2018Learning Neural Templates for Text Generationcited by 61
  9. 2018Content preserving text generation with attribute controlscited by 47
  10. 2019Constrained Decoding for Neural NLG from Compositional Representations in Task-Oriented Dialoguecited by 35
  11. 2016Sequence-to-Sequence Generation for Spoken Dialogue via Deep Syntax Trees and Stringscited by 27
  12. 2020Stable Style Transformer: Delete and Generate Approach with Encoder-Decoder for Text Style Transfercited by 22
3 more
  1. 2018A Deep Ensemble Model with Slot Alignment for Sequence-to-Sequence Natural Language Generationcited by 20
  2. 2018End-to-End Content and Plan Selection for Data-to-Text Generationcited by 20
  3. 2019Designing a Symbolic Intermediate Representation for Neural Surface Realizationcited by 4

Built on by

Cited by year

Citing papers per year: 2021: 1.

1 paper.