mlsanityData to 7 Oct 2026

Toward Diverse Precondition Generation

arXiv 2106.07117 ↗First posted 14 Jun 2021cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Language understanding must identify the logical connections between events in a discourse, but core events are often unstated due to their commonsense nature. This paper fills in these missing events by generating precondition events. Precondition generation can be framed as a sequence-to-sequence problem: given a target event, generate a possible precondition. However, in most real-world scenarios, an event can have several preconditions, requiring diverse generation -- a challenge for standard seq2seq approaches. We propose DiP, a Diverse Precondition generation system that can generate unique and diverse preconditions. DiP uses a generative process with three components -- an event sampler, a candidate generator, and a post-processor. The event sampler provides control codes (precondition triggers) which the candidate generator uses to focus its generation. Unlike other conditional generation systems, DiP automatically generates control codes without training on diverse examples. Analysis against baselines reveals that DiP improves the diversity of preconditions significantly while also generating more preconditions.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 13 of its 27 references that are in the map. First posted on arXiv 14 Jun 2021.

Builds on

13 of 27 references.

References · 13

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  5. 2016Enriching Word Vectors with Subword Informationcited by 1,578
  6. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
  7. 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,196
  8. 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 754
  9. 2018Texygen: A Benchmarking Platform for Text Generation Modelscited by 484
  10. 2019PLATO: Pre-trained Dialogue Generation Model with Discrete Latent Variablecited by 145
  11. 2020Enabling Language Models to Fill in the Blankscited by 121
  12. 2020COD3S: Diverse Generation with Discrete Semantic Signaturescited by 9
1 more
  1. 2020Modeling Preconditions in Text with a Crowd-sourced Datasetcited by 8

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 1.

2 papers.