mlsanityData to 7 Oct 2026

Attentive Tree-structured Network for Monotonicity Reasoning

arXiv 2101.00540 ↗First posted 3 Jan 2021cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Many state-of-art neural models designed for monotonicity reasoning perform poorly on downward inference. To address this shortcoming, we developed an attentive tree-structured neural network. It consists of a tree-based long-short-term-memory network (Tree-LSTM) with soft attention. It is designed to model the syntactic parse tree information from the sentence pair of a reasoning task. A self-attentive aggregator is used for aligning the representations of the premise and the hypothesis. We present our model and evaluate it using the Monotonicity Entailment Dataset (MED). We show and attempt to explain that our model outperforms existing models on MED.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 15 of its 25 references that are in the map. First posted on arXiv 3 Jan 2021.

Builds on

15 of 25 references.

References · 15

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,665
  4. 2015A large annotated corpus for learning natural language inferencecited by 1,837
  5. 2017Supervised Learning of Universal Sentence Representations from Natural Language Inference Datacited by 428
  6. 2017A Structured Self-attentive Sentence Embeddingcited by 318
  7. 2015Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networkscited by 305
  8. 2016A Decomposable Attention Model for Natural Language Inferencecited by 214
  9. 2016Enhanced LSTM for Natural Language Inferencecited by 199
  10. 2017Bilateral Multi-Perspective Matching for Natural Language Sentencescited by 120
  11. 2019Probing Natural Language Inference Models through Semantic Fragmentscited by 64
  12. 2019Can neural networks understand monotonicity reasoning?cited by 45
3 more
  1. 2019HELP: A Dataset for Identifying Shortcomings of Neural Models in Monotonicity Reasoningcited by 35
  2. 2016Modelling Sentence Pairs with Tree-structured Attentive Encodercited by 3
  3. 2017Textual Entailment with Structured Attentions and Compositioncited by 2

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.