Multivalent Entailment Graphs for Question Answering
Not on the map. Why?
Abstract (arXiv)
Drawing inferences between open-domain natural language predicates is a necessity for true language understanding. There has been much progress in unsupervised learning of entailment graphs for this purpose. We make three contributions: (1) we reinterpret the Distributional Inclusion Hypothesis to model entailment between predicates of different valencies, like DEFEAT(Biden, Trump) entails WIN(Biden); (2) we actualize this theory by learning unsupervised Multivalent Entailment Graphs of open-domain predicates; and (3) we demonstrate the capabilities of these graphs on a novel question answering task. We show that directional entailment is more helpful for inference than bidirectional similarity on questions of fine-grained semantics. We also show that drawing on evidence across valencies answers more questions than by using only the same valency evidence.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 6 of its 37 references that are in the map. First posted on arXiv 16 Apr 2021.
Builds on
6 of 37 references.
References · 6
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,140
- 2019Language Models as Knowledge Bases?cited by 1,922
- 2019Probabilistic Models of Relational Implicationcited by 17
- 2016Distributional Inclusion Hypothesis for Tensor-based Compositioncited by 4
Built on by
Citing papers per year: 2021: 2; 2022: 3; 2023: 3; 2024: 2.
10 papers.
- 2023Sources of Hallucination by Large Language Models on Inference Taskscited by 168
- 2024Editing Conceptual Knowledge for Large Language Modelscited by 21
- 2023AbsPyramid: Benchmarking the Abstraction Ability of Language Models with a Unified Entailment Graphcited by 17
- 2024AbsInstruct: Eliciting Abstraction Ability from LLMs through Explanation Tuning with Plausibility Estimationcited by 14
- 2022Entailment Graph Learning with Textual Entailment and Soft Transitivitycited by 11
- 2022Smoothing Entailment Graphs with Language Modelscited by 8
- 2022Language Models Are Poor Learners of Directional Inferencecited by 4
- 2021Continuous Entailment Patterns for Lexical Inference in Contextcited by 3
- 2021Blindness to Modality Helps Entailment Graph Miningcited by 2
- 2023From the One, Judge of the Whole: Typed Entailment Graph Construction with Predicate Generationcited by 0
- 2024Editing Conceptual Knowledge for Large Language Models10 Mar 2024
- 2024AbsInstruct: Eliciting Abstraction Ability from LLMs through Explanation Tuning with Plausibility Estimation16 Feb 2024
- 2023AbsPyramid: Benchmarking the Abstraction Ability of Language Models with a Unified Entailment Graph15 Nov 2023
- 2023From the One, Judge of the Whole: Typed Entailment Graph Construction with Predicate Generation7 Jun 2023
- 2023Sources of Hallucination by Large Language Models on Inference Tasks23 May 2023
- 2022Language Models Are Poor Learners of Directional Inference10 Oct 2022
- 2022Smoothing Entailment Graphs with Language Models30 Jul 2022
- 2022Entailment Graph Learning with Textual Entailment and Soft Transitivity7 Apr 2022
- 2021Blindness to Modality Helps Entailment Graph Mining21 Sep 2021
- 2021Continuous Entailment Patterns for Lexical Inference in Context8 Sep 2021