Lexicosyntactic Inference in Neural Models
Not on the map. Why?
Abstract (arXiv)
We investigate neural models' ability to capture lexicosyntactic inferences: inferences triggered by the interaction of lexical and syntactic information. We take the task of event factuality prediction as a case study and build a factuality judgment dataset for all English clause-embedding verbs in various syntactic contexts. We use this dataset, which we make publicly available, to probe the behavior of current state-of-the-art neural systems, showing that these systems make certain systematic errors that are clearly visible through the lens of factuality prediction.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Aug 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 0; 2023: 3; 2024: 1; 2025: 3; 2026: 1.
14 papers.
Sort:
- 2021Dynabench: Rethinking Benchmarking in NLPcited by 447
- 2023SemEval-2023 Task 11: Learning With Disagreements (LeWiDi)cited by 52
- 2021NOPE: A Corpus of Naturally-Occurring Presuppositions in Englishcited by 23
- 2021Exploring Transitivity in Neural NLI Models through Veridicalitycited by 15
- 2021He Thinks He Knows Better than the Doctors: BERT for Event Factuality Fails on Pragmaticscited by 12
- 2025LeWiDi-2025 at NLPerspectives: Third Edition of the Learning with Disagreements Shared Taskcited by 8
- 2023Finding Common Ground: Annotating and Predicting Common Ground in Spoken Conversationscited by 6
- 2021Joint Universal Syntactic and Semantic Parsingcited by 5
- 2023SETI: Systematicity Evaluation of Textual Inferencecited by 4
- 2021Intensionalizing Abstract Meaning Representations: Non-Veridicality and Scopecited by 2
- 2024Multimodal Belief Predictioncited by 1
- 2025Zero-Shot Belief: A Hard Problem for LLMscited by 0
- 2026UO-FIE: Combining Exact-Label Supervision with Graded Utility for Factivity Inference23 Sep 2026
- 2025LeWiDi-2025 at NLPerspectives: Third Edition of the Learning with Disagreements Shared Task9 Oct 2025
- 2025Exploring Graph Representations of Logical Forms for Language Modeling20 May 2025
- 2025Zero-Shot Belief: A Hard Problem for LLMs12 Feb 2025
- 2024Multimodal Belief Prediction11 Jun 2024
- 2023Finding Common Ground: Annotating and Predicting Common Ground in Spoken Conversations2 Nov 2023
- 2023SETI: Systematicity Evaluation of Textual Inference24 May 2023
- 2023SemEval-2023 Task 11: Learning With Disagreements (LeWiDi)28 Apr 2023
- 2021Intensionalizing Abstract Meaning Representations: Non-Veridicality and Scope20 Sep 2021
- 2021NOPE: A Corpus of Naturally-Occurring Presuppositions in English14 Sep 2021
- 2021He Thinks He Knows Better than the Doctors: BERT for Event Factuality Fails on Pragmatics2 Jul 2021
- 2021Joint Universal Syntactic and Semantic Parsing12 Apr 2021
2 more
- 2021Dynabench: Rethinking Benchmarking in NLP7 Apr 2021
- 2021Exploring Transitivity in Neural NLI Models through Veridicality26 Jan 2021
- 2021Dynabench: Rethinking Benchmarking in NLPcited by 447
- 2023SemEval-2023 Task 11: Learning With Disagreements (LeWiDi)cited by 52
- 2021NOPE: A Corpus of Naturally-Occurring Presuppositions in Englishcited by 23
- 2021Exploring Transitivity in Neural NLI Models through Veridicalitycited by 15
- 2021He Thinks He Knows Better than the Doctors: BERT for Event Factuality Fails on Pragmaticscited by 12
- 2025LeWiDi-2025 at NLPerspectives: Third Edition of the Learning with Disagreements Shared Taskcited by 8
- 2023Finding Common Ground: Annotating and Predicting Common Ground in Spoken Conversationscited by 6
- 2021Joint Universal Syntactic and Semantic Parsingcited by 5
- 2023SETI: Systematicity Evaluation of Textual Inferencecited by 4
- 2021Intensionalizing Abstract Meaning Representations: Non-Veridicality and Scopecited by 2
- 2024Multimodal Belief Predictioncited by 1
- 2025Zero-Shot Belief: A Hard Problem for LLMscited by 0
12 most cited of 14 All 14 (JSON)
- 2026UO-FIE: Combining Exact-Label Supervision with Graded Utility for Factivity Inference23 Sep 2026
- 2025LeWiDi-2025 at NLPerspectives: Third Edition of the Learning with Disagreements Shared Task9 Oct 2025
- 2025Exploring Graph Representations of Logical Forms for Language Modeling20 May 2025
- 2025Zero-Shot Belief: A Hard Problem for LLMs12 Feb 2025
- 2024Multimodal Belief Prediction11 Jun 2024
- 2023Finding Common Ground: Annotating and Predicting Common Ground in Spoken Conversations2 Nov 2023
- 2023SETI: Systematicity Evaluation of Textual Inference24 May 2023
- 2023SemEval-2023 Task 11: Learning With Disagreements (LeWiDi)28 Apr 2023
- 2021Intensionalizing Abstract Meaning Representations: Non-Veridicality and Scope20 Sep 2021
- 2021NOPE: A Corpus of Naturally-Occurring Presuppositions in English14 Sep 2021
- 2021He Thinks He Knows Better than the Doctors: BERT for Event Factuality Fails on Pragmatics2 Jul 2021
- 2021Joint Universal Syntactic and Semantic Parsing12 Apr 2021
12 newest of 14 All 14 (JSON)