mlsanityData to 7 Oct 2026

Modeling Event Plausibility with Consistent Conceptual Abstraction

arXiv 2104.10247 ↗First posted 20 Apr 2021cs.CLcited by 20

Not on the map. Why?

Abstract (arXiv)

Understanding natural language requires common sense, one aspect of which is the ability to discern the plausibility of events. While distributional models -- most recently pre-trained, Transformer language models -- have demonstrated improvements in modeling event plausibility, their performance still falls short of humans'. In this work, we show that Transformer-based plausibility models are markedly inconsistent across the conceptual classes of a lexical hierarchy, inferring that "a person breathing" is plausible while "a dentist breathing" is not, for example. We find this inconsistency persists even when models are softly injected with lexical knowledge, and we present a simple post-hoc method of forcing model consistency that improves correlation with human plausibility judgements.

Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 22 of its 52 references that are in the map. First posted on arXiv 20 Apr 2021.

Builds on

22 of 52 references.

References · 22

  1. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  2. 2019Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inferencecited by 864
  3. 2018Annotation Artifacts in Natural Language Inference Datacited by 656
  4. 2019K-BERT: Enabling Language Representation with Knowledge Graphcited by 303
  5. 2019Abductive Commonsense Reasoningcited by 300
  6. 2018Hypothesis Only Baselines in Natural Language Inferencecited by 291
  7. 2020COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphscited by 254
  8. 2019ASER: A Large-scale Eventuality Knowledge Graphcited by 89
  9. 2020TransOMCS: From Linguistic Graphs to Commonsense Knowledgecited by 52
  10. 2019Universal Dependency Parsing from Scratchcited by 46
  11. 2019Can neural networks understand monotonicity reasoning?cited by 45
  12. 2020Probing Linguistic Systematicitycited by 37
10 more
  1. 2016Ordinal Common-sense Inferencecited by 35
  2. 2019A Surprisingly Robust Trick for Winograd Schema Challengecited by 30
  3. 2018Modeling Semantic Plausibility by Injecting World Knowledgecited by 24
  4. 2020Adapting BERT for Word Sense Disambiguation with Gloss Selection Objective and Example Sentencescited by 14
  5. 2019Knowledge-aware Pronoun Coreference Resolutioncited by 11
  6. 2019Can a Gorilla Ride a Camel? Learning Semantic Plausibility from Textcited by 9
  7. 2019SP-10K: A Large-scale Evaluation Set for Selectional Preference Acquisitioncited by 8
  8. 2020On the Role of Conceptualization in Commonsense Knowledge Graph Constructioncited by 7
  9. 2018Representing Verbs as Argument Conceptscited by 6
  10. 2017Ontology-Aware Token Embeddings for Prepositional Phrase Attachmentcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 5; 2023: 4; 2024: 5; 2025: 3; 2026: 2.

20 papers.

Sort:

By area:

  1. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
  2. 2022Event knowledge in large language models: the gap between the impossible and the unlikelycited by 44
  3. 2023Editing Common Sense in Transformerscited by 28
  4. 2021A Consciousness-Inspired Planning Agent for Model-Based Reinforcement Learningcited by 27
  5. 2023CAT: A Contextualized Conceptualization and Instantiation Framework for Commonsense Reasoningcited by 25
  6. 2022Acquiring and Modelling Abstract Commonsense Knowledge via Conceptualizationcited by 17
  7. 2024Commonsense Knowledge Editing Based on Free-Text in LLMscited by 16
  8. 2024Reasons and Solutions for the Decline in Model Performance after Editingcited by 7
  9. 2022Better Language Model with Hypernym Class Predictioncited by 5
  10. 2022Does Entity Abstraction Help Generative Transformers Reason?cited by 3
  11. 2022Possible Stories: Evaluating Situated Commonsense Reasoning under Multiple Possible Scenarioscited by 3
  12. 2024A Dataset for Physical and Abstract Plausibility and Sources of Human Disagreementcited by 3
8 more
  1. 2023Made of Steel? Learning Plausible Materials for Components in the Vehicle Repair Domaincited by 2
  2. 2025Know-MRI: A Knowledge Mechanisms Revealer&Interpreter for Large Language Modelscited by 1
  3. 2024EntailE: Introducing Textual Entailment in Commonsense Knowledge Graph Completioncited by 0
  4. 2024Plausible-Parrots @ MSP2023: Enhancing Semantic Plausibility Modeling using Entity and Event Knowledgecited by 0
  5. 2025Plausibility Vaccine: Injecting LLM Knowledge for Event Plausibilitycited by 0
  6. 2025Modelling Adjectival Modification Effects on Semantic Plausibilitycited by 0
  7. 2026Contextualising (Im)plausible Events Triggers Figurative Languagecited by 0
  8. 2026Break Through the Compression Bottleneck: From Theory to Practicecited by 0