mlsanityData to 7 Oct 2026

ASER: Towards Large-scale Commonsense Knowledge Acquisition via Higher-order Selectional Preference over Eventualities

arXiv 2104.02137 ↗First posted 5 Apr 2021cs.AI cs.CLcited by 28

Not on the map. Why?

Abstract (arXiv)

Commonsense knowledge acquisition and reasoning have long been a core artificial intelligence problem. However, in the past, there has been a lack of scalable methods to collect commonsense knowledge. In this paper, we propose to develop principles for collecting commonsense knowledge based on selectional preference. We generalize the definition of selectional preference from one-hop linguistic syntactic relations to higher-order relations over linguistic graphs. Unlike previous commonsense knowledge definition (e.g., ConceptNet), selectional preference (SP) knowledge only relies on statistical distribution over linguistic graphs, which can be efficiently and accurately acquired from the unlabeled corpus with modern tools. Following this principle, we develop a large-scale eventuality (a linguistic term covering activity, state, and event)-based knowledge graph ASER, where each eventuality is represented as a dependency graph, and the relation between them is a discourse relation defined in shallow discourse parsing. The higher-order selectional preference over collected linguistic graphs reflects various kinds of commonsense knowledge. Moreover, motivated by the observation that humans understand events by abstracting the observed events to a higher level and can thus transfer their knowledge to new events, we propose a conceptualization module to significantly boost the coverage of ASER. In total, ASER contains 648 million edges between 438 million eventualities. After conceptualization with Probase, a selectional preference based concept-instance relational knowledge base, our concept graph contains 15 million conceptualized eventualities and 224 million edges between them. Detailed analysis is provided to demonstrate its quality. All the collected data, APIs, and tools are available at https://github.com/HKUST-KnowComp/ASER.

Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). Builds on 34 of its 115 references that are in the map. First posted on arXiv 5 Apr 2021.

Builds on

34 of 115 references.

References · 34

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  6. 2019Language Models as Knowledge Bases?cited by 1,922
  7. 2019How Can We Know What Language Models Know?cited by 953
  8. 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 649
  9. 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
  10. 2016A Corpus and Evaluation Framework for Deeper Understanding of Commonsense Storiescited by 413
  11. 2020COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphscited by 254
  12. 2020AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Promptscited by 246
22 more
  1. 2019Commonsense Knowledge Mining from Pretrained Modelscited by 189
  2. 2019ASER: A Large-scale Eventuality Knowledge Graphcited by 89
  3. 2020GLUCOSE: GeneraLized and COntextualized Story Explanationscited by 85
  4. 2018Event2Mind: Commonsense Inference on Events, Intents, and Reactionscited by 82
  5. 2018A Multi-Axis Annotation Scheme for Event Temporal Relationscited by 73
  6. 2018Tracking State Changes in Procedural Text: A Challenge Dataset and Models for Process Paragraph Comprehensioncited by 62
  7. 2020Joint Constrained Learning for Event-Event Relation Extractioncited by 53
  8. 2019Joint Event and Temporal Relation Extraction with Shared Representations and Structured Predictioncited by 52
  9. 2020TransOMCS: From Linguistic Graphs to Commonsense Knowledgecited by 52
  10. 2020GenericsKB: A Knowledge Base of Generic Statementscited by 51
  11. 2019Inferring Concept Hierarchies from Text Corpora via Hyperbolic Embeddingscited by 49
  12. 2020On the Importance of Word and Sentence Representation Learning in Implicit Discourse Relation Classificationcited by 40
  13. 2020Facts as Experts: Adaptable and Interpretable Neural Memory over Symbolic Knowledgecited by 37
  14. 2018Constructing Narrative Event Evolutionary Graph for Script Event Predictioncited by 33
  15. 2018Hearst Patterns Revisited: Automatic Hypernym Detection from Large Text Corporacited by 26
  16. 2019Commonsense Properties from Query Logs and Question Answering Forumscited by 26
  17. 2020Analogous Process Structure Induction for Sub-event Sequence Predictioncited by 26
  18. 2021DISCOS: Bridging the Gap between Discourse Knowledge and Commonsense Knowledgecited by 26
  19. 2020Advanced Semantics for Commonsense Knowledge Extractioncited by 24
  20. 2017Hierarchical Embeddings for Hypernymy Detection and Directionalitycited by 19
  21. 2020CoCoLM: COmplex COmmonsense Enhanced Language Model with Discourse Relationscited by 15
  22. 2019SP-10K: A Large-scale Evaluation Set for Selectional Preference Acquisitioncited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 3; 2022: 8; 2023: 10; 2024: 5; 2025: 1; 2026: 1.

28 papers.

Sort:

By area:

  1. 2024A Comprehensive Study of Knowledge Editing for Large Language Modelscited by 157
  2. 2023Boosting Language Models Reasoning with Chain-of-Knowledge Promptingcited by 77
  3. 2022Extracting Cultural Commonsense Knowledge at Scalecited by 76
  4. 2023ChatGPT Evaluation on Sentence Level Relations: A Focus on Temporal, Causal, and Discourse Relationscited by 39
  5. 2023CAT: A Contextualized Conceptualization and Instantiation Framework for Commonsense Reasoningcited by 25
  6. 2022Knowledge-in-Context: Towards Knowledgeable Semi-Parametric Language Modelscited by 24
  7. 2022FolkScope: Intention Knowledge Graph Construction for E-commerce Commonsense Discoverycited by 23
  8. 2025AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corporacited by 23
  9. 2023COLA: Contextualized Commonsense Causal Reasoning from the Causal Inference Perspectivecited by 22
  10. 2023Complex Query Answering on Eventuality Knowledge Graph with Implicit Logical Constraintscited by 21
  11. 2021Refined Commonsense Knowledge from Large-Scale Web Contentscited by 19
  12. 2022Acquiring and Modelling Abstract Commonsense Knowledge via Conceptualizationcited by 17
16 more
  1. 2023AbsPyramid: Benchmarking the Abstraction Ability of Language Models with a Unified Entailment Graphcited by 17
  2. 2021Benchmarking Commonsense Knowledge Base Population with an Effective Evaluation Datasetcited by 15
  3. 2024AbsInstruct: Eliciting Abstraction Ability from LLMs through Explanation Tuning with Plausibility Estimationcited by 14
  4. 2023Large Knowledge Model: Perspectives and Challengescited by 12
  5. 2024IntentionQA: A Benchmark for Evaluating Purchase Intention Comprehension Abilities of Language Models in E-commercecited by 11
  6. 2022SubeventWriter: Iterative Sub-event Sequence Generation with Coherence Controllercited by 10
  7. 2021Does Pre-training Induce Systematic Inference? How Masked Language Models Acquire Commonsense Knowledgecited by 8
  8. 2022PseudoReasoner: Leveraging Pseudo Labels for Commonsense Knowledge Base Populationcited by 5
  9. 2022Commonsense Knowledge Salience Evaluation with a Benchmark Dataset in E-commercecited by 4
  10. 2023Decker: Double Check with Heterogeneous Knowledge for Commonsense Fact Verificationcited by 4
  11. 2023Gold: A Global and Local-aware Denoising Framework for Commonsense Knowledge Graph Noise Detectioncited by 4
  12. 2024On the Role of Entity and Event Level Conceptualization in Generalizable Reasoning: A Survey of Tasks, Methods, Applications, and Future Directionscited by 3
  13. 2024Automatic Extraction of Relationships among Motivations, Emotions and Actions from Natural Language Textscited by 2
  14. 2022Are All Steps Equally Important? Benchmarking Essentiality Detection of Eventscited by 1
  15. 2023IEKG: A Commonsense Knowledge Graph for Idiomatic Expressionscited by 1
  16. 2026Matching Tasks to Objectives: Fine-Tuning and Prompt-Tuning Strategies for Encoder-Decoder Pre-trained Language Modelscited by 1