ASER: Towards Large-scale Commonsense Knowledge Acquisition via Higher-order Selectional Preference over Eventualities
Not on the map. Why?
Abstract (arXiv)
Commonsense knowledge acquisition and reasoning have long been a core artificial intelligence problem. However, in the past, there has been a lack of scalable methods to collect commonsense knowledge. In this paper, we propose to develop principles for collecting commonsense knowledge based on selectional preference. We generalize the definition of selectional preference from one-hop linguistic syntactic relations to higher-order relations over linguistic graphs. Unlike previous commonsense knowledge definition (e.g., ConceptNet), selectional preference (SP) knowledge only relies on statistical distribution over linguistic graphs, which can be efficiently and accurately acquired from the unlabeled corpus with modern tools. Following this principle, we develop a large-scale eventuality (a linguistic term covering activity, state, and event)-based knowledge graph ASER, where each eventuality is represented as a dependency graph, and the relation between them is a discourse relation defined in shallow discourse parsing. The higher-order selectional preference over collected linguistic graphs reflects various kinds of commonsense knowledge. Moreover, motivated by the observation that humans understand events by abstracting the observed events to a higher level and can thus transfer their knowledge to new events, we propose a conceptualization module to significantly boost the coverage of ASER. In total, ASER contains 648 million edges between 438 million eventualities. After conceptualization with Probase, a selectional preference based concept-instance relational knowledge base, our concept graph contains 15 million conceptualized eventualities and 224 million edges between them. Detailed analysis is provided to demonstrate its quality. All the collected data, APIs, and tools are available at https://github.com/HKUST-KnowComp/ASER.
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). Builds on 34 of its 115 references that are in the map. First posted on arXiv 5 Apr 2021.
Builds on
34 of 115 references.
References · 34
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2019Language Models as Knowledge Bases?cited by 1,922
- 2019How Can We Know What Language Models Know?cited by 953
- 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 649
- 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
- 2016A Corpus and Evaluation Framework for Deeper Understanding of Commonsense Storiescited by 413
- 2020COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphscited by 254
- 2020AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Promptscited by 246
22 more
- 2019Commonsense Knowledge Mining from Pretrained Modelscited by 189
- 2019ASER: A Large-scale Eventuality Knowledge Graphcited by 89
- 2020GLUCOSE: GeneraLized and COntextualized Story Explanationscited by 85
- 2018Event2Mind: Commonsense Inference on Events, Intents, and Reactionscited by 82
- 2018A Multi-Axis Annotation Scheme for Event Temporal Relationscited by 73
- 2018Tracking State Changes in Procedural Text: A Challenge Dataset and Models for Process Paragraph Comprehensioncited by 62
- 2020Joint Constrained Learning for Event-Event Relation Extractioncited by 53
- 2019Joint Event and Temporal Relation Extraction with Shared Representations and Structured Predictioncited by 52
- 2020TransOMCS: From Linguistic Graphs to Commonsense Knowledgecited by 52
- 2020GenericsKB: A Knowledge Base of Generic Statementscited by 51
- 2019Inferring Concept Hierarchies from Text Corpora via Hyperbolic Embeddingscited by 49
- 2020On the Importance of Word and Sentence Representation Learning in Implicit Discourse Relation Classificationcited by 40
- 2020Facts as Experts: Adaptable and Interpretable Neural Memory over Symbolic Knowledgecited by 37
- 2018Constructing Narrative Event Evolutionary Graph for Script Event Predictioncited by 33
- 2018Hearst Patterns Revisited: Automatic Hypernym Detection from Large Text Corporacited by 26
- 2019Commonsense Properties from Query Logs and Question Answering Forumscited by 26
- 2020Analogous Process Structure Induction for Sub-event Sequence Predictioncited by 26
- 2021DISCOS: Bridging the Gap between Discourse Knowledge and Commonsense Knowledgecited by 26
- 2020Advanced Semantics for Commonsense Knowledge Extractioncited by 24
- 2017Hierarchical Embeddings for Hypernymy Detection and Directionalitycited by 19
- 2020CoCoLM: COmplex COmmonsense Enhanced Language Model with Discourse Relationscited by 15
- 2019SP-10K: A Large-scale Evaluation Set for Selectional Preference Acquisitioncited by 8
Built on by
Citing papers per year: 2021: 3; 2022: 8; 2023: 10; 2024: 5; 2025: 1; 2026: 1.
28 papers.
Sort:
By area:
- 2024A Comprehensive Study of Knowledge Editing for Large Language Modelscited by 157
- 2023Boosting Language Models Reasoning with Chain-of-Knowledge Promptingcited by 77
- 2022Extracting Cultural Commonsense Knowledge at Scalecited by 76
- 2023ChatGPT Evaluation on Sentence Level Relations: A Focus on Temporal, Causal, and Discourse Relationscited by 39
- 2023CAT: A Contextualized Conceptualization and Instantiation Framework for Commonsense Reasoningcited by 25
- 2022Knowledge-in-Context: Towards Knowledgeable Semi-Parametric Language Modelscited by 24
- 2022FolkScope: Intention Knowledge Graph Construction for E-commerce Commonsense Discoverycited by 23
- 2025AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corporacited by 23
- 2023COLA: Contextualized Commonsense Causal Reasoning from the Causal Inference Perspectivecited by 22
- 2023Complex Query Answering on Eventuality Knowledge Graph with Implicit Logical Constraintscited by 21
- 2021Refined Commonsense Knowledge from Large-Scale Web Contentscited by 19
- 2022Acquiring and Modelling Abstract Commonsense Knowledge via Conceptualizationcited by 17
16 more
- 2023AbsPyramid: Benchmarking the Abstraction Ability of Language Models with a Unified Entailment Graphcited by 17
- 2021Benchmarking Commonsense Knowledge Base Population with an Effective Evaluation Datasetcited by 15
- 2024AbsInstruct: Eliciting Abstraction Ability from LLMs through Explanation Tuning with Plausibility Estimationcited by 14
- 2023Large Knowledge Model: Perspectives and Challengescited by 12
- 2024IntentionQA: A Benchmark for Evaluating Purchase Intention Comprehension Abilities of Language Models in E-commercecited by 11
- 2022SubeventWriter: Iterative Sub-event Sequence Generation with Coherence Controllercited by 10
- 2021Does Pre-training Induce Systematic Inference? How Masked Language Models Acquire Commonsense Knowledgecited by 8
- 2022PseudoReasoner: Leveraging Pseudo Labels for Commonsense Knowledge Base Populationcited by 5
- 2022Commonsense Knowledge Salience Evaluation with a Benchmark Dataset in E-commercecited by 4
- 2023Decker: Double Check with Heterogeneous Knowledge for Commonsense Fact Verificationcited by 4
- 2023Gold: A Global and Local-aware Denoising Framework for Commonsense Knowledge Graph Noise Detectioncited by 4
- 2024On the Role of Entity and Event Level Conceptualization in Generalizable Reasoning: A Survey of Tasks, Methods, Applications, and Future Directionscited by 3
- 2024Automatic Extraction of Relationships among Motivations, Emotions and Actions from Natural Language Textscited by 2
- 2022Are All Steps Equally Important? Benchmarking Essentiality Detection of Eventscited by 1
- 2023IEKG: A Commonsense Knowledge Graph for Idiomatic Expressionscited by 1
- 2026Matching Tasks to Objectives: Fine-Tuning and Prompt-Tuning Strategies for Encoder-Decoder Pre-trained Language Modelscited by 1
- 2026Matching Tasks to Objectives: Fine-Tuning and Prompt-Tuning Strategies for Encoder-Decoder Pre-trained Language Models23 Jun 2026
- 2025AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corpora29 May 2025
- 2024Automatic Extraction of Relationships among Motivations, Emotions and Actions from Natural Language Texts2 Aug 2024
- 2024On the Role of Entity and Event Level Conceptualization in Generalizable Reasoning: A Survey of Tasks, Methods, Applications, and Future Directions16 Jun 2024
- 2024IntentionQA: A Benchmark for Evaluating Purchase Intention Comprehension Abilities of Language Models in E-commerce14 Jun 2024
- 2024AbsInstruct: Eliciting Abstraction Ability from LLMs through Explanation Tuning with Plausibility Estimation16 Feb 2024
- 2024A Comprehensive Study of Knowledge Editing for Large Language Models2 Jan 2024
- 2023IEKG: A Commonsense Knowledge Graph for Idiomatic Expressions11 Dec 2023
- 2023Large Knowledge Model: Perspectives and Challenges5 Dec 2023
- 2023AbsPyramid: Benchmarking the Abstraction Ability of Language Models with a Unified Entailment Graph15 Nov 2023
- 2023Gold: A Global and Local-aware Denoising Framework for Commonsense Knowledge Graph Noise Detection18 Oct 2023
- 2023Boosting Language Models Reasoning with Chain-of-Knowledge Prompting10 Jun 2023
16 more
- 2023Complex Query Answering on Eventuality Knowledge Graph with Implicit Logical Constraints30 May 2023
- 2023Decker: Double Check with Heterogeneous Knowledge for Commonsense Fact Verification10 May 2023
- 2023COLA: Contextualized Commonsense Causal Reasoning from the Causal Inference Perspective9 May 2023
- 2023CAT: A Contextualized Conceptualization and Instantiation Framework for Commonsense Reasoning8 May 2023
- 2023ChatGPT Evaluation on Sentence Level Relations: A Focus on Temporal, Causal, and Discourse Relations28 Apr 2023
- 2022FolkScope: Intention Knowledge Graph Construction for E-commerce Commonsense Discovery15 Nov 2022
- 2022Knowledge-in-Context: Towards Knowledgeable Semi-Parametric Language Models28 Oct 2022
- 2022PseudoReasoner: Leveraging Pseudo Labels for Commonsense Knowledge Base Population14 Oct 2022
- 2022Extracting Cultural Commonsense Knowledge at Scale14 Oct 2022
- 2022SubeventWriter: Iterative Sub-event Sequence Generation with Coherence Controller13 Oct 2022
- 2022Are All Steps Equally Important? Benchmarking Essentiality Detection of Events8 Oct 2022
- 2022Acquiring and Modelling Abstract Commonsense Knowledge via Conceptualization3 Jun 2022
- 2022Commonsense Knowledge Salience Evaluation with a Benchmark Dataset in E-commerce22 May 2022
- 2021Does Pre-training Induce Systematic Inference? How Masked Language Models Acquire Commonsense Knowledge16 Dec 2021
- 2021Refined Commonsense Knowledge from Large-Scale Web Contents30 Nov 2021
- 2021Benchmarking Commonsense Knowledge Base Population with an Effective Evaluation Dataset16 Sep 2021
- 2023Boosting Language Models Reasoning with Chain-of-Knowledge Promptingcited by 77
- 2023CAT: A Contextualized Conceptualization and Instantiation Framework for Commonsense Reasoningcited by 25
- 2023COLA: Contextualized Commonsense Causal Reasoning from the Causal Inference Perspectivecited by 22
- 2022Acquiring and Modelling Abstract Commonsense Knowledge via Conceptualizationcited by 17
- 2022PseudoReasoner: Leveraging Pseudo Labels for Commonsense Knowledge Base Populationcited by 5
- 2023Gold: A Global and Local-aware Denoising Framework for Commonsense Knowledge Graph Noise Detectioncited by 4
- 2023Gold: A Global and Local-aware Denoising Framework for Commonsense Knowledge Graph Noise Detection18 Oct 2023
- 2023Boosting Language Models Reasoning with Chain-of-Knowledge Prompting10 Jun 2023
- 2023COLA: Contextualized Commonsense Causal Reasoning from the Causal Inference Perspective9 May 2023
- 2023CAT: A Contextualized Conceptualization and Instantiation Framework for Commonsense Reasoning8 May 2023
- 2022PseudoReasoner: Leveraging Pseudo Labels for Commonsense Knowledge Base Population14 Oct 2022
- 2022Acquiring and Modelling Abstract Commonsense Knowledge via Conceptualization3 Jun 2022
- 2024A Comprehensive Study of Knowledge Editing for Large Language Modelscited by 157
- 2022Extracting Cultural Commonsense Knowledge at Scalecited by 76
- 2023ChatGPT Evaluation on Sentence Level Relations: A Focus on Temporal, Causal, and Discourse Relationscited by 39
- 2022FolkScope: Intention Knowledge Graph Construction for E-commerce Commonsense Discoverycited by 23
- 2025AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corporacited by 23
- 2023Complex Query Answering on Eventuality Knowledge Graph with Implicit Logical Constraintscited by 21
- 2021Refined Commonsense Knowledge from Large-Scale Web Contentscited by 19
- 2023AbsPyramid: Benchmarking the Abstraction Ability of Language Models with a Unified Entailment Graphcited by 17
- 2021Benchmarking Commonsense Knowledge Base Population with an Effective Evaluation Datasetcited by 15
- 2024AbsInstruct: Eliciting Abstraction Ability from LLMs through Explanation Tuning with Plausibility Estimationcited by 14
- 2023Large Knowledge Model: Perspectives and Challengescited by 12
- 2024IntentionQA: A Benchmark for Evaluating Purchase Intention Comprehension Abilities of Language Models in E-commercecited by 11
12 most cited of 21 All 21 (JSON)
- 2026Matching Tasks to Objectives: Fine-Tuning and Prompt-Tuning Strategies for Encoder-Decoder Pre-trained Language Models23 Jun 2026
- 2025AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corpora29 May 2025
- 2024Automatic Extraction of Relationships among Motivations, Emotions and Actions from Natural Language Texts2 Aug 2024
- 2024On the Role of Entity and Event Level Conceptualization in Generalizable Reasoning: A Survey of Tasks, Methods, Applications, and Future Directions16 Jun 2024
- 2024IntentionQA: A Benchmark for Evaluating Purchase Intention Comprehension Abilities of Language Models in E-commerce14 Jun 2024
- 2024AbsInstruct: Eliciting Abstraction Ability from LLMs through Explanation Tuning with Plausibility Estimation16 Feb 2024
- 2024A Comprehensive Study of Knowledge Editing for Large Language Models2 Jan 2024
- 2023IEKG: A Commonsense Knowledge Graph for Idiomatic Expressions11 Dec 2023
- 2023Large Knowledge Model: Perspectives and Challenges5 Dec 2023
- 2023AbsPyramid: Benchmarking the Abstraction Ability of Language Models with a Unified Entailment Graph15 Nov 2023
- 2023Complex Query Answering on Eventuality Knowledge Graph with Implicit Logical Constraints30 May 2023
- 2023Decker: Double Check with Heterogeneous Knowledge for Commonsense Fact Verification10 May 2023
12 newest of 21 All 21 (JSON)