mlsanityData to 7 Oct 2026

Refined Commonsense Knowledge from Large-Scale Web Contents

arXiv 2112.04596 ↗First posted 30 Nov 2021cs.CL cs.AIcited by 19

Not on the map. Why?

Abstract (arXiv)

Commonsense knowledge (CSK) about concepts and their properties is helpful for AI applications. Prior works, such as ConceptNet, have compiled large CSK collections. However, they are restricted in their expressiveness to subject-predicate-object (SPO) triples with simple concepts for S and strings for P and O. This paper presents a method called ASCENT++ to automatically build a large-scale knowledge base (KB) of CSK assertions, with refined expressiveness and both better precision and recall than prior works. ASCENT++ goes beyond SPO triples by capturing composite concepts with subgroups and aspects, and by refining assertions with semantic facets. The latter is essential to express the temporal and spatial validity of assertions and further qualifiers. Furthermore, ASCENT++ combines open information extraction (OpenIE) with judicious cleaning and ranking by typicality and saliency scores. For high coverage, our method taps into the large-scale crawl C4 with broad web contents. The evaluation with human judgments shows the superior quality of the ASCENT++ KB, and an extrinsic evaluation for QA-support tasks underlines the benefits of ASCENT++. A web interface, data, and code can be accessed at https://ascentpp.mpi-inf.mpg.de/.

Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 40 of its 99 references that are in the map. First posted on arXiv 30 Nov 2021.

Builds on

40 of 99 references.

References · 40

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  6. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
  7. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  8. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  9. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  10. 2019Language Models as Knowledge Bases?cited by 1,922
  11. 2020Knowledge Graphscited by 619
  12. 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
28 more
  1. 2021Symbolic Knowledge Distillation: from General Language Models to Commonsense Modelscited by 270
  2. 2020COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphscited by 254
  3. 2019KagNet: Knowledge-Aware Graph Networks for Commonsense Reasoningcited by 216
  4. 2019Commonsense Knowledge Mining from Pretrained Modelscited by 189
  5. 2020How Context Affects Language Models' Factual Predictionscited by 181
  6. 2020Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answeringcited by 122
  7. 2019ASER: A Large-scale Eventuality Knowledge Graphcited by 89
  8. 2019Inducing Relational Knowledge from BERTcited by 75
  9. 2020TransOMCS: From Linguistic Graphs to Commonsense Knowledgecited by 52
  10. 2020GenericsKB: A Knowledge Base of Generic Statementscited by 51
  11. 2020CSKG: The CommonSense Knowledge Graphcited by 45
  12. 2021Phrase-BERT: Improved Phrase Embeddings from BERT with an Application to Corpus Explorationcited by 44
  13. 2016Ordinal Common-sense Inferencecited by 35
  14. 2019Uncertain Natural Language Inferencecited by 35
  15. 2021Lawyers are Dishonest? Quantifying Representational Harms in Commonsense Knowledge Resourcescited by 30
  16. 2021ASER: Towards Large-scale Commonsense Knowledge Acquisition via Higher-order Selectional Preference over Eventualitiescited by 28
  17. 2019Commonsense Properties from Query Logs and Question Answering Forumscited by 26
  18. 2019How Large Are Lions? Inducing Distributions over Quantitative Attributescited by 26
  19. 2020Advanced Semantics for Commonsense Knowledge Extractioncited by 24
  20. 2020Joint Reasoning for Multi-Faceted Commonsense Knowledgecited by 12
  21. 2020Do Dogs have Whiskers? A New Knowledge Base of hasPart Relationscited by 10
  22. 2019OpenKI: Integrating Open Information Extraction and Knowledge Bases with Relation Inferencecited by 9
  23. 2018Graphene: Semantically-Linked Propositions in Open Information Extractioncited by 8
  24. 2018Olive Oil is Made of Olives, Baby Oil is Made for Babies: Interpreting Noun Compounds using Paraphrases in a Neural Modelcited by 7
  25. 2020Commonsense Knowledge in Wikidatacited by 7
  26. 2020GIANT: Scalable Creation of a Web-scale Ontologycited by 6
  27. 2019Incorporating Relation Knowledge into Commonsense Reading Comprehension with Multi-task Learningcited by 4
  28. 2021Inside ASCENT: Exploring a Deep Commonsense Knowledge Base and its Usage in Question Answeringcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 6; 2023: 6; 2024: 5; 2025: 0; 2026: 1.

19 papers.

Sort:

By area:

  1. 2022Extracting Cultural Commonsense Knowledge at Scalecited by 76
  2. 2023Free-Bloom: Zero-Shot Text-to-Video Generator with LLM Director and LDM Animatorcited by 74
  3. 2022BertNet: Harvesting Knowledge Graphs with Arbitrary Relations from Pretrained Language Modelscited by 20
  4. 2024Cultural Commonsense Knowledge for Intercultural Dialoguescited by 20
  5. 2023Localized Symbolic Knowledge Distillation for Visual Commonsense Modelscited by 12
  6. 2022Great Truths are Always Simple: A Rather Simple Knowledge Encoder for Enhancing the Commonsense Reasoning Capacity of Pre-Trained Modelscited by 9
  7. 2022Modelling Commonsense Properties using Pre-Trained Bi-Encoderscited by 9
  8. 2022UnCommonSense: Informative Negative Knowledge about Everyday Conceptscited by 8
  9. 2023Completeness, Recall, and Negation in Open-World Knowledge Bases: A Surveycited by 7
  10. 2023Making Large Language Models Better Knowledge Miners for Online Marketing with Progressive Prompting Augmentationcited by 5
  11. 2023Can large language models generate salient negative statements?cited by 3
  12. 2021Materialized Knowledge Bases from Commonsense Transformerscited by 2
7 more
  1. 2023Mapping and Cleaning Open Commonsense Knowledge Bases with Generative Translationcited by 2
  2. 2024CookingSense: A Culinary Knowledgebase with Multidisciplinary Assertionscited by 2
  3. 2022Do Children Texts Hold The Key To Commonsense Knowledge?cited by 1
  4. 2024Rules still work for Open Information Extractioncited by 0
  5. 2024Large Language Models as a Tool for Mining Object Knowledgecited by 0
  6. 2024Culinary Class Wars: Evaluating LLMs using ASH in Cuisine Transfer Taskcited by 0
  7. 2026MMCOMET: A Large-Scale Multimodal Commonsense Knowledge Graph for Contextual Reasoningcited by 0