Materialized Knowledge Bases from Commonsense Transformers
Not on the map. Why?
Abstract (arXiv)
Starting from the COMET methodology by Bosselut et al. (2019), generating commonsense knowledge directly from pre-trained language models has recently received significant attention. Surprisingly, up to now no materialized resource of commonsense knowledge generated this way is publicly available. This paper fills this gap, and uses the materialized resources to perform a detailed analysis of the potential of this approach in terms of precision and recall. Furthermore, we identify common problem cases, and outline use cases enabled by materialized resources. We posit that the availability of these resources is important for the advancement of the field, as it enables an off-the-shelf-use of the resulting knowledge, as well as further analyses on its strengths and weaknesses.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 18 of its 29 references that are in the map. First posted on arXiv 29 Dec 2021.
Builds on
18 of 29 references.
References · 18
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,067
- 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
- 2021Symbolic Knowledge Distillation: from General Language Models to Commonsense Modelscited by 270
- 2020COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphscited by 254
- 2020How Context Affects Language Models' Factual Predictionscited by 181
- 2020A Knowledge-Enhanced Pretraining Model for Commonsense Story Generationcited by 116
- 2020SemEval-2020 Task 4: Commonsense Validation and Explanationcited by 42
- 2020Video2Commonsense: Generating Commonsense Descriptions to Enrich Video Captioningcited by 36
6 more
- 2019Commonsense Properties from Query Logs and Question Answering Forumscited by 26
- 2020Advanced Semantics for Commonsense Knowledge Extractioncited by 24
- 2020An Empirical Investigation of Contextualized Number Predictioncited by 21
- 2021Refined Commonsense Knowledge from Large-Scale Web Contentscited by 19
- 2019Dynamic Neuro-Symbolic Knowledge Graph Construction for Zero-shot Commonsense Question Answeringcited by 16
- 2020Joint Reasoning for Multi-Faceted Commonsense Knowledgecited by 12
Built on by
Citing papers per year: 2022: 1; 2023: 1.
2 papers.