Mapping and Cleaning Open Commonsense Knowledge Bases with Generative Translation
Not on the map. Why?
Abstract (arXiv)
Structured knowledge bases (KBs) are the backbone of many know-ledge-intensive applications, and their automated construction has received considerable attention. In particular, open information extraction (OpenIE) is often used to induce structure from a text. However, although it allows high recall, the extracted knowledge tends to inherit noise from the sources and the OpenIE algorithm. Besides, OpenIE tuples contain an open-ended, non-canonicalized set of relations, making the extracted knowledge's downstream exploitation harder. In this paper, we study the problem of mapping an open KB into the fixed schema of an existing KB, specifically for the case of commonsense knowledge. We propose approaching the problem by generative translation, i.e., by training a language model to generate fixed-schema assertions from open ones. Experiments show that this approach occupies a sweet spot between traditional manual, rule-based, or classification-based canonicalization and purely generative KB construction like COMET. Moreover, it produces higher mapping accuracy than the former while avoiding the association-based noise of the latter.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 26 of its 50 references that are in the map. First posted on arXiv 22 Jun 2023.
Builds on
26 of 50 references.
References · 26
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2019Language Models as Knowledge Bases?cited by 1,936
- 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
- 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,067
- 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 781
- 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 388
- 2020COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphscited by 254
- 2020Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answeringcited by 122
14 more
- 2020Improving Conversational Recommender Systems via Knowledge Graph based Semantic Fusioncited by 122
- 2020A Survey of Knowledge-Enhanced Text Generationcited by 120
- 2019Knowledge-Enriched Transformer for Emotion Detection in Textual Conversationscited by 92
- 2019Multi-Label Classification with Label Graph Superimposingcited by 65
- 2020GenericsKB: A Knowledge Base of Generic Statementscited by 51
- 2022DeepStruct: Pretraining of Language Models for Structure Predictioncited by 45
- 2022A Survey on Neural Open Information Extraction: Current Status and Future Directionscited by 27
- 2019Commonsense Properties from Query Logs and Question Answering Forumscited by 26
- 2020Advanced Semantics for Commonsense Knowledge Extractioncited by 24
- 2021Zero-Shot Information Extraction as a Unified Text-to-Triple Translationcited by 22
- 2019OPIEC: An Open Information Extraction Corpuscited by 20
- 2021Refined Commonsense Knowledge from Large-Scale Web Contentscited by 19
- 2019OpenKI: Integrating Open Information Extraction and Knowledge Bases with Relation Inferencecited by 9
- 2021Inside ASCENT: Exploring a Deep Commonsense Knowledge Base and its Usage in Question Answeringcited by 3
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 0; 2026: 1.
2 papers.