Completeness, Recall, and Negation in Open-World Knowledge Bases: A Survey
Not on the map. Why?
Abstract (arXiv)
General-purpose knowledge bases (KBs) are a cornerstone of knowledge-centric AI. Many of them are constructed pragmatically from Web sources, and are thus far from complete. This poses challenges for the consumption as well as the curation of their content. While several surveys target the problem of completing incomplete KBs, the first problem is arguably to know whether and where the KB is incomplete in the first place, and to which degree. In this survey we discuss how knowledge about completeness, recall, and negation in KBs can be expressed, extracted, and inferred. We cover (i) the logical foundations of knowledge representation and querying under partial closed-world semantics; (ii) the estimation of this information via statistical patterns; (iii) the extraction of information about recall from KBs and text; (iv) the identification of interesting negative statements; and (v) relaxed notions of relative recall. This survey is targeted at two types of audiences: (1) practitioners who are interested in tracking KB quality, focusing extraction efforts, and building quality-aware downstream applications; and (2) data management, knowledge base and semantic web researchers who wish to understand the state of the art of knowledge bases beyond the open-world assumption. Consequently, our survey presents both fundamental methodologies and their working, and gives practice-oriented recommendations on how to choose between different approaches for a problem at hand.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 37 of its 138 references that are in the map. First posted on arXiv 9 May 2023.
Builds on
37 of 138 references.
References · 37
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2019Language Models as Knowledge Bases?cited by 1,936
- 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,554
- 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,128
- 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,067
- 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
- 2020Knowledge Graphscited by 621
- 2020How Can We Know When Language Models Know? On the Calibration of Language Models for Question Answeringcited by 445
- 2020K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapterscited by 319
- 2020Birds have four legs?! NumerSense: Probing Numerical Commonsense Knowledge of Pre-trained Language Modelscited by 110
25 more
- 2020UniK-QA: Unified Representations of Structured and Unstructured Knowledge for Open-Domain Question Answeringcited by 61
- 2020Machine Knowledge: Creation and Curation of Comprehensive Knowledge Basescited by 55
- 2021GenIE: Generative Information Extractioncited by 53
- 2019Fine-tuning Pre-Trained Transformer Language Models to Distantly Supervised Relation Extractioncited by 36
- 2022Prompting as Probing: Using Language Models for Knowledge Base Constructioncited by 32
- 2019Commonsense Properties from Query Logs and Question Answering Forumscited by 26
- 2022Conversational Question Answering on Heterogeneous Sourcescited by 26
- 2020Advanced Semantics for Commonsense Knowledge Extractioncited by 24
- 2019OPIEC: An Open Information Extraction Corpuscited by 20
- 2023Evaluating Language Models for Knowledge Base Completioncited by 20
- 2021Refined Commonsense Knowledge from Large-Scale Web Contentscited by 19
- 2021UNIQORN: Unified Question Answering over RDF Knowledge Graphs and Natural Language Textcited by 17
- 2016Predicting Completeness in Knowledge Basescited by 15
- 2015From Data Fusion to Knowledge Fusioncited by 10
- 2020Negative Statements Considered Usefulcited by 9
- 2020NegatER: Unsupervised Discovery of Negatives in Commonsense Knowledge Basescited by 9
- 2022UnCommonSense: Informative Negative Knowledge about Everyday Conceptscited by 8
- 2019Non-Parametric Class Completeness Estimators for Collaborative Knowledge Graphs -- The Case of Wikidatacited by 5
- 2018Demand-Weighted Completeness Prediction for a Knowledge Basecited by 2
- 2020Uncovering Hidden Semantics of Set Information in Knowledge Basescited by 2
- 2021Materialized Knowledge Bases from Commonsense Transformerscited by 2
- 2017Doctoral Advisor or Medical Condition: Towards Entity-specific Rankings of Knowledge Base Properties [Extended Version]cited by 1
- 2018Enriching Knowledge Bases with Counting Quantifierscited by 1
- 2018Embedding Cardinality Constraints in Neural Link Predictorscited by 1
- 2020CounQER: A System for Discovering and Linking Count Information in Knowledge Basescited by 1
Built on by
Citing papers per year: 2023: 1; 2024: 1; 2025: 3; 2026: 2.
7 papers.
- 2024Enabling LLM Knowledge Analysis via Extensive Materializationcited by 12
- 2023Can large language models generate salient negative statements?cited by 3
- 2025Large Language Models for Knowledge Graph Embedding: A Surveycited by 3
- 2025EMERGE: A Benchmark for Updating Knowledge Graphs with Emerging Textual Knowledgecited by 0
- 2025gHAWK: Local and Global Structure Encoding for Scalable Training of Graph Neural Networks on Knowledge Graphscited by 0
- 2026MMCOMET: A Large-Scale Multimodal Commonsense Knowledge Graph for Contextual Reasoningcited by 0
- 2026Three Types of Negation of Triple and its Elements and an Extension of Triplecited by 0
- 2026Three Types of Negation of Triple and its Elements and an Extension of Triple8 Sep 2026
- 2026MMCOMET: A Large-Scale Multimodal Commonsense Knowledge Graph for Contextual Reasoning1 Mar 2026
- 2025gHAWK: Local and Global Structure Encoding for Scalable Training of Graph Neural Networks on Knowledge Graphs9 Dec 2025
- 2025EMERGE: A Benchmark for Updating Knowledge Graphs with Emerging Textual Knowledge4 Jul 2025
- 2025Large Language Models for Knowledge Graph Embedding: A Survey14 Jan 2025
- 2024Enabling LLM Knowledge Analysis via Extensive Materialization7 Nov 2024
- 2023Can large language models generate salient negative statements?26 May 2023