mlsanityData to 14 Oct 2026

Completeness, Recall, and Negation in Open-World Knowledge Bases: A Survey

arXiv 2305.05403 ↗First posted 9 May 2023cs.AI cs.CL cs.DBcited by 7

Not on the map. Why?

Abstract (arXiv)

General-purpose knowledge bases (KBs) are a cornerstone of knowledge-centric AI. Many of them are constructed pragmatically from Web sources, and are thus far from complete. This poses challenges for the consumption as well as the curation of their content. While several surveys target the problem of completing incomplete KBs, the first problem is arguably to know whether and where the KB is incomplete in the first place, and to which degree. In this survey we discuss how knowledge about completeness, recall, and negation in KBs can be expressed, extracted, and inferred. We cover (i) the logical foundations of knowledge representation and querying under partial closed-world semantics; (ii) the estimation of this information via statistical patterns; (iii) the extraction of information about recall from KBs and text; (iv) the identification of interesting negative statements; and (v) relaxed notions of relative recall. This survey is targeted at two types of audiences: (1) practitioners who are interested in tracking KB quality, focusing extraction efforts, and building quality-aware downstream applications; and (2) data management, knowledge base and semantic web researchers who wish to understand the state of the art of knowledge bases beyond the open-world assumption. Consequently, our survey presents both fundamental methodologies and their working, and gives practice-oriented recommendations on how to choose between different approaches for a problem at hand.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 37 of its 138 references that are in the map. First posted on arXiv 9 May 2023.

Builds on

37 of 138 references.

References · 37

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2019Language Models as Knowledge Bases?cited by 1,936
  5. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,554
  6. 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,128
  7. 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,067
  8. 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
  9. 2020Knowledge Graphscited by 621
  10. 2020How Can We Know When Language Models Know? On the Calibration of Language Models for Question Answeringcited by 445
  11. 2020K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapterscited by 319
  12. 2020Birds have four legs?! NumerSense: Probing Numerical Commonsense Knowledge of Pre-trained Language Modelscited by 110
25 more
  1. 2020UniK-QA: Unified Representations of Structured and Unstructured Knowledge for Open-Domain Question Answeringcited by 61
  2. 2020Machine Knowledge: Creation and Curation of Comprehensive Knowledge Basescited by 55
  3. 2021GenIE: Generative Information Extractioncited by 53
  4. 2019Fine-tuning Pre-Trained Transformer Language Models to Distantly Supervised Relation Extractioncited by 36
  5. 2022Prompting as Probing: Using Language Models for Knowledge Base Constructioncited by 32
  6. 2019Commonsense Properties from Query Logs and Question Answering Forumscited by 26
  7. 2022Conversational Question Answering on Heterogeneous Sourcescited by 26
  8. 2020Advanced Semantics for Commonsense Knowledge Extractioncited by 24
  9. 2019OPIEC: An Open Information Extraction Corpuscited by 20
  10. 2023Evaluating Language Models for Knowledge Base Completioncited by 20
  11. 2021Refined Commonsense Knowledge from Large-Scale Web Contentscited by 19
  12. 2021UNIQORN: Unified Question Answering over RDF Knowledge Graphs and Natural Language Textcited by 17
  13. 2016Predicting Completeness in Knowledge Basescited by 15
  14. 2015From Data Fusion to Knowledge Fusioncited by 10
  15. 2020Negative Statements Considered Usefulcited by 9
  16. 2020NegatER: Unsupervised Discovery of Negatives in Commonsense Knowledge Basescited by 9
  17. 2022UnCommonSense: Informative Negative Knowledge about Everyday Conceptscited by 8
  18. 2019Non-Parametric Class Completeness Estimators for Collaborative Knowledge Graphs -- The Case of Wikidatacited by 5
  19. 2018Demand-Weighted Completeness Prediction for a Knowledge Basecited by 2
  20. 2020Uncovering Hidden Semantics of Set Information in Knowledge Basescited by 2
  21. 2021Materialized Knowledge Bases from Commonsense Transformerscited by 2
  22. 2017Doctoral Advisor or Medical Condition: Towards Entity-specific Rankings of Knowledge Base Properties [Extended Version]cited by 1
  23. 2018Enriching Knowledge Bases with Counting Quantifierscited by 1
  24. 2018Embedding Cardinality Constraints in Neural Link Predictorscited by 1
  25. 2020CounQER: A System for Discovering and Linking Count Information in Knowledge Basescited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 1; 2025: 3; 2026: 2.

7 papers.