mlsanityData to 7 Oct 2026

Detecting Knowledge Inconsistencies Across Text, Tables, and Knowledge Graphs

arXiv 2607.25959 ↗First posted 28 Jul 2026cs.CL cs.AIcited by 0

On the map: Retrieval-augmented generation → RAG robustness and adaptive retrieval

Abstract (arXiv)

Wikipedia and Wikidata are widely used for information access, LLM pre-training, and retrieval-augmented generation. Their knowledge is deeply connected but scattered across text, tables, and knowledge graphs. This raises a practical question: when these modalities disagree, how can we detect and explain the conflict? We study this problem as modality-level inconsistency detection. We first introduce a taxonomy of cross-modal knowledge inconsistencies, covering information granularity differences, direct conflicts, temporal changes, and KG incompleteness. We then present Kontrast, an automatic framework that uses Text-to-SPARQL and LLM reasoning to compare table-based answers with KG evidence and categorize the resulting inconsistencies. Experiments on various Table-QA datasets show that cross-modal inconsistencies are common and informative. They reveal not only true knowledge conflicts, but also missing KG structure and temporal mismatches while being limited by Text-to-SPARQL errors and noise. Our analysis shows that text, tables, and KGs can complement and correct one another through systematic comparison. Kontrast provides a practical tool for large-scale knowledge auditing and establishes a benchmark for future work on cross-modal knowledge consistency. Code and data are available at https://github.com/ECLADATTA/KONTRAST.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in RAG robustness and adaptive retrieval, one of 15 directions in Retrieval-augmented generation. Builds on 28 of its 42 references that are in the map. First posted on arXiv 28 Jul 2026.

Builds on

28 of 42 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Detecting Corpus-Level Knowledge Inconsistencies in Wikipedia with Large Language Models27 Sep
  2. 2025DRAGged into Conflicts: Detecting and Addressing Conflicting Sources in Search-Augmented LLMs10 Jun
  3. 2025Retrieval-Augmented Generation with Conflicting Evidence17 Apr
  4. 2024WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia19 Jun

Other references · 24

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  5. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
  6. 2015Compositional Semantic Parsing on Semi-Structured Tablescited by 509
  7. 2021Entity-Based Knowledge Conflicts in Question Answeringcited by 349
  8. 2024Knowledge Conflicts for LLMs: A Surveycited by 274
  9. 2020ToTTo: A Controlled Table-To-Text Generation Datasetcited by 267
  10. 2020HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Datacited by 263
  11. 2021FeTaQA: Free-form Table Question Answeringcited by 174
  12. 2020Open Question Answering over Tables and Textcited by 163
12 more
  1. 2021HiTab: A Hierarchical Table Dataset for Question Answering and Natural Language Generationcited by 117
  2. 2021Open Domain Question Answering over Tables via Dense Retrievalcited by 74
  3. 2024What Evidence Do Language Models Find Convincing?cited by 74
  4. 2022QAMPARI: An Open-domain Question Answering Benchmark for Questions with Many Answers from Multiple Paragraphscited by 42
  5. 2024SPINACH: SPARQL-Based Information Navigation for Challenging Real-World Questionscited by 27
  6. 2025MoNaCo: More Natural and Complex Questions for Reasoning Across Dozens of Documentscited by 20
  7. 2024Open Domain Question Answering with Conflicting Contextscited by 18
  8. 2023CompMix: A Benchmark for Heterogeneous Question Answeringcited by 12
  9. 2025GRASP: Generic Reasoning And SPARQL Generation across Knowledge Graphscited by 7
  10. 2024TANQ: An open domain dataset of table answered questionscited by 6
  11. 2024Uncertainty Management in the Construction of Knowledge Graphs: a Surveycited by 5
  12. 2025Consensus or Conflict? Fine-Grained Evaluation of Conflicting Answers in Question-Answeringcited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Exploring Knowledge Conflicts for Faithful LLM Reasoning: Benchmark and Method
  2. 2026Tracking the Limits of Knowledge Propagation: How LLMs Fail at Multi-Step Reasoning with Conflicting Knowledge
  3. 2025PRISMM-Bench: A Benchmark of Peer-Review Grounded Multimodal Inconsistencies
  4. 2024Untangle the KNOT: Interweaving Conflicting Knowledge and Reasoning Skills in Large Language Models
  5. 2026Large Language Models in Resolving Contextual Knowledge Conflicts
  6. 2025MAGIC: A Multi-Hop and Graph-Based Benchmark for Inter-Context Conflicts in Retrieval-Augmented Generation
  7. 2024Reasoning about concepts with LLMs: Inconsistencies abound
  8. 2023LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond