Detecting Knowledge Inconsistencies Across Text, Tables, and Knowledge Graphs
On the map: Retrieval-augmented generation → RAG robustness and adaptive retrieval
Abstract (arXiv)
Wikipedia and Wikidata are widely used for information access, LLM pre-training, and retrieval-augmented generation. Their knowledge is deeply connected but scattered across text, tables, and knowledge graphs. This raises a practical question: when these modalities disagree, how can we detect and explain the conflict? We study this problem as modality-level inconsistency detection. We first introduce a taxonomy of cross-modal knowledge inconsistencies, covering information granularity differences, direct conflicts, temporal changes, and KG incompleteness. We then present Kontrast, an automatic framework that uses Text-to-SPARQL and LLM reasoning to compare table-based answers with KG evidence and categorize the resulting inconsistencies. Experiments on various Table-QA datasets show that cross-modal inconsistencies are common and informative. They reveal not only true knowledge conflicts, but also missing KG structure and temporal mismatches while being limited by Text-to-SPARQL errors and noise. Our analysis shows that text, tables, and KGs can complement and correct one another through systematic comparison. Kontrast provides a practical tool for large-scale knowledge auditing and establishes a benchmark for future work on cross-modal knowledge consistency. Code and data are available at https://github.com/ECLADATTA/KONTRAST.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in RAG robustness and adaptive retrieval, one of 15 directions in Retrieval-augmented generation. Builds on 28 of its 42 references that are in the map. First posted on arXiv 28 Jul 2026.
Builds on
28 of 42 references.
Closest ancestors · 4
Same direction, newest first
- 2025Detecting Corpus-Level Knowledge Inconsistencies in Wikipedia with Large Language Models27 Sep
- 2025DRAGged into Conflicts: Detecting and Addressing Conflicting Sources in Search-Augmented LLMs10 Jun
- 2025Retrieval-Augmented Generation with Conflicting Evidence17 Apr
- 2024WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia19 Jun
Other references · 24
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
- 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
- 2015Compositional Semantic Parsing on Semi-Structured Tablescited by 509
- 2021Entity-Based Knowledge Conflicts in Question Answeringcited by 349
- 2024Knowledge Conflicts for LLMs: A Surveycited by 274
- 2020ToTTo: A Controlled Table-To-Text Generation Datasetcited by 267
- 2020HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Datacited by 263
- 2021FeTaQA: Free-form Table Question Answeringcited by 174
- 2020Open Question Answering over Tables and Textcited by 163
12 more
- 2021HiTab: A Hierarchical Table Dataset for Question Answering and Natural Language Generationcited by 117
- 2021Open Domain Question Answering over Tables via Dense Retrievalcited by 74
- 2024What Evidence Do Language Models Find Convincing?cited by 74
- 2022QAMPARI: An Open-domain Question Answering Benchmark for Questions with Many Answers from Multiple Paragraphscited by 42
- 2024SPINACH: SPARQL-Based Information Navigation for Challenging Real-World Questionscited by 27
- 2025MoNaCo: More Natural and Complex Questions for Reasoning Across Dozens of Documentscited by 20
- 2024Open Domain Question Answering with Conflicting Contextscited by 18
- 2023CompMix: A Benchmark for Heterogeneous Question Answeringcited by 12
- 2025GRASP: Generic Reasoning And SPARQL Generation across Knowledge Graphscited by 7
- 2024TANQ: An open domain dataset of table answered questionscited by 6
- 2024Uncertainty Management in the Construction of Knowledge Graphs: a Surveycited by 5
- 2025Consensus or Conflict? Fine-Grained Evaluation of Conflicting Answers in Question-Answeringcited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Exploring Knowledge Conflicts for Faithful LLM Reasoning: Benchmark and Method
- 2026Tracking the Limits of Knowledge Propagation: How LLMs Fail at Multi-Step Reasoning with Conflicting Knowledge
- 2025PRISMM-Bench: A Benchmark of Peer-Review Grounded Multimodal Inconsistencies
- 2024Untangle the KNOT: Interweaving Conflicting Knowledge and Reasoning Skills in Large Language Models
- 2026Large Language Models in Resolving Contextual Knowledge Conflicts
- 2025MAGIC: A Multi-Hop and Graph-Based Benchmark for Inter-Context Conflicts in Retrieval-Augmented Generation
- 2024Reasoning about concepts with LLMs: Inconsistencies abound
- 2023LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond