Position: Logical Soundness is not a Reliable Criterion for Neurosymbolic Fact-Checking with LLMs
Not on the map. Why?
Abstract (arXiv)
As large language models (LLMs) are increasing integrated into fact-checking pipelines, formal logic is often proposed as a rigorous means by which to mitigate bias, errors and hallucinations in these models' outputs. For example, some neurosymbolic systems verify claims by using LLMs to translate natural language into logical formulae and then checking whether the proposed claims are logically sound, i.e. whether they can be validly derived from premises that are verified to be true. We argue that such approaches structurally fail to detect misleading claims due to systematic divergences between conclusions that are logically sound and inferences that humans typically make and accept. Drawing on studies in cognitive science and pragmatics, we present a typology of cases in which logically sound conclusions systematically elicit human inferences that are unsupported by the underlying premises. Consequently, we advocate for a complementary approach: leveraging human-like reasoning tendencies of LLMs as a feature rather than a bug, and using these models to validate the outputs of formal components in neurosymbolic systems against potentially misleading conclusions.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 36 of its 52 references that are in the map. First posted on arXiv 5 Apr 2026.
Builds on
36 of 52 references.
References · 36
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
- 2023Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedbackcited by 788
- 2022Teaching Models to Express Their Uncertainty in Wordscited by 731
- 2023Bias and Fairness in Large Language Models: A Surveycited by 626
- 2021A Survey on Automated Fact-Checkingcited by 376
- 2023Can LLM-Generated Misinformation Be Detected?cited by 173
- 2023Fact-Checking Complex Claims with Program-Guided Reasoningcited by 146
- 2023Factuality Challenges in the Era of Large Language Modelscited by 125
- 2024LogicBench: Towards Systematic Evaluation of Logical Reasoning Ability of Large Language Modelscited by 67
- 2025A Survey of Uncertainty Estimation Methods on Large Language Modelscited by 57
- 2021ProoFVer: Natural Logic Theorem Proving for Fact Verificationcited by 52
24 more
- 2023Multimodal Automated Fact-Checking: A Surveycited by 51
- 2023Towards Reliable Misinformation Mitigation: Generalization, Uncertainty, and GPT-4cited by 45
- 2023GenAI Against Humanity: Nefarious Applications of Generative Artificial Intelligence and Large Language Modelscited by 40
- 2023Explainable Claim Verification via Knowledge-Grounded Reasoning with Large Language Modelscited by 37
- 2024Decomposition Dilemmas: Does Claim Decomposition Boost or Burden Fact-Checking Performance?cited by 34
- 2023The Perils & Promises of Fact-checking with Large Language Modelscited by 31
- 2024Large Language Models Portray Socially Subordinate Groups as More Homogeneous, Consistent with a Bias Observed in Humanscited by 31
- 2025Pragmatics in the Era of Large Language Models: A Survey on Datasets, Evaluation, Opportunities and Challengescited by 31
- 2024Logically Consistent Language Models via Neuro-Symbolic Integrationcited by 30
- 2024Enhancing Reasoning Capabilities of LLMs via Principled Synthetic Logic Corpuscited by 29
- 2023A Systematic Comparison of Syllogistic Reasoning in Humans and Language Modelscited by 20
- 2025Step-by-Step Fact Verification System for Medical Claims with Explainable Reasoningcited by 17
- 2025Unmasking Digital Falsehoods: A Comparative Analysis of LLM-Based Misinformation Detection Strategiescited by 16
- 2024Do Large Language Models Understand Conversational Implicature -- A case study with a chinese sitcomcited by 15
- 2024Comparing Inferential Strategies of Humans and Large Language Models in Deductive Reasoningcited by 13
- 2025Shifting Perspectives: Steering Vectors for Robust Bias Mitigation in LLMscited by 13
- 2025The Missing Parts: Augmenting Fact Verification with Half-Truth Detectioncited by 7
- 2025Enhancing Logical Reasoning in Language Models via Symbolically-Guided Monte Carlo Process Supervisioncited by 6
- 2025Beyond Correctness: Exposing LLM-generated Logical Flaws in Reasoning via Multi-step Automated Theorem Provingcited by 6
- 2024Zero-Shot Fact Verification via Natural Logic and Large Language Modelscited by 5
- 2024Fact or Fiction? Improving Fact Verification with Knowledge Graphs through Simplified Subgraph Retrievalscited by 4
- 2024Probing Large Language Models for Scalar Adjective Lexical Semantics and Scalar Diversity Pragmaticscited by 3
- 2024Improving the Language Understanding Capabilities of Large Language Models Using Reinforcement Learningcited by 3
- 2025Understand the Implication: Learning to Think for Pragmatic Understandingcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Sound and Complete Neurosymbolic Reasoning with LLM-Grounded Interpretations
- 2026Logic-Parametric Neuro-Symbolic NLI: Controlling Logical Formalisms for Verifiable LLM Reasoning
- 2025Intermediate Languages Matter: Formal Languages and LLMs affect Neurosymbolic Reasoning
- 2025Robustness of Neurosymbolic Reasoners on First-Order Logic Problems
- 2024Conditional and Modal Reasoning in Large Language Models
- 2026Language Statistics and False Belief Reasoning: Evidence from 41 Open-Weight LMs
- 2025Intermediate Languages Matter: Formal Choice Drives Neurosymbolic LLM Reasoning
- 2023Evaluating Large Language Models with NeuBAROCO: Syllogistic Reasoning Ability and Human-like Biases