Enhancing Large Language Models through Neuro-Symbolic Integration and Ontological Reasoning
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Large Language Models (LLMs) demonstrate impressive capabilities in natural language processing but suffer from inaccuracies and logical inconsistencies known as hallucinations. This compromises their reliability, especially in domains requiring factual accuracy. We propose a neuro-symbolic approach integrating symbolic ontological reasoning and machine learning methods to enhance the consistency and reliability of LLM outputs. Our workflow utilizes OWL ontologies, a symbolic reasoner (e.g., HermiT) for consistency checking, and a lightweight machine learning model (logistic regression) for mapping natural language statements into logical forms compatible with the ontology. When inconsistencies between LLM outputs and the ontology are detected, the system generates explanatory feedback to guide the LLM towards a corrected, logically coherent response in an iterative refinement loop. We present a working Python prototype demonstrating this pipeline. Experimental results in a defined domain suggest significant improvements in semantic coherence and factual accuracy of LLM outputs, showcasing the potential of combining LLM fluency with the rigor of formal semantics.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 7 of its 26 references that are in the map. First posted on arXiv 10 Apr 2025.
Builds on
7 of 26 references.
References · 7
- 2024Hallucination is Inevitable: An Innate Limitation of Large Language Modelscited by 329
- 2024Increasing the LLM Accuracy for Question Answering: Ontologies to the Rescue!cited by 18
- 2024On the Limitations of Large Language Models (LLMs): False Attributioncited by 12
- 2024A Short Review for Ontology Learning: Stride to Large Language Models Trendcited by 4
- 2024RoLD: Robot Latent Diffusion for Multi-task Policy Modelingcited by 3
- 2024Towards Ontology-Enhanced Representation Learning for Large Language Modelscited by 3
- 2023Model Inversion Attacks on Homogeneous and Heterogeneous Graph Neural Networkscited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025The Knowledge-Reasoning Dissociation: Fundamental Limitations of LLMs in Clinical Natural Language Inferencecited by 2
- 2026A neurosymbolic Approach with Epistemic Deep Learning for Hierarchical Image Classificationcited by 1
- 2026SymDiag: Explainable Diagnosis for LLM Reasoning via Neuro-Symbolic Verificationcited by 0
- 2026Ontology-Grounded, Reasoner-Verified Benchmarks for Evaluating LLM Reasoning in Scientific AIcited by 0
- 2026Ontology-Grounded, Reasoner-Verified Benchmarks for Evaluating LLM Reasoning in Scientific AI30 Sep 2026
- 2026SymDiag: Explainable Diagnosis for LLM Reasoning via Neuro-Symbolic Verification9 Aug 2026
- 2026A neurosymbolic Approach with Epistemic Deep Learning for Hierarchical Image Classification11 May 2026
- 2025The Knowledge-Reasoning Dissociation: Fundamental Limitations of LLMs in Clinical Natural Language Inference14 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2024Logically Consistent Language Models via Neuro-Symbolic Integration
- 2024Reliable Reasoning Beyond Natural Language
- 2025Neuro-Symbolic Artificial Intelligence: Towards Improving the Reasoning Abilities of Large Language Models
- 2025Intermediate Languages Matter: Formal Languages and LLMs affect Neurosymbolic Reasoning
- 2026Ontology-Guided Neuro-Symbolic Inference: Grounding Language Models with Mathematical Domain Knowledge
- 2025Intermediate Languages Matter: Formal Choice Drives Neurosymbolic LLM Reasoning
- 2025PEIRCE: Unifying Material and Formal Reasoning via LLM-Driven Neuro-Symbolic Refinement
- 2026UFAL-CUNI at SemEval-2026 Task 11: An Efficient Modular Neuro-symbolic Method for Syllogistic Reasoning