Ontology-Guided Neuro-Symbolic Inference: Grounding Language Models with Mathematical Domain Knowledge
Not on the map. Why?
Abstract (arXiv)
Language models exhibit fundamental limitations -- hallucination, brittleness, and lack of formal grounding -- that are particularly problematic in high-stakes specialist fields requiring verifiable reasoning. I investigate whether formal domain ontologies can enhance language model reliability through retrieval-augmented generation. Using mathematics as proof of concept, I implement a neuro-symbolic pipeline leveraging the OpenMath ontology with hybrid retrieval and cross-encoder reranking to inject relevant definitions into model prompts. Evaluation on the MATH benchmark with three open-source models reveals that ontology-guided context improves performance when retrieval quality is high, but irrelevant context actively degrades it -- highlighting both the promise and challenges of neuro-symbolic approaches.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 11 of its 24 references that are in the map. First posted on arXiv 19 Feb 2026.
Builds on
11 of 24 references.
References · 11
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2023Let's Verify Step by Stepcited by 3,598
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2022Solving Quantitative Reasoning Problems with Language Modelscited by 1,359
- 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 508
- 2024Gemma Scope: Open Sparse Autoencoders Everywhere All At Once on Gemma 2cited by 381
- 2025rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinkingcited by 308
- 2022A Causal Framework to Quantify the Robustness of Mathematical Reasoning with Language Modelscited by 68
- 2024MATHSENSEI: A Tool-Augmented Large Language Model for Mathematical Reasoningcited by 34
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Enhancing Large Language Models through Neuro-Symbolic Integration and Ontological Reasoning
- 2025Rethinking Reasoning in LLMs: Neuro-Symbolic Local RetoMaton Beyond ICL and CoT
- 2025OntoURL: A Benchmark for Evaluating Large Language Models on Symbolic Ontological Understanding, Reasoning and Learning
- 2026NeuroProlog: Multi-Task Fine-Tuning for Neurosymbolic Mathematical Reasoning via the Cocktail Effect
- 2025Intermediate Languages Matter: Formal Languages and LLMs affect Neurosymbolic Reasoning
- 2026To Neuro-Symbolic Classification and Beyond by Compiling Description Logic Ontologies to Probabilistic Circuits
- 2025PEIRCE: Unifying Material and Formal Reasoning via LLM-Driven Neuro-Symbolic Refinement
- 2024Neuro-Symbolic Data Generation for Math Reasoning