Adaptive LLM-Symbolic Reasoning via Dynamic Logical Solver Composition
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Neuro-symbolic NLP methods aim to leverage the complementary strengths of large language models and formal logical solvers. However, current approaches are mostly static in nature, i.e., the integration of a target solver is predetermined at design time, hindering the ability to employ diverse formal inference strategies. To address this, we introduce an adaptive, multi-paradigm, neuro-symbolic inference framework that: (1) automatically identifies formal reasoning strategies from problems expressed in natural language; and (2) dynamically selects and applies specialized formal logical solvers via autoformalization interfaces. Extensive experiments on individual and multi-paradigm reasoning tasks support the following conclusions: LLMs are effective at predicting the necessary formal reasoning strategies with an accuracy above 90 percent. This enables flexible integration with formal logical solvers, resulting in our framework outperforming competing baselines by 27 percent and 6 percent compared to GPT-4o and DeepSeek-V3.1, respectively. Moreover, adaptive reasoning can even positively impact pure LLM methods, yielding gains of 10, 5, and 6 percent on zero-shot, CoT, and symbolic CoT settings with GPT-4o. Finally, although smaller models struggle with adaptive neuro-symbolic reasoning, post-training offers a viable path to improvement. Overall, this work establishes the foundations for adaptive LLM-symbolic reasoning, offering a path forward for unifying material and formal inferences on heterogeneous reasoning challenges.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 15 of its 38 references that are in the map. First posted on arXiv 8 Oct 2025.
Builds on
15 of 38 references.
Closest ancestors · 4
Same direction, newest first
- 2025Do Large Language Models Excel in Complex Logical Reasoning with Formal Language?22 May
- 2025Integrating Expert Knowledge into Logical Programs via LLMs17 Feb
- 2025VERUS-LM: a Versatile Framework for Combining LLMs with Symbolic Reasoning24 Jan
- 2024DeepSeek-V3 Technical Report27 Dec
Other references · 11
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2024GPT-4o System Cardcited by 4,588
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 698
- 2023Harnessing the Power of Large Language Models for Natural Language to First-Order Logic Translationcited by 59
- 2025Autoformalization in the Wild: Assessing LLMs on Real-World Mathematical Definitionscited by 22
- 2025REST: Stress Testing Large Reasoning Models by Asking Multiple Problems at Oncecited by 12
- 2024forallutoexistsval: Autonomous Assessment of LLMs in Formal Synthesis and Interpretation Taskscited by 3
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026LogicTrack: Auditing Reasoning Trajectories of Large Language Models with Formal Logic Solverscited by 1
- 2026Logic-Parametric Neuro-Symbolic NLI: Controlling Logical Formalisms for Verifiable LLM Reasoningcited by 0
- 2026Decompose-and-Formalise: Recursively Verifiable Natural Language Inferencecited by 0
- 2026From Coarse to Fine: Benchmarking and Reward Modeling for Writing-Centric Generation Taskscited by 0
- 2026SciR: A Controllable Benchmark for Scientific Reasoning in LLMscited by 0
- 2026Neurosymbolic Clinical Trial Matching via LLM-Driven Abduction and Logical Verificationcited by 0
- 2026Accountable AI with Grounded, Faithful, Consistent, Actionable Rationales: A Case Study in Clinical Trial Matching with VERDICTcited by 0
- 2026LogicTrack: Auditing Reasoning Trajectories of Large Language Models with Formal Logic Solvers18 Sep 2026
- 2026Accountable AI with Grounded, Faithful, Consistent, Actionable Rationales: A Case Study in Clinical Trial Matching with VERDICT3 Sep 2026
- 2026Neurosymbolic Clinical Trial Matching via LLM-Driven Abduction and Logical Verification18 Jun 2026
- 2026SciR: A Controllable Benchmark for Scientific Reasoning in LLMs11 Jun 2026
- 2026From Coarse to Fine: Benchmarking and Reward Modeling for Writing-Centric Generation Tasks30 Apr 2026
- 2026Decompose-and-Formalise: Recursively Verifiable Natural Language Inference27 Jan 2026
- 2026Logic-Parametric Neuro-Symbolic NLI: Controlling Logical Formalisms for Verifiable LLM Reasoning9 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2023Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning
- 2024Leveraging LLMs for Hypothetical Deduction in Logical Inference: A Neuro-Symbolic Approach
- 2025Neuro-Symbolic Artificial Intelligence: Towards Improving the Reasoning Abilities of Large Language Models
- 2024HYBRIDMIND: Meta Selection of Natural Language and Symbolic Language for Enhanced LLM Reasoning
- 2026Pushing the Boundaries of Natural Reasoning: Interleaved Bonus from Formal-Logic Verification
- 2026IFDNS: An Iterative Feedback-Driven Neuro-Symbolic Method for Faithful Logical Reasoning
- 2024A Closer Look at Logical Reasoning with LLMs: The Choice of Tool Matters
- 2024Reliable Reasoning Beyond Natural Language