Structured Decomposition for LLM Reasoning: Cross-Domain Validation and Semantic Web Integration
On the map: LLM reasoning → Clinical and biomedical applications
Abstract (arXiv)
Rule-based reasoning over natural language input arises in domains where decisions must be auditable and justifiable: clinical protocols specify eligibility criteria in prose, evidence rules define admissibility through textual conditions, and scientific standards dictate methodological requirements. Applying rules to such inputs demands both interpretive flexibility and formal guarantees. Large language models (LLMs) provide flexibility but cannot ensure consistent rule application; symbolic systems provide guarantees but require structured input. This paper presents an integration pattern that combines these strengths: LLMs serve as ontology population engines, translating unstructured text into ABox assertions according to expert-authored TBox specifications, while SWRL-based reasoners apply rules with deterministic guarantees. The framework decomposes reasoning into entity identification, assertion extraction, and symbolic verification, with task definitions grounded in OWL 2 ontologies. Experiments across three domains (legal hearsay determination, scientific method-task application, clinical trial eligibility) and eleven language models validate the approach. Structured decomposition achieves statistically significant improvements over few-shot prompting in aggregate, with gains observed across all three domains. An ablation study confirms that symbolic verification provides substantial benefit beyond structured prompting alone. The populated ABox integrates with standard semantic web tooling for inspection and querying, positioning the framework for richer inference patterns that simpler formalisms cannot express.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 32 of its 64 references that are in the map. First posted on arXiv 4 Jan 2026.
Builds on
32 of 64 references.
References · 32
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
- 2022PAL: Program-aided Language Modelscited by 652
- 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 558
- 2024GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Modelscited by 550
- 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 322
- 2024Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Toolscited by 176
- 2024Large Legal Fictions: Profiling Legal Hallucinations in Large Language Modelscited by 150
- 2023Revisiting Relation Extraction in the era of Large Language Modelscited by 102
- 2022DDXPlus: A New Dataset For Automatic Medical Diagnosiscited by 88
20 more
- 2023LLMs4OL: Large Language Models for Ontology Learningcited by 77
- 2023Can LLMs Follow Simple Rules?cited by 46
- 2023OLaLa: Ontology Matching with Large Language Modelscited by 35
- 2024Logically Consistent Language Models via Neuro-Symbolic Integrationcited by 30
- 2025Towards Robust Legal Reasoning: Harnessing Logical LLMs in Lawcited by 30
- 2025Fine-tuning Large Language Models for Improving Factuality in Legal Question Answeringcited by 28
- 2025LLMs Provide Unstable Answers to Legal Questionscited by 19
- 2023NLI4CT: Multi-Evidence Natural Language Inference for Clinical Trial Reportscited by 18
- 2024Chain of Logic: Rule-Based Reasoning with Large Language Modelscited by 18
- 2024Autoformalizing Natural Language to First-Order Logic: A Case Study in Logical Fallacy Detectioncited by 18
- 2025On Verifiable Legal Reasoning: A Multi-Agent Framework with Formalized Knowledge Representationscited by 18
- 2022LegalBench: Prototyping a Collaborative Benchmark for Legal Reasoningcited by 17
- 2024Reliable Reasoning Beyond Natural Languagecited by 14
- 2025Explainable Rule Application via Structured Prompting: A Neural-Symbolic Approachcited by 14
- 2025Synergizing Logical Reasoning, Knowledge Management and Collaboration in Multi-Agent LLM Systemcited by 10
- 2025Towards Cognitive Synergy in LLM-Based Multi-Agent Systems: Integrating Theory of Mind and Critical Evaluationcited by 8
- 2024textttLM^texttt2: A Simple Society of Language Models Solves Complex Reasoningcited by 7
- 2025Teaching AI to Handle Exceptions: Supervised Fine-Tuning with Human-Aligned Judgmentcited by 4
- 2025Ontology Learning with LLMs: A Benchmark Study on Axiom Identificationcited by 4
- 2025GAIus: Combining Genai with Legal Clauses Retrieval for Knowledge-based Assistantcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Rethinking LLM Verification: Evidence Structure, Uncertainty, and Selective Refinement
- 2025LLMSR@XLLM25: An Empirical Study of LLM for Structural Reasoning
- 2026Clinical Reasoning Graphs: Structured Evaluation of LLM Diagnostic Reasoning Reveals Competence Without Consistency
- 2025Large Language Model-Enhanced Symbolic Reasoning for Knowledge Base Completion
- 2026Ontology-Grounded, Reasoner-Verified Benchmarks for Evaluating LLM Reasoning in Scientific AI
- 2025Automating Expert-Level Medical Reasoning Evaluation of Large Language Models
- 2025Can AI Validate Science? Benchmarking LLMs for Accurate Scientific Claim rightarrow Evidence Reasoning
- 2025LOGicalThought: Logic-Based Ontological Grounding of LLMs for High-Assurance Reasoning