mlsanityData to 7 Oct 2026

Schema-Anchored Latent Reasoning for Semantic Parsing-Based Knowledge Base Question Answering

arXiv 2609.20398 ↗First posted 17 Sep 2026cs.CLcited by 0

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

Abstract (arXiv)

Semantic parsing (SP)-based knowledge base question answering aims to answer natural language questions by generating executable logical forms (LFs) over knowledge bases (KBs). When applying Large Language Models (LLMs) to this task, a key challenge over large, heterogeneous KBs is selecting question-related schema elements (i.e., relations and classes) and composing them into complex LFs. Recent LLM-based methods often make early discrete commitments to schema elements during intermediate reasoning, allowing incorrect intermediate schema decisions to propagate and finally result in incorrect LFs. To overcome this limitation, we propose SALR, a schema-anchored latent reasoning method for LF construction. It performs multi-step reasoning by generating continuous thoughts in the model's hidden states, thereby delaying the explicit commitment to LF decisions. To ground this latent reasoning process in the corresponding KB schema, SALR aligns continuous thoughts with a codebook of KB schema elements through an alignment objective supervised by schema traces deterministically derived from gold LFs. It then incorporates the aligned schema codes into inputs for subsequent reasoning steps. This schema-mediated feedback guides LF generation without requiring the model to emit an explicit textual reasoning trajectory. Experiments on GrailQA and WebQSP show that SALR achieves consistent overall gains over strong baselines. Notably, on compositional questions from GrailQA, SALR outperforms TIARA, a strong SP-based baseline, by 2.86 F1 points. Further analyses show that schema-mediated feedback affects LF generation and that schema information is recoverable from the latent states.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 12 of its 41 references that are in the map. First posted on arXiv 17 Sep 2026.

Builds on

12 of 41 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026Code-on-Graph: Iterative Programmatic Reasoning via Large Language Models on Knowledge Graphs2 Jun
  2. 2025KnowCoder-A1: Incentivizing Agentic Reasoning Capability with Outcome Supervision for KBQA29 Oct

Other references · 10

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  5. 2024Quiet-STaR: Language Models Can Teach Themselves to Think Before Speakingcited by 292
  6. 2024From Explicit CoT to Implicit CoT: Learning to Internalize CoT Step by Stepcited by 225
  7. 2025CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillationcited by 216
  8. 2022DecAF: Joint Decoding of Answers and Logical Forms for Question Answering over Knowledge Basescited by 83
  9. 2025Reasoning by Superposition: A Theoretical Perspective on Chain of Continuous Thoughtcited by 73
  10. 2025LLM Latent Reasoning as Chain of Superpositioncited by 37

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Beyond Chains: Bridging Large Language Models and Knowledge Bases in Complex Question Answering
  2. 2023FlexKBQA: A Flexible LLM-Powered Framework for Few-Shot Knowledge Base Question Answering
  3. 2025From Graph Retrieval to Schema Realization: Counterfactual Validation for Text-to-SPARQL over Heterogeneous Knowledge Graphs
  4. 2026SGR: A Stepwise Reasoning Framework for LLMs with External Subgraph Generation
  5. 2026Which bird does not have wings: Negative-constrained KGQA with Schema-guided Semantic Matching and Self-directed Refinement
  6. 2024AtomR: Atomic Operator-Empowered Large Language Models for Heterogeneous Knowledge Reasoning
  7. 2025iQUEST: An Iterative Question-Guided Framework for Knowledge Base Question Answering
  8. 2025ARK-V1: An LLM-Agent for Knowledge Graph Question Answering Requiring Commonsense Reasoning