Disentangling Extraction and Reasoning in Multi-hop Spatial Reasoning
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Spatial reasoning over text is challenging as the models not only need to extract the direct spatial information from the text but also reason over those and infer implicit spatial relations. Recent studies highlight the struggles even large language models encounter when it comes to performing spatial reasoning over text. In this paper, we explore the potential benefits of disentangling the processes of information extraction and reasoning in models to address this challenge. To explore this, we design various models that disentangle extraction and reasoning(either symbolic or neural) and compare them with state-of-the-art(SOTA) baselines with no explicit design for these parts. Our experimental results consistently demonstrate the efficacy of disentangling, showcasing its ability to enhance models' generalizability within realistic data domains.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 10 of its 36 references that are in the map. First posted on arXiv 25 Oct 2023.
Builds on
10 of 36 references.
References · 10
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2017Decoupled Weight Decay Regularizationcited by 1,831
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 894
- 2017Recurrent Relational Networkscited by 72
- 2022Multi-hop Question Answeringcited by 64
- 2023Large Language Models are Strong Zero-Shot Retrievercited by 26
- 2022ThinkSum: Probabilistic reasoning over sets using large language modelscited by 23
- 2015End-To-End Memory Networkscited by 6
- 2021Relational Gating for "What If" Reasoningcited by 4
- 2023The Role of Semantic Parsing in Understanding Procedural Textcited by 4
Built on by
Citing papers per year: 2024: 3; 2025: 2; 2026: 1.
6 papers.
- 2024SpaRC and SpaRP: Spatial Reasoning Characterization and Path Generation for Understanding Spatial Reasoning Capability of Large Language Modelscited by 5
- 2024Prompt2DeModel: Declarative Neuro-Symbolic Modeling with Natural Languagecited by 3
- 2025An Empirical Study of Conformal Prediction in LLM with ASP Scaffolds for Robust Reasoningcited by 3
- 2025Neuro-Symbolic Frameworks: Conceptual Characterization and Empirical Comparative Analysiscited by 2
- 2024AS-ES Learning: Towards Efficient CoT Learning in Small Modelscited by 1
- 2026Spatial Reasoning via Modality Switching Between Language and Symbolic Representationscited by 1
- 2026Spatial Reasoning via Modality Switching Between Language and Symbolic Representations30 Jun 2026
- 2025Neuro-Symbolic Frameworks: Conceptual Characterization and Empirical Comparative Analysis8 Sep 2025
- 2025An Empirical Study of Conformal Prediction in LLM with ASP Scaffolds for Robust Reasoning7 Mar 2025
- 2024Prompt2DeModel: Declarative Neuro-Symbolic Modeling with Natural Language30 Jul 2024
- 2024SpaRC and SpaRP: Spatial Reasoning Characterization and Path Generation for Understanding Spatial Reasoning Capability of Large Language Models7 Jun 2024
- 2024AS-ES Learning: Towards Efficient CoT Learning in Small Models4 Mar 2024
Similar, not cited
Close in wording, no citation either way
- 2024Advancing Spatial Reasoning in Large Language Models: An In-Depth Evaluation and Enhancement Using the StepGame Benchmark
- 2024Neuro-symbolic Training for Reasoning over Spatial Language
- 2025Stuck in the Matrix: Probing Spatial Reasoning in Large Language Models
- 2026From Symbolic to Geometric: Enabling Spatial Reasoning in Large Language Models
- 2023DepWiGNN: A Depth-wise Graph Neural Network for Multi-hop Spatial Reasoning in Text
- 2022StepGame: A New Benchmark for Robust Multi-Hop Spatial Reasoning in Texts
- 2025Can Large Language Models Integrate Spatial Data? Empirical Insights into Reasoning Strengths and Computational Weaknesses
- 2025Foundation Models for Geospatial Reasoning: Assessing Capabilities of Large Language Models in Understanding Geometries and Topological Spatial Relations