The Sword, Shield, and Achilles' Heel: Characterizing the Linguistic Inductive Bias of Large Language Models for Spatial Reasoning in Navigation Planning
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Large Language Model (LLM)-based navigation systems commonly construct explicit spatial representations (e.g., topological graphs, semantic raster maps) and translate them into textual descriptions as LLMs' inputs. However, the linguistic structures of such text-based spatial representations and the choices of contextual features (e.g., topology, geometry) they contain are often treated as neutral engineering decisions rather than key factors that shape LLMs' behavior. To fill the gap, we propose a dual-interventional framework that disentangles linguistic structures from different contextual cues to evaluate the linguistic inductive bias of LLMs for navigation planning. In the framework, representation intervention varies the linguistic format and the degree of linguistic compression, clarifying when linguistic representations support or inhibit navigation planning. Context intervention, combined with contextual feature combination and conflict probing, explicitly clarifies the preferences and weaknesses of LLMs when processing different contextual cues. Experiments across diverse spatial reasoning tasks and multiple model scales reveal a consistent pattern: topological information is a sturdy shield and the backbone of robust planning; linguistic format is a double-edged sword whose effect depends on model size, task demands, and the compression level; and semantic information is a fatal Achilles' heel -- incorrect semantic cues can systematically derail the planning process. Overall, our study shows that effective text-based spatial representations in LLM-based navigation should preserve topological integrity, calibrate representational compression to model capacity, and ensure semantic correctness, rather than simply adopting a single representation. Our code is publicly available at https://github.com/jonesdong150/LLM-Navigation-Inductive-Bias.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 29 of its 43 references that are in the map. First posted on arXiv 29 May 2026.
Builds on
29 of 43 references.
Closest ancestors · 2
Same direction, newest first
- 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Models26 May
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Models12 Jul
Other references · 27
- 2017Attention Is All You Needcited by 60,361
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2023Qwen Technical Reportcited by 3,344
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
15 more
- 2024Qwen2 Technical Reportcited by 2,120
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2022LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Actioncited by 439
- 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 411
- 2022Visual Language Maps for Robot Navigationcited by 365
- 2023Language Models Represent Space and Timecited by 316
- 2023On the Planning Abilities of Large Language Models : A Critical Investigationcited by 312
- 2023Can Language Models Solve Graph Problems in Natural Language?cited by 252
- 2020RoboTHOR: An Open Simulation-to-Real Embodied AI Platformcited by 193
- 2023Talk like a Graph: Encoding Graphs for Large Language Modelscited by 176
- 2017Neural Map: Structured Memory for Deep Reinforcement Learningcited by 90
- 2024MapGPT: Map-Guided Prompting with Adaptive Path Planning for Vision-and-Language Navigationcited by 86
- 2025MapNav: A Novel Memory Representation via Annotated Semantic Maps for Vision-and-Language Navigationcited by 60
- 2024Can LLM Graph Reasoning Generalize beyond Pattern Memorization?cited by 47
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026From Human Cognition to Neural Activations: Probing the Computational Primitives of Spatial Reasoning in LLMs
- 2025From Text to Space: Mapping Abstract Spatial Models in LLMs during a Grid-World Navigation Task
- 2025Cognitive Maps in Language Models: A Mechanistic Analysis of Spatial Planning
- 2025A Survey of Large Language Model-Powered Spatial Intelligence Across Scales: Advances in Embodied Agents, Smart Cities, and Earth Science
- 2025Stuck in the Matrix: Probing Spatial Reasoning in Large Language Models
- 2023Inherent limitations of LLMs regarding spatial information
- 2025MazeEval: A Benchmark for Testing Sequential Decision-Making in Language Models
- 2026Do LLMs Build Spatial World Models? Evidence from Grid-World Maze Tasks