Spatial Reasoning in LLM Game Agents: Impact of Causal Context and Multi-Step Planning
On the map: LLM reasoning → Spatial and embodied reasoning
also in 1 more
Abstract (arXiv)
LLM-based game agents often perform poorly on more complex tasks. This work examines whether these failures are linked to limited spatial reasoning and evaluates whether causal prompt augmentation and multi-step planning can improve win-rates while managing response latency. Using the open-source Qwen3 model family, we conduct experiments across varying model scales, reasoning modes, and planning horizons. We further introduce a focused GVGAI benchmark consisting of three custom games with five difficulty levels to isolate spatial navigation. The evaluation follows two paradigms: an initial ``positioning experiment'' to test an agent's ability to find its exact coordinates, and a study of game-play success. Our results show that while larger models with an enabled thinking mode identify their positions more accurately, overall performance in coordinate matching remains limited for smaller models. Win rates decrease as game levels and layout complexity increase, validating the benchmark's difficulty scaling. Integrating causal context into the prompts tends to improve the agents' success rates, particularly for bigger models. While enabling thinking mode and longer planning horizons significantly improve performance, multi-step planning further reduces mean per-step response times, offering a practical trade-off between reasoning depth and execution speed.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 22 of its 33 references that are in the map. First posted on arXiv 22 Jul 2026.
Builds on
22 of 33 references.
Closest ancestors · 1
Same direction, newest first
Other references · 21
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2024BALROG: Benchmarking Agentic LLM and VLM Reasoning On Gamescited by 141
- 2023SmartPlay: A Benchmark for LLMs as Intelligent Agentscited by 123
- 2024GameBench: Evaluating Strategic Reasoning Abilities of LLM Agentscited by 89
- 2018General Video Game AI: a Multi-Track Framework for Evaluating Agents, Games and Content Generation Algorithmscited by 45
- 2025OptimalThinkingBench: Evaluating Over and Underthinking in LLMscited by 35
- 2018Deep Reinforcement Learning for General Video Game AIcited by 25
- 2025Wait, Wait, Wait... Why Do Reasoning Models Loop?cited by 24
- 2017Representation Learning for Grounded Spatial Reasoningcited by 23
9 more
- 2023Passive learning of active causal strategies in agents and language modelscited by 21
- 2025Measuring General Intelligence with Generated Gamescited by 21
- 2024The SIFo Benchmark: Investigating the Sequential Instruction Following Ability of Large Language Modelscited by 18
- 2024ADAM: An Embodied Causal Agent in Open-World Environmentscited by 13
- 2025GVGAI-LLM: Evaluating Large Language Model Agents with Infinite Gamescited by 8
- 2025Causal-aware Large Language Models: Enhancing Decision-Making Through Learning, Adapting and Actingcited by 6
- 2024From Code to Play: Benchmarking Program Search for Games Using Large Language Modelscited by 5
- 2025Curious Causality-Seeking Agents Learn Meta Causal Worldcited by 4
- 2026From Gameplay Traces to Game Mechanics: Causal Induction with Large Language Modelscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Compiling VGDL into Causal Modelscited by 0
- 2026Compiling VGDL into Causal Models10 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026MAP: A Map-then-Act Paradigm for Long-Horizon Interactive Agent Reasoning
- 2026Deconstructing Spatial Complexity: Hierarchical Decomposition for LLM Spatial Reasoning
- 2026Do LLMs Build Spatial World Models? Evidence from Grid-World Maze Tasks
- 2026Extracting Search Trees from LLM Reasoning Traces Reveals Myopic Planning
- 2025From Text to Space: Mapping Abstract Spatial Models in LLMs during a Grid-World Navigation Task
- 2026Sparks of Cooperative Reasoning: LLMs as Strategic Hanabi Agents
- 2026Mind the Gap Between Spatial Reasoning and Acting! Step-by-Step Evaluation of Agents With Spatial-Gym
- 2025EvoEmpirBench: Dynamic Spatial Reasoning with Agent-ExpVer