2.5-D Decomposition for LLM-Based Spatial Construction
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Autonomous systems that build structures from natural-language instructions need reliable spatial reasoning, yet large language models (LLMs) make systematic coordinate errors when generating three-dimensional block placements. We present a neuro-symbolic pipeline based on 2.5-D decomposition: the LLM plans in the two-dimensional horizontal plane while a deterministic executor computes all vertical placements from column occupancy, eliminating an entire class of errors. On the Build What I Mean benchmark (160 rounds), GPT-4o-mini with this pipeline achieves 94.6% mean structural accuracy across 12 independent runs, within 3.0 percentage points of the 97.6% ceiling imposed by architect-agent errors that no builder-side improvement can address. This outperforms both GPT-4o at 90.3% and the best competing system at 76.3%. A controlled ablation confirms that 2.5-D decomposition is the dominant contributor, accounting for 28.7 percentage points of accuracy. The pipeline transfers directly to edge hardware: Nemotron-3 120B on an NVIDIA Jetson Thor AGX achieves 96.0% mean structural accuracy with the identical pipeline, slightly exceeding the cloud result. Expanding the system prompt by four targeted examples to exceed the model's 8,320-token prefix cache page size, combined with low-effort reasoning, reduces mean per-request latency by 3X to 19.7 seconds at 95.6% accuracy. The underlying principle, removing deterministic dimensions from the LLM's output space, applies to any autonomous construction or assembly task where gravity or other physical constraints fix one or more degrees of freedom. A transfer experiment on 500 IGLU collaborative building tasks confirms the effect generalizes beyond the primary benchmark.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 14 of its 26 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
14 of 26 references.
Closest ancestors · 1
Same direction, newest first
Other references · 13
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
- 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 554
- 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 550
- 2018Neural-Symbolic VQA: Disentangling Reasoning from Vision and Language Understandingcited by 304
- 2023Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memorycited by 288
- 2023Evaluating Spatial Understanding of Large Language Modelscited by 65
- 2022Interactive Grounded Language Understanding in a Collaborative Environment: IGLU 2021cited by 23
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025From Templates to Natural Language: Generalization Challenges in Instruction-Tuned LLMs for Spatial Reasoning
- 2026How Far Are Vision-Language Models from Constructing the Real World? A Benchmark for Physical Generative Reasoning
- 2026Tokenization Allows Multimodal Large Language Models to Understand, Generate and Edit Architectural Floor Plans
- 2026Scaling-Aware Adapter for Structure-Grounded LLM Reasoning
- 2026FLOORA: A Human-Aligned Domain-Specific Language Model for Architectural Design
- 2026LMBuild: Evaluating LLM Agents for Generating Buildable and Functional Structures
- 2024CAD-GPT: Synthesising CAD Construction Sequence with Spatial Reasoning-Enhanced Multimodal LLMs
- 2025SPhyR: Spatial-Physical Reasoning Benchmark on Material Distribution