Rule-Compliant Visual Spatial Planning for Multimodal Large Language Models
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Multimodal large language models (MLLMs) combine linguistic reasoning with visual perception, yet their ability to perform visual spatial planning under explicit or previously unseen rule constraints remains underexplored. This setting requires models to jointly understand spatial layouts, interpret natural-language rules, and plan valid actions accordingly. To address this gap, we introduce RuleMaze, a controllable benchmark in which MLLMs must navigate mazes while obeying natural-language rules of varying complexity. RuleMaze isolates rule-compliant spatial planning by requiring accurate perception, rule interpretation, and constrained action planning. To enable scalable and systematic rule construction, we propose Language-Logic-Function Hybridization, which automatically generates natural-language rules and translates them into logical representations and executable validators, eliminating manual rule engineering. To improve rule following and generalization, we introduce Disentangled Multimodal Planning (DMP), which separates perception, execution, and rule verification through interpretable reasoning primitives. By disentangling these components, DMP facilitates systematic generalization to more complex and previously unseen rules, while providing transparent intermediate planning traces. Experiments demonstrate that DMP substantially improves rule compliance and planning success compared to end-to-end textual planning baselines. Overall, RuleMaze establishes a principled benchmark for studying grounded and interpretable rule-based spatial planning in MLLMs. Code is available at https://github.com/oceanflowlab/RuleMaze.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 23 of its 39 references that are in the map. First posted on arXiv 20 Aug 2026.
Builds on
23 of 39 references.
Closest ancestors · 3
Same direction, newest first
- 2025AR-VRM: Imitating Human Motions for Visual Robot Manipulation with Analogical Reasoning11 Aug
- 2025Visual Planning: Let's Think Only with Images16 May
- 2025LEGO-Puzzles: How Good Are MLLMs at Multi-Step Spatial Reasoning?25 Mar
Other references · 20
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thoughtcited by 206
- 2024On the Self-Verification Limitations of Large Language Models on Reasoning and Planning Taskscited by 142
- 2023Dolphins: Multimodal Language Model for Drivingcited by 124
- 2024Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescuecited by 103
- 2024Can Large Language Models Reason and Plan?cited by 82
- 2023Exploring Diverse In-Context Configurations for Image Captioningcited by 63
- 2024DeepEdit: Knowledge Editing as Decoding with Constraintscited by 33
- 2025Reasoning via Video: The First Evaluation of Video Models' Reasoning Abilities through Maze-Solving Taskscited by 22
- 2024ChinaTravel: An Open-Ended Travel Planning Benchmark with Compositional Constraint Validation for Language Agentscited by 16
- 2024Attribution Analysis Meets Model Editing: Advancing Knowledge Correction in Vision Language Models with VisEditcited by 14
8 more
- 2025ToolVQA: A Dataset for Multi-step Reasoning VQA with External Toolscited by 13
- 2023LGMCTS: Language-Guided Monte-Carlo Tree Search for Executable Semantic Object Rearrangementcited by 11
- 2024PlanLLM: Video Procedure Planning with Refinable Large Language Modelscited by 10
- 2025Open-Vocabulary HOI Detection with Interaction-aware Prompt and Concept Calibrationcited by 8
- 2025Revisiting the Necessity of Lengthy Chain-of-Thought in Vision-centric Reasoning Generalizationcited by 8
- 2026Taming I2V models for Image HOI Editing: A Cognitive Benchmark and Agentic Self-Correcting Frameworkcited by 5
- 2025TRKT: Weakly Supervised Dynamic Scene Graph Generation with Temporal-enhanced Relation-aware Knowledge Transferringcited by 3
- 2026Unleashing Multimodal Large Language Models for Training-free HOI Detection in the Wildcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026SpatialImaginer: Towards Adaptive Visual Imagination for Spatial Reasoning
- 2025Assessing the Value of Visual Input: A Benchmark of Multimodal Large Language Models for Robotic Path Planning
- 2024VSP: Assessing the dual challenges of perception and reasoning in spatial planning tasks for VLMs
- 2026Towards a Data-Centric Understanding of Spatial Reasoning in Multimodal Large Language Models
- 2025Bridging the Dynamic Perception Gap: Training-Free Draft Chain-of-Thought for Dynamic Multimodal Spatial Reasoning
- 2026LAST: Leveraging Tools as Hints to Enhance Spatial Reasoning for Multimodal Large Language Models
- 2026Learning Visual Spatial Planning from Symbolic State via Modality-Gap-Aware Self-Distillation
- 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarks