mlsanityData to 7 Oct 2026

MMP-A*: Multimodal Perception Enhanced Incremental Heuristic Search on Path Planning

arXiv 2601.01910 ↗First posted 5 Jan 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Autonomous path planning requires a synergy between global reasoning and geometric precision, especially in complex or cluttered environments. While classical A* is valued for its optimality, it incurs prohibitive computational and memory costs in large-scale scenarios. Recent attempts to mitigate these limitations by using Large Language Models for waypoint guidance remain insufficient, as they rely only on text-based reasoning without spatial grounding. As a result, such models often produce incorrect waypoints in topologically complex environments with dead ends, and lack the perceptual capacity to interpret ambiguous physical boundaries. These inconsistencies lead to costly corrective expansions and undermine the intended computational efficiency. We introduce MMP-A*, a multimodal framework that integrates the spatial grounding capabilities of vision-language models with a novel adaptive decay mechanism. By anchoring high-level reasoning in physical geometry, the framework produces coherent waypoint guidance that addresses the limitations of text-only planners. The adaptive decay mechanism dynamically regulates the influence of uncertain waypoints within the heuristic, ensuring geometric validity while substantially reducing memory overhead. To evaluate robustness, we test the framework in challenging environments characterized by severe clutter and topological complexity. Experimental results show that MMP-A* achieves near-optimal trajectories with significantly reduced operational costs, demonstrating its potential as a perception-grounded and computationally efficient paradigm for autonomous navigation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 43 references that are in the map. First posted on arXiv 5 Jan 2026.

Builds on

25 of 43 references.

References · 25

  1. 2023A Survey on Evaluation of Large Language Modelscited by 1,227
  2. 2023Vision-Language Models for Vision Tasks: A Surveycited by 834
  3. 2023A Comprehensive Overview of Large Language Modelscited by 639
  4. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 446
  5. 2023Large Language Models as Commonsense Knowledge for Large-Scale Task Planningcited by 231
  6. 2025Plan-and-Act: Improving Planning of Agents for Long-Horizon Taskscited by 190
  7. 2021Can Language Models Encode Perceptual Structure Without Grounding? A Case Study in Colorcited by 118
  8. 2025PlanGenLLMs: A Modern Survey of LLM Planning Capabilitiescited by 82
  9. 2024LLM3:Large Language Model-based Task and Motion Planning with Motion Failure Reasoningcited by 63
  10. 2024Affordances-Oriented Planning using Foundation Models for Continuous Vision-Language Navigationcited by 60
  11. 2023Can Large Language Models be Good Path Planners? A Benchmark and Investigation on Spatial-temporal Reasoningcited by 49
  12. 2024Guiding Long-Horizon Task and Motion Planning with Vision Language Modelscited by 46
13 more
  1. 2024LLM-A*: Large Language Model Enhanced Incremental Heuristic Search on Path Planningcited by 44
  2. 2023CoPAL: Corrective Planning of Robot Actions with Large Language Modelscited by 39
  3. 2025Large Language Models for Planning: A Comprehensive and Systematic Surveycited by 38
  4. 2025Multimodal Fusion and Vision-Language Models: A Survey for Robot Visioncited by 37
  5. 2024PlanLLM: Video Procedure Planning with Refinable Large Language Modelscited by 10
  6. 2023Can LLMs Fix Issues with Reasoning Models? Towards More Likely Models for AI Planningcited by 8
  7. 2024Look Further Ahead: Testing the Limits of GPT-4 in Path Planningcited by 7
  8. 2024Evaluating Vision-Language Models as Evaluators in Path Planningcited by 6
  9. 2024LLM-Enhanced Path Planning: Safe and Efficient Autonomous Navigation with Instructional Inputscited by 5
  10. 2025VLM-RRT: Vision Language Model Guided RRT Search for Autonomous UAV Navigationcited by 5
  11. 2025Assessing the Value of Visual Input: A Benchmark of Multimodal Large Language Models for Robotic Path Planningcited by 4
  12. 2025Pareto-Grid-Guided Large Language Models for Fast and High-Quality Heuristics Design in Multi-Objective Combinatorial Optimizationcited by 4
  13. 2025Robust Mobile Robot Path Planning via LLM-Based Dynamic Waypoint Generationcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Rule-Compliant Visual Spatial Planning for Multimodal Large Language Models
  2. 2025Using VLM Reasoning to Constrain Task and Motion Planning
  3. 2025Visual Planning: Let's Think Only with Images
  4. 2025Boosting Zero-Shot VLN via Abstract Obstacle Map-Based Waypoint Prediction with TopoGraph-and-VisitInfo-Aware Prompting
  5. 2023Look Before You Leap: Unveiling the Power of GPT-4V in Robotic Vision-Language Planning
  6. 2024RoboMP2: A Robotic Multimodal Perception-Planning Framework with Multimodal Large Language Models
  7. 2024VSP: Assessing the dual challenges of perception and reasoning in spatial planning tasks for VLMs
  8. 2026APIVOT: Adaptive Planning with Interleaved Vision-Language Thoughts