ExploreVLM: Closed-Loop Robot Exploration Task Planning with Vision-Language Models
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
The advancement of embodied intelligence is accelerating the integration of robots into daily life as human assistants. This evolution requires robots to not only interpret high-level instructions and plan tasks but also perceive and adapt within dynamic environments. Vision-Language Models (VLMs) present a promising solution by combining visual understanding and language reasoning. However, existing VLM-based methods struggle with interactive exploration, accurate perception, and real-time plan adaptation. To address these challenges, we propose ExploreVLM, a novel closed-loop task planning framework powered by Vision-Language Models (VLMs). The framework is built around a step-wise feedback mechanism that enables real-time plan adjustment and supports interactive exploration. At its core is a dual-stage task planner with self-reflection, enhanced by an object-centric spatial relation graph that provides structured, language-grounded scene representations to guide perception and planning. An execution validator supports the closed loop by verifying each action and triggering re-planning. Extensive real-world experiments demonstrate that ExploreVLM significantly outperforms state-of-the-art baselines, particularly in exploration-centric tasks. Ablation studies further validate the critical role of the reflective planner and structured perception in achieving robust and efficient task execution.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 18 of its 22 references that are in the map. First posted on arXiv 16 Aug 2025.
Builds on
18 of 22 references.
Closest ancestors · 2
Same direction, newest first
- 2024VLM See, Robot Do: Human Demo Video to Robot Action Plan via Vision Language Model11 Oct
- 2024ReplanVLM: Replanning Robotic Tasks with Visual Language Models31 Jul
Other references · 16
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2024GPT-4o System Cardcited by 4,588
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
- 2020Integrated Task and Motion Planningcited by 290
- 2021BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environmentscited by 165
- 2023Look Before You Leap: Unveiling the Power of GPT-4V in Robotic Vision-Language Planningcited by 161
- 2023Generalized Planning in PDDL Domains with Pretrained Large Language Modelscited by 139
- 2023Large Language Models for Robotics: A Surveycited by 133
4 more
- 2024RoboEXP: Action-Conditioned Scene Graph via Interactive Exploration for Robotic Manipulationcited by 48
- 2023Human Demonstrations are Generalizable Knowledge for Robotscited by 6
- 2024Grasp, See, and Place: Efficient Unknown Object Rearrangement with Policy Structure Priorcited by 5
- 2025Efficient Alignment of Unconditioned Action Prior for Language-conditioned Pick and Place in Cluttercited by 3
Built on by
Citing papers per year: 2025: 3; 2026: 4.
7 papers.
- 2025Seeing to Act, Prompting to Specify: A Bayesian Factorization of Vision Language Action Policycited by 18
- 2026RoboAgent: Chaining Basic Capabilities for Embodied Task Planningcited by 7
- 2025AREA3D: Active Reconstruction Agent with Unified Feed-Forward 3D Perception and Vision-Language Guidancecited by 4
- 2025ManiAgent: An Agentic Framework for General Robotic Manipulationcited by 3
- 2026TSHA: A Benchmark for Visual Language Models in Trustworthy Safety Hazard Assessment Scenarioscited by 0
- 2026UniETP: Unifying Environments for Generalizable Embodied Task Planningcited by 0
- 2026Safe Task Planning with Long-Term Graph Memory for Embodied Agentscited by 0
- 2026Safe Task Planning with Long-Term Graph Memory for Embodied Agents8 Sep 2026
- 2026UniETP: Unifying Environments for Generalizable Embodied Task Planning20 Jul 2026
- 2026RoboAgent: Chaining Basic Capabilities for Embodied Task Planning9 Apr 2026
- 2026TSHA: A Benchmark for Visual Language Models in Trustworthy Safety Hazard Assessment Scenarios31 Mar 2026
- 2025Seeing to Act, Prompting to Specify: A Bayesian Factorization of Vision Language Action Policy12 Dec 2025
- 2025AREA3D: Active Reconstruction Agent with Unified Feed-Forward 3D Perception and Vision-Language Guidance28 Nov 2025
- 2025ManiAgent: An Agentic Framework for General Robotic Manipulation13 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2025Vision-Language-Policy Model for Dynamic Robot Task Planning
- 2025Think, Remember, Navigate: Zero-Shot Object-Goal Navigation with VLM-Powered Reasoning
- 2026Plan-Bench: Can Existing VLMs Go Well Beyond Perception to Reason and Plan in Embodied Worlds?
- 2025Using Language Models as Closed-Loop High-Level Planners for Robotics Applications: A Brief Overview and Benchmarks
- 2025Making VLMs More Robot-Friendly: Self-Critical Distillation of Low-Level Procedural Reasoning
- 2024DKPROMPT: Domain Knowledge Prompting Vision-Language Models for Open-World Planning
- 2026ProAct-VLM: Pre-Failure Vision-Language Task Replanning with Continuous Perception Feedback ↗
- 2024Navigation with VLM framework: Towards Going to Any Language