SCOPE: Evolving Symbolic World for Planning in Open-Ended Environments
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Recent works have explored integrating Vision-Language Models (VLMs) with classical planners that rely on symbolic representations of planning problems to generate long-horizon plans for complex embodied tasks. However, in open-ended environments, these symbolic representations obtained from perception are often incomplete, leading to suboptimal performance. To address this, we introduce SCOPE, a self-adaptive symbolic planning framework that supports refining action plans and evolving the symbolic world, i.e., the symbolic representations of open-ended environments. SCOPE comprises two synergistic modules: a Symbolic Execution Simulator (SESim) that conducts symbolic validation and real execution of action plans, leveraging the feedback to refine the plans and evolve the symbolic world; and a Self-Adaptive Symbolic Memory (SASMem) that further distills feedback into evolving symbolic knowledge to enhance long-horizon planning and modeling of the symbolic world. Experiments in open-ended environments show that SCOPE significantly improves the completeness of the symbolic world, the success rate of plans under environment perturbations, and cross-task grounding and adaptability across diverse embodied scenarios.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 36 of its 45 references that are in the map. First posted on arXiv 21 Jun 2026.
Builds on
36 of 45 references.
Closest ancestors · 5
Same direction, newest first
- 2024VSP: Assessing the dual challenges of perception and reasoning in spatial planning tasks for VLMs2 Jul
- 2024VLM Agents Generate Their Own Memories: Distilling Experience into Embodied Programs of Thought20 Jun
- 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models3 Jun
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
- 2023Grounding Classical Task Planners via Vision-Language Models17 Apr
Other references · 31
- 2023GPT-4 Technical Reportcited by 18,396
- 2025Qwen3 Technical Reportcited by 8,820
- 2024GPT-4o System Cardcited by 4,588
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,035
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
- 2022Socratic Models: Composing Zero-Shot Multimodal Reasoning with Languagecited by 513
- 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 501
- 2018VirtualHome: Simulating Household Activities via Programscited by 415
19 more
- 2019The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervisioncited by 372
- 2016Visual Relationship Detection with Language Priorscited by 334
- 2022A Survey of Vision-Language Pre-Trained Modelscited by 177
- 2023Look Before You Leap: Unveiling the Power of GPT-4V in Robotic Vision-Language Planningcited by 161
- 2019Language as an Abstraction for Hierarchical Deep Reinforcement Learningcited by 138
- 2019Hierarchical Foresight: Self-Supervised Learning of Long-Horizon Tasks via Visual Subgoal Generationcited by 83
- 2020Hierarchical Planning for Long-Horizon Manipulation with Geometric and Symbolic Scene Graphscited by 83
- 2023ISR-LLM: Iterative Self-Refined Large Language Model for Long-Horizon Sequential Task Planningcited by 77
- 2023Exploring Diverse In-Context Configurations for Image Captioningcited by 63
- 2025Embodied AI Agents: Modeling the Worldcited by 61
- 2022Predicate Invention for Bilevel Planningcited by 49
- 2024Vitron: A Unified Pixel-level Vision LLM for Understanding, Generating, Segmenting, Editingcited by 49
- 2018Task Planning in Robotics: an Empirical Comparison of PDDL-based and ASP-based Systemscited by 40
- 2023Learning adaptive planning representations with natural language guidancecited by 36
- 2025Text2World: Benchmarking Large Language Models for Symbolic World Model Generationcited by 26
- 2021Grounding Predicates through Actionscited by 25
- 2025NeSyC: A Neuro-symbolic Continual Learner For Complex Embodied Tasks In Open Domainscited by 15
- 2025EMAC+: Embodied Multimodal Agent for Collaborative Planning with VLM+LLMcited by 5
- 2025Vote-Tree-Planner: Optimizing Execution Order in LLM-based Task Planning Pipeline via Votingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025SCOPE: Language Models as One-Time Teacher for Hierarchical Planning in Text Environments
- 2024Can-Do! A Dataset and Neuro-Symbolic Grounded Framework for Embodied Planning with Large Multimodal Models
- 2026Plan-Bench: Can Existing VLMs Go Well Beyond Perception to Reason and Plan in Embodied Worlds?
- 2025Expand Your SCOPE: Semantic Cognition over Potential-Based Exploration for Embodied Visual Navigation
- 2026Learning Visual Spatial Planning from Symbolic State via Modality-Gap-Aware Self-Distillation
- 2025World-aware Planning Narratives Enhance Large Vision-Language Model Planner
- 2025Making VLMs More Robot-Friendly: Self-Critical Distillation of Low-Level Procedural Reasoning
- 2024Learning for Long-Horizon Planning via Neuro-Symbolic Abductive Imitation