Explore Like Humans: Autonomous Exploration with Online SG-Memo Construction for Embodied Agents
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Constructing structured spatial memory is essential for enabling long-horizon reasoning in complex embodied navigation tasks. Current memory construction predominantly relies on a decoupled, two-stage paradigm: agents first aggregate environmental data through exploration, followed by the offline reconstruction of spatial memory. However, this post-hoc and geometry-centric approach precludes agents from leveraging high-level semantic intelligence, often causing them to overlook navigationally critical landmarks (e.g., doorways and staircases) that serve as fundamental semantic anchors in human cognitive maps. To bridge this gap, we propose ABot-Explorer, a novel active exploration framework that unifies memory construction and exploration into an online, RGB-only process. At its core, ABot-Explorer leverages Large Vision-Language Models (VLMs) to distill Semantic Navigational Affordances (SNA), which act as cognitive-aligned anchors to guide the agent's movement. By dynamically integrating these SNAs into a hierarchical SG-Memo, ABot-Explorer mirrors human-like exploratory logic by prioritizing structural transit nodes to facilitate efficient coverage. To support this framework, we contribute a large-scale dataset extending InteriorGS with SNA and SG-Memo annotations. Experimental results demonstrate that ABot-Explorer significantly outperforms current state-of-the-art methods in both exploration efficiency and environment coverage, while the resulting SG-Memo is shown to effectively support diverse downstream tasks.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 37 of its 40 references that are in the map. First posted on arXiv 21 Apr 2026.
Builds on
37 of 40 references.
References · 37
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
- 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 559
- 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 365
- 20193D Scene Graph: A Structure for Unified Semantics, 3D Space, and Cameracited by 281
- 2024Hierarchical Open-Vocabulary 3D Scene Graphs for Language-Grounded Robot Navigationcited by 196
- 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 169
- 2022CLIP-Fields: Weakly Supervised Semantic Fields for Robotic Memorycited by 165
- 2022Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigationcited by 132
- 2024SG-Nav: Online 3D Scene Graph Prompting for LLM-based Zero-shot Object Navigationcited by 109
- 2024Mobility VLA: Multimodal Instruction Navigation with Long-Context VLMs and Topological Graphscited by 73
- 2022Topological Semantic Graph Memory for Image-Goal Navigationcited by 45
25 more
- 2024Dynamic Open-Vocabulary 3D Scene Graphs for Long-term Language-Guided Mobile Manipulationcited by 39
- 2025OmniNav: A Unified Framework for Prospective Exploration and Visual-Language Navigationcited by 36
- 2025SmartWay: Enhanced Waypoint Prediction and Backtracking for Zero-Shot Vision-and-Language Navigationcited by 29
- 2026ABot-N0: Technical Report on the VLA Foundation Model for Versatile Embodied Navigationcited by 25
- 2025RayFronts: Open-Set Semantic Ray Frontiers for Online Scene Understanding and Explorationcited by 23
- 2025Towards Physically Executable 3D Gaussian for Embodied Navigationcited by 17
- 2025AstraNav-World: World Model for Foresight Control and Consistencycited by 17
- 2025NavForesee: A Unified Vision-Language World Model for Hierarchical Planning and Dual-Horizon Navigation Predictioncited by 16
- 2024MemoNav: Working Memory Model for Visual Navigationcited by 13
- 2025MSGNav: Unleashing the Power of Multi-modal 3D Scene Graph for Zero-Shot Embodied Navigationcited by 13
- 2025FrontierNet: Learning Visual Cues to Explorecited by 12
- 2025SocialNav: Training Human-Inspired Foundation Model for Socially-Aware Embodied Navigationcited by 12
- 2025GLEAM: Learning Generalizable Exploration Policy for Active Mapping in Complex 3D Indoor Scenescited by 11
- 2025FSR-VLN: Fast and Slow Reasoning for Vision-Language Navigation with Hierarchical Multi-modal Scene Graphcited by 11
- 2025CE-Nav: Flow-Guided Reinforcement Refinement for Cross-Embodiment Local Navigationcited by 10
- 2025Nav-R2 Dual-Relation Reasoning for Generalizable Open-Vocabulary Object-Goal Navigationcited by 10
- 2026SpatialNav: Leveraging Spatial Scene Graphs for Zero-Shot Vision-and-Language Navigationcited by 9
- 2025PIPE Planner: Pathwise Information Gain with Map Predictions for Indoor Robot Explorationcited by 5
- 2024Zero-Shot Vision-and-Language Navigation with Collision Mitigation in Continuous Environmentcited by 4
- 2025Astra: Toward General-Purpose Mobile Robots via Hierarchical Multimodal Learningcited by 4
- 2025CogniPlan: Uncertainty-Guided Path Planning with Conditional Generative Layout Predictioncited by 2
- 2024P2 Explore: Efficient Exploration in Unknown Cluttered Environment with Floor Plan Predictioncited by 1
- 2024A Skeleton-Based Topological Planner for Exploration in Complex Unknown Environmentscited by 1
- 2025Fine-Grained Instruction-Guided Graph Reasoning for Vision-and-Language Navigationcited by 1
- 2025GVD-TG: Topological Graph based on Fast Hierarchical GVD Sampling for Robot Explorationcited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Expand Your SCOPE: Semantic Cognition over Potential-Based Exploration for Embodied Visual Navigation
- 2025From reactive to cognitive: brain-inspired spatial intelligence for embodied agents
- 2026HarnessVLN: Unifying Training-Free Embodied Navigation through an Agent Harness
- 2026NavHarness: Towards Lifelong Embodied Navigation
- 2026CGFM-Nav: Cognitive Graph-Field Memory for Semantic-Guided Lifelong Multimodal Embodied Navigation
- 2026SpaceVLN: A Zero-Shot Vision-and-Language Navigation Agent with Online Spatial Cognitive Memory and Reasoning
- 2026VLingNav: Embodied Navigation with Adaptive Reasoning and Visual-Assisted Linguistic Memory
- 2026Hypothesis Graph Refinement: Hypothesis-Driven Exploration with Cascade Error Correction for Embodied Navigation