mlsanityData to 7 Oct 2026

REST: Receding Horizon Explorative Steiner Tree for Zero-Shot Object-Goal Navigation

arXiv 2603.18624 ↗First posted 19 Mar 2026cs.RO cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Zero-shot object-goal navigation (ZSON) requires navigating unknown environments to find a target object without task-specific training. Prior hierarchical solutions mainly focus on either scene understanding and representations (belief) or high-level decision-making and planning (policy), yet treat the option, i.e., the subgoal candidate that belief proposes and policy selects, as an interface inherited from adjacent modules rather than a design axis in its own right. In practice, options are predominantly single waypoints scored by destination utility: a lone destination hides the value gathered en route, and a flat list obscures the relationships among candidates. Our insight is that the option space should be a tree of paths. Full paths expose en-route information gain that destination-only scoring systematically neglects; a tree of shared segments enables coarse-to-fine LLM reasoning that dismisses or pursues entire branches before examining individual leaves, compressing the combinatorial path space into an efficient hierarchy. We instantiate this insight in REST (Receding Horizon Explorative Steiner Tree), a training-free framework that (1) builds an explicit open-vocabulary 3D map from online RGB-D streams; (2) grows an agent-centric tree of safe and informative paths as the option space via sampling-based planning; and (3) textualizes each branch into a spatial narrative and selects the next-best path through chain-of-thought LLM reasoning. Across the Gibson, HM3D, and HSSD benchmarks, REST consistently ranks among the top methods in success rate and path efficiency.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 42 references that are in the map. First posted on arXiv 19 Mar 2026.

Builds on

33 of 42 references.

References · 33

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  3. 2025Qwen3-VL Technical Reportcited by 2,534
  4. 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 579
  5. 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 498
  6. 2018Gibson Env: Real-World Perception for Embodied Agentscited by 477
  7. 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 421
  8. 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 240
  9. 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigationcited by 201
  10. 2022CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigationcited by 194
  11. 2022ZSON: Zero-Shot Object-Goal Navigation using Multimodal Goal Embeddingscited by 177
  12. 2023Habitat Synthetic Scenes Dataset (HSSD-200): An Analysis of 3D Scene Scale and Realism Tradeoffs for ObjectGoal Navigationcited by 162
21 more
  1. 2016SemanticFusion: Dense 3D Semantic Mapping with Convolutional Neural Networkscited by 134
  2. 2023ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigationcited by 126
  3. 2023L3MVN: Leveraging Large Language Models for Visual Target Navigationcited by 118
  4. 2024SG-Nav: Online 3D Scene Graph Prompting for LLM-based Zero-shot Object Navigationcited by 106
  5. 2023PIRLNav: Pretraining with Imitation and RL Finetuning for ObjectNavcited by 91
  6. 2023Bridging Zero-shot Object Navigation and Foundation Models through Pixel-Guided Navigation Skillcited by 75
  7. 2025UniGoal: Towards Universal Zero-shot Goal-oriented Navigationcited by 56
  8. 2024VoroNav: Voronoi-based Zero-shot Object Navigation with Large Language Modelcited by 55
  9. 2021VTNet: Visual Transformer Network for Object Goal Navigationcited by 50
  10. 2021Learning to Map for Active Semantic Goal Navigationcited by 47
  11. 2019An Efficient Sampling-based Method for Online Informative Path Planning in Unknown Environmentscited by 38
  12. 2024ImagineNav: Prompting Vision-Language Models as Embodied Navigator through Scene Imaginationcited by 38
  13. 2025ApexNav: An Adaptive Exploration Strategy for Zero-Shot Object Navigation with Target-centric Semantic Fusioncited by 29
  14. 2024TriHelper: Zero-Shot Object Navigation with Dynamic Assistancecited by 24
  15. 2024GAMap: Zero-Shot Object Goal Navigation with Multi-Scale Geometric-Affordance Guidancecited by 22
  16. 2025EdgeTAM: On-Device Track Anything Modelcited by 21
  17. 2025MobileCLIP2: Improving Multi-Modal Reinforced Trainingcited by 20
  18. 2023Object Goal Navigation with Recursive Implicit Mapscited by 16
  19. 2020UFOMap: An Efficient Probabilistic 3D Mapping Framework That Embraces the Unknowncited by 11
  20. 2025PanoNav: Mapless Zero-Shot Object Navigation with Panoramic Scene Parsing and Dynamic Memorycited by 8
  21. 2024A Tree-based Next-best-trajectory Method for 3D UAV Explorationcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Hierarchical Fast-Slow ReAct Agent for Zero-Shot Object-Goal Navigation
  2. 2026Think before Go: Hierarchical Reasoning for Image-goal Navigation
  3. 2026HRO: Hierarchical Room-to-Object Framework for Zero-Shot Object Goal Navigation with Large Language Models
  4. 2025CL-CoTNav: Closed-Loop Hierarchical Chain-of-Thought for Zero-Shot Object-Goal Navigation with Vision-Language Models
  5. 2024Zero-shot Object Navigation with Vision-Language Models Reasoning
  6. 2025Nav-R2 Dual-Relation Reasoning for Generalizable Open-Vocabulary Object-Goal Navigation
  7. 2026MarvisNav: Making Memory Visible on Route Choices for Zero-Shot Object Navigation ↗
  8. 2025BeliefMapNav: 3D Voxel-Based Belief Map for Zero-Shot Object Navigation