ForesightNav: Learning Scene Imagination for Efficient Exploration
Not on the map. Why?
Abstract (arXiv)
Understanding how humans leverage prior knowledge to navigate unseen environments while making exploratory decisions is essential for developing autonomous robots with similar abilities. In this work, we propose ForesightNav, a novel exploration strategy inspired by human imagination and reasoning. Our approach equips robotic agents with the capability to predict contextual information, such as occupancy and semantic details, for unexplored regions. These predictions enable the robot to efficiently select meaningful long-term navigation goals, significantly enhancing exploration in unseen environments. We validate our imagination-based approach using the Structured3D dataset, demonstrating accurate occupancy prediction and superior performance in anticipating unseen scene geometry. Our experiments show that the imagination module improves exploration efficiency in unseen environments, achieving a 100% completion rate for PointNav and an SPL of 67% for ObjectNav on the Structured3D Validation split. These contributions demonstrate the power of imagination-driven reasoning for autonomous systems to enhance generalizable and efficient exploration.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 39 of its 47 references that are in the map. First posted on arXiv 22 Apr 2025.
Builds on
39 of 47 references.
References · 39
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2022Language-driven Semantic Segmentationcited by 711
- 2018On Evaluation of Embodied Navigation Agentscited by 526
- 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 421
- 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 369
- 2022Visual Language Maps for Robot Navigationcited by 362
- 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 357
27 more
- 2023ConceptFusion: Open-set Multimodal 3D Mappingcited by 302
- 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 289
- 2019Structured3D: A Large Photo-realistic Dataset for Structured 3D Modelingcited by 285
- 20193D Scene Graph: A Structure for Unified Semantics, 3D Space, and Cameracited by 280
- 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 240
- 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigationcited by 201
- 2022CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigationcited by 194
- 2023ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigationcited by 126
- 2022Navigating to Objects in the Real Worldcited by 104
- 2022Cross-modal Map Learning for Vision and Language Navigationcited by 91
- 2023PIRLNav: Pretraining with Imitation and RL Finetuning for ObjectNavcited by 91
- 2023Can an Embodied Agent Find Your "Cat-shaped Mug"? LLM-Guided Exploration for Zero-Shot Object Navigationcited by 74
- 2021Auxiliary Tasks and Exploration Enable ObjectNavcited by 73
- 2020Semantic Visual Navigation by Watching YouTube Videoscited by 60
- 2024PoliFormer: Scaling On-Policy RL with Transformers Results in Masterful Navigatorscited by 55
- 2023How To Not Train Your Dragon: Training-free Embodied Object Goal Navigation with Semantic Frontierscited by 53
- 2024POP-3D: Open-Vocabulary 3D Occupancy Prediction from Imagescited by 52
- 2021Learning to Map for Active Semantic Goal Navigationcited by 47
- 2021Hierarchical Object-to-Zone Graph for Object Navigationcited by 34
- 2024RoboHop: Segment-based Topological Map Representation for Open-World Visual Navigationcited by 25
- 2023Autonomous Power Line Inspection with Drones via Perception-Aware MPCcited by 14
- 2024Tag Map: A Text-Based Map for Spatial Reasoning and Navigation with Large Language Modelscited by 12
- 2022Object Goal Navigation using Data Regularized Q-Learningcited by 10
- 2022SC-Explorer: Incremental 3D Scene Completion for Safe and Efficient Exploration Mapping and Planningcited by 6
- 2024Beyond the Frontier: Predicting Unseen Walls from Occupancy Grids by Learning from Floor Planscited by 6
- 2024IPPON: Common Sense Guided Informative Path Planning for Object Goal Navigationcited by 6
- 2022Learning-Augmented Model-Based Planning for Visual Explorationcited by 5
Built on by
Citing papers per year: 2025: 4; 2026: 5.
9 papers.
- 2025Cross from Left to Right Brain: Adaptive Text Dreamer for Vision-and-Language Navigationcited by 16
- 2026NavWAM: A Navigation World Action Model for Goal-Conditioned Visual Navigationcited by 7
- 2026WildOS: Open-Vocabulary Object Search in the Wildcited by 3
- 2026OpenFrontier: General Navigation with Visual-Language Grounded Frontierscited by 3
- 2025Sight Over Site: Perception-Aware Reinforcement Learning for Efficient Robotic Inspectioncited by 1
- 2025Schr"odinger's Navigator: Imagining an Ensemble of Futures for Zero-Shot Object Navigationcited by 1
- 2026VoLN: Vision-Only Long-Horizon Navigation---Paradigm, Benchmark, and Methodcited by 1
- 2025FastMap: Real-Time Semantic Map Completion via Bitwise Masked Modelingcited by 0
- 2026Generation of Vectorized Maps Beyond Vehicle Viewcited by 0
- 2026Generation of Vectorized Maps Beyond Vehicle View7 Sep 2026
- 2026VoLN: Vision-Only Long-Horizon Navigation---Paradigm, Benchmark, and Method23 Jul 2026
- 2026NavWAM: A Navigation World Action Model for Goal-Conditioned Visual Navigation11 Jun 2026
- 2026OpenFrontier: General Navigation with Visual-Language Grounded Frontiers5 Mar 2026
- 2026WildOS: Open-Vocabulary Object Search in the Wild22 Feb 2026
- 2025Schr"odinger's Navigator: Imagining an Ensemble of Futures for Zero-Shot Object Navigation24 Dec 2025
- 2025Sight Over Site: Perception-Aware Reinforcement Learning for Efficient Robotic Inspection22 Sep 2025
- 2025FastMap: Real-Time Semantic Map Completion via Bitwise Masked Modeling9 Jun 2025
- 2025Cross from Left to Right Brain: Adaptive Text Dreamer for Vision-and-Language Navigation27 May 2025