mlsanityData to 7 Oct 2026

ForesightNav: Learning Scene Imagination for Efficient Exploration

arXiv 2504.16062 ↗First posted 22 Apr 2025cs.RO cs.CVcited by 9

Not on the map. Why?

Abstract (arXiv)

Understanding how humans leverage prior knowledge to navigate unseen environments while making exploratory decisions is essential for developing autonomous robots with similar abilities. In this work, we propose ForesightNav, a novel exploration strategy inspired by human imagination and reasoning. Our approach equips robotic agents with the capability to predict contextual information, such as occupancy and semantic details, for unexplored regions. These predictions enable the robot to efficiently select meaningful long-term navigation goals, significantly enhancing exploration in unseen environments. We validate our imagination-based approach using the Structured3D dataset, demonstrating accurate occupancy prediction and superior performance in anticipating unseen scene geometry. Our experiments show that the imagination module improves exploration efficiency in unseen environments, achieving a 100% completion rate for PointNav and an SPL of 67% for ObjectNav on the Structured3D Validation split. These contributions demonstrate the power of imagination-driven reasoning for autonomous systems to enhance generalizable and efficient exploration.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 39 of its 47 references that are in the map. First posted on arXiv 22 Apr 2025.

Builds on

39 of 47 references.

References · 39

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  5. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  6. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  7. 2022Language-driven Semantic Segmentationcited by 711
  8. 2018On Evaluation of Embodied Navigation Agentscited by 526
  9. 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 421
  10. 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 369
  11. 2022Visual Language Maps for Robot Navigationcited by 362
  12. 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 357
27 more
  1. 2023ConceptFusion: Open-set Multimodal 3D Mappingcited by 302
  2. 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 289
  3. 2019Structured3D: A Large Photo-realistic Dataset for Structured 3D Modelingcited by 285
  4. 20193D Scene Graph: A Structure for Unified Semantics, 3D Space, and Cameracited by 280
  5. 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 240
  6. 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigationcited by 201
  7. 2022CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigationcited by 194
  8. 2023ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigationcited by 126
  9. 2022Navigating to Objects in the Real Worldcited by 104
  10. 2022Cross-modal Map Learning for Vision and Language Navigationcited by 91
  11. 2023PIRLNav: Pretraining with Imitation and RL Finetuning for ObjectNavcited by 91
  12. 2023Can an Embodied Agent Find Your "Cat-shaped Mug"? LLM-Guided Exploration for Zero-Shot Object Navigationcited by 74
  13. 2021Auxiliary Tasks and Exploration Enable ObjectNavcited by 73
  14. 2020Semantic Visual Navigation by Watching YouTube Videoscited by 60
  15. 2024PoliFormer: Scaling On-Policy RL with Transformers Results in Masterful Navigatorscited by 55
  16. 2023How To Not Train Your Dragon: Training-free Embodied Object Goal Navigation with Semantic Frontierscited by 53
  17. 2024POP-3D: Open-Vocabulary 3D Occupancy Prediction from Imagescited by 52
  18. 2021Learning to Map for Active Semantic Goal Navigationcited by 47
  19. 2021Hierarchical Object-to-Zone Graph for Object Navigationcited by 34
  20. 2024RoboHop: Segment-based Topological Map Representation for Open-World Visual Navigationcited by 25
  21. 2023Autonomous Power Line Inspection with Drones via Perception-Aware MPCcited by 14
  22. 2024Tag Map: A Text-Based Map for Spatial Reasoning and Navigation with Large Language Modelscited by 12
  23. 2022Object Goal Navigation using Data Regularized Q-Learningcited by 10
  24. 2022SC-Explorer: Incremental 3D Scene Completion for Safe and Efficient Exploration Mapping and Planningcited by 6
  25. 2024Beyond the Frontier: Predicting Unseen Walls from Occupancy Grids by Learning from Floor Planscited by 6
  26. 2024IPPON: Common Sense Guided Informative Path Planning for Object Goal Navigationcited by 6
  27. 2022Learning-Augmented Model-Based Planning for Visual Explorationcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 4; 2026: 5.

9 papers.