Uncertainty-driven Planner for Exploration and Navigation
Not on the map. Why?
Abstract (arXiv)
We consider the problems of exploration and point-goal navigation in previously unseen environments, where the spatial complexity of indoor scenes and partial observability constitute these tasks challenging. We argue that learning occupancy priors over indoor maps provides significant advantages towards addressing these problems. To this end, we present a novel planning framework that first learns to generate occupancy maps beyond the field-of-view of the agent, and second leverages the model uncertainty over the generated areas to formulate path selection policies for each task of interest. For point-goal navigation the policy chooses paths with an upper confidence bound policy for efficient and traversable paths, while for exploration the policy maximizes model uncertainty over candidate paths. We perform experiments in the visually realistic environments of Matterport3D using the Habitat simulator and demonstrate: 1) Improved results on exploration and map quality metrics over competitive methods, and 2) The effectiveness of our planning module when paired with the state-of-the-art DD-PPO method for the point-goal navigation task.
Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). Builds on 33 of its 54 references that are in the map. First posted on arXiv 24 Feb 2022.
Builds on
33 of 54 references.
References · 33
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
- 2017Deep Bayesian Active Learning with Image Datacited by 812
- 2018On Evaluation of Embodied Navigation Agentscited by 526
- 2017Minimax Regret Bounds for Reinforcement Learningcited by 500
- 2018Gibson Env: Real-World Perception for Embodied Agentscited by 477
- 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 421
- 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 405
21 more
- 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 352
- 2016Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learningcited by 351
- 2020Learning to Explore using Active Neural SLAMcited by 308
- 2019Self-Supervised Exploration via Disagreementcited by 263
- 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 240
- 2017Cognitive Mapping and Planning for Visual Navigationcited by 209
- 2020Neural Topological SLAM for Visual Navigationcited by 193
- 2019Learning Exploration Policies for Navigationcited by 113
- 2019Scene Memory Transformer for Embodied Agents in Long-Horizon Taskscited by 106
- 2020Occupancy Anticipation for Efficient Exploration and Navigationcited by 104
- 2018Visual Representations for Semantic Target Driven Navigationcited by 89
- 2017MINOS: Multimodal Indoor Simulator for Navigation in Complex Environmentscited by 66
- 2021Learning to Map for Active Semantic Goal Navigationcited by 47
- 2020SSCNav: Confidence-Aware Semantic Scene Completion for Visual Semantic Navigationcited by 43
- 2020Seeing the Un-Scene: Learning Amodal Semantic Maps for Room Navigationcited by 34
- 2021Differentiable SLAM-net: Learning Particle SLAM for Visual Navigationcited by 34
- 2020Learning to plan with uncertain topological mapscited by 29
- 2021The Surprising Effectiveness of Visual Odometry Techniques for Embodied PointGoal Navigationcited by 27
- 2019Benchmarking Classic and Learned Navigation in Complex 3D Environmentscited by 24
- 2019Simultaneous Mapping and Target Driven Navigationcited by 11
- 2020Online Mapping and Motion Planning under Uncertainty for Safe Navigation in Unknown Environmentscited by 6
Built on by
Citing papers per year: 2022: 3; 2023: 4; 2024: 11; 2025: 9; 2026: 4.
31 papers.
Sort:
By area:
- 2022Cross-modal Map Learning for Vision and Language Navigationcited by 91
- 2024RoboEXP: Action-Conditioned Scene Graph via Interactive Exploration for Robotic Manipulationcited by 48
- 2024ActiveSplat: High-Fidelity Scene Reconstruction through Active Gaussian Splattingcited by 32
- 2023Active Neural Mappingcited by 30
- 2024NARUTO: Neural Active Reconstruction from Uncertain Target Observationscited by 27
- 2024Neural Visibility Field for Uncertainty-Driven Active Mappingcited by 25
- 2025ActiveGAMER: Active GAussian Mapping through Efficient Renderingcited by 19
- 2023Omnidirectional Information Gathering for Knowledge Transfer-based Audio-Visual Navigationcited by 18
- 2025NextBestPath: Efficient 3D Mapping of Unseen Environmentscited by 13
- 2023Leveraging Neural Radiance Fields for Uncertainty-Aware Visual Localizationcited by 12
- 2023MOPA: Modular Object Navigation with PointGoal Agentscited by 11
- 2025GLEAM: Learning Generalizable Exploration Policy for Active Mapping in Complex 3D Indoor Scenescited by 10
19 more
- 2024MapEx: Indoor Structure Exploration with Probabilistic Information Gain from Global Map Predictionscited by 9
- 2024Multimodal LLM Guided Exploration and Active Mapping using Fisher Informationcited by 9
- 2024Active Neural Mapping at Scalecited by 8
- 2025Accelerating Residual Reinforcement Learning with Uncertainty Estimationcited by 6
- 2022Learning-Augmented Model-Based Planning for Visual Explorationcited by 5
- 2024Map It Anywhere (MIA): Empowering Bird's Eye View Mapping using Large-scale Public Datacited by 5
- 2025Understanding while Exploring: Semantics-driven Active Mappingcited by 5
- 2026MAGICIAN: Efficient Long-Term Planning with Imagined Gaussians for Active Mappingcited by 5
- 2025Peering into the Unknown: Active View Selection with Neural Uncertainty Maps for 3D Reconstructioncited by 4
- 2024GAM-Depth: Self-Supervised Indoor Depth Estimation Leveraging a Gradient-Aware Mask and Semantic Constraintscited by 3
- 2022Comparison of Model-Free and Model-Based Learning-Informed Planning for PointGoal Navigationcited by 2
- 2024LatentBKI: Open-Dictionary Continuous Mapping in Visual-Language Latent Spaces with Quantifiable Uncertaintycited by 2
- 2024OTO Planner: An Efficient Only Travelling Once Exploration Planner for Complex and Unknown Environmentscited by 0
- 2025SenseExpo: Spatial Exploration and Navigation via Scene Estimation from Expeditious Predictive Operatorscited by 0
- 2025Mapping at First Sense: A Lightweight Neural Network-Based Indoor Structures Prediction Method for Robot Autonomous Explorationcited by 0
- 2025SuperEx: Enhancing Indoor Mapping and Exploration using Non-Line-of-Sight Perceptioncited by 0
- 2026Remember to be Curious: Episodic Context and Persistent Worlds for 3D Explorationcited by 0
- 2026Diagnosing and Dynamically Filtering Occupancy World Models for Active Mappingcited by 0
- 2026Multi-Scale Semantic Mapping in Urban Environments via Observation Calibration and Policy Dependence Regularizationcited by 0
- 2026Multi-Scale Semantic Mapping in Urban Environments via Observation Calibration and Policy Dependence Regularization28 Sep 2026
- 2026Diagnosing and Dynamically Filtering Occupancy World Models for Active Mapping6 Sep 2026
- 2026Remember to be Curious: Episodic Context and Persistent Worlds for 3D Exploration21 May 2026
- 2026MAGICIAN: Efficient Long-Term Planning with Imagined Gaussians for Active Mapping23 Mar 2026
- 2025SuperEx: Enhancing Indoor Mapping and Exploration using Non-Line-of-Sight Perception12 Oct 2025
- 2025Accelerating Residual Reinforcement Learning with Uncertainty Estimation21 Jun 2025
- 2025Peering into the Unknown: Active View Selection with Neural Uncertainty Maps for 3D Reconstruction17 Jun 2025
- 2025Understanding while Exploring: Semantics-driven Active Mapping30 May 2025
- 2025GLEAM: Learning Generalizable Exploration Policy for Active Mapping in Complex 3D Indoor Scenes26 May 2025
- 2025Mapping at First Sense: A Lightweight Neural Network-Based Indoor Structures Prediction Method for Robot Autonomous Exploration5 Apr 2025
- 2025SenseExpo: Spatial Exploration and Navigation via Scene Estimation from Expeditious Predictive Operators20 Mar 2025
- 2025NextBestPath: Efficient 3D Mapping of Unseen Environments7 Feb 2025
19 more
- 2025ActiveGAMER: Active GAussian Mapping through Efficient Rendering12 Jan 2025
- 2024ActiveSplat: High-Fidelity Scene Reconstruction through Active Gaussian Splatting29 Oct 2024
- 2024Multimodal LLM Guided Exploration and Active Mapping using Fisher Information22 Oct 2024
- 2024LatentBKI: Open-Dictionary Continuous Mapping in Visual-Language Latent Spaces with Quantifiable Uncertainty15 Oct 2024
- 2024Active Neural Mapping at Scale30 Sep 2024
- 2024MapEx: Indoor Structure Exploration with Probabilistic Information Gain from Global Map Predictions23 Sep 2024
- 2024Map It Anywhere (MIA): Empowering Bird's Eye View Mapping using Large-scale Public Data11 Jul 2024
- 2024OTO Planner: An Efficient Only Travelling Once Exploration Planner for Complex and Unknown Environments11 Jun 2024
- 2024Neural Visibility Field for Uncertainty-Driven Active Mapping11 Jun 2024
- 2024NARUTO: Neural Active Reconstruction from Uncertain Target Observations29 Feb 2024
- 2024RoboEXP: Action-Conditioned Scene Graph via Interactive Exploration for Robotic Manipulation23 Feb 2024
- 2024GAM-Depth: Self-Supervised Indoor Depth Estimation Leveraging a Gradient-Aware Mask and Semantic Constraints22 Feb 2024
- 2023Leveraging Neural Radiance Fields for Uncertainty-Aware Visual Localization10 Oct 2023
- 2023Active Neural Mapping30 Aug 2023
- 2023Omnidirectional Information Gathering for Knowledge Transfer-based Audio-Visual Navigation20 Aug 2023
- 2023MOPA: Modular Object Navigation with PointGoal Agents7 Apr 2023
- 2022Comparison of Model-Free and Model-Based Learning-Informed Planning for PointGoal Navigation17 Dec 2022
- 2022Learning-Augmented Model-Based Planning for Visual Exploration15 Nov 2022
- 2022Cross-modal Map Learning for Vision and Language Navigation10 Mar 2022
- 2022Cross-modal Map Learning for Vision and Language Navigationcited by 91
- 2024RoboEXP: Action-Conditioned Scene Graph via Interactive Exploration for Robotic Manipulationcited by 48
- 2024ActiveSplat: High-Fidelity Scene Reconstruction through Active Gaussian Splattingcited by 32
- 2023Active Neural Mappingcited by 30
- 2024NARUTO: Neural Active Reconstruction from Uncertain Target Observationscited by 27
- 2024Neural Visibility Field for Uncertainty-Driven Active Mappingcited by 25
- 2025ActiveGAMER: Active GAussian Mapping through Efficient Renderingcited by 19
- 2023Omnidirectional Information Gathering for Knowledge Transfer-based Audio-Visual Navigationcited by 18
- 2025NextBestPath: Efficient 3D Mapping of Unseen Environmentscited by 13
- 2023Leveraging Neural Radiance Fields for Uncertainty-Aware Visual Localizationcited by 12
- 2023MOPA: Modular Object Navigation with PointGoal Agentscited by 11
- 2025GLEAM: Learning Generalizable Exploration Policy for Active Mapping in Complex 3D Indoor Scenescited by 10
12 most cited of 29 All 29 (JSON)
- 2026Multi-Scale Semantic Mapping in Urban Environments via Observation Calibration and Policy Dependence Regularization28 Sep 2026
- 2026Remember to be Curious: Episodic Context and Persistent Worlds for 3D Exploration21 May 2026
- 2026MAGICIAN: Efficient Long-Term Planning with Imagined Gaussians for Active Mapping23 Mar 2026
- 2025SuperEx: Enhancing Indoor Mapping and Exploration using Non-Line-of-Sight Perception12 Oct 2025
- 2025Accelerating Residual Reinforcement Learning with Uncertainty Estimation21 Jun 2025
- 2025Peering into the Unknown: Active View Selection with Neural Uncertainty Maps for 3D Reconstruction17 Jun 2025
- 2025Understanding while Exploring: Semantics-driven Active Mapping30 May 2025
- 2025GLEAM: Learning Generalizable Exploration Policy for Active Mapping in Complex 3D Indoor Scenes26 May 2025
- 2025Mapping at First Sense: A Lightweight Neural Network-Based Indoor Structures Prediction Method for Robot Autonomous Exploration5 Apr 2025
- 2025SenseExpo: Spatial Exploration and Navigation via Scene Estimation from Expeditious Predictive Operators20 Mar 2025
- 2025NextBestPath: Efficient 3D Mapping of Unseen Environments7 Feb 2025
- 2025ActiveGAMER: Active GAussian Mapping through Efficient Rendering12 Jan 2025
12 newest of 29 All 29 (JSON)