Probable Object Location (POLo) Score Estimation for Efficient Object Goal Navigation
Not on the map. Why?
Abstract (arXiv)
To advance the field of autonomous robotics, particularly in object search tasks within unexplored environments, we introduce a novel framework centered around the Probable Object Location (POLo) score. Utilizing a 3D object probability map, the POLo score allows the agent to make data-driven decisions for efficient object search. We further enhance the framework's practicality by introducing POLoNet, a neural network trained to approximate the computationally intensive POLo score. Our approach addresses critical limitations of both end-to-end reinforcement learning methods, which suffer from memory decay over long-horizon tasks, and traditional map-based methods that neglect visibility constraints. Our experiments, involving the first phase of the OVMM 2023 challenge, demonstrate that an agent equipped with POLoNet significantly outperforms a range of baseline methods, including end-to-end RL techniques and prior map-based strategies. To provide a comprehensive evaluation, we introduce new performance metrics that offer insights into the efficiency and effectiveness of various agents in object goal navigation.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 24 of its 31 references that are in the map. First posted on arXiv 14 Nov 2023.
Builds on
24 of 31 references.
References · 24
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
- 2022Detecting Twenty-thousand Classes using Image-level Supervisioncited by 613
- 2018On Evaluation of Embodied Navigation Agentscited by 526
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 501
- 2017End-to-end Driving via Conditional Imitation Learningcited by 479
- 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 421
- 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 352
- 2017Cognitive Mapping and Planning for Visual Navigationcited by 209
- 2022PONI: Potential Functions for ObjectGoal Navigation with Interaction-free Learningcited by 149
- 2022Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scalecited by 116
- 2019Learning Exploration Policies for Navigationcited by 113
- 2022Navigating to Objects in the Real Worldcited by 104
12 more
- 2023HomeRobot: Open-Vocabulary Mobile Manipulationcited by 104
- 2018Learning to Navigate in Cities Without a Mapcited by 103
- 2020MultiON: Benchmarking Semantic Map Memory using Multi-Object Navigationcited by 95
- 2023PIRLNav: Pretraining with Imitation and RL Finetuning for ObjectNavcited by 91
- 2021Auxiliary Tasks and Exploration Enable ObjectNavcited by 73
- 2018Can recurrent neural networks warp time?cited by 53
- 2021Learning to Map for Active Semantic Goal Navigationcited by 47
- 2019An Efficient Sampling-based Method for Online Informative Path Planning in Unknown Environmentscited by 38
- 2020Seeing the Un-Scene: Learning Amodal Semantic Maps for Room Navigationcited by 34
- 2022TIDEE: Tidying Up Novel Rooms using Visuo-Semantic Commonsense Priorscited by 30
- 2020Multi-timescale Representation Learning in LSTM Language Modelscited by 13
- 2022Understanding the Impact of Image Quality and Distance of Objects to Object Detection Performancecited by 4
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 1; 2026: 2.
4 papers.
- 2023Visual Semantic Navigation with Real Robotscited by 2
- 2025TOPO-Bench: An Open-Source Topological Mapping Evaluation Framework with Quantifiable Perceptual Aliasingcited by 0
- 2026Learning Social Navigation from Internet Videos in the Policy State Spacecited by 0
- 2026Retrospective Open-Vocabulary Memory for Long-Term Object Searchcited by 0
- 2026Retrospective Open-Vocabulary Memory for Long-Term Object Search29 Sep 2026
- 2026Learning Social Navigation from Internet Videos in the Policy State Space26 Sep 2026
- 2025TOPO-Bench: An Open-Source Topological Mapping Evaluation Framework with Quantifiable Perceptual Aliasing5 Oct 2025
- 2023Visual Semantic Navigation with Real Robots28 Nov 2023