How to Train PointGoal Navigation Agents on a (Sample and Compute) Budget
Not on the map. Why?
Abstract (arXiv)
PointGoal navigation has seen significant recent interest and progress, spurred on by the Habitat platform and associated challenge. In this paper, we study PointGoal navigation under both a sample budget (75 million frames) and a compute budget (1 GPU for 1 day). We conduct an extensive set of experiments, cumulatively totaling over 50,000 GPU-hours, that let us identify and discuss a number of ostensibly minor but significant design choices -- the advantage estimation procedure (a key component in training), visual encoder architecture, and a seemingly minor hyper-parameter change. Overall, these design choices to lead considerable and consistent improvements over the baselines present in Savva et al. Under a sample budget, performance for RGB-D agents improves 8 SPL on Gibson (14% relative improvement) and 20 SPL on Matterport3D (38% relative improvement). Under a compute budget, performance for RGB-D agents improves by 19 SPL on Gibson (32% relative improvement) and 35 SPL on Matterport3D (220% relative improvement). We hope our findings and recommendations will make serve to make the community's experiments more efficient.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). First posted on arXiv 11 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 2.
7 papers.
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 511
- 2021Simple but Effective: CLIP Embeddings for Embodied AIcited by 191
- 2021Auxiliary Tasks and Exploration Enable ObjectNavcited by 74
- 2022Retrospectives on the Embodied AI Workshopcited by 46
- 2022Is Mapping Necessary for Realistic PointGoal Navigation?cited by 35
- 2021Towards Disturbance-Free Visual Mobile Manipulationcited by 6
- 2021Landmark Policy Optimization for Object Navigation Taskcited by 0
- 2022Retrospectives on the Embodied AI Workshop13 Oct 2022
- 2022Is Mapping Necessary for Realistic PointGoal Navigation?2 Jun 2022
- 2021Towards Disturbance-Free Visual Mobile Manipulation17 Dec 2021
- 2021Simple but Effective: CLIP Embeddings for Embodied AI18 Nov 2021
- 2021Landmark Policy Optimization for Object Navigation Task17 Sep 2021
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitat28 Jun 2021
- 2021Auxiliary Tasks and Exploration Enable ObjectNav8 Apr 2021