Sequence-Agnostic Multi-Object Navigation
Not on the map. Why?
Abstract (arXiv)
The Multi-Object Navigation (MultiON) task requires a robot to localize an instance (each) of multiple object classes. It is a fundamental task for an assistive robot in a home or a factory. Existing methods for MultiON have viewed this as a direct extension of Object Navigation (ON), the task of localising an instance of one object class, and are pre-sequenced, i.e., the sequence in which the object classes are to be explored is provided in advance. This is a strong limitation in practical applications characterized by dynamic changes. This paper describes a deep reinforcement learning framework for sequence-agnostic MultiON based on an actor-critic architecture and a suitable reward specification. Our framework leverages past experiences and seeks to reward progress toward individual as well as multiple target object classes. We use photo-realistic scenes from the Gibson benchmark dataset in the AI Habitat 3D simulation environment to experimentally show that our method performs better than a pre-sequenced approach and a state of the art ON method extended to MultiON.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 24 of its 31 references that are in the map. First posted on arXiv 10 May 2023.
Builds on
24 of 31 references.
References · 24
- 2017Mask R-CNNcited by 7,259
- 2016Layer Normalizationcited by 5,579
- 2015Deep Reinforcement Learning with Double Q-learningcited by 1,704
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
- 2013Exact solutions to the nonlinear dynamics of learning in deep linear neural networkscited by 748
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 579
- 2020Image Augmentation Is All You Need: Regularizing Deep Reinforcement Learning from Pixelscited by 573
- 2018Gibson Env: Real-World Perception for Embodied Agentscited by 477
- 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 421
- 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 352
- 2016Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learningcited by 351
12 more
- 2020Learning to Explore using Active Neural SLAMcited by 308
- 20193D Scene Graph: A Structure for Unified Semantics, 3D Space, and Cameracited by 280
- 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 240
- 2017Cognitive Mapping and Planning for Visual Navigationcited by 209
- 2022PONI: Potential Functions for ObjectGoal Navigation with Interaction-free Learningcited by 149
- 2020MultiON: Benchmarking Semantic Map Memory using Multi-Object Navigationcited by 95
- 2018Visual Representations for Semantic Target Driven Navigationcited by 89
- 2020Auxiliary Tasks Speed Up Learning PointGoal Navigationcited by 52
- 2021Teaching Agents how to Map: Spatial Reasoning for Multi-Object Navigationcited by 17
- 2022Object Goal Navigation using Data Regularized Q-Learningcited by 10
- 2021SGoLAM: Simultaneous Goal Localization and Mapping for Multi-Object Goal Navigationcited by 3
- 2022Object Goal Navigation Based on Semantics and RGB Ego Viewcited by 2
Built on by
Citing papers per year: 2024: 3; 2025: 1; 2026: 1.
5 papers.
- 2024Task-oriented Sequential Grounding and Navigation in 3D Scenescited by 9
- 2024CAMON: Cooperative Agents for Multi-Object Navigation with LLM-based Conversationscited by 7
- 2026SpaMEM: Benchmarking Dynamic Spatial Reasoning via Perception-Memory Integration in Embodied Environmentscited by 6
- 2025SayCoNav: Utilizing Large Language Models for Adaptive Collaboration in Decentralized Multi-Robot Navigationcited by 5
- 2024Open-Set 3D Semantic Instance Maps for Vision Language Navigation -- O3D-SIMcited by 2
- 2026SpaMEM: Benchmarking Dynamic Spatial Reasoning via Perception-Memory Integration in Embodied Environments24 Apr 2026
- 2025SayCoNav: Utilizing Large Language Models for Adaptive Collaboration in Decentralized Multi-Robot Navigation19 May 2025
- 2024Task-oriented Sequential Grounding and Navigation in 3D Scenes7 Aug 2024
- 2024CAMON: Cooperative Agents for Multi-Object Navigation with LLM-based Conversations30 Jun 2024
- 2024Open-Set 3D Semantic Instance Maps for Vision Language Navigation -- O3D-SIM27 Apr 2024