mlsanityData to 7 Oct 2026

Sequence-Agnostic Multi-Object Navigation

arXiv 2305.06178 ↗First posted 10 May 2023cs.RO cs.AI cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

The Multi-Object Navigation (MultiON) task requires a robot to localize an instance (each) of multiple object classes. It is a fundamental task for an assistive robot in a home or a factory. Existing methods for MultiON have viewed this as a direct extension of Object Navigation (ON), the task of localising an instance of one object class, and are pre-sequenced, i.e., the sequence in which the object classes are to be explored is provided in advance. This is a strong limitation in practical applications characterized by dynamic changes. This paper describes a deep reinforcement learning framework for sequence-agnostic MultiON based on an actor-critic architecture and a suitable reward specification. Our framework leverages past experiences and seeks to reward progress toward individual as well as multiple target object classes. We use photo-realistic scenes from the Gibson benchmark dataset in the AI Habitat 3D simulation environment to experimentally show that our method performs better than a pre-sequenced approach and a state of the art ON method extended to MultiON.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 24 of its 31 references that are in the map. First posted on arXiv 10 May 2023.

Builds on

24 of 31 references.

References · 24

  1. 2017Mask R-CNNcited by 7,259
  2. 2016Layer Normalizationcited by 5,579
  3. 2015Deep Reinforcement Learning with Double Q-learningcited by 1,704
  4. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
  5. 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
  6. 2013Exact solutions to the nonlinear dynamics of learning in deep linear neural networkscited by 748
  7. 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 579
  8. 2020Image Augmentation Is All You Need: Regularizing Deep Reinforcement Learning from Pixelscited by 573
  9. 2018Gibson Env: Real-World Perception for Embodied Agentscited by 477
  10. 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 421
  11. 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 352
  12. 2016Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learningcited by 351
12 more
  1. 2020Learning to Explore using Active Neural SLAMcited by 308
  2. 20193D Scene Graph: A Structure for Unified Semantics, 3D Space, and Cameracited by 280
  3. 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 240
  4. 2017Cognitive Mapping and Planning for Visual Navigationcited by 209
  5. 2022PONI: Potential Functions for ObjectGoal Navigation with Interaction-free Learningcited by 149
  6. 2020MultiON: Benchmarking Semantic Map Memory using Multi-Object Navigationcited by 95
  7. 2018Visual Representations for Semantic Target Driven Navigationcited by 89
  8. 2020Auxiliary Tasks Speed Up Learning PointGoal Navigationcited by 52
  9. 2021Teaching Agents how to Map: Spatial Reasoning for Multi-Object Navigationcited by 17
  10. 2022Object Goal Navigation using Data Regularized Q-Learningcited by 10
  11. 2021SGoLAM: Simultaneous Goal Localization and Mapping for Multi-Object Goal Navigationcited by 3
  12. 2022Object Goal Navigation Based on Semantics and RGB Ego Viewcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 1; 2026: 1.

5 papers.