mlsanityData to 7 Oct 2026

Multi-Robot Active Mapping via Neural Bipartite Graph Matching

arXiv 2203.16319 ↗First posted 30 Mar 2022cs.CV cs.ROcited by 8

Not on the map. Why?

Abstract (arXiv)

We study the problem of multi-robot active mapping, which aims for complete scene map construction in minimum time steps. The key to this problem lies in the goal position estimation to enable more efficient robot movements. Previous approaches either choose the frontier as the goal position via a myopic solution that hinders the time efficiency, or maximize the long-term value via reinforcement learning to directly regress the goal position, but does not guarantee the complete map construction. In this paper, we propose a novel algorithm, namely NeuralCoMapping, which takes advantage of both approaches. We reduce the problem to bipartite graph matching, which establishes the node correspondences between two graphs, denoting robots and frontiers. We introduce a multiplex graph neural network (mGNN) that learns the neural distance to fill the affinity matrix for more effective graph matching. We optimize the mGNN with a differentiable linear assignment layer by maximizing the long-term values that favor time efficiency and map completeness via reinforcement learning. We compare our algorithm with several state-of-the-art multi-robot active mapping approaches and adapted reinforcement-learning baselines. Experimental results demonstrate the superior performance and exceptional generalization ability of our algorithm on various indoor scenes and unseen number of robots, when only trained with 9 indoor scenes.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 20 of its 51 references that are in the map. First posted on arXiv 30 Mar 2022.

Builds on

20 of 51 references.

References · 20

  1. 2017Attention Is All You Needcited by 59,932
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
  4. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
  5. 2018Attention, Learn to Solve Routing Problems!cited by 646
  6. 2018Gibson Env: Real-World Perception for Embodied Agentscited by 477
  7. 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 421
  8. 2020Learning to Explore using Active Neural SLAMcited by 308
  9. 2020Neural Topological SLAM for Visual Navigationcited by 193
  10. 2021iGibson 2.0: Object-Centric Simulation for Robot Learning of Everyday Household Taskscited by 191
  11. 2020iGibson 1.0: a Simulation Environment for Interactive Tasks in Large Realistic Scenescited by 151
  12. 2016BundleFusion: Real-time Globally Consistent 3D Reconstruction using On-the-fly Surface Re-integrationcited by 116
8 more
  1. 2020Topological Planning with Transformers for Vision-and-Language Navigationcited by 115
  2. 2019Learning Exploration Policies for Navigationcited by 113
  3. 2020Occupancy Anticipation for Efficient Exploration and Navigationcited by 104
  4. 2019Learning Combinatorial Embedding Networks for Deep Graph Matchingcited by 98
  5. 2021Auxiliary Tasks and Exploration Enable ObjectNavcited by 73
  6. 2021Learning Efficient Multi-Agent Cooperative Visual Explorationcited by 19
  7. 2020Multi-Agent Routing Value Iteration Networkcited by 17
  8. 2019Coloring Big Graphs with AlphaGoZerocited by 13

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 4; 2024: 3.

8 papers.