Enhancing Multi-Robot Perception via Learned Data Association
Not on the map. Why?
Abstract (arXiv)
In this paper, we address the multi-robot collaborative perception problem, specifically in the context of multi-view infilling for distributed semantic segmentation. This setting entails several real-world challenges, especially those relating to unregistered multi-agent image data. Solutions must effectively leverage multiple, non-static, and intermittently-overlapping RGB perspectives. To this end, we propose the Multi-Agent Infilling Network: an extensible neural architecture that can be deployed (in a distributed manner) to each agent in a robotic swarm. Specifically, each robot is in charge of locally encoding and decoding visual information, and an extensible neural mechanism allows for an uncertainty-aware and context-based exchange of intermediate features. We demonstrate improved performance on a realistic multi-robot AirSim dataset.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 20 references that are in the map. First posted on arXiv 1 Jul 2021.
Builds on
18 of 20 references.
References · 18
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,483
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
- 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
- 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 780
- 2015Multi-view Convolutional Neural Networks for 3D Shape Recognitioncited by 564
- 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 517
- 2017DeepVO: Towards End-to-End Visual Odometry with Deep Recurrent Convolutional Neural Networkscited by 173
- 2020When2com: Multi-Agent Perception via Communication Graph Groupingcited by 157
- 2017Convolutional neural network architecture for geometric matchingcited by 138
- 2016Deep Image Homography Estimationcited by 135
6 more
- 2020Who2com: Collaborative Perception via Learnable Handshake Communicationcited by 127
- 2017Occlusion Aware Unsupervised Learning of Optical Flowcited by 101
- 2018DGC-Net: Dense Geometric Correspondence Networkcited by 67
- 2017Accurate Optical Flow via Direct Cost Volume Processingcited by 66
- 2017Toward Geometric Deep SLAMcited by 38
- 2019EMPNet: Neural Localisation and Mapping Using Embedded Memory Pointscited by 9
Built on by
Not cited yet.