mlsanityData to 14 Oct 2026

LPAC: Learnable Perception-Action-Communication Loops with Applications to Coverage Control

arXiv 2401.04855 ↗First posted 10 Jan 2024cs.RO cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Coverage control is the problem of navigating a robot swarm to collaboratively monitor features or a phenomenon of interest not known a priori. The problem is challenging in decentralized settings with robots that have limited communication and sensing capabilities. We propose a learnable Perception-Action-Communication (LPAC) architecture for the problem, wherein a convolutional neural network (CNN) processes localized perception; a graph neural network (GNN) facilitates robot communications; finally, a shallow multi-layer perceptron (MLP) computes robot actions. The GNN enables collaboration in the robot swarm by computing what information to communicate with nearby robots and how to incorporate received information. Evaluations show that the LPAC models -- trained using imitation learning -- outperform standard decentralized and centralized coverage control algorithms. The learned policy generalizes to environments different from the training dataset, transfers to larger environments with more robots, and is robust to noisy position estimates. The results indicate the suitability of LPAC architectures for decentralized navigation in robot swarms to achieve collaborative behavior.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 26 of its 61 references that are in the map. First posted on arXiv 10 Jan 2024.

Builds on

26 of 61 references.

References · 26

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  5. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  6. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
  7. 2016Learning to Communicate with Deep Multi-Agent Reinforcement Learningcited by 575
  8. 2020D3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometrycited by 206
  9. 2017CNN-SLAM: Real-time dense monocular SLAM with learned depth predictioncited by 152
  10. 2019Graph Neural Networks for Decentralized Multi-Robot Path Planningcited by 86
  11. 2020Graph Neural Networks: Architectures, Stability and Transferabilitycited by 80
  12. 2019Learning Decentralized Controllers for Robot Swarms with Graph Neural Networkscited by 62
14 more
  1. 2020Augmenting Visual Place Recognition with Structural Cuescited by 23
  2. 2020Multi-Robot Coverage and Exploration using Spatial Graph Neural Networkscited by 19
  3. 2021Graph Neural Networks for Decentralized Multi-Robot Submodular Action Selectioncited by 14
  4. 2021Coverage Control in Multi-Robot Systems via Graph Neural Networkscited by 13
  5. 2020Synthesizing Decentralized Controllers with Graph Neural Networks and Imitation Learningcited by 12
  6. 2022Graph Neural Networks for Multi-Robot Active Information Acquisitioncited by 12
  7. 2021A Framework for Real-World Multi-Robot Systems Running Decentralized GNN-Based Policiescited by 11
  8. 2021ModGNN: Expert Policy Approximation in Multi-Agent Systems with a Modular Graph Neural Network Architecturecited by 9
  9. 2021Scalable Perception-Action-Communication Loops with Convolutional and Graph Neural Networkscited by 7
  10. 2020With Whom to Communicate: Learning Efficient Communication for Multi-Robot Collision Avoidancecited by 4
  11. 2021Multi-Robot Gaussian Process Estimation and Coverage: A Deterministic Sequencing Algorithm and Regret Analysiscited by 4
  12. 2014Multi-Robot Control Using Time-Varying Density Functionscited by 3
  13. 2023Graph Neural Networks for Decentralized Multi-Agent Perimeter Defensecited by 3
  14. 2023A Scalable Multi-Robot Framework for Decentralized and Asynchronous Perception-Action-Communication Loopscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 1.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023Simulation of robot swarms for learning communication-aware coordination
  2. 2026Visual Swarm Navigation via Deep Reinforcement Learning and Evolutionary Hybrid Design
  3. 2022Decentralized cooperative perception for autonomous vehicles: Learning to value the unknown
  4. 2026Sensor to Pixels: Decentralized Swarm Gathering via Image-Based Reinforcement Learning
  5. 2019Learning Vision-based Flight in Drone Swarms by Imitation
  6. 2024Learning to Imitate Spatial Organization in Multi-robot Systems
  7. 2025Local-Canonicalization Equivariant Graph Neural Networks for Sample-Efficient and Generalizable Swarm Robot Control
  8. 2026Modular Reinforcement Learning For Cooperative Swarms