Collective Behavior Clone with Visual Attention via Neural Interaction Graph Prediction
On the map: Offline RL and imitation learning from data → Imitation learning methods
Abstract (arXiv)
In this paper, we propose a framework, collective behavioral cloning (CBC), to learn the underlying interaction mechanism and control policy of a swarm system. Given the trajectory data of a swarm system, we propose a graph variational autoencoder (GVAE) to learn the local interaction graph. Based on the interaction graph and swarm trajectory, we use behavioral cloning to learn the control policy of the swarm system. To demonstrate the practicality of CBC, we deploy it on a real-world decentralized vision-based robot swarm system. A visual attention network is trained based on the learned interaction graph for online neighbor selection. Experimental results show that our method outperforms previous approaches in predicting both the interaction graph and swarm actions with higher accuracy. This work offers a promising approach for understanding interaction mechanisms and swarm dynamics in future swarm robotics research. Code and data are available.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Imitation learning methods, one of 13 directions in Offline RL and imitation learning from data. First posted on arXiv 10 Mar 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2024Learning to Imitate Spatial Organization in Multi-robot Systems
- 2021Scalable Perception-Action-Communication Loops with Convolutional and Graph Neural Networks
- 2023Learning Decentralized Flocking Controllers with Spatio-Temporal Graph Neural Network
- 2026Modular Reinforcement Learning For Cooperative Swarms
- 2025Local-Canonicalization Equivariant Graph Neural Networks for Sample-Efficient and Generalizable Swarm Robot Control
- 2026Generative adversarial imitation learning for robot swarms: Learning from human demonstrations and trained policies
- 2026Visual Swarm Navigation via Deep Reinforcement Learning and Evolutionary Hybrid Design
- 2026How Swarms Differ: Challenges in Collective Behaviour Comparison