mlsanityData to 14 Oct 2026

Ant-inspired Walling Strategies for Scalable Swarm Separation: Reinforcement Learning Approaches Based on Finite State Machines

arXiv 2510.22524 ↗First posted 26 Oct 2025cs.ROcited by 0

On the map: Deep reinforcement learning methods → RL for robot navigation and UAV control

Abstract (arXiv)

In natural systems, emergent structures often arise to balance competing demands. Army ants, for example, form temporary "walls" that prevent interference between foraging trails. Inspired by this behavior, we developed two decentralized controllers for heterogeneous robotic swarms to maintain spatial separation while executing concurrent tasks. The first is a finite-state machine (FSM)-based controller that uses encounter-triggered transitions to create rigid, stable walls. The second integrates FSM states with a Deep Q-Network (DQN), dynamically optimizing separation through emergent "demilitarized zones." In simulation, both controllers reduce mixing between subgroups, with the DQN-enhanced controller improving adaptability and reducing mixing by 40-50% while achieving faster convergence.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL for robot navigation and UAV control, one of 15 directions in Deep reinforcement learning methods. Builds on 2 of its 13 references that are in the map. First posted on arXiv 26 Oct 2025.

Builds on

2 of 13 references.

References · 2

  1. 2019A Minimalistic Approach to Segregation in Robot Swarmscited by 1
  2. 2024Strategic Sacrifice: Self-Organized Robot Swarm Localization for Inspection Productivitycited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Physics-Informed Modeling and Control of Emergent Behaviors in Robot Swarms ↗
  2. 2025Emergent Heterogeneous Swarm Control Through Hebbian Learning
  3. 2026Asymmetric physics enables efficient learning in quadrupedal robot swarms ↗
  4. 2024Counterfactual rewards promote collective transport using individually controlled swarm microrobots
  5. 2026Visual Swarm Navigation via Deep Reinforcement Learning and Evolutionary Hybrid Design
  6. 2025Deep Reinforcement Learning for Multi-Agent Coordination
  7. 2024Distributed Autonomous Swarm Formation for Dynamic Network Bridging
  8. 2026Sensor to Pixels: Decentralized Swarm Gathering via Image-Based Reinforcement Learning