Green Emergency Communications in RIS- and MA-Assisted Multi-UAV SAGINs: A Partially Observable Reinforcement Learning Approach
On the map: Deep reinforcement learning methods → RL for robot navigation and UAV control
Abstract (arXiv)
In post-disaster space-air-ground integrated networks (SAGINs), terrestrial infrastructure is often impaired, and unmanned aerial vehicles (UAVs) must rapidly restore connectivity for mission-critical ground terminals in cluttered non-line-of-sight (NLoS) urban environments. To enhance coverage, UAVs employ movable antennas (MAs), while reconfigurable intelligent surfaces (RISs) on surviving high-rises redirect signals. The key challenge is communication-limited partial observability, leaving each UAV with a narrow, fast-changing neighborhood view that destabilizes value estimation. Existing multi-agent reinforcement learning (MARL) approaches are inadequate--non-communication methods rely on unavailable global critics, heuristic sharing is brittle and redundant, and learnable protocols (e.g., CommNet, DIAL) lose per-neighbor structure and aggravate non-stationarity under tight bandwidth. To address partial observability, we propose a spatiotemporal A2C where each UAV transmits prior-decision messages with local state, a compact policy fingerprint, and a recurrent belief, encoded per neighbor and concatenated. A spatial discount shapes value targets to emphasize local interactions, while analysis under one-hop-per-slot latency explains stable training with delayed views. Experimental results show our policy outperforms IA2C, ConseNet, FPrint, DIAL, and CommNet--achieving faster convergence, higher asymptotic reward, reduced Temporal-Difference(TD)/advantage errors, and a better communication throughput-energy trade-off.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL for robot navigation and UAV control, one of 15 directions in Deep reinforcement learning methods. Builds on 17 of its 31 references that are in the map. First posted on arXiv 17 Nov 2025.
Builds on
17 of 31 references.
Closest ancestors · 1
Same direction, newest first
Other references · 16
- 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,558
- 2016Learning to Communicate with Deep Multi-Agent Reinforcement Learningcited by 575
- 2016Learning Multiagent Communication with Backpropagationcited by 366
- 2018Fully Decentralized Multi-Agent Reinforcement Learning with Networked Agentscited by 194
- 2018Learning Attentional Communication for Multi-Agent Cooperationcited by 175
- 2017Deep Decentralized Multi-task Multi-Agent Reinforcement Learning under Partial Observabilitycited by 148
- 2018Learning when to Communicate at Scale in Multiagent Cooperative and Competitive Taskscited by 121
- 2017Stabilising Experience Replay for Deep Multi-Agent Reinforcement Learningcited by 117
- 2017Multiagent Bidirectionally-Coordinated Nets: Emergence of Human-level Coordination in Learning to Play StarCraft Combat Gamescited by 96
- 2018Intelligent Reflecting Surface Enhanced Wireless Network via Joint Active and Passive Beamformingcited by 46
- 2025A Tutorial on Movable Antennas for Wireless Networkscited by 4
- 2023Movable-Antenna Array Enhanced Beamforming: Achieving Full Array Gain with Null Steeringcited by 2
4 more
- 2024Movable Antenna Enhanced Wireless Sensing Via Antenna Position Optimizationcited by 2
- 2024Throughput Maximization for Movable Antenna Systems with Movement Delay Considerationcited by 1
- 2024Distributed Massive MIMO-Aided Task Offloading in Satellite-Terrestrial Integrated Multi-Tier VEC Networkscited by 1
- 2024Movable Antennas Enabled ISAC Systems: Fundamentals, Opportunities, and Future Directionscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Integrated Communication and Control for Energy-Efficient UAV Swarms: A Multi-Agent Reinforcement Learning Approach
- 2026Communication-Aware Multi-Agent Reinforcement Learning for Decentralized Cooperative UAV Deployment
- 2026AERIS: Offline Policy Improvement for Multi-UAV Integrated Sensing and Communication
- 2024AdaptNet: Rethinking Sensing and Communication for a Seamless Internet of Drones Experience ↗
- 2026JCAS-MARL: Joint Communication and Sensing UAV Networks via Resource-Constrained Multi-Agent Reinforcement Learning
- 2026Plasticity-Enhanced Multi-Agent Mixture of Experts for Dynamic Objective Adaptation in UAVs-Assisted Emergency Communication Networks
- 2025Towards Robust Multi-UAV Collaboration: MARL with Noise-Resilient Communication and Attention Mechanisms
- 2026MA-HEAD-Net: Adaptive Rule-Guided Multi-Agent DRL for AoI Minimization in UAV-Assisted Emergency Networks