Dual-Gated Epistemic Time-Dilation: Autonomous Compute Modulation in Asynchronous MARL
Not on the map. Why?
Abstract (arXiv)
While Multi-Agent Reinforcement Learning (MARL) algorithms achieve unprecedented successes across complex continuous domains, their standard deployment strictly adheres to a synchronous operational paradigm. Under this paradigm, agents are universally forced to execute deep neural network inferences at every micro-frame, regardless of immediate necessity. This dense throughput acts as a fundamental barrier to physical deployment on edge-devices where thermal and metabolic budgets are highly constrained. We propose Epistemic Time-Dilation MAPPO (ETD-MAPPO), augmented with a Dual-Gated Epistemic Trigger. Instead of depending on rigid frame-skipping (macro-actions), agents autonomously modulate their execution frequency by interpreting aleatoric uncertainty (via Shannon entropy of their policy) and epistemic uncertainty (via state-value divergence in a Twin-Critic architecture). To format this, we structure the environment as a Semi-Markov Decision Process (SMDP) and build the SMDP-Aligned Asynchronous Gradient Masking Critic to ensure proper credit assignment. Empirical findings demonstrate massive improvements (> 60% relative baseline acquisition leaps) over current temporal models. By assessing LBF, MPE, and the 115-dimensional state space of Google Research Football (GRF), ETD correctly prevented premature policy collapse. Remarkably, this unconstrained approach leads to emergent Temporal Role Specialization, reducing computational overhead by a statistically dominant 73.6% entirely during off-ball execution without deteriorating centralized task dominance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 7 of its 16 references that are in the map. First posted on arXiv 24 Mar 2026.
Builds on
7 of 16 references.
References · 7
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2019The StarCraft Multi-Agent Challengecited by 589
- 2019Google Research Football: A Novel Reinforcement Learning Environmentcited by 257
- 2020EGO-Planner: An ESDF-free Gradient-based Local Planner for Quadrotorscited by 47
- 2020Macro-Action-Based Deep Multi-Agent Reinforcement Learningcited by 18
- 2024Asynchronous Credit Assignment for Multi-Agent Reinforcement Learningcited by 2
Built on by
Not cited yet.