# Multi-Agent Reinforcement Learning for Online Traffic Scheduling in Time-Sensitive Application

arXiv: https://arxiv.org/abs/2608.05346 · HTML: https://mlsanity.com/paper/2608.05346/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 6 of its 14 references that are in the map.
- First posted on arXiv 5 Aug 2026.

## Builds on (most cited first, 6 of 6)

- [Asynchronous Methods for Deep Reinforcement Learning](https://mlsanity.com/paper/1602.01783/) (2016)
- [Trust Region Policy Optimisation in Multi-Agent Reinforcement Learning](https://mlsanity.com/paper/2109.11251/) (2021)
- [An eXtended Reality Offloading IP Traffic Dataset and Models](https://mlsanity.com/paper/2301.11217/) (2023)
- [A Survey of Scheduling Algorithms for the Time-Aware Shaper in Time-Sensitive Networking (TSN)](https://mlsanity.com/paper/2211.10954/) (2022)
- [Time-Sensitive Networking (TSN) for Industrial Automation: Current Advances and Future Directions](https://mlsanity.com/paper/2306.03691/) (2023)
- [AI-based Dynamic Schedule Calculation in Time Sensitive Networks using GCN-TD3](https://mlsanity.com/paper/2405.05019/) (2024)

## Built on by (most cited first, 1 of 1)

- [Deadline-Aware Multi-Agent Reinforcement Learning for TSN-Based Vehicular Edge Networks](https://mlsanity.com/paper/2610.09870/) (2026)

## Abstract (arXiv)

Time-sensitive networking (TSN) is increasingly integrated into mobile edge computing (MEC) to support applications with stringent latency requirements, such as extended reality (XR). However, existing TSN scheduling solutions predominantly rely on static optimization techniques or centralized learning models that are based on fixed traffic patterns, limiting their effectiveness in dynamic environments. In practice, MEC environments often host multiple co-located XR traffic flows whose characteristics evolve over time, creating complex inter-queue dependencies that current schedulers fail to capture. Addressing these challenges requires adaptive, decentralized scheduling mechanisms capable of coordinating multiple TSN queues under varying traffic conditions. To this end, this paper proposes a multi-agent reinforcement learning (MARL) framework for TSN scheduling, where each TSN queue is modeled as an autonomous agent. The Heterogeneous-Agent Proximal Policy Optimization (HAPPO) algorithm is employed to explicitly model inter-agent dependencies and jointly optimize service delivery across queues. The simulation results demonstrate that the proposed approach reduces average frame waiting times by up to 26.8% and worst-case delays by approximately 16.8%, highlighting its effectiveness in dynamic XR-driven MEC scenarios.