mlsanityData to 14 Oct 2026

A Deep Reinforcement Learning-Based TCP Congestion Control Algorithm: Design, Simulation, and Evaluation

arXiv 2508.01047 ↗First posted 1 Aug 2025cs.NI cs.AIcited by 0

On the map: Deep reinforcement learning methods → RL for energy, networks and operations

Abstract (arXiv)

This paper introduces a Deep Reinforcement Learning (DRL) based TCP congestion-control algorithm that uses a Deep Q-Network (DQN) to adapt the congestion window (cWnd) dynamically based on observed network state. The proposed approach utilizes DQNs to optimize the congestion window by observing key network parameters and taking real-time actions. The algorithm is trained and evaluated within the NS-3 network simulator using the OpenGym interface. The results demonstrate that the DRL-based algorithm provides a superior balance between throughput and latency compared to both traditional TCP New Reno and TCP Cubic algorithms. Specifically: Compared to TCP Cubic, the DRL algorithm achieved comparable throughput (statistically insignificant difference of -3.79%, p>0.05) while delivering a massive 46.29% reduction in Round-Trip Time (RTT). Furthermore, the DRL agent maintained near-zero packet loss, whereas Cubic suffered from significant buffer overflow. Compared to TCP New Reno, the DRL algorithm achieved comparable throughput (+0.38%) with a 32.40% reduction in RTT. Results from NS-3 simulations indicate that the proposed DRL agent effectively mitigates bufferbloat without compromising bandwidth utilization. This study emphasizes the potential of reinforcement learning techniques for solving complex congestion control problems in modern networks by learning the network capacity rather than saturating it.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL for energy, networks and operations, one of 15 directions in Deep reinforcement learning methods. Builds on 2 of its 77 references that are in the map. First posted on arXiv 1 Aug 2025.

Builds on

2 of 77 references.

References · 2

  1. 2015Deep Reinforcement Learning with Double Q-learningcited by 1,745
  2. 2023A Tutorial Introduction to Reinforcement Learningcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Towards Fair and Efficient Learning-based Congestion Control
  2. 2024Closed-form congestion control via deep symbolic regression
  3. 2025Deep Reinforcement Learning for Dynamic Resource Allocation in Wireless Networks
  4. 2024A Deep Reinforcement Learning Approach for Adaptive Traffic Routing in Next-gen Networks
  5. 2026A Constrained RL Approach for Cost-Efficient Delivery of Latency-Sensitive Applications
  6. 2025A Deep Reinforcement Learning Method for Multi-objective Transmission Switching
  7. 2025A Flexible Multi-Agent Deep Reinforcement Learning Framework for Dynamic Routing and Scheduling of Latency-Critical Services
  8. 2024Intervention-Assisted Policy Gradient Methods for Online Stochastic Queuing Network Optimization: Technical Report