# Partially Detected Intelligent Traffic Signal Control: Environmental Adaptation

arXiv: https://arxiv.org/abs/1910.10808 · HTML: https://mlsanity.com/paper/1910.10808/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 23 Oct 2019.

## Built on by (most cited first, 3 of 3)

- [Network-wide traffic signal control optimization using a multi-agent deep reinforcement learning](https://mlsanity.com/paper/2104.09936/) (2021)
- [Deep Reinforcement Q-Learning for Intelligent Traffic Signal Control with Partial Detection](https://mlsanity.com/paper/2109.14337/) (2021)
- [Optimizing Traffic Signal Control using High-Dimensional State Representation and Efficient Deep Reinforcement Learning](https://mlsanity.com/paper/2411.07759/) (2024)

## Abstract (arXiv)

Partially Detected Intelligent Traffic Signal Control (PD-ITSC) systems that can optimize traffic signals based on limited detected information could be a cost-efficient solution for mitigating traffic congestion in the future. In this paper, we focus on a particular problem in PD-ITSC - adaptation to changing environments. To this end, we investigate different reinforcement learning algorithms, including Q-learning, Proximal Policy Optimization (PPO), Advantage Actor-Critic (A2C), and Actor-Critic with Kronecker-Factored Trust Region (ACKTR). Our findings suggest that RL algorithms can find optimal strategies under partial vehicle detection; however, policy-based algorithms can adapt to changing environments more efficiently than value-based algorithms. We use these findings to draw conclusions about the value of different models for PD-ITSC systems.
