mlsanityData to 14 Oct 2026

One Perception, All Maneuvers: Directional Traffic Signal Understanding for Maneuver-Level Signal Intent Prediction

arXiv 2609.32316 ↗First posted 26 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Traffic lights are a key regulatory signal for autonomous driving at urban intersections, yet existing traffic signal perception is still predominantly formulated as instance-level detection or color recognition. Such formulations identify where traffic lights are and what colors they display, but leave a critical semantic gap before downstream planning: which ego maneuver is controlled by each visible signal and what dynamic permission the signal expresses for that maneuver. In this paper, we formulate Directional Traffic Signal Understanding, a decision-oriented task that predicts structured signal states for straight, left-turn, right-turn, and U-turn maneuvers from a front-view image. Each state contains the associated signal color and signal-implied passability. Based on OpenLane-V2, we provide a direction-level benchmark with maneuver-level supervision and metrics for color recognition, passability, full-frame consistency, and safety-critical errors. A direction-aware baseline combines global context, localized traffic-light evidence, and maneuver-specific representations. Experiments show that direction-level modeling improves passability prediction over image-level classifiers and detection-oriented pipelines, particularly at complex multi-signal intersections. The resulting representation provides a direct and interpretable traffic-signal interface for downstream planning together with topology, route, and surrounding-agent information.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 39 references that are in the map. First posted on arXiv 26 Sep 2026.

Builds on

24 of 39 references.

References · 24

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  5. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  6. 2020End-to-End Object Detection with Transformerscited by 7,414
  7. 2016Feature Pyramid Networks for Object Detectioncited by 5,036
  8. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  9. 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
  10. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  11. 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
  12. 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
12 more
  1. 2019A Survey of Deep Learning Techniques for Autonomous Drivingcited by 403
  2. 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarkingcited by 354
  3. 2023NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving Scenariocited by 262
  4. 2017Computer Vision for Autonomous Vehicles: Problems, Datasets and State of the Artcited by 182
  5. 2023OpenLane-V2: A Topology Reasoning Benchmark for Unified 3D HD Mappingcited by 83
  6. 2023DeepAccident: A Motion and Accident Prediction Benchmark for V2X Autonomous Drivingcited by 73
  7. 2023Graph-based Topology Reasoning for Driving Scenescited by 54
  8. 2024TopoLogic: An Interpretable Pipeline for Lane Topology Reasoning on Driving Scenescited by 29
  9. 2024Driving with Regulation: Trustworthy and Interpretable Decision-Making for Autonomous Driving with Retrieval-Augmented Reasoningcited by 13
  10. 2024Driving by the Rules: A Benchmark for Integrating Traffic Sign Regulations into Vectorized HD Mapcited by 11
  11. 2024TLD-READY: Traffic Light Detection -- Relevance Estimation and Deployment Analysiscited by 5
  12. 2025Enhancing LLM-based Autonomous Driving with Modular Traffic Light and Sign Recognitioncited by 3

Built on by

Not cited yet.