On Salience-Sensitive Sign Classification in Autonomous Vehicle Path Planning: Experimental Explorations with a Novel Dataset
Not on the map. Why?
Abstract (arXiv)
Safe path planning in autonomous driving is a complex task due to the interplay of static scene elements and uncertain surrounding agents. While all static scene elements are a source of information, there is asymmetric importance to the information available to the ego vehicle. We present a dataset with a novel feature, sign salience, defined to indicate whether a sign is distinctly informative to the goals of the ego vehicle with regards to traffic regulations. Using convolutional networks on cropped signs, in tandem with experimental augmentation by road type, image coordinates, and planned maneuver, we predict the sign salience property with 76% accuracy, finding the best improvement using information on vehicle maneuver with sign images.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 15 of its 34 references that are in the map. First posted on arXiv 2 Dec 2021.
Builds on
15 of 34 references.
References · 15
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2019Objects as Pointscited by 1,172
- 2019The Mapillary Traffic Sign Dataset for Detection and Classification on a Global Scalecited by 49
- 2020Who Make Drivers Stop? Towards Driver-centric Risk Assessment: Risk Object Identification via Causal Inferencecited by 34
- 2019Looking at the right stuff: Guided semantic-gaze for autonomous drivingcited by 32
- 2020Trajectory Prediction in Autonomous Driving with a Lane Heading Auxiliary Losscited by 30
- 2020Explaining Autonomous Driving by Learning End-to-End Visual Attentioncited by 25
- 2018No Blind Spots: Full-Surround Multi-Object Tracking for Autonomous Vehicles using Cameras & LiDARscited by 19
- 2020Interaction Graphs for Object Importance Estimation in On-road Driving Videoscited by 15
- 2019Traffic Sign Detection under Challenging Conditions: A Deeper Look Into Performance Variations and Spectral Characteristicscited by 14
- 2021Autonomous Vehicles that Alert Humans to Take-Over Controls: Modeling with Real-World Datacited by 13
Built on by
Citing papers per year: 2023: 5; 2024: 6; 2025: 1; 2026: 1.
13 papers.
Sort:
By area:
- 2024Towards Explainable, Safe Autonomous Driving with Language Embeddings for Novelty Identification and Active Learning: Framework and Experimental Analysis with Real-World Data Setscited by 25
- 2024The Why, When, and How to Use Active Learning in Large-Data-Driven 3D Object Detection for Safe Autonomous Driving: An Empirical Explorationcited by 17
- 2024ActiveAnno3D -- An Active Learning Framework for Multi-Modal 3D Object Detectioncited by 17
- 2024Language-Driven Active Learning for Diverse Open-Set 3D Object Detectioncited by 15
- 2023Salient Sign Detection In Safe Autonomous Driving: AI Which Reasons Over Full Visual Contextcited by 14
- 2023Robust Traffic Light Detection Using Salience-Sensitive Loss: Computational Framework and Evaluationscited by 11
- 2023Pedestrian Behavior Maps for Safety Advisories: CHAMP Framework and Real-World Data Analysiscited by 9
- 2025Can Vision-Language Models Understand and Interpret Dynamic Gestures from Pedestrians? Pilot Datasets and Exploration Towards Instructive Nonverbal Commands for Cooperative Autonomous Vehiclescited by 9
- 2024Evaluating Vision-Language Models for Zero-Shot Detection, Classification, and Association of Motorcycles, Passengers, and Helmetscited by 4
- 2024Perception Without Vision for Trajectory Prediction: Ego Vehicle Dynamics as Scene Representation for Efficient Active Learning in Autonomous Drivingcited by 2
- 2026What Do They See? Interpreting Complex Road Scenarios Through the Eyes of Vision-Language-Action Models for Safe and Trustworthy Autonomous Vehicle Learningcited by 1
- 2023A Scale-Invariant Trajectory Simplification Method for Efficient Data Collection in Videoscited by 0
- 2026What Do They See? Interpreting Complex Road Scenarios Through the Eyes of Vision-Language-Action Models for Safe and Trustworthy Autonomous Vehicle Learning18 Jul 2026
- 2025Can Vision-Language Models Understand and Interpret Dynamic Gestures from Pedestrians? Pilot Datasets and Exploration Towards Instructive Nonverbal Commands for Cooperative Autonomous Vehicles15 Apr 2025
- 2024Evaluating Vision-Language Models for Zero-Shot Detection, Classification, and Association of Motorcycles, Passengers, and Helmets5 Aug 2024
- 2024Perception Without Vision for Trajectory Prediction: Ego Vehicle Dynamics as Scene Representation for Efficient Active Learning in Autonomous Driving15 May 2024
- 2024Language-Driven Active Learning for Diverse Open-Set 3D Object Detection19 Apr 2024
- 2024Towards Explainable, Safe Autonomous Driving with Language Embeddings for Novelty Identification and Active Learning: Framework and Experimental Analysis with Real-World Data Sets11 Feb 2024
- 2024ActiveAnno3D -- An Active Learning Framework for Multi-Modal 3D Object Detection5 Feb 2024
- 2024The Why, When, and How to Use Active Learning in Large-Data-Driven 3D Object Detection for Safe Autonomous Driving: An Empirical Exploration30 Jan 2024
- 2023Robust Detection, Association, and Localization of Vehicle Lights: A Context-Based Cascaded CNN Approach and Evaluations27 Jul 2023
- 2023Robust Traffic Light Detection Using Salience-Sensitive Loss: Computational Framework and Evaluations8 May 2023
- 2023Pedestrian Behavior Maps for Safety Advisories: CHAMP Framework and Real-World Data Analysis8 May 2023
- 2023A Scale-Invariant Trajectory Simplification Method for Efficient Data Collection in Videos3 Apr 2023
- 2025Can Vision-Language Models Understand and Interpret Dynamic Gestures from Pedestrians? Pilot Datasets and Exploration Towards Instructive Nonverbal Commands for Cooperative Autonomous Vehiclescited by 9
- 2024Evaluating Vision-Language Models for Zero-Shot Detection, Classification, and Association of Motorcycles, Passengers, and Helmetscited by 4
- 2025Can Vision-Language Models Understand and Interpret Dynamic Gestures from Pedestrians? Pilot Datasets and Exploration Towards Instructive Nonverbal Commands for Cooperative Autonomous Vehicles15 Apr 2025
- 2024Evaluating Vision-Language Models for Zero-Shot Detection, Classification, and Association of Motorcycles, Passengers, and Helmets5 Aug 2024
- 2024Towards Explainable, Safe Autonomous Driving with Language Embeddings for Novelty Identification and Active Learning: Framework and Experimental Analysis with Real-World Data Setscited by 25
- 2024The Why, When, and How to Use Active Learning in Large-Data-Driven 3D Object Detection for Safe Autonomous Driving: An Empirical Explorationcited by 17
- 2024ActiveAnno3D -- An Active Learning Framework for Multi-Modal 3D Object Detectioncited by 17
- 2024Language-Driven Active Learning for Diverse Open-Set 3D Object Detectioncited by 15
- 2023Salient Sign Detection In Safe Autonomous Driving: AI Which Reasons Over Full Visual Contextcited by 14
- 2023Robust Traffic Light Detection Using Salience-Sensitive Loss: Computational Framework and Evaluationscited by 11
- 2023Pedestrian Behavior Maps for Safety Advisories: CHAMP Framework and Real-World Data Analysiscited by 9
- 2024Perception Without Vision for Trajectory Prediction: Ego Vehicle Dynamics as Scene Representation for Efficient Active Learning in Autonomous Drivingcited by 2
- 2023A Scale-Invariant Trajectory Simplification Method for Efficient Data Collection in Videoscited by 0
- 2023Robust Detection, Association, and Localization of Vehicle Lights: A Context-Based Cascaded CNN Approach and Evaluationscited by 0
- 2024Perception Without Vision for Trajectory Prediction: Ego Vehicle Dynamics as Scene Representation for Efficient Active Learning in Autonomous Driving15 May 2024
- 2024Language-Driven Active Learning for Diverse Open-Set 3D Object Detection19 Apr 2024
- 2024Towards Explainable, Safe Autonomous Driving with Language Embeddings for Novelty Identification and Active Learning: Framework and Experimental Analysis with Real-World Data Sets11 Feb 2024
- 2024ActiveAnno3D -- An Active Learning Framework for Multi-Modal 3D Object Detection5 Feb 2024
- 2024The Why, When, and How to Use Active Learning in Large-Data-Driven 3D Object Detection for Safe Autonomous Driving: An Empirical Exploration30 Jan 2024
- 2023Robust Detection, Association, and Localization of Vehicle Lights: A Context-Based Cascaded CNN Approach and Evaluations27 Jul 2023
- 2023Robust Traffic Light Detection Using Salience-Sensitive Loss: Computational Framework and Evaluations8 May 2023
- 2023Pedestrian Behavior Maps for Safety Advisories: CHAMP Framework and Real-World Data Analysis8 May 2023
- 2023A Scale-Invariant Trajectory Simplification Method for Efficient Data Collection in Videos3 Apr 2023
- 2023Salient Sign Detection In Safe Autonomous Driving: AI Which Reasons Over Full Visual Context14 Jan 2023