Perception Without Vision for Trajectory Prediction: Ego Vehicle Dynamics as Scene Representation for Efficient Active Learning in Autonomous Driving
Not on the map. Why?
Abstract (arXiv)
This study investigates the use of trajectory and dynamic state information for efficient data curation in autonomous driving machine learning tasks. We propose methods for clustering trajectory-states and sampling strategies in an active learning framework, aiming to reduce annotation and data costs while maintaining model performance. Our approach leverages trajectory information to guide data selection, promoting diversity in the training data. We demonstrate the effectiveness of our methods on the trajectory prediction task using the nuScenes dataset, showing consistent performance gains over random sampling across different data pool sizes, and even reaching sub-baseline displacement errors at just 50% of the data cost. Our results suggest that sampling typical data initially helps overcome the ''cold start problem,'' while introducing novelty becomes more beneficial as the training pool size increases. By integrating trajectory-state-informed active learning, we demonstrate that more efficient and robust autonomous driving systems are possible and practical using low-cost data curation strategies.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 30 of its 48 references that are in the map. First posted on arXiv 15 May 2024.
Builds on
30 of 48 references.
References · 30
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 537
- 2022Beyond neural scaling laws: beating power law scaling via data pruningcited by 528
- 2018Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networkscited by 289
- 2020One Thousand and One Hours: Self-driving Motion Prediction Datasetcited by 240
- 2018Convolutional Social Pooling for Vehicle Trajectory Predictioncited by 221
- 2023D4: Improving LLM Pretraining via Document De-Duplication and Diversificationcited by 150
- 2022Active Learning on a Budget: Opposite Strategies Suit High and Low Budgetscited by 133
- 2021Multimodal Trajectory Prediction Conditioned on Lane-Graph Traversalscited by 113
- 2019Accelerating Deep Learning by Focusing on the Biggest Loserscited by 94
- 2020Trajectory Forecasts in Unknown Environments Conditioned on Grid-Based Planscited by 72
- 2024Multi-Frame, Lightweight & Efficient Vision-Language Models for Question Answering in Autonomous Drivingcited by 52
18 more
- 20193D BAT: A Semi-Automatic, Web-based 3D Annotation Toolbox for Full-Surround, Multi-Modal Data Streamscited by 36
- 2018Addressing the Item Cold-start Problem by Attribute-driven Active Learningcited by 33
- 2020Trajectory Prediction in Autonomous Driving with a Lane Heading Auxiliary Losscited by 30
- 2024Towards Explainable, Safe Autonomous Driving with Language Embeddings for Novelty Identification and Active Learning: Framework and Experimental Analysis with Real-World Data Setscited by 25
- 2022Automated Detection of Label Errors in Semantic Segmentation Datasets via Deep Learning and Uncertainty Quantificationcited by 20
- 2024The Why, When, and How to Use Active Learning in Large-Data-Driven 3D Object Detection for Safe Autonomous Driving: An Empirical Explorationcited by 17
- 2024ActiveAnno3D -- An Active Learning Framework for Multi-Modal 3D Object Detectioncited by 17
- 2024ActiveAD: Planning-Oriented Active Learning for End-to-End Autonomous Drivingcited by 16
- 2023Salient Sign Detection In Safe Autonomous Driving: AI Which Reasons Over Full Visual Contextcited by 14
- 2021On Salience-Sensitive Sign Classification in Autonomous Vehicle Path Planning: Experimental Explorations with a Novel Datasetcited by 13
- 2022Diverse Multiple Trajectory Prediction Using a Two-stage Prediction Network Trained with Lane Losscited by 12
- 2023Context-Aware Timewise VAEs for Real-Time Vehicle Trajectory Predictioncited by 12
- 2023Robust Traffic Light Detection Using Salience-Sensitive Loss: Computational Framework and Evaluationscited by 11
- 2023Navya3DSeg -- Navya 3D Semantic Segmentation Dataset & split generation for autonomous vehiclescited by 9
- 2023Multi-Task Consistency for Active Learningcited by 9
- 2022Space, Time, and Interaction: A Taxonomy of Corner Cases in Trajectory Datasets for Automated Drivingcited by 7
- 2023Semi-Supervised Active Learning for Semantic Segmentation in Unknown Environments Using Informative Path Planningcited by 6
- 2023Learning to Predict Navigational Patterns from Partial Observationscited by 3
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.