Autonomous Driving Research Requires a Community-Driven Data Paradigm
Not on the map. Why?
Abstract (arXiv)
Autonomous driving has made remarkable progress, with recent AI advances enabling commercial deployments that are reshaping urban mobility. Yet the field remains far from its universal social promise: autonomous systems that can operate robustly anywhere, anytime, for anyone. We posit that this gap is not merely a modeling problem, but a problem of the prevailing data paradigm. Current research relies heavily on a few benchmark datasets with limited spatial and scenario coverage, even though the community has collectively produced over 600 autonomous driving datasets across nearly 50 countries. However, this abundance has not translated into broad research impact: most datasets remain significantly underused due to fragmentation, limited visibility, incompatible protocols, and benchmark incentives that concentrate attention on a few dominant datasets. We therefore argue that autonomous driving research requires a collaborative, community-driven data paradigm. Such a paradigm would improve the discovery, reuse, integration, and evaluation of diverse datasets; make underexplored data easier and more rewarding to study; and lower the barrier for new contributors. We outline its key principles, illustrate an early realization, and call for collaboration across academia and industry to transform fragmented datasets into shared community infrastructure for anytime-anywhere autonomy.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 59 of its 86 references that are in the map. First posted on arXiv 25 Sep 2026.
Builds on
59 of 86 references.
References · 59
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
- 2020Center-based 3D Object Detection and Trackingcited by 1,144
- 2022Planning-oriented Autonomous Drivingcited by 1,087
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,059
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 988
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
- 2016Multi-View 3D Object Detection Network for Autonomous Drivingcited by 724
38 more
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 622
- 2023DriveLM: Driving with Graph Visual Question Answeringcited by 536
- 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehiclescited by 493
- 2018Pyramid Stereo Matching Networkcited by 489
- 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarkingcited by 354
- 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 334
- 2022Motion Transformer with Global Intention Localization and Local Movement Refinementcited by 270
- 2023NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving Scenariocited by 262
- 2021Online Continual Learning in Image Classification: An Empirical Surveycited by 245
- 2023Parting with Misconceptions about Learning-based Vehicle Motion Planningcited by 242
- 2020One Thousand and One Hours: Self-driving Motion Prediction Datasetcited by 240
- 2020A2D2: Audi Autonomous Driving Datasetcited by 190
- 2021ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detectioncited by 159
- 2020Train in Germany, Test in The USA: Making 3D Object Detectors Generalizecited by 151
- 2025Pseudo-Simulation for Autonomous Drivingcited by 150
- 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tailcited by 146
- 2021Offboard 3D Object Detection from Point Cloud Sequencescited by 145
- 2025OmniDrive: A Holistic Vision-Language Dataset for Autonomous Driving with Counterfactual Reasoningcited by 143
- 2016Vehicle Detection from 3D Lidar Using Fully Convolutional Networkcited by 107
- 2021SPG: Unsupervised Domain Adaptation for 3D Object Detection via Semantic Point Generationcited by 94
- 2024HUGSIM: A Real-Time, Photo-Realistic and Closed-Loop Simulator for Autonomous Drivingcited by 90
- 2024NeuroNCAP: Photorealistic Closed-loop Safety Testing for Autonomous Drivingcited by 62
- 2025WOD-E2E: Waymo Open Dataset for End-to-End Driving in Challenging Long-tail Scenarioscited by 62
- 2022LiDAR Distillation: Bridging the Beam-Induced Domain Gap for 3D Object Detectioncited by 55
- 2022Ithaca365: Dataset and Driving Perception under Repeated and Challenging Weather Conditionscited by 48
- 2022CLAD: A realistic Continual Learning benchmark for Autonomous Drivingcited by 36
- 2025NuScenes-SpatialQA: A Spatial Understanding and Reasoning Benchmark for Vision-Language Models in Autonomous Drivingcited by 35
- 2022CL3D: Unsupervised Domain Adaptation for Cross-LiDAR 3D Detectioncited by 27
- 2023Towards Unsupervised Object Detection From LiDAR Point Cloudscited by 23
- 2023Open-sourced Data Ecosystem in Autonomous Driving: the Present and Futurecited by 23
- 2023Bi3D: Bi-domain Active Learning for Cross-domain 3D Object Detectioncited by 22
- 2024ROADWork: A Dataset and Benchmark for Learning to Recognize, Observe, Analyze and Drive Through Work Zonescited by 22
- 2021MonoCInIS: Camera Independent Monocular 3D Object Detection using Instance Segmentationcited by 16
- 2023LiDAR-CS Dataset: LiDAR Point Cloud Dataset with Cross-Sensors for 3D Object Detectioncited by 13
- 2021METEOR:A Dense, Heterogeneous, and Unstructured Traffic Dataset With Rare Behaviorscited by 12
- 2021Gated3D: Monocular 3D Object Detection From Temporal Illumination Cuescited by 10
- 2025Para-Lane: Multi-Lane Dataset Registering Parallel Scans for Benchmarking Novel View Synthesiscited by 10
- 2025Comparison of Waymo Rider-Only Crash Rates by Crash Type to Human Benchmarks at 56.7 Million Milescited by 9
50 most cited of 59 All 59 (JSON)
Built on by
Not cited yet.