BAAI-VANJEE Roadside Dataset: Towards the Connected Automated Vehicle Highway technologies in Challenging Environments of China
Not on the map. Why?
Abstract (arXiv)
As the roadside perception plays an increasingly significant role in the Connected Automated Vehicle Highway(CAVH) technologies, there are immediate needs of challenging real-world roadside datasets for bench marking and training various computer vision tasks such as 2D/3D object detection and multi-sensor fusion. In this paper, we firstly introduce a challenging BAAI-VANJEE roadside dataset which consist of LiDAR data and RGB images collected by VANJEE smart base station placed on the roadside about 4.5m high. This dataset contains 2500 frames of LiDAR data, 5000 frames of RGB images, including 20% collected at the same time. It also contains 12 classes of objects, 74K 3D object annotations and 105K 2D object annotations. By providing a real complex urban intersections and highway scenes, we expect the BAAI-VANJEE roadside dataset will actively assist the academic and industrial circles to accelerate the innovation research and achievement transformation in the field of intelligent transportation in big data era.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 10 of its 14 references that are in the map. First posted on arXiv 29 May 2021.
Builds on
10 of 14 references.
References · 10
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
- 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,462
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
- 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 941
- 2018The ApolloScape Open Dataset for Autonomous Driving and its Applicationcited by 190
- 2020A2D2: Audi Autonomous Driving Datasetcited by 190
- 2019A*3D Dataset: Towards Autonomous Driving in Challenging Environmentscited by 65
- 2019D2-City: A Large-Scale Dashcam Video Dataset of Diverse Traffic Scenarioscited by 28
Built on by
Citing papers per year: 2022: 2; 2023: 3; 2024: 7; 2025: 6; 2026: 1.
19 papers.
Sort:
By area:
- 2024RCooper: A Real-world Large-scale Dataset for Roadside Cooperative Perceptioncited by 38
- 2022A Survey and Framework of Cooperative Perception: From Heterogeneous Singleton to Hierarchical Cooperationcited by 21
- 2022Infrastructure-Based Object Detection and Tracking for Cooperative Driving Automation: A Surveycited by 14
- 2023PointSSC: A Cooperative Vehicle-Infrastructure Point Cloud Benchmark for Semantic Scene Completioncited by 14
- 2024Collaborative Perception Datasets in Autonomous Driving: A Surveycited by 11
- 2024Open-Vocabulary Object Detection via Language Hierarchycited by 10
- 2025R-LiViT: A LiDAR-Visual-Thermal Dataset Enabling Vulnerable Road User Focused Roadside Perceptioncited by 9
- 2025Collaborative Perception Datasets for Autonomous Driving: A Reviewcited by 8
- 2023Robust Roadside Perception: an Automated Data Synthesis Pipeline Minimizing Human Annotationcited by 6
- 2024Vulnerable Road User Detection and Safety Enhancement: A Comprehensive Surveycited by 5
- 2024Vision Technologies with Applications in Traffic Surveillance Systems: A Holistic Surveycited by 4
- 2024Domain Adaptation for Large-Vocabulary Object Detectorscited by 2
7 more
- 2024Transfer Learning from Simulated to Real Scenes for Monocular 3D Object Detectioncited by 2
- 2025UrbanTwin: Synthetic Roadside LiDAR Datasetscited by 2
- 2025A Fully Interpretable Statistical Approach for Roadside LiDAR Background Subtractioncited by 1
- 2026RESOLVE: A Multi-Resolution and Multi-Modal Dataset for Roadside Cooperative Perceptioncited by 1
- 2023Framework for Quality Evaluation of Smart Roadside Infrastructure Sensors for Automated Driving Applicationscited by 0
- 2025UrbanTwin: Building High-Fidelity Digital Twins for Sim2Real LiDAR Perception and Evaluationcited by 0
- 2025High-Fidelity Digital Twins for Bridging the Sim2Real Gap in LiDAR-Based ITS Perceptioncited by 0
- 2026RESOLVE: A Multi-Resolution and Multi-Modal Dataset for Roadside Cooperative Perception30 Jun 2026
- 2025A Fully Interpretable Statistical Approach for Roadside LiDAR Background Subtraction25 Oct 2025
- 2025UrbanTwin: Synthetic Roadside LiDAR Datasets8 Sep 2025
- 2025High-Fidelity Digital Twins for Bridging the Sim2Real Gap in LiDAR-Based ITS Perception3 Sep 2025
- 2025UrbanTwin: Building High-Fidelity Digital Twins for Sim2Real LiDAR Perception and Evaluation3 Sep 2025
- 2025Collaborative Perception Datasets for Autonomous Driving: A Review17 Apr 2025
- 2025R-LiViT: A LiDAR-Visual-Thermal Dataset Enabling Vulnerable Road User Focused Roadside Perception21 Mar 2025
- 2024Vision Technologies with Applications in Traffic Surveillance Systems: A Holistic Survey30 Nov 2024
- 2024Open-Vocabulary Object Detection via Language Hierarchy27 Oct 2024
- 2024Transfer Learning from Simulated to Real Scenes for Monocular 3D Object Detection28 Aug 2024
- 2024Vulnerable Road User Detection and Safety Enhancement: A Comprehensive Survey29 May 2024
- 2024Collaborative Perception Datasets in Autonomous Driving: A Survey22 Apr 2024
7 more
- 2024RCooper: A Real-world Large-scale Dataset for Roadside Cooperative Perception15 Mar 2024
- 2024Domain Adaptation for Large-Vocabulary Object Detectors13 Jan 2024
- 2023PointSSC: A Cooperative Vehicle-Infrastructure Point Cloud Benchmark for Semantic Scene Completion22 Sep 2023
- 2023Robust Roadside Perception: an Automated Data Synthesis Pipeline Minimizing Human Annotation29 Jun 2023
- 2023Framework for Quality Evaluation of Smart Roadside Infrastructure Sensors for Automated Driving Applications16 Apr 2023
- 2022A Survey and Framework of Cooperative Perception: From Heterogeneous Singleton to Hierarchical Cooperation22 Aug 2022
- 2022Infrastructure-Based Object Detection and Tracking for Cooperative Driving Automation: A Survey28 Jan 2022
- 2024RCooper: A Real-world Large-scale Dataset for Roadside Cooperative Perceptioncited by 38
- 2022A Survey and Framework of Cooperative Perception: From Heterogeneous Singleton to Hierarchical Cooperationcited by 21
- 2022Infrastructure-Based Object Detection and Tracking for Cooperative Driving Automation: A Surveycited by 14
- 2023PointSSC: A Cooperative Vehicle-Infrastructure Point Cloud Benchmark for Semantic Scene Completioncited by 14
- 2024Collaborative Perception Datasets in Autonomous Driving: A Surveycited by 11
- 2024Open-Vocabulary Object Detection via Language Hierarchycited by 10
- 2025R-LiViT: A LiDAR-Visual-Thermal Dataset Enabling Vulnerable Road User Focused Roadside Perceptioncited by 9
- 2023Robust Roadside Perception: an Automated Data Synthesis Pipeline Minimizing Human Annotationcited by 6
- 2024Vulnerable Road User Detection and Safety Enhancement: A Comprehensive Surveycited by 5
- 2024Vision Technologies with Applications in Traffic Surveillance Systems: A Holistic Surveycited by 4
- 2024Domain Adaptation for Large-Vocabulary Object Detectorscited by 2
- 2024Transfer Learning from Simulated to Real Scenes for Monocular 3D Object Detectioncited by 2
12 most cited of 18 All 18 (JSON)
- 2026RESOLVE: A Multi-Resolution and Multi-Modal Dataset for Roadside Cooperative Perception30 Jun 2026
- 2025A Fully Interpretable Statistical Approach for Roadside LiDAR Background Subtraction25 Oct 2025
- 2025UrbanTwin: Synthetic Roadside LiDAR Datasets8 Sep 2025
- 2025High-Fidelity Digital Twins for Bridging the Sim2Real Gap in LiDAR-Based ITS Perception3 Sep 2025
- 2025UrbanTwin: Building High-Fidelity Digital Twins for Sim2Real LiDAR Perception and Evaluation3 Sep 2025
- 2025R-LiViT: A LiDAR-Visual-Thermal Dataset Enabling Vulnerable Road User Focused Roadside Perception21 Mar 2025
- 2024Vision Technologies with Applications in Traffic Surveillance Systems: A Holistic Survey30 Nov 2024
- 2024Open-Vocabulary Object Detection via Language Hierarchy27 Oct 2024
- 2024Transfer Learning from Simulated to Real Scenes for Monocular 3D Object Detection28 Aug 2024
- 2024Vulnerable Road User Detection and Safety Enhancement: A Comprehensive Survey29 May 2024
- 2024Collaborative Perception Datasets in Autonomous Driving: A Survey22 Apr 2024
- 2024RCooper: A Real-world Large-scale Dataset for Roadside Cooperative Perception15 Mar 2024
12 newest of 18 All 18 (JSON)