SimBEV: A Synthetic Multi-Task Multi-Sensor Driving Data Generation Tool and Dataset
Not on the map. Why?
Abstract (arXiv)
Bird's-eye view (BEV) perception has garnered significant attention in autonomous driving in recent years, in part because BEV representation facilitates multi-modal sensor fusion. BEV representation enables a variety of perception tasks including BEV segmentation, a concise view of the environment useful for planning a vehicle's trajectory. However, this representation is not fully supported by existing datasets, and creation of new datasets for this purpose can be a time-consuming endeavor. To address this challenge, we introduce SimBEV. SimBEV is a randomized synthetic data generation tool that is extensively configurable and scalable, supports a wide array of sensors, incorporates information from multiple sources to capture accurate BEV ground truth, and enables a variety of perception tasks including BEV segmentation and 3D object detection. SimBEV is used to create the SimBEV dataset, a large collection of annotated perception data from diverse driving scenarios. SimBEV and the SimBEV dataset are open and available to the public.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 58 of its 78 references that are in the map. First posted on arXiv 4 Feb 2025.
Builds on
58 of 78 references.
References · 58
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
- 2016Playing for Data: Ground Truth from Computer Gamescited by 818
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 732
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 713
38 more
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
- 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 658
- 2015Cyclical Learning Rates for Training Neural Networkscited by 629
- 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 485
- 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 466
- 2022PETRv2: A Unified Framework for 3D Perception from Multi-Camera Imagescited by 352
- 2019Class-balanced Grouping and Sampling for Point Cloud 3D Object Detectioncited by 350
- 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 336
- 2021OPV2V: An Open Benchmark Dataset and Fusion Pipeline for Perception with Vehicle-to-Vehicle Communicationcited by 304
- 2022BEVFormer v2: Adapting Modern Image Backbones to Bird's-Eye-View Recognition via Perspective Supervisioncited by 302
- 2023A Survey on Multimodal Large Language Models for Autonomous Drivingcited by 290
- 2020One Thousand and One Hours: Self-driving Motion Prediction Datasetcited by 240
- 2022CoBEVT: Cooperative Bird's Eye View Semantic Segmentation with Sparse Transformerscited by 227
- 2022Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformercited by 212
- 2017PointFusion: Deep Sensor Fusion for 3D Bounding Box Estimationcited by 170
- 2022V2X-Sim: Multi-Agent Collaborative Perception Dataset and Benchmark for Autonomous Drivingcited by 157
- 2022M2BEV: Multi-Camera Joint 3D Detection and Segmentation with Unified Birds-Eye View Representationcited by 156
- 2022SHIFT: A Synthetic Driving Dataset for Continuous Multi-Task Domain Adaptationcited by 146
- 2022Vision-Centric BEV Perception: A Surveycited by 126
- 2022BEVSegFormer: Bird's Eye View Semantic Segmentation From Arbitrary Camera Rigscited by 123
- 2024RCBEVDet: Radar-camera Fusion in Bird's Eye View for 3D Object Detectioncited by 82
- 2023UniTR: A Unified and Efficient Multi-Modal Transformer for Bird's-Eye-View Representationcited by 74
- 2024A Survey on Autonomous Driving Datasets: Statistics, Annotation Quality, and a Future Outlookcited by 66
- 2019A*3D Dataset: Towards Autonomous Driving in Challenging Environmentscited by 65
- 2022MSMDFusion: Fusing LiDAR and Camera at Multiple Scales with Multi-Depth Seeds for 3D Object Detectioncited by 62
- 2023LXL: LiDAR Excluded Lean 3D Object Detection with 4D Imaging Radar and Camera Fusioncited by 58
- 2023Synthetic Datasets for Autonomous Driving: A Surveycited by 48
- 2020Multi-modal Sensor Fusion-Based Deep Neural Network for End-to-end Autonomous Driving with Scene Understandingcited by 42
- 2023Fast-BEV: A Fast and Strong Bird's-Eye View Perception Baselinecited by 40
- 2023CAPE: Camera View Position Embedding for Multi-View 3D Object Detectioncited by 40
- 2023Uni3D: A Unified Baseline for Multi-dataset 3D Object Detectioncited by 39
- 2023BEVNeXt: Reviving Dense BEV Frameworks for 3D Object Detectioncited by 35
- 2023BEVFusion4D: Learning LiDAR-Camera Fusion Under Bird's-Eye-View via Cross-Modality Guidance and Temporal Aggregationcited by 31
- 2022Time3D: End-to-End Joint Monocular 3D Object Detection and Tracking for Autonomous Drivingcited by 30
- 2023Bi-LRFusion: Bi-Directional LiDAR-Radar Fusion for 3D Dynamic Object Detectioncited by 28
- 2022GitNet: Geometric Prior-based Transformation for Birds-Eye-View Segmentationcited by 24
- 2019Challenges in Designing Datasets and Validation for Autonomous Drivingcited by 23
- 2021Deep Multi-Task Learning for Joint Localization, Perception, and Predictioncited by 22
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.