mlsanityData to 14 Oct 2026

A Synthetic Benchmark for Collaborative 3D Semantic Occupancy Prediction in V2X-Enabled Autonomous Driving

arXiv 2506.17004 ↗First posted 20 Jun 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

3D semantic occupancy prediction is an emerging perception paradigm in autonomous driving, providing a voxel-level representation of both geometric details and semantic categories. However, its effectiveness is inherently constrained in single-vehicle setups by occlusions, restricted sensor range, and narrow viewpoints. To address these limitations, collaborative perception enables the exchange of complementary information, thereby enhancing the completeness and accuracy of predictions. Despite its potential, research on collaborative 3D semantic occupancy prediction is hindered by the lack of dedicated datasets. To bridge this gap, we design a high-resolution semantic voxel sensor in CARLA to produce dense and comprehensive annotations. We further develop a baseline model that performs inter-agent feature fusion via spatial alignment and attention aggregation. In addition, we establish benchmarks with varying prediction ranges designed to systematically assess the impact of spatial extent on collaborative prediction. Experimental results demonstrate the superior performance of our baseline, with increasing gains observed as range expands. Our code is available at https://github.com/tlab-wide/Co3SOP}{https://github.com/tlab-wide/Co3SOP.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 33 of its 38 references that are in the map. First posted on arXiv 20 Jun 2025.

Builds on

33 of 38 references.

References · 33

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2016Feature Pyramid Networks for Object Detectioncited by 5,036
  3. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  4. 2015Spatial Transformer Networkscited by 1,429
  5. 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 575
  6. 2016Semantic Scene Completion from a Single Depth Imagecited by 472
  7. 2021FCOS3D: Fully Convolutional One-Stage Monocular 3D Object Detectioncited by 447
  8. 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 363
  9. 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 332
  10. 2022V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformercited by 320
  11. 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 316
  12. 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 313
21 more
  1. 2021OPV2V: An Open Benchmark Dataset and Fusion Pipeline for Perception with Vehicle-to-Vehicle Communicationcited by 304
  2. 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 293
  3. 2020V2VNet: Vehicle-to-Vehicle Communication for Joint Perception and Predictioncited by 292
  4. 2022DAIR-V2X: A Large-Scale Dataset for Vehicle-Infrastructure Cooperative 3D Object Detectioncited by 273
  5. 2022Where2comm: Communication-Efficient Collaborative Perception via Spatial Confidence Mapscited by 255
  6. 2020Sparse Single Sweep LiDAR Point Cloud Segmentation via Learning Contextual Shape Priors from Scene Completioncited by 223
  7. 2020LMSCNet: Lightweight Multiscale 3D Semantic Completioncited by 188
  8. 2022V2X-Sim: Multi-Agent Collaborative Perception Dataset and Benchmark for Autonomous Drivingcited by 157
  9. 2023V2V4Real: A Real-world Large-scale Dataset for Vehicle-to-Vehicle Cooperative Perceptioncited by 155
  10. 2023V2X-Seq: A Large-Scale Sequential Dataset for Vehicle-Infrastructure Cooperative Perception and Forecastingcited by 114
  11. 2020S3CNet: A Sparse Semantic Scene Completion Network for LiDAR Point Cloudscited by 102
  12. 2024TUMTraf V2X Cooperative Perception Datasetcited by 67
  13. 2022Waymo Open Dataset: Panoramic Video Panoptic Segmentationcited by 58
  14. 2023Towards Vehicle-to-everything Autonomous Driving: A Survey on Collaborative Perceptioncited by 38
  15. 2024RCooper: A Real-world Large-scale Dataset for Roadside Cooperative Perceptioncited by 38
  16. 2024A Survey on Occupancy Perception for Autonomous Driving: The Information Fusion Perspectivecited by 37
  17. 2024Vision-based 3D occupancy prediction in autonomous driving: a review and outlookcited by 29
  18. 2023Grid-Centric Traffic Scenario Perception for Autonomous Driving: A Comprehensive Reviewcited by 25
  19. 2024Collaborative Perception Datasets in Autonomous Driving: A Surveycited by 11
  20. 2024V2VSSC: A 3D Semantic Scene Completion Benchmark for Perception with Vehicle to Vehicle Communicationcited by 4
  21. 2024Collective Perception Datasets for Autonomous Driving: A Comprehensive Reviewcited by 4

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.