mlsanityData to 14 Oct 2026

Sparse-Aware Vector Quantization for Bandwidth-Efficient Collaborative 3D Semantic Occupancy Prediction

arXiv 2607.01928 ↗First posted 2 Jul 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Collaborative perception extends single-agent perception by enabling multiple vehicles to exchange complementary perceptual information. However, it introduces an inherent trade-off between perception gain and communication overhead, which is particularly severe for 3D semantic occupancy prediction that relies on fine-grained spatial structures. Existing methods typically compress 3D features into 2D, causing severe spatial information loss, or transmit dense 3D representations, hindering real-world deployment. To overcome these limitations, we propose a bandwidth-efficient collaborative Vector Quantization Semantic Occupancy Prediction (VQSOP) framework. VQSOP employs a Sparse-Aware Vector Quantization (SAVQ) mechanism that exploits 3D scene sparsity to compactly encode informative regions, drastically reducing communication overhead while preserving complete geometric context. Furthermore, to enhance structural consistency and feature continuity, we design a Dual-Branch Adaptive Spatial Refinement (ASR) module that dynamically fuses local high-frequency details with broad contextual semantics. Extensive experiments demonstrate that our approach achieves state-of-the-art performance while reducing communication volume by up to 82x.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 39 of its 46 references that are in the map. First posted on arXiv 2 Jul 2026.

Builds on

39 of 46 references.

References · 39

  1. 2017Neural Discrete Representation Learningcited by 4,712
  2. 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
  3. 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 409
  4. 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 363
  5. 2022V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformercited by 320
  6. 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 316
  7. 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 313
  8. 2021OPV2V: An Open Benchmark Dataset and Fusion Pipeline for Perception with Vehicle-to-Vehicle Communicationcited by 304
  9. 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 293
  10. 2020V2VNet: Vehicle-to-Vehicle Communication for Joint Perception and Predictioncited by 292
  11. 2022Where2comm: Communication-Efficient Collaborative Perception via Spatial Confidence Mapscited by 255
  12. 2022CoBEVT: Cooperative Bird's Eye View Semantic Segmentation with Sparse Transformerscited by 227
27 more
  1. 2020Sparse Single Sweep LiDAR Point Cloud Segmentation via Learning Contextual Shape Priors from Scene Completioncited by 223
  2. 2021Learning Distilled Collaboration Graph for Multi-Agent Perceptioncited by 194
  3. 2019Cooper: Cooperative Perception for Connected Autonomous Vehicles based on 3D Point Cloudscited by 165
  4. 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 157
  5. 2019Cooperative Perception for 3D Object Detection in Driving Scenarios using Infrastructure Sensorscited by 110
  6. 2020S3CNet: A Sparse Semantic Scene Completion Network for LiDAR Point Cloudscited by 102
  7. 2024SparseOcc: Rethinking Sparse Latent Representation for Vision-Based Semantic Occupancy Predictioncited by 96
  8. 2022COOPERNAUT: End-to-End Driving with Cooperative Perception for Networked Vehiclescited by 95
  9. 2021Explanations in Autonomous Driving: A Surveycited by 81
  10. 2023Collaboration Helps Camera Overtake LiDAR in 3D Detectioncited by 81
  11. 2023DeepAccident: A Motion and Accident Prediction Benchmark for V2X Autonomous Drivingcited by 73
  12. 2023HM-ViT: Hetero-modal Vehicle-to-Vehicle Cooperative perception with vision transformercited by 70
  13. 2024Communication-Efficient Collaborative Perception via Information Filling with Codebookcited by 68
  14. 2023Fully Sparse 3D Occupancy Predictioncited by 64
  15. 2024OPUS: Occupancy Prediction Using a Sparse Setcited by 56
  16. 2023Spatio-Temporal Domain Awareness for Multi-Agent Collaborative Perceptioncited by 52
  17. 2023PointOcc: Cylindrical Tri-Perspective View for Point-based 3D Semantic Occupancy Predictioncited by 52
  18. 2023CORE: Cooperative Reconstruction for Multi-Agent Perceptioncited by 41
  19. 2023Camera-based 3D Semantic Scene Completion with Sparse Guidance Networkcited by 40
  20. 2023AIDE: A Vision-Driven Multi-View, Multi-Modal, Multi-Tasking Dataset for Assistive Driving Perceptioncited by 39
  21. 2024ViewFormer: Exploring Spatiotemporal Modeling for Multi-View 3D Occupancy Perception via View-Guided Transformerscited by 37
  22. 2024Collaborative Semantic Occupancy Prediction with Hybrid Feature Fusion in Connected Automated Vehiclescited by 33
  23. 2023The OpenCDA Open-source Ecosystem for Cooperative Driving Automation Researchcited by 27
  24. 2023Collaborative Multi-Object Tracking with Conformal Uncertainty Propagationcited by 27
  25. 2023CoBEVFusion: Cooperative Perception with LiDAR-Camera Bird's-Eye View Fusioncited by 6
  26. 2025Vision-Only Gaussian Splatting for Collaborative Semantic Occupancy Predictioncited by 3
  27. 2026WhisperNet: A Scalable Solution for Bandwidth-Efficient Collaborationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024LOMA: Language-assisted Semantic Occupancy Network via Triplane Mamba
  2. 2025SparseWorld: A Flexible, Adaptive, and Efficient 4D Occupancy World Model Powered by Sparse and Dynamic Queries
  3. 2026VLMFusionOcc3D: VLM Assisted Multi-Modal 3D Semantic Occupancy Prediction
  4. 2025Residual Vector Quantization For Communication-Efficient Multi-Agent Perception
  5. 2025AGO: Adaptive Grounding for Open World 3D Occupancy Prediction
  6. 2024OccScene: Semantic Occupancy-based Cross-task Mutual Learning for 3D Scene Generation
  7. 2026CascadeOcc: Rethinking 3D Occupancy World Models with Cascaded VQ Representations
  8. 2023RadOcc: Learning Cross-Modality Occupancy Knowledge through Rendering Assisted Distillation