Sparse-Aware Vector Quantization for Bandwidth-Efficient Collaborative 3D Semantic Occupancy Prediction
Not on the map. Why?
Abstract (arXiv)
Collaborative perception extends single-agent perception by enabling multiple vehicles to exchange complementary perceptual information. However, it introduces an inherent trade-off between perception gain and communication overhead, which is particularly severe for 3D semantic occupancy prediction that relies on fine-grained spatial structures. Existing methods typically compress 3D features into 2D, causing severe spatial information loss, or transmit dense 3D representations, hindering real-world deployment. To overcome these limitations, we propose a bandwidth-efficient collaborative Vector Quantization Semantic Occupancy Prediction (VQSOP) framework. VQSOP employs a Sparse-Aware Vector Quantization (SAVQ) mechanism that exploits 3D scene sparsity to compactly encode informative regions, drastically reducing communication overhead while preserving complete geometric context. Furthermore, to enhance structural consistency and feature continuity, we design a Dual-Branch Adaptive Spatial Refinement (ASR) module that dynamically fuses local high-frequency details with broad contextual semantics. Extensive experiments demonstrate that our approach achieves state-of-the-art performance while reducing communication volume by up to 82x.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 39 of its 46 references that are in the map. First posted on arXiv 2 Jul 2026.
Builds on
39 of 46 references.
References · 39
- 2017Neural Discrete Representation Learningcited by 4,712
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 409
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 363
- 2022V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformercited by 320
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 316
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 313
- 2021OPV2V: An Open Benchmark Dataset and Fusion Pipeline for Perception with Vehicle-to-Vehicle Communicationcited by 304
- 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 293
- 2020V2VNet: Vehicle-to-Vehicle Communication for Joint Perception and Predictioncited by 292
- 2022Where2comm: Communication-Efficient Collaborative Perception via Spatial Confidence Mapscited by 255
- 2022CoBEVT: Cooperative Bird's Eye View Semantic Segmentation with Sparse Transformerscited by 227
27 more
- 2020Sparse Single Sweep LiDAR Point Cloud Segmentation via Learning Contextual Shape Priors from Scene Completioncited by 223
- 2021Learning Distilled Collaboration Graph for Multi-Agent Perceptioncited by 194
- 2019Cooper: Cooperative Perception for Connected Autonomous Vehicles based on 3D Point Cloudscited by 165
- 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 157
- 2019Cooperative Perception for 3D Object Detection in Driving Scenarios using Infrastructure Sensorscited by 110
- 2020S3CNet: A Sparse Semantic Scene Completion Network for LiDAR Point Cloudscited by 102
- 2024SparseOcc: Rethinking Sparse Latent Representation for Vision-Based Semantic Occupancy Predictioncited by 96
- 2022COOPERNAUT: End-to-End Driving with Cooperative Perception for Networked Vehiclescited by 95
- 2021Explanations in Autonomous Driving: A Surveycited by 81
- 2023Collaboration Helps Camera Overtake LiDAR in 3D Detectioncited by 81
- 2023DeepAccident: A Motion and Accident Prediction Benchmark for V2X Autonomous Drivingcited by 73
- 2023HM-ViT: Hetero-modal Vehicle-to-Vehicle Cooperative perception with vision transformercited by 70
- 2024Communication-Efficient Collaborative Perception via Information Filling with Codebookcited by 68
- 2023Fully Sparse 3D Occupancy Predictioncited by 64
- 2024OPUS: Occupancy Prediction Using a Sparse Setcited by 56
- 2023Spatio-Temporal Domain Awareness for Multi-Agent Collaborative Perceptioncited by 52
- 2023PointOcc: Cylindrical Tri-Perspective View for Point-based 3D Semantic Occupancy Predictioncited by 52
- 2023CORE: Cooperative Reconstruction for Multi-Agent Perceptioncited by 41
- 2023Camera-based 3D Semantic Scene Completion with Sparse Guidance Networkcited by 40
- 2023AIDE: A Vision-Driven Multi-View, Multi-Modal, Multi-Tasking Dataset for Assistive Driving Perceptioncited by 39
- 2024ViewFormer: Exploring Spatiotemporal Modeling for Multi-View 3D Occupancy Perception via View-Guided Transformerscited by 37
- 2024Collaborative Semantic Occupancy Prediction with Hybrid Feature Fusion in Connected Automated Vehiclescited by 33
- 2023The OpenCDA Open-source Ecosystem for Cooperative Driving Automation Researchcited by 27
- 2023Collaborative Multi-Object Tracking with Conformal Uncertainty Propagationcited by 27
- 2023CoBEVFusion: Cooperative Perception with LiDAR-Camera Bird's-Eye View Fusioncited by 6
- 2025Vision-Only Gaussian Splatting for Collaborative Semantic Occupancy Predictioncited by 3
- 2026WhisperNet: A Scalable Solution for Bandwidth-Efficient Collaborationcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024LOMA: Language-assisted Semantic Occupancy Network via Triplane Mamba
- 2025SparseWorld: A Flexible, Adaptive, and Efficient 4D Occupancy World Model Powered by Sparse and Dynamic Queries
- 2026VLMFusionOcc3D: VLM Assisted Multi-Modal 3D Semantic Occupancy Prediction
- 2025Residual Vector Quantization For Communication-Efficient Multi-Agent Perception
- 2025AGO: Adaptive Grounding for Open World 3D Occupancy Prediction
- 2024OccScene: Semantic Occupancy-based Cross-task Mutual Learning for 3D Scene Generation
- 2026CascadeOcc: Rethinking 3D Occupancy World Models with Cascaded VQ Representations
- 2023RadOcc: Learning Cross-Modality Occupancy Knowledge through Rendering Assisted Distillation