mlsanityData to 14 Oct 2026

Class-Adaptive Cooperative Perception for Multi-Class LiDAR-based 3D Object Detection in V2X Systems

arXiv 2604.10305 ↗First posted 11 Apr 2026cs.CV cs.AI cs.ETcited by 0

Not on the map. Why?

Abstract (arXiv)

Cooperative perception allows connected vehicles and roadside infrastructure to share sensor observations, creating a fused scene representation beyond the capability of any single platform. However, most cooperative 3D object detectors use a uniform fusion strategy for all object classes, which limits their ability to handle the different geometric structures and point-sampling patterns of small and large objects. This problem is further reinforced by narrow evaluation protocols that often emphasize a single dominant class or only a few cooperation settings, leaving robust multi-class detection across diverse vehicle-to-everything interactions insufficiently explored. To address this gap, we propose a class-adaptive cooperative perception architecture for multi-class 3D object detection from LiDAR data. The model integrates four components: multi-scale window attention with learned scale routing for spatially adaptive feature extraction, a class-specific fusion module that separates small and large objects into attentive fusion pathways, bird's-eye-view enhancement through parallel dilated convolution and channel recalibration for richer contextual representation, and class-balanced objective weighting to reduce bias toward frequent categories. Experiments on the V2X-Real benchmark cover vehicle-centric, infrastructure-centric, vehicle-to-vehicle, infrastructure-to-infrastructure, and vehicle-to-infrastructure settings under identical backbone and training configurations. The proposed method consistently improves mean detection performance over strong intermediate-fusion baselines, with the largest gains on trucks, clear improvements on pedestrians, and competitive results on cars. These results show that aligning feature extraction and fusion with class-dependent geometry and point density leads to more balanced cooperative perception in realistic vehicle-to-everything deployments.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 52 references that are in the map. First posted on arXiv 11 Apr 2026.

Builds on

40 of 52 references.

References · 40

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2017Mask R-CNNcited by 7,277
  5. 2016Feature Pyramid Networks for Object Detectioncited by 5,036
  6. 2017Squeeze-and-Excitation Networkscited by 4,789
  7. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  8. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  9. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
  10. 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,241
  11. 2018CBAM: Convolutional Block Attention Modulecited by 2,477
  12. 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
28 more
  1. 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,577
  2. 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
  3. 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,276
  4. 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,245
  5. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
  6. 2019Objects as Pointscited by 1,175
  7. 2020Center-based 3D Object Detection and Trackingcited by 1,144
  8. 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 891
  9. 2019Hybrid Task Cascade for Instance Segmentationcited by 481
  10. 2019From Points to Parts: 3D Object Detection from Point Cloud with Part-aware and Part-aggregation Networkcited by 368
  11. 2019Class-balanced Grouping and Sampling for Point Cloud 3D Object Detectioncited by 350
  12. 2022V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformercited by 320
  13. 2021OPV2V: An Open Benchmark Dataset and Fusion Pipeline for Perception with Vehicle-to-Vehicle Communicationcited by 304
  14. 2020V2VNet: Vehicle-to-Vehicle Communication for Joint Perception and Predictioncited by 292
  15. 2022DAIR-V2X: A Large-Scale Dataset for Vehicle-Infrastructure Cooperative 3D Object Detectioncited by 273
  16. 2019RepPoints: Point Set Representation for Object Detectioncited by 264
  17. 2022Where2comm: Communication-Efficient Collaborative Perception via Spatial Confidence Mapscited by 255
  18. 2022CoBEVT: Cooperative Bird's Eye View Semantic Segmentation with Sparse Transformerscited by 227
  19. 2021Learning Distilled Collaboration Graph for Multi-Agent Perceptioncited by 194
  20. 2019F-Cooper: Feature based Cooperative Perception for Autonomous Vehicle Edge Computing System Using 3D Point Cloudscited by 171
  21. 2020When2com: Multi-Agent Perception via Communication Graph Groupingcited by 157
  22. 2023V2V4Real: A Real-world Large-scale Dataset for Vehicle-to-Vehicle Cooperative Perceptioncited by 155
  23. 2019Cooperative Perception for 3D Object Detection in Driving Scenarios using Infrastructure Sensorscited by 110
  24. 2019TANet: Robust 3D Object Detection from Point Clouds with Triple Attentioncited by 108
  25. 2023Collaborative Perception in Autonomous Driving: Methods, Datasets and Challengescited by 87
  26. 2024V2X-Real: a Large-Scale Dataset for Vehicle-to-Everything Cooperative Perceptioncited by 66
  27. 2022Towards Long-Tailed 3D Detectioncited by 40
  28. 2023Interruption-Aware Cooperative Perception for V2X Communication-Aided Autonomous Drivingcited by 25

Built on by

Not cited yet.