Co-Fusion4D: Spatio-temporal Collaborative Fusion for Robust 3D Object Detection
Not on the map. Why?
Abstract (arXiv)
In autonomous driving, 3D object detection is essential for accurate perception and reliable decision-making. However, object motion and ego-motion often induce cross-frame spatiotemporal inconsistencies in BEV-based detectors, leading to temporal BEV feature misalignment and degraded spatiotemporal consistency. To address these challenges, we propose Co-Fusion4D, a unified framework that explicitly preserves cross-frame spatiotemporal consistency and suppresses temporal feature drift. Co-Fusion4D adopts a current-frame-centric strategy, treating the current frame as the primary source of information while selectively incorporating historical frames after spatiotemporal filtering and alignment. This dominant-complementary mechanism effectively mitigates cumulative alignment errors, suppresses noisy feature propagation, and exploits reliable temporal cues for a more consistent BEV representation. In addition, Co-Fusion4D integrates a Dual Attention Fusion (DAF) module to further enhance spatiotemporal feature interaction. DAF jointly leverages intra-frame spatial attention and inter-frame temporal attention to adaptively align and fuse multi-frame features, emphasizing motion-consistent regions while suppressing spurious correlations. By departing from conventional uniform fusion paradigms, this design substantially improves the temporal stability and discriminative capability of BEV representations. Extensive experiments on the nuScenes benchmark demonstrate that Co-Fusion4D achieves state-of-the-art performance, with 74.9% mAP and 75.6% NDS, without relying on test-time augmentation or external data.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 44 references that are in the map. First posted on arXiv 19 May 2026.
Builds on
28 of 44 references.
References · 28
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
- 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 941
- 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 891
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
- 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 466
- 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 336
- 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 315
- 2022Unifying Voxel-based Representation with Transformer for 3D Object Detectioncited by 202
16 more
- 2022Vision-Centric BEV Perception: A Surveycited by 126
- 2021FusionPainting: Multimodal Fusion with Adaptive Attention for 3D Object Detectioncited by 92
- 2023SparseFusion: Fusing Multi-Modal Sparse Representations for Multi-Sensor 3D Object Detectioncited by 83
- 2022LidarMultiNet: Towards a Unified Multi-Task Network for LiDAR Perceptioncited by 74
- 2022MSMDFusion: Fusing LiDAR and Camera at Multiple Scales with Multi-Depth Seeds for 3D Object Detectioncited by 62
- 2023FocalFormer3D : Focusing on Hard Instance for 3D Object Detectioncited by 58
- 2024IS-Fusion: Instance-Scene Collaborative Fusion for Multimodal 3D Object Detectioncited by 57
- 2022Voxel Field Fusion for 3D Object Detectioncited by 50
- 2023FastPillars: A Deployment-friendly Pillar-based 3D Detectorcited by 39
- 2024GraphBEV: Towards Robust BEV Feature Alignment for Multi-Modal 3D Object Detectioncited by 33
- 2023BEVFusion4D: Learning LiDAR-Camera Fusion Under Bird's-Eye-View via Cross-Modality Guidance and Temporal Aggregationcited by 31
- 2024GAFusion: Adaptive Fusing LiDAR and Camera with Multiple Guidance for 3D Object Detectioncited by 15
- 2023Transformer-Based Sensor Fusion for Autonomous Driving: A Surveycited by 14
- 2024Co-Fix3D: Enhancing 3D Object Detection with Collaborative Refinementcited by 2
- 2025DGFusion: Dual-guided Fusion for Robust Multi-Modal 3D Object Detectioncited by 2
- 2025StereoDETR: Stereo-based Transformer for 3D Object Detectioncited by 2
Built on by
Not cited yet.