Control Your Queries: Heterogeneous Query Interaction for Camera-Radar Fusion
Not on the map. Why?
Abstract (arXiv)
In autonomous driving, camera-radar fusion offers complementary sensing and low deployment cost. Existing methods perform fusion through input mixing, feature map mixing, or query-based feature sampling. We propose a new fusion paradigm, termed heterogeneous query interaction, and present ConFusion, a camera-radar 3D object detector. ConFusion combines image queries, radar queries, and learnable world queries distributed in 3D space to improve query initialization and object coverage. To encourage cross-type interaction among heterogeneous queries, we introduce heterogeneous query mixing (QMix), which performs dedicated cross-type attention after feature sampling to consolidate complementary object evidence. We further propose interactive query swap sampling (QSwap), which improves feature sampling by allowing related queries to exchange informative feature tokens under attention and geometric constraints. Experiments on the nuScenes dataset show that ConFusion achieves state-of-the-art performance, reaching 59.1 mAP and 65.6 NDS on the validation set, and 61.6 mAP and 67.9 NDS on the test set.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 66 of its 72 references that are in the map. First posted on arXiv 28 Apr 2026.
Builds on
66 of 72 references.
References · 66
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 844
- 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 655
- 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 550
- 2022DN-DETR: Accelerate DETR Training by Introducing Query DeNoisingcited by 486
- 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 464
- 2019PointPainting: Sequential Fusion for 3D Object Detectioncited by 449
38 more
- 2021Conditional DETR for Fast Training Convergencecited by 422
- 2021Is Pseudo-Lidar needed for Monocular 3D Object detection?cited by 248
- 2022DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detectioncited by 224
- 2022Unifying Voxel-based Representation with Transformer for 3D Object Detectioncited by 202
- 2022FUTR3D: A Unified Sensor Fusion Framework for 3D Detectioncited by 194
- 20203D-CVF: Generating Joint Camera and LiDAR Features Using Cross-View Spatial Feature Fusion for 3D Object Detectioncited by 176
- 2021Multimodal Virtual Point 3D Detectioncited by 166
- 2020EPNet: Enhancing Point Features with Image Semantics for 3D Object Detectioncited by 164
- 2019An Energy and GPU-Computation Efficient Backbone Network for Real-Time Object Detectioncited by 163
- 2020CenterFusion: Center-based Radar and Camera Fusion for 3D Object Detectioncited by 159
- 2023SparseBEV: High-Performance Sparse 3D Object Detection from Multi-Camera Videoscited by 149
- 2022DeepInteraction: 3D Object Detection via Modality Interactioncited by 125
- 2021FusionPainting: Multimodal Fusion with Adaptive Attention for 3D Object Detectioncited by 92
- 2023SparseFusion: Fusing Multi-Modal Sparse Representations for Multi-Sensor 3D Object Detectioncited by 83
- 2024RCBEVDet: Radar-camera Fusion in Bird's Eye View for 3D Object Detectioncited by 82
- 2023CRN: Camera Radar Net for Accurate, Robust, Efficient 3D Perceptioncited by 81
- 2023UniTR: A Unified and Efficient Multi-Modal Transformer for Bird's-Eye-View Representationcited by 74
- 2023Far3D: Expanding the Horizon for Surround-view 3D Object Detectioncited by 70
- 2023Sparse4D v3: Advancing End-to-End 3D Detection and Trackingcited by 69
- 2023Cross Modal Transformer: Towards Fast and Robust 3D Object Detectioncited by 68
- 2022CRAFT: Camera-Radar 3D Object Detection with Spatio-Contextual Fusion Transformercited by 66
- 2022MSMDFusion: Fusing LiDAR and Camera at Multiple Scales with Multi-Depth Seeds for 3D Object Detectioncited by 62
- 2023Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Reviewcited by 57
- 2023LXL: LiDAR Excluded Lean 3D Object Detection with 4D Imaging Radar and Camera Fusioncited by 57
- 2024IS-Fusion: Instance-Scene Collaborative Fusion for Multimodal 3D Object Detectioncited by 57
- 2022Bridging the View Disparity Between Radar and Camera Features for Multi-modal Fusion 3D Object Detectioncited by 46
- 2023EA-LSS: Edge-aware Lift-splat-shot Framework for 3D BEV Object Detectioncited by 38
- 2024Ray Denoising: Depth-aware Hard Negative Sampling for Multi-view 3D Object Detectioncited by 36
- 2024Unleashing HyDRa: Hybrid Fusion, Depth Consistency and Radar for Unified 3D Perceptioncited by 35
- 2023BEVFusion4D: Learning LiDAR-Camera Fusion Under Bird's-Eye-View via Cross-Modality Guidance and Temporal Aggregationcited by 31
- 2022CramNet: Camera-Radar Fusion with Ray-Constrained Cross-Attention for Robust 3D Object Detectioncited by 30
- 2023Detecting As Labeling: Rethinking LiDAR-camera Fusion in 3D Object Detectioncited by 28
- 2024CRKD: Enhanced Camera-Radar Object Detection with Cross-modality Knowledge Distillationcited by 27
- 2023Echoes Beyond Points: Unleashing the Power of Raw Radar Data in Multi-modality Fusioncited by 25
- 2024SparseLIF: High-Performance Sparse LiDAR-Camera Fusion for 3D Object Detectioncited by 25
- 2023RCM-Fusion: Radar-Camera Multi-Level Fusion for 3D Object Detectioncited by 23
- 2024MV2DFusion: Leveraging Modality-Specific Object Semantics for Multi-Modal 3D Detectioncited by 23
- 2021MmWave Radar and Vision Fusion for Object Detection in Autonomous Driving: A Reviewcited by 22
50 most cited of 66 All 66 (JSON)
Built on by
Not cited yet.