mlsanityData to 7 Oct 2026

Control Your Queries: Heterogeneous Query Interaction for Camera-Radar Fusion

arXiv 2604.25574 ↗First posted 28 Apr 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

In autonomous driving, camera-radar fusion offers complementary sensing and low deployment cost. Existing methods perform fusion through input mixing, feature map mixing, or query-based feature sampling. We propose a new fusion paradigm, termed heterogeneous query interaction, and present ConFusion, a camera-radar 3D object detector. ConFusion combines image queries, radar queries, and learnable world queries distributed in 3D space to improve query initialization and object coverage. To encourage cross-type interaction among heterogeneous queries, we introduce heterogeneous query mixing (QMix), which performs dedicated cross-type attention after feature sampling to consolidate complementary object evidence. We further propose interactive query swap sampling (QSwap), which improves feature sampling by allowing related queries to exchange informative feature tokens under attention and geometric constraints. Experiments on the nuScenes dataset show that ConFusion achieves state-of-the-art performance, reaching 59.1 mAP and 65.6 NDS on the validation set, and 61.6 mAP and 67.9 NDS on the test set.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 66 of its 72 references that are in the map. First posted on arXiv 28 Apr 2026.

Builds on

66 of 72 references.

References · 66

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020End-to-End Object Detection with Transformerscited by 7,384
  3. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  4. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  5. 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
  6. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
  7. 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 844
  8. 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 655
  9. 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 550
  10. 2022DN-DETR: Accelerate DETR Training by Introducing Query DeNoisingcited by 486
  11. 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 464
  12. 2019PointPainting: Sequential Fusion for 3D Object Detectioncited by 449
38 more
  1. 2021Conditional DETR for Fast Training Convergencecited by 422
  2. 2021Is Pseudo-Lidar needed for Monocular 3D Object detection?cited by 248
  3. 2022DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detectioncited by 224
  4. 2022Unifying Voxel-based Representation with Transformer for 3D Object Detectioncited by 202
  5. 2022FUTR3D: A Unified Sensor Fusion Framework for 3D Detectioncited by 194
  6. 20203D-CVF: Generating Joint Camera and LiDAR Features Using Cross-View Spatial Feature Fusion for 3D Object Detectioncited by 176
  7. 2021Multimodal Virtual Point 3D Detectioncited by 166
  8. 2020EPNet: Enhancing Point Features with Image Semantics for 3D Object Detectioncited by 164
  9. 2019An Energy and GPU-Computation Efficient Backbone Network for Real-Time Object Detectioncited by 163
  10. 2020CenterFusion: Center-based Radar and Camera Fusion for 3D Object Detectioncited by 159
  11. 2023SparseBEV: High-Performance Sparse 3D Object Detection from Multi-Camera Videoscited by 149
  12. 2022DeepInteraction: 3D Object Detection via Modality Interactioncited by 125
  13. 2021FusionPainting: Multimodal Fusion with Adaptive Attention for 3D Object Detectioncited by 92
  14. 2023SparseFusion: Fusing Multi-Modal Sparse Representations for Multi-Sensor 3D Object Detectioncited by 83
  15. 2024RCBEVDet: Radar-camera Fusion in Bird's Eye View for 3D Object Detectioncited by 82
  16. 2023CRN: Camera Radar Net for Accurate, Robust, Efficient 3D Perceptioncited by 81
  17. 2023UniTR: A Unified and Efficient Multi-Modal Transformer for Bird's-Eye-View Representationcited by 74
  18. 2023Far3D: Expanding the Horizon for Surround-view 3D Object Detectioncited by 70
  19. 2023Sparse4D v3: Advancing End-to-End 3D Detection and Trackingcited by 69
  20. 2023Cross Modal Transformer: Towards Fast and Robust 3D Object Detectioncited by 68
  21. 2022CRAFT: Camera-Radar 3D Object Detection with Spatio-Contextual Fusion Transformercited by 66
  22. 2022MSMDFusion: Fusing LiDAR and Camera at Multiple Scales with Multi-Depth Seeds for 3D Object Detectioncited by 62
  23. 2023Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Reviewcited by 57
  24. 2023LXL: LiDAR Excluded Lean 3D Object Detection with 4D Imaging Radar and Camera Fusioncited by 57
  25. 2024IS-Fusion: Instance-Scene Collaborative Fusion for Multimodal 3D Object Detectioncited by 57
  26. 2022Bridging the View Disparity Between Radar and Camera Features for Multi-modal Fusion 3D Object Detectioncited by 46
  27. 2023EA-LSS: Edge-aware Lift-splat-shot Framework for 3D BEV Object Detectioncited by 38
  28. 2024Ray Denoising: Depth-aware Hard Negative Sampling for Multi-view 3D Object Detectioncited by 36
  29. 2024Unleashing HyDRa: Hybrid Fusion, Depth Consistency and Radar for Unified 3D Perceptioncited by 35
  30. 2023BEVFusion4D: Learning LiDAR-Camera Fusion Under Bird's-Eye-View via Cross-Modality Guidance and Temporal Aggregationcited by 31
  31. 2022CramNet: Camera-Radar Fusion with Ray-Constrained Cross-Attention for Robust 3D Object Detectioncited by 30
  32. 2023Detecting As Labeling: Rethinking LiDAR-camera Fusion in 3D Object Detectioncited by 28
  33. 2024CRKD: Enhanced Camera-Radar Object Detection with Cross-modality Knowledge Distillationcited by 27
  34. 2023Echoes Beyond Points: Unleashing the Power of Raw Radar Data in Multi-modality Fusioncited by 25
  35. 2024SparseLIF: High-Performance Sparse LiDAR-Camera Fusion for 3D Object Detectioncited by 25
  36. 2023RCM-Fusion: Radar-Camera Multi-Level Fusion for 3D Object Detectioncited by 23
  37. 2024MV2DFusion: Leveraging Modality-Specific Object Semantics for Multi-Modal 3D Detectioncited by 23
  38. 2021MmWave Radar and Vision Fusion for Object Detection in Autonomous Driving: A Reviewcited by 22

50 most cited of 66 All 66 (JSON)

Built on by

Not cited yet.