mlsanityData to 14 Oct 2026

SGDet3D++: Geometry-Grounded Semantics for 4D Radar and Camera 3D Object Detection

arXiv 2609.27671 ↗First posted 23 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

4D radar complements dense image semantics with long-range geometry and radial motion, but existing radar--camera detectors largely solve where to align the modalities while leaving whether a piece of evidence supports an evolving object hypothesis implicit. An image token may describe an occluder, a nearby radar return may belong to another object, and a pose-aligned memory slot may carry incompatible motion. We formulate hypothesis-conditioned evidence grounding, which separates candidate access from evidence use: semantic, geometric, or temporal evidence is filtered or conditioned by the evolving 3D state before updating the corresponding query. sgdetpp instantiates this principle through Anchor-Grounded Semantic Retrieval (AGR), which conditions deformable image retrieval on pooled anchor-consistent radar support; Geometry-Consistent Anchor Refinement (GCR), which attentively aggregates individual associated returns; and Doppler-Verified Correspondence (DVC), which replaces history only when current radial motion contradicts it. sgdetpp improves the strongest compared method by 3.82 mAP and 6.82 ODS on OmniHD-Scenes and by 6.82 mAP and 9.22 NDS on ManTruckScenes, while also leading the listed methods in the TJ4DRadSet test comparison. Mechanism-targeted evaluations show that AGR improves strict AP in every projected-occlusion bin, the yaw-aligned box gate raises target-return purity from 29.95% to 58.87%, and DVC preserves 96.11% of motion-consistent history while retaining 75.90% contradiction recall. Code will be released.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 35 references that are in the map. First posted on arXiv 23 Sep 2026.

Builds on

26 of 35 references.

References · 26

  1. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
  2. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
  3. 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
  4. 2023PanoOcc: Unified Occupancy Representation for Camera-based 3D Panoptic Segmentationcited by 115
  5. 2023CRN: Camera Radar Net for Accurate, Robust, Efficient 3D Perceptioncited by 82
  6. 2024RCBEVDet: Radar-camera Fusion in Bird's Eye View for 3D Object Detectioncited by 82
  7. 2022CRAFT: Camera-Radar 3D Object Detection with Spatio-Contextual Fusion Transformercited by 67
  8. 2023LXL: LiDAR Excluded Lean 3D Object Detection with 4D Imaging Radar and Camera Fusioncited by 58
  9. 2024MAN TruckScenes: A multimodal dataset for autonomous trucking in diverse conditionscited by 41
  10. 2024Unleashing HyDRa: Hybrid Fusion, Depth Consistency and Radar for Unified 3D Perceptioncited by 35
  11. 2024OmniHD-Scenes: A Next-Generation Multimodal Dataset for Autonomous Drivingcited by 27
  12. 2023RCM-Fusion: Radar-Camera Multi-Level Fusion for 3D Object Detectioncited by 23
14 more
  1. 2025Doracamom: Joint 3D Detection and Occupancy Prediction with Multi-view 4D Radars and Cameras for Omnidirectional Perceptioncited by 22
  2. 2023MVFAN: Multi-View Feature Assisted Network for 4D Radar Object Detectioncited by 20
  3. 2024RaCFormer: Towards High-Quality 3D Object Detection via Query-based Radar-Camera Fusioncited by 19
  4. 2024MSSF: A 4D Radar and Camera Fusion Framework With Multi-Stage Sampling for 3D Object Detection in Autonomous Drivingcited by 14
  5. 2024CR3DT: Camera-RADAR Fusion for 3D Detection and Trackingcited by 10
  6. 2023Reviewing 3D Object Detectors in the Context of High-Resolution 3+1D Radarcited by 8
  7. 2024UniBEVFusion: Unified Radar-Vision BEVFusion for 3D Object Detectioncited by 7
  8. 2025CVFusion: Cross-View Fusion of 4D Radar and Camera for 3D Object Detectioncited by 6
  9. 2025Structure-Aware Radar-Camera Depth Estimationcited by 5
  10. 2025Wavelet-based Multi-View Fusion of 4D Radar Tensor and Camera for Robust 3D Object Detectioncited by 4
  11. 2026SD4R: Sparse-to-Dense Learning for 3D Object Detection with 4D Radarcited by 4
  12. 2026HyperDet: 3D Object Detection with Hyper 4D Radar Point Cloudscited by 3
  13. 2026RC-GeoCP: Geometric Consensus for 4D Radar-Camera Collaborative Perceptioncited by 2
  14. 20264DR360: State Reasoning for Joint 3D Detection and Occupancy Prediction in 4D Radar-Camera Full-Scene Perceptioncited by 2

Built on by

Not cited yet.