# SGDet3D++: Geometry-Grounded Semantics for 4D Radar and Camera 3D Object Detection

arXiv: https://arxiv.org/abs/2609.27671 · HTML: https://mlsanity.com/paper/2609.27671/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 26 of its 35 references that are in the map.
- First posted on arXiv 23 Sep 2026.

## Builds on (most cited first, 26 of 26)

- [BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformers](https://mlsanity.com/paper/2203.17270/) (2022)
- [Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3D](https://mlsanity.com/paper/2008.05711/) (2020)
- [BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representation](https://mlsanity.com/paper/2205.13542/) (2022)
- [PanoOcc: Unified Occupancy Representation for Camera-based 3D Panoptic Segmentation](https://mlsanity.com/paper/2306.10013/) (2023)
- [CRN: Camera Radar Net for Accurate, Robust, Efficient 3D Perception](https://mlsanity.com/paper/2304.00670/) (2023)
- [RCBEVDet: Radar-camera Fusion in Bird's Eye View for 3D Object Detection](https://mlsanity.com/paper/2403.16440/) (2024)
- [CRAFT: Camera-Radar 3D Object Detection with Spatio-Contextual Fusion Transformer](https://mlsanity.com/paper/2209.06535/) (2022)
- [LXL: LiDAR Excluded Lean 3D Object Detection with 4D Imaging Radar and Camera Fusion](https://mlsanity.com/paper/2307.00724/) (2023)
- [MAN TruckScenes: A multimodal dataset for autonomous trucking in diverse conditions](https://mlsanity.com/paper/2407.07462/) (2024)
- [Unleashing HyDRa: Hybrid Fusion, Depth Consistency and Radar for Unified 3D Perception](https://mlsanity.com/paper/2403.07746/) (2024)
- [OmniHD-Scenes: A Next-Generation Multimodal Dataset for Autonomous Driving](https://mlsanity.com/paper/2412.10734/) (2024)
- [RCM-Fusion: Radar-Camera Multi-Level Fusion for 3D Object Detection](https://mlsanity.com/paper/2307.10249/) (2023)
- [Doracamom: Joint 3D Detection and Occupancy Prediction with Multi-view 4D Radars and Cameras for Omnidirectional Perception](https://mlsanity.com/paper/2501.15394/) (2025)
- [MVFAN: Multi-View Feature Assisted Network for 4D Radar Object Detection](https://mlsanity.com/paper/2310.16389/) (2023)
- [RaCFormer: Towards High-Quality 3D Object Detection via Query-based Radar-Camera Fusion](https://mlsanity.com/paper/2412.12725/) (2024)
- [MSSF: A 4D Radar and Camera Fusion Framework With Multi-Stage Sampling for 3D Object Detection in Autonomous Driving](https://mlsanity.com/paper/2411.15016/) (2024)
- [CR3DT: Camera-RADAR Fusion for 3D Detection and Tracking](https://mlsanity.com/paper/2403.15313/) (2024)
- [Reviewing 3D Object Detectors in the Context of High-Resolution 3+1D Radar](https://mlsanity.com/paper/2308.05478/) (2023)
- [UniBEVFusion: Unified Radar-Vision BEVFusion for 3D Object Detection](https://mlsanity.com/paper/2409.14751/) (2024)
- [CVFusion: Cross-View Fusion of 4D Radar and Camera for 3D Object Detection](https://mlsanity.com/paper/2507.04587/) (2025)
- [Structure-Aware Radar-Camera Depth Estimation](https://mlsanity.com/paper/2506.05008/) (2025)
- [Wavelet-based Multi-View Fusion of 4D Radar Tensor and Camera for Robust 3D Object Detection](https://mlsanity.com/paper/2512.22972/) (2025)
- [SD4R: Sparse-to-Dense Learning for 3D Object Detection with 4D Radar](https://mlsanity.com/paper/2602.20653/) (2026)
- [HyperDet: 3D Object Detection with Hyper 4D Radar Point Clouds](https://mlsanity.com/paper/2602.11554/) (2026)
- [RC-GeoCP: Geometric Consensus for 4D Radar-Camera Collaborative Perception](https://mlsanity.com/paper/2603.00654/) (2026)
- [4DR360: State Reasoning for Joint 3D Detection and Occupancy Prediction in 4D Radar-Camera Full-Scene Perception](https://mlsanity.com/paper/2607.09629/) (2026)

## Abstract (arXiv)

4D radar complements dense image semantics with long-range geometry and radial motion, but existing radar--camera detectors largely solve where to align the modalities while leaving whether a piece of evidence supports an evolving object hypothesis implicit. An image token may describe an occluder, a nearby radar return may belong to another object, and a pose-aligned memory slot may carry incompatible motion. We formulate hypothesis-conditioned evidence grounding, which separates candidate access from evidence use: semantic, geometric, or temporal evidence is filtered or conditioned by the evolving 3D state before updating the corresponding query. sgdetpp instantiates this principle through Anchor-Grounded Semantic Retrieval (AGR), which conditions deformable image retrieval on pooled anchor-consistent radar support; Geometry-Consistent Anchor Refinement (GCR), which attentively aggregates individual associated returns; and Doppler-Verified Correspondence (DVC), which replaces history only when current radial motion contradicts it. sgdetpp improves the strongest compared method by 3.82 mAP and 6.82 ODS on OmniHD-Scenes and by 6.82 mAP and 9.22 NDS on ManTruckScenes, while also leading the listed methods in the TJ4DRadSet test comparison. Mechanism-targeted evaluations show that AGR improves strict AP in every projected-occlusion bin, the yaw-aligned box gate raises target-return purity from 29.95% to 58.87%, and DVC preserves 96.11% of motion-consistent history while retaining 75.90% contradiction recall. Code will be released.