mlsanityData to 7 Oct 2026

4DR360: State Reasoning for Joint 3D Detection and Occupancy Prediction in 4D Radar-Camera Full-Scene Perception

arXiv 2607.09629 ↗First posted 10 Jul 2026cs.CV cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Reliable autonomous driving requires full-scene perception that couples foreground objects with dense semantic layout. Recently, 4D millimeter-wave radar has emerged as a robust and affordable sensor, yet its sparse returns make radar-camera fusion necessary for comprehensive scene understanding. Existing radar-camera methods mainly optimize detection, while dual-task systems usually decode boxes and occupancy with limited interaction. To address this gap and advance radar-based multi-task learning, we propose method, a 4D radar-camera framework for 360^circ full-scene perception, which models semantic occupancy as a persistent scene state rather than a terminal output. method follows a cross-modal state reasoning paradigm, where the occupancy state is modeled and propagated through stages for coarse-to-fine feature aggregation. Specifically, State-guided BEV Enhancement (SBE) strengthens intra-frame BEV representation, while Doppler-guided Temporal Fusion (DTF) preserves state evidence over longer temporal horizons. Beyond the model, we further extend ManTruckScenes with satellite-map-based generated occupancy labels and pair it with OmniHD-Scenes in a unified cross-dataset detection-and-occupancy protocol. The resulting experiments cover accuracy, robustness, ablation, and efficiency under one radar-camera multi-task evaluation framework. Code and labels will be released upon acceptance.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 15 of its 26 references that are in the map. First posted on arXiv 10 Jul 2026.

Builds on

15 of 26 references.

References · 15

  1. 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 844
  2. 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
  3. 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 325
  4. 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 306
  5. 2023OpenOccupancy: A Large Scale Benchmark for Surrounding Semantic Occupancy Perceptioncited by 218
  6. 2020CenterFusion: Center-based Radar and Camera Fusion for 3D Object Detectioncited by 159
  7. 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 155
  8. 2022TJ4DRadSet: A 4D Radar Dataset for Autonomous Drivingcited by 74
  9. 2022CRAFT: Camera-Radar 3D Object Detection with Spatio-Contextual Fusion Transformercited by 66
  10. 2023LXL: LiDAR Excluded Lean 3D Object Detection with 4D Imaging Radar and Camera Fusioncited by 57
  11. 2024OmniHD-Scenes: A Next-Generation Multimodal Dataset for Autonomous Drivingcited by 27
  12. 2025Doracamom: Joint 3D Detection and Occupancy Prediction with Multi-view 4D Radars and Cameras for Omnidirectional Perceptioncited by 21
3 more
  1. 2024UniVision: A Unified Framework for Vision-Centric 3D Perceptioncited by 7
  2. 2025Structure-Aware Radar-Camera Depth Estimationcited by 5
  3. 2026RC-GeoCP: Geometric Consensus for 4D Radar-Camera Collaborative Perceptioncited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.