mlsanityData to 14 Oct 2026

RESAR-BEV: An Explainable Progressive Residual Autoregressive Approach for Camera-Radar Fusion in BEV Segmentation

arXiv 2505.06515 ↗First posted 10 May 2025cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Bird's-Eye-View (BEV) semantic segmentation provides comprehensive environmental perception for autonomous driving but suffers multi-modal misalignment and sensor noise. We propose RESAR-BEV, a progressive refinement framework that advances beyond single-step end-to-end approaches: (1) progressive refinement through residual autoregressive learning that decomposes BEV segmentation into interpretable coarse-to-fine stages via our Drive-Transformer and Modifier-Transformer residual prediction cascaded architecture, (2) robust BEV representation combining ground-proximity voxels with adaptive height offsets and dual-path voxel feature encoding (max+attention pooling) for efficient feature extraction, and (3) decoupled supervision with offline Ground Truth decomposition and online joint optimization to prevent overfitting while ensuring structural coherence. Experiments on nuScenes demonstrate RESAR-BEV achieves state-of-the-art performance with 54.0% mIoU across 7 essential driving-scene categories while maintaining real-time capability at 14.6 FPS. The framework exhibits robustness in challenging scenarios of long-range perception and adverse weather conditions.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 37 of its 56 references that are in the map. First posted on arXiv 10 May 2025.

Builds on

37 of 56 references.

References · 37

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  3. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
  4. 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
  5. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
  6. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
  7. 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
  8. 2022Autoregressive Image Generation using Residual Quantizationcited by 722
  9. 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 713
  10. 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 658
  11. 2017Frustum PointNets for 3D Object Detection from RGB-D Datacited by 640
  12. 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 466
25 more
  1. 2021FCOS3D: Fully Convolutional One-Stage Monocular 3D Object Detectioncited by 447
  2. 2022BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detectioncited by 341
  3. 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 315
  4. 2022BEVFormer v2: Adapting Modern Image Backbones to Bird's-Eye-View Recognition via Perspective Supervisioncited by 302
  5. 2022Vision Transformer with Deformable Attentioncited by 295
  6. 2022Cross-view Transformers for real-time Map-view Semantic Segmentationcited by 264
  7. 2021FIERY: Future Instance Prediction in Bird's-Eye View from Surround Monocular Camerascited by 239
  8. 2022BEVerse: Unified Perception and Prediction in Birds-Eye-View for Vision-Centric Autonomous Drivingcited by 191
  9. 2019Cross-view Semantic Segmentation for Sensing Surroundingscited by 174
  10. 2020CenterFusion: Center-based Radar and Camera Fusion for 3D Object Detectioncited by 161
  11. 2022PolarFormer: Multi-camera 3D Object Detection with Polar Transformercited by 147
  12. 2022Simple-BEV: What Really Matters for Multi-Sensor BEV Perception?cited by 128
  13. 2022BEVSegFormer: Bird's Eye View Semantic Segmentation From Arbitrary Camera Rigscited by 123
  14. 2018Monocular Semantic Occupancy Grid Mapping with Convolutional Variational Encoder-Decoder Networkscited by 84
  15. 2023CRN: Camera Radar Net for Accurate, Robust, Efficient 3D Perceptioncited by 82
  16. 2017Deep Projective 3D Semantic Segmentationcited by 81
  17. 2022CRAFT: Camera-Radar 3D Object Detection with Spatio-Contextual Fusion Transformercited by 67
  18. 2020FISHING Net: Future Inference of Semantic Heatmaps In Gridscited by 55
  19. 2022Polar Parametrization for Vision-based Surround-View 3D Detectioncited by 53
  20. 2023DiffBEV: Conditional Diffusion Model for Bird's Eye View Perceptioncited by 30
  21. 2024BEVCar: Camera-Radar Fusion for BEV Map and Object Segmentationcited by 27
  22. 2022BEV-Locator: An End-to-end Visual Semantic Localization Network Using Multi-View Imagescited by 12
  23. 2024BEV-TSR: Text-Scene Retrieval in BEV Space for Autonomous Drivingcited by 11
  24. 2024GeoBEV: Learning Geometric BEV Representation for Multi-view 3D Object Detectioncited by 11
  25. 2024DualBEV: Unifying Dual View Transformation with Probabilistic Correspondencescited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.