AeDet: Azimuth-invariant Multi-view 3D Object Detection
Not on the map. Why?
Abstract (arXiv)
Recent LSS-based multi-view 3D object detection has made tremendous progress, by processing the features in Brid-Eye-View (BEV) via the convolutional detector. However, the typical convolution ignores the radial symmetry of the BEV features and increases the difficulty of the detector optimization. To preserve the inherent property of the BEV features and ease the optimization, we propose an azimuth-equivariant convolution (AeConv) and an azimuth-equivariant anchor. The sampling grid of AeConv is always in the radial direction, thus it can learn azimuth-invariant BEV features. The proposed anchor enables the detection head to learn predicting azimuth-irrelevant targets. In addition, we introduce a camera-decoupled virtual depth to unify the depth prediction for the images with different camera intrinsic parameters. The resultant detector is dubbed Azimuth-equivariant Detector (AeDet). Extensive experiments are conducted on nuScenes, and AeDet achieves a 62.0% NDS, surpassing the recent multi-view 3D object detectors such as PETRv2 and BEVDepth by a large margin. Project page: https://fcjian.github.io/aedet.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 30 of its 32 references that are in the map. First posted on arXiv 22 Nov 2022.
Builds on
30 of 32 references.
References · 30
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2022A ConvNet for the 2020scited by 3,545
- 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,573
- 2017Deformable Convolutional Networkscited by 1,481
- 2015Spatial Transformer Networkscited by 1,423
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
- 2020Center-based 3D Object Detection and Trackingcited by 1,143
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 711
18 more
- 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 655
- 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 568
- 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 550
- 2018Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object Detection for Autonomous Drivingcited by 455
- 2021FCOS3D: Fully Convolutional One-Stage Monocular 3D Object Detectioncited by 444
- 2016Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescuecited by 368
- 2022PETRv2: A Unified Framework for 3D Perception from Multi-Camera Imagescited by 351
- 2019Class-balanced Grouping and Sampling for Point Cloud 3D Object Detectioncited by 350
- 2021Categorical Depth Distribution Network for Monocular 3D Object Detectioncited by 326
- 2021TOOD: Task-aligned One-stage Object Detectioncited by 218
- 2022Unifying Voxel-based Representation with Transformer for 3D Object Detectioncited by 202
- 2019Learning Depth-Guided Convolutions for Monocular 3D Object Detectioncited by 169
- 2022PolarFormer: Multi-camera 3D Object Detection with Polar Transformercited by 147
- 2017Semi-Supervised Deep Learning for Monocular Depth Map Predictioncited by 109
- 2022Polar Parametrization for Vision-based Surround-View 3D Detectioncited by 53
- 2021Exploring Classification Equilibrium in Long-Tailed Object Detectioncited by 51
- 2021Multiview Detection with Shadow Transformer (and View-Coherent Data Augmentation)cited by 45
- 2020Monocular 3D Object Detection with Decoupled Structured Polygon Estimation and Height-Guided Depth Estimationcited by 43
Built on by
Citing papers per year: 2023: 4; 2024: 11; 2025: 3; 2026: 1.
19 papers.
Sort:
By area:
- 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 313
- 2023Exploring Recurrent Long-term Temporal Fusion for Multi-view 3D Perceptioncited by 65
- 2024InstaGen: Enhancing Object Detection by Training on Synthetic Datasetcited by 26
- 2024HENet: Hybrid Encoding for End-to-end Multi-task 3D Perception from Multi-view Camerascited by 16
- 2023Leveraging Vision-Centric Multi-Modal Expertise for 3D Object Detectioncited by 13
- 20243DGS-DET: Empower 3D Gaussian Splatting with Boundary Guidance and Box-Focused Sampling for Indoor 3D Object Detectioncited by 13
- 2024SeaBird: Segmentation in Bird's View with Dice Loss Improves Monocular 3D Detection of Large Objectscited by 12
- 2023SOGDet: Semantic-Occupancy Guided Multi-view 3D Object Detectioncited by 9
- 2024LabelDistill: Label-guided Cross-modal Knowledge Distillation for Camera-based 3D Object Detectioncited by 9
- 2024Building a Strong Pre-Training Baseline for Universal 3D Large-Scale Perceptioncited by 8
- 2025HENet++: Hybrid Encoding and Multi-task Learning for 3D Perception and End-to-end Autonomous Drivingcited by 6
- 2026VGGT-Det: Mining VGGT Internal Priors for Sensor-Geometry-Free Multi-View Indoor 3D Object Detectioncited by 6
7 more
- 2024Learning High-resolution Vector Representation from Multi-Camera Images for 3D Object Detectioncited by 4
- 2024PolarBEVDet: Exploring Polar Representation for Multi-View 3D Object Detection in Bird's-Eye-Viewcited by 3
- 2024S2-Track: A Simple yet Strong Approach for End-to-End 3D Multi-Object Trackingcited by 2
- 2024LSSInst: Improving Geometric Modeling in LSS-Based BEV Perception with Instance Representationcited by 2
- 2024Learning an Adaptive and View-Invariant Vision Transformer for Real-Time UAV Trackingcited by 1
- 2025OnlineBEV: Recurrent Temporal Fusion in Bird's Eye View Representations for Multi-Camera 3D Perceptioncited by 0
- 2025Collaborative Perceiver: Elevating Vision-based 3D Object Detection via Local Density-Aware Spatial Occupancycited by 0
- 2026VGGT-Det: Mining VGGT Internal Priors for Sensor-Geometry-Free Multi-View Indoor 3D Object Detection1 Mar 2026
- 2025HENet++: Hybrid Encoding and Multi-task Learning for 3D Perception and End-to-end Autonomous Driving10 Nov 2025
- 2025Collaborative Perceiver: Elevating Vision-based 3D Object Detection via Local Density-Aware Spatial Occupancy28 Jul 2025
- 2025OnlineBEV: Recurrent Temporal Fusion in Bird's Eye View Representations for Multi-Camera 3D Perception11 Jul 2025
- 2024Learning an Adaptive and View-Invariant Vision Transformer for Real-Time UAV Tracking28 Dec 2024
- 2024LSSInst: Improving Geometric Modeling in LSS-Based BEV Perception with Instance Representation9 Nov 2024
- 20243DGS-DET: Empower 3D Gaussian Splatting with Boundary Guidance and Box-Focused Sampling for Indoor 3D Object Detection2 Oct 2024
- 2024PolarBEVDet: Exploring Polar Representation for Multi-View 3D Object Detection in Bird's-Eye-View29 Aug 2024
- 2024Learning High-resolution Vector Representation from Multi-Camera Images for 3D Object Detection22 Jul 2024
- 2024LabelDistill: Label-guided Cross-modal Knowledge Distillation for Camera-based 3D Object Detection14 Jul 2024
- 2024S2-Track: A Simple yet Strong Approach for End-to-End 3D Multi-Object Tracking4 Jun 2024
- 2024Building a Strong Pre-Training Baseline for Universal 3D Large-Scale Perception12 May 2024
7 more
- 2024HENet: Hybrid Encoding for End-to-end Multi-task 3D Perception from Multi-view Cameras3 Apr 2024
- 2024SeaBird: Segmentation in Bird's View with Dice Loss Improves Monocular 3D Detection of Large Objects29 Mar 2024
- 2024InstaGen: Enhancing Object Detection by Training on Synthetic Dataset8 Feb 2024
- 2023Leveraging Vision-Centric Multi-Modal Expertise for 3D Object Detection24 Oct 2023
- 2023SOGDet: Semantic-Occupancy Guided Multi-view 3D Object Detection26 Aug 2023
- 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detection21 Mar 2023
- 2023Exploring Recurrent Long-term Temporal Fusion for Multi-view 3D Perception10 Mar 2023
- 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 313
- 2023Exploring Recurrent Long-term Temporal Fusion for Multi-view 3D Perceptioncited by 65
- 2024HENet: Hybrid Encoding for End-to-end Multi-task 3D Perception from Multi-view Camerascited by 16
- 2023Leveraging Vision-Centric Multi-Modal Expertise for 3D Object Detectioncited by 13
- 20243DGS-DET: Empower 3D Gaussian Splatting with Boundary Guidance and Box-Focused Sampling for Indoor 3D Object Detectioncited by 13
- 2024SeaBird: Segmentation in Bird's View with Dice Loss Improves Monocular 3D Detection of Large Objectscited by 12
- 2023SOGDet: Semantic-Occupancy Guided Multi-view 3D Object Detectioncited by 9
- 2024LabelDistill: Label-guided Cross-modal Knowledge Distillation for Camera-based 3D Object Detectioncited by 9
- 2024Building a Strong Pre-Training Baseline for Universal 3D Large-Scale Perceptioncited by 8
- 2026VGGT-Det: Mining VGGT Internal Priors for Sensor-Geometry-Free Multi-View Indoor 3D Object Detectioncited by 6
- 2024Learning High-resolution Vector Representation from Multi-Camera Images for 3D Object Detectioncited by 4
- 2024PolarBEVDet: Exploring Polar Representation for Multi-View 3D Object Detection in Bird's-Eye-Viewcited by 3
12 most cited of 17 All 17 (JSON)
- 2026VGGT-Det: Mining VGGT Internal Priors for Sensor-Geometry-Free Multi-View Indoor 3D Object Detection1 Mar 2026
- 2025Collaborative Perceiver: Elevating Vision-based 3D Object Detection via Local Density-Aware Spatial Occupancy28 Jul 2025
- 2025OnlineBEV: Recurrent Temporal Fusion in Bird's Eye View Representations for Multi-Camera 3D Perception11 Jul 2025
- 2024Learning an Adaptive and View-Invariant Vision Transformer for Real-Time UAV Tracking28 Dec 2024
- 2024LSSInst: Improving Geometric Modeling in LSS-Based BEV Perception with Instance Representation9 Nov 2024
- 20243DGS-DET: Empower 3D Gaussian Splatting with Boundary Guidance and Box-Focused Sampling for Indoor 3D Object Detection2 Oct 2024
- 2024PolarBEVDet: Exploring Polar Representation for Multi-View 3D Object Detection in Bird's-Eye-View29 Aug 2024
- 2024Learning High-resolution Vector Representation from Multi-Camera Images for 3D Object Detection22 Jul 2024
- 2024LabelDistill: Label-guided Cross-modal Knowledge Distillation for Camera-based 3D Object Detection14 Jul 2024
- 2024S2-Track: A Simple yet Strong Approach for End-to-End 3D Multi-Object Tracking4 Jun 2024
- 2024Building a Strong Pre-Training Baseline for Universal 3D Large-Scale Perception12 May 2024
- 2024HENet: Hybrid Encoding for End-to-end Multi-task 3D Perception from Multi-view Cameras3 Apr 2024
12 newest of 17 All 17 (JSON)