QuadBEV: An Efficient Quadruple-Task Perception Framework via Bird's-Eye-View Representation
Not on the map. Why?
Abstract (arXiv)
Bird's-Eye-View (BEV) perception has become a vital component of autonomous driving systems due to its ability to integrate multiple sensor inputs into a unified representation, enhancing performance in various downstream tasks. However, the computational demands of BEV models pose challenges for real-world deployment in vehicles with limited resources. To address these limitations, we propose QuadBEV, an efficient multitask perception framework that leverages the shared spatial and contextual information across four key tasks: 3D object detection, lane detection, map segmentation, and occupancy prediction. QuadBEV not only streamlines the integration of these tasks using a shared backbone and task-specific heads but also addresses common multitask learning challenges such as learning rate sensitivity and conflicting task objectives. Our framework reduces redundant computations, thereby enhancing system efficiency, making it particularly suited for embedded systems. We present comprehensive experiments that validate the effectiveness and robustness of QuadBEV, demonstrating its suitability for real-world applications.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 45 of its 48 references that are in the map. First posted on arXiv 9 Oct 2024.
Builds on
45 of 48 references.
References · 45
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
- 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,358
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
- 2020Center-based 3D Object Detection and Trackingcited by 1,144
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
- 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 982
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
- 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 834
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 713
- 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 658
- 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 572
33 more
- 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 552
- 2018End-to-End Multi-Task Learning with Attentioncited by 534
- 2016Cross-stitch Networks for Multi-task Learningcited by 467
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 409
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 363
- 2022PETRv2: A Unified Framework for 3D Perception from Multi-Camera Imagescited by 352
- 2019Class-balanced Grouping and Sampling for Point Cloud 3D Object Detectioncited by 350
- 2022BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detectioncited by 341
- 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 332
- 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 314
- 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 293
- 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 281
- 2022Cross-view Transformers for real-time Map-view Semantic Segmentationcited by 264
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 245
- 2022Time Will Tell: New Outlooks and A Baseline for Temporal Multi-View 3D Object Detectioncited by 178
- 2022Sparse4D: Multi-view 3D Object Detection with Sparse Spatial-Temporal Fusioncited by 162
- 2022PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmarkcited by 140
- 2018Towards End-to-End Lane Detection: an Instance Segmentation Approachcited by 129
- 2019IoU Loss for 2D/3D Object Detectioncited by 128
- 2023RenderOcc: Vision-Centric 3D Occupancy Prediction with 2D Rendering Supervisioncited by 128
- 2022BEVSegFormer: Bird's Eye View Semantic Segmentation From Arbitrary Camera Rigscited by 123
- 2021Translating Images into Mapscited by 115
- 2023PanoOcc: Unified Occupancy Representation for Camera-based 3D Panoptic Segmentationcited by 115
- 20183D-LaneNet: End-to-End 3D Multiple Lane Detectioncited by 107
- 2023FlashOcc: Fast and Memory-Efficient Occupancy Prediction via Channel-to-Height Plugincited by 103
- 2016Fully-adaptive Feature Sharing in Multi-Task Networks with Applications in Person Attribute Classificationcited by 93
- 2023OpenLane-V2: A Topology Reasoning Benchmark for Unified 3D HD Mappingcited by 83
- 2019Branched Multi-Task Networks: Deciding What Layers To Sharecited by 76
- 2023Temporal Enhanced Training of Multi-view 3D Object Detector via Historical Object Predictioncited by 49
- 2023Anchor3DLane: Learning to Regress 3D Anchors for Monocular 3D Lane Detectioncited by 48
- 2022Learning Ego 3D Representation as Ray Tracingcited by 43
- 2023CAPE: Camera View Position Embedding for Multi-View 3D Object Detectioncited by 40
- 2022TiG-BEV: Multi-view BEV 3D Object Detection via Target Inner-Geometry Learningcited by 37
Built on by
Citing papers per year: 2026: 1.
1 paper.