YOLO-BEV: Generating Bird's-Eye View in the Same Way as 2D Object Detection
Not on the map. Why?
Abstract (arXiv)
Vehicle perception systems strive to achieve comprehensive and rapid visual interpretation of their surroundings for improved safety and navigation. We introduce YOLO-BEV, an efficient framework that harnesses a unique surrounding cameras setup to generate a 2D bird's-eye view of the vehicular environment. By strategically positioning eight cameras, each at a 45-degree interval, our system captures and integrates imagery into a coherent 3x3 grid format, leaving the center blank, providing an enriched spatial representation that facilitates efficient processing. In our approach, we employ YOLO's detection mechanism, favoring its inherent advantages of swift response and compact model structure. Instead of leveraging the conventional YOLO detection head, we augment it with a custom-designed detection head, translating the panoramically captured data into a unified bird's-eye view map of ego car. Preliminary results validate the feasibility of YOLO-BEV in real-time vehicular perception tasks. With its streamlined architecture and potential for rapid deployment due to minimized parameters, YOLO-BEV poses as a promising tool that may reshape future perspectives in autonomous driving systems.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 17 of its 21 references that are in the map. First posted on arXiv 26 Oct 2023.
Builds on
17 of 21 references.
References · 17
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2017Mask R-CNNcited by 7,277
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2015SSD: Single Shot MultiBox Detectorcited by 3,130
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
- 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 658
- 2021FCOS3D: Fully Convolutional One-Stage Monocular 3D Object Detectioncited by 447
- 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 420
- 2020Learning Lane Graph Representations for Motion Forecastingcited by 382
5 more
- 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 315
- 2021FIERY: Future Instance Prediction in Bird's-Eye View from Surround Monocular Camerascited by 239
- 2019Cross-view Semantic Segmentation for Sensing Surroundingscited by 174
- 2020TPNet: Trajectory Proposal Network for Motion Predictioncited by 80
- 2020A Sim2Real Deep Learning Approach for the Transformation of Images from Multiple Vehicle-Mounted Cameras to a Semantically Segmented Image in Bird's Eye Viewcited by 72
Built on by
Citing papers per year: 2024: 1.
1 paper.
- 2024Path Planning based on 2D Object Bounding-boxcited by 0
- 2024Path Planning based on 2D Object Bounding-box22 Feb 2024