FlashBEV: Fast and Memory-Efficient Exact BEV Transformation with IO-Awareness
Not on the map. Why?
Abstract (arXiv)
Bird's-eye-view (BEV) perception is a core component of camera-based 3D understanding in autonomous driving, where view transformation (VT) maps multi-camera image features into a unified BEV representation. Sampling-based view transformation (Sampling-VT) is attractive because it supports dense and continuous BEV aggregation for high-resolution and long-range perception. Its deployment bottleneck, however, is systems-level: standard tensorized implementations of Sampling-VT -- which we refer to as Tensorized Sampling-VT -- explicitly materialize large height-dependent intermediate tensors, causing memory and latency costs that scale poorly with vertical resolution and the number of cameras. We revisit Tensorized Sampling-VT from an operator-execution perspective and show that it follows a gather-reduction pattern: each BEV query independently accumulates contributions across cameras and height bins, enabling thread-local accumulation with on-the-fly recomputation that eliminates the need to materialize height- and camera-dependent intermediates. Based on this insight, we propose FlashBEV, a fully fused and IO-aware execution strategy mathematically equivalent to Tensorized Sampling-VT (same operator output) while substantially reducing global memory traffic and kernel-launch overhead. Experiments show that FlashBEV achieves more than an order of magnitude lower peak GPU memory and significant inference-latency speedups, with memory effectively independent of the number of height bins, reducing the operator's peak memory to O(BCXY) (output only). This unlocks higher BEV range/resolution and vertical discretization within fixed deployment budgets on memory-constrained devices. Our contribution is an execution redesign -- same math, different execution -- that removes a key scalability barrier for deployment-ready Sampling-VT. Code available at https://github.com/yokosyun/FlashBEV
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 30 references that are in the map. First posted on arXiv 11 Jul 2026.
Builds on
29 of 30 references.
References · 29
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 844
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 711
- 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 568
- 2022BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detectioncited by 340
- 2021Categorical Depth Distribution Network for Monocular 3D Object Detectioncited by 326
- 2022BEVFormer v2: Adapting Modern Image Backbones to Bird's-Eye-View Recognition via Perspective Supervisioncited by 302
- 2023SparseBEV: High-Performance Sparse 3D Object Detection from Multi-Camera Videoscited by 149
17 more
- 2022PolarFormer: Multi-camera 3D Object Detection with Polar Transformercited by 147
- 2022Simple-BEV: What Really Matters for Multi-Sensor BEV Perception?cited by 128
- 2023FB-BEV: BEV Representation from Forward-Backward View Transformationscited by 98
- 2022BEVPoolv2: A Cutting-edge Implementation of BEVDet Toward Deploymentcited by 79
- 2023BEVHeight: A Robust Framework for Vision-based Roadside 3D Object Detectioncited by 74
- 2023Fast-BEV: A Fast and Strong Bird's-Eye View Perception Baselinecited by 40
- 2023EA-LSS: Edge-aware Lift-splat-shot Framework for 3D BEV Object Detectioncited by 38
- 2023PointBeV: A Sparse Approach to BeV Predictionscited by 23
- 2022BEV-SAN: Accurate BEV 3D Object Detection via Slice Attention Networkscited by 20
- 2025Toward Real-world BEV Perception: Depth Uncertainty Estimation via Gaussian Splattingcited by 20
- 2023HeightFormer: Explicit Height Modeling without Extra Data for Camera-only 3D Object Detection in Bird's Eye Viewcited by 19
- 2023Parametric Depth Based Feature Representation Learning for Object Detection and Segmentation in Bird's Eye Viewcited by 10
- 2024DualBEV: Unifying Dual View Transformation with Probabilistic Correspondencescited by 9
- 2024RayFormer: Improving Query-Based Multi-Camera 3D Object Detection via Ray-Centric Strategiescited by 9
- 2024HV-BEV: Decoupling Horizontal and Vertical Feature Sampling for Multi-View 3D Object Detectioncited by 3
- 2024LSSInst: Improving Geometric Modeling in LSS-Based BEV Perception with Instance Representationcited by 2
- 2025Fast-BEV++: Fast by Algorithm, Deployable by Designcited by 2
Built on by
Not cited yet.