mlsanityData to 14 Oct 2026

TinyBEV: Cross Modal Knowledge Distillation for Efficient Multi Task Bird's Eye View Perception and Planning

arXiv 2509.18372 ↗First posted 22 Sep 2025cs.CVcited by 0

On the map: Knowledge distillation → Detection and dense prediction distillation

Abstract (arXiv)

We present TinyBEV, a unified, camera only Bird's Eye View (BEV) framework that distills the full-stack capabilities of a large planning-oriented teacher (UniAD [19]) into a compact, real-time student model. Unlike prior efficient camera only baselines such as VAD[23] and VADv2[7], TinyBEV supports the complete autonomy stack 3D detection, HD-map segmentation, motion forecasting, occupancy prediction, and goal-directed planning within a streamlined 28M-parameter backbone, achieving a 78% reduction in parameters over UniAD [19]. Our model-agnostic, multi-stage distillation strategy combines feature-level, output-level, and adaptive region-aware supervision to effectively transfer high-capacity multi-modal knowledge to a lightweight BEV representation. On nuScenes[4], Tiny-BEV achieves 39.0 mAP for detection, 1.08 minADE for motion forecasting, and a 0.32 collision rate, while running 5x faster (11 FPS) and requiring only camera input. These results demonstrate that full-stack driving intelligence can be retained in resource-constrained settings, bridging the gap between large-scale, multi-modal perception-planning models and deployment-ready real-time autonomy.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Detection and dense prediction distillation, one of 12 directions in Knowledge distillation. Builds on 22 of its 44 references that are in the map. First posted on arXiv 22 Sep 2025.

Builds on

22 of 44 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023X3KD: Knowledge Distillation Across Modalities, Tasks and Stages for Multi-Camera 3D Object Detection3 Mar
  2. 2022Structured Knowledge Distillation Towards Efficient and Compact Multi-View 3D Detection14 Nov

Other references · 20

  1. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  2. 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,329
  3. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
  4. 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,135
  5. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
  6. 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
  7. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 622
  8. 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 572
  9. 2021FCOS3D: Fully Convolutional One-Stage Monocular 3D Object Detectioncited by 447
  10. 2019A Survey of Deep Learning Techniques for Autonomous Drivingcited by 403
  11. 2018ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worstcited by 397
  12. 2020Learning Lane Graph Representations for Motion Forecastingcited by 382
8 more
  1. 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 289
  2. 2021End-to-end Interpretable Neural Motion Plannercited by 242
  3. 2021MP3: A Unified Model to Map, Perceive, Predict and Plancited by 212
  4. 2022FUTR3D: A Unified Sensor Fusion Framework for 3D Detectioncited by 194
  5. 2017Computer Vision for Autonomous Vehicles: Problems, Datasets and State of the Artcited by 182
  6. 2020Can Autonomous Vehicles Identify, Recover From, and Adapt to Distribution Shifts?cited by 139
  7. 2023QD-BEV : Quantization-aware View-guided Distillation for Multi-view 3D Object Detectioncited by 8
  8. 2024Cyclic Refiner: Object-Aware Temporal Representation Learning for Multi-View 3D Detection and Trackingcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025KD360-VoxelBEV: LiDAR and 360-degree Camera Cross Modality Knowledge Distillation for Bird's-Eye-View Segmentation
  2. 2025BridgeTA: Bridging the Representation Gap in Knowledge Distillation via Teacher Assistant for Bird's Eye View Map Segmentation
  3. 2023UniDistill: A Universal Cross-Modality Knowledge Distillation Framework for 3D Object Detection in Bird's-Eye View
  4. 2025MamBEV: Enabling State Space Models to Learn Birds-Eye-View Representations
  5. 2025BEVTraj: Map-Free End-to-End Trajectory Prediction in Bird's-Eye View with Deformable Attention and Sparse Goal Proposals
  6. 2026BEVLM: Distilling Semantic Knowledge from LLMs into Bird's-Eye View Representations
  7. 2025BEVUDA++: Geometric-aware Unsupervised Domain Adaptation for Multi-View 3D Object Detection
  8. 2024OneBEV: Using One Panoramic Image for Bird's-Eye-View Semantic Mapping