mlsanityData to 7 Oct 2026

Unveiling the Black Box: Independent Functional Module Evaluation for Bird's-Eye-View Perception Model

arXiv 2409.11969 ↗First posted 18 Sep 2024cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

End-to-end models are emerging as the mainstream in autonomous driving perception. However, the inability to meticulously deconstruct their internal mechanisms results in diminished development efficacy and impedes the establishment of trust. Pioneering in the issue, we present the Independent Functional Module Evaluation for Bird's-Eye-View Perception Model (BEV-IFME), a novel framework that juxtaposes the module's feature maps against Ground Truth within a unified semantic Representation Space to quantify their similarity, thereby assessing the training maturity of individual functional modules. The core of the framework lies in the process of feature map encoding and representation aligning, facilitated by our proposed two-stage Alignment AutoEncoder, which ensures the preservation of salient information and the consistency of feature structure. The metric for evaluating the training maturity of functional modules, Similarity Score, demonstrates a robust positive correlation with BEV metrics, with an average correlation coefficient of 0.9387, attesting to the framework's reliability for assessment purposes.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 26 of its 30 references that are in the map. First posted on arXiv 18 Sep 2024.

Builds on

26 of 30 references.

References · 26

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2020End-to-End Object Detection with Transformerscited by 7,384
  4. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  5. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
  6. 2016Stacked Hourglass Networks for Human Pose Estimationcited by 913
  7. 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 568
  8. 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 485
  9. 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 455
  10. 2022BEVFormer v2: Adapting Modern Image Backbones to Bird's-Eye-View Recognition via Perspective Supervisioncited by 302
  11. 2022Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipecited by 122
  12. 2019Towards Visually Explaining Variational Autoencoderscited by 113
14 more
  1. 2018MonoGRNet: A Geometric Reasoning Network for Monocular 3D Object Localizationcited by 84
  2. 2021Explainability of deep vision-based autonomous driving systems: Review and challengescited by 80
  3. 2022MV-FCOS3D++: Multi-View Camera-Only 4D Object Detection with Pretrained Monocular Backbonescited by 29
  4. 2021LGD: Label-guided Self-distillation for Object Detectioncited by 19
  5. 2020LabelEnc: A New Intermediate Supervision Method for Object Detectioncited by 18
  6. 2024CLIP-BEVFormer: Enhancing Multi-View Image-Based BEV Detector with Ground Truth Flowcited by 14
  7. 2018Regularizing Deep Networks by Modeling and Predicting Label Structurecited by 9
  8. 2024LabelDistill: Label-guided Cross-modal Knowledge Distillation for Camera-based 3D Object Detectioncited by 9
  9. 2023Label-guided Attention Distillation for Lane Segmentationcited by 7
  10. 2024Exploring the Causality of End-to-End Autonomous Drivingcited by 7
  11. 2022Label-Guided Auxiliary Training Improves 3D Object Detectorcited by 6
  12. 2024Exploring Latent Pathways: Enhancing the Interpretability of Autonomous Driving with a Variational Autoencodercited by 6
  13. 2024Feature Map Convergence Evaluation for Functional Modulecited by 6
  14. 2024Hierarchical and Decoupled BEV Perception Learning Framework for Autonomous Drivingcited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.