Learning Ego-Centric BEV Representations from a Perspective-Privileged View: Cross-View Supervision for Online HD Map Construction
Not on the map. Why?
Abstract (arXiv)
Bird's-eye-view (BEV) representations derived from multi-camera input have become a central interface for online high-definition (HD) map construction. However, most approaches rely solely on ego-centric supervision, requiring large-scale scene structure to be inferred from incomplete observations, occlusions, and diminishing information density at long range, where perspective effects and spatial sparsity hinder consistent structural reasoning. We introduce Cross-View Supervision (CVS), a representation learning paradigm that transfers geometric and topological priors from an ego-aligned overhead perspective into camera-based BEV encoders. Rather than adding auxiliary semantic losses, CVS aligns representations in a shared BEV feature space and distills globally consistent structural knowledge from a perspective-privileged teacher into the ego-centric backbone. This supervision enhances structural coherence without modifying the inference architecture or requiring overhead input at test time. Experiments on nuScenes using ego-aligned aerial imagery from the AID4AD cross-view extension demonstrate consistent improvements over StreamMapNet while maintaining identical camera-only inference. CVS yields +3.9mAP in the standard 60×30,m region and +9.9mAP in the extended 100×50,m setting, corresponding to a 44% relative gain at long range. These results highlight perspective-privileged structural supervision as a promising training principle for improving BEV representation learning in HD map construction.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 34 of its 46 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
34 of 46 references.
References · 34
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2019Similarity of Neural Network Representations Revisitedcited by 1,755
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
- 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 490
- 2022BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detectioncited by 341
- 2018Insights on representational similarity in neural networks with canonical correlationcited by 324
- 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 315
- 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 314
22 more
- 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 281
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 245
- 2019ResUNet++: An Advanced Architecture for Medical Image Segmentationcited by 211
- 2023MapTRv2: An End-to-End Framework for Online Vectorized HD Map Constructioncited by 193
- 2020Predicting Semantic Map Representations from Images using Pyramid Occupancy Networkscited by 175
- 2023StreamMapNet: Streaming Mapping Network for Vectorized Online HD Map Constructioncited by 145
- 2018RoadTracer: Automatic Extraction of Road Networks from Aerial Imagescited by 102
- 2023End-to-End Vectorized HD-map Construction with Piecewise Bezier Curvecited by 82
- 2023One-for-All: Bridge the Gap Between Heterogeneous Architectures in Knowledge Distillationcited by 78
- 2024MapTracker: Tracking with Strided Memory Fusion for Consistent Vector HD Mappingcited by 68
- 2020Sat2Graph: Road Graph Extraction through Graph-Tensor Encodingcited by 55
- 2024MGMap: Mask-Guided Learning for Online Vectorized HD Map Constructioncited by 52
- 2024Stream Query Denoising for Vectorized HD Map Constructioncited by 43
- 2023DistillBEV: Boosting Multi-Camera 3D Object Detection with Cross-Modal Knowledge Distillationcited by 41
- 2023DiffBEV: Conditional Diffusion Model for Bird's Eye View Perceptioncited by 30
- 2024MapDistill: Boosting Efficient Camera-based HD Map Construction via Camera-LiDAR Fusion Model Distillationcited by 26
- 2024Mask2Map: Vectorized HD Map Construction Using Bird's Eye View Segmentation Maskscited by 26
- 2024DifFUSER: Diffusion Model for Robust Multi-Sensor Fusion in 3D Object Detection and BEV Segmentationcited by 18
- 2025BEVDiffuser: Plug-and-Play Diffusion Model for BEV Denoising with Ground-Truth Guidancecited by 17
- 2022High-Definition Map Generation Technologies For Autonomous Drivingcited by 14
- 2025MapDiffusion: Generative Diffusion for Vectorized Online HD Map Construction and Uncertainty Estimation in Autonomous Drivingcited by 13
- 2025AID4AD: Aerial Image Data for Automated Driving Perceptioncited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.