BEVCon: Advancing Bird's Eye View Perception with Contrastive Learning
Not on the map. Why?
Abstract (arXiv)
We present BEVCon, a simple yet effective contrastive learning framework designed to improve Bird's Eye View (BEV) perception in autonomous driving. BEV perception offers a top-down-view representation of the surrounding environment, making it crucial for 3D object detection, segmentation, and trajectory prediction tasks. While prior work has primarily focused on enhancing BEV encoders and task-specific heads, we address the underexplored potential of representation learning in BEV models. BEVCon introduces two contrastive learning modules: an instance feature contrast module for refining BEV features and a perspective view contrast module that enhances the image backbone. The dense contrastive learning designed on top of detection losses leads to improved feature representations across both the BEV encoder and the backbone. Extensive experiments on the nuScenes dataset demonstrate that BEVCon achieves consistent performance gains, achieving up to +2.4% mAP improvement over state-of-the-art baselines. Our results highlight the critical role of representation learning in BEV perception and offer a complementary avenue to conventional task-specific optimizations.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 43 of its 47 references that are in the map. First posted on arXiv 6 Aug 2025.
Builds on
43 of 47 references.
References · 43
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2017Mask R-CNNcited by 7,277
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2020Supervised Contrastive Learningcited by 2,829
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2020Improved Baselines with Momentum Contrastive Learningcited by 2,287
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,838
31 more
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
- 2022Planning-oriented Autonomous Drivingcited by 1,087
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 713
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
- 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 658
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
- 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 572
- 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 552
- 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 482
- 2022PETRv2: A Unified Framework for 3D Perception from Multi-Camera Imagescited by 352
- 2022BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detectioncited by 341
- 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 315
- 2022BEVFormer v2: Adapting Modern Image Backbones to Bird's-Eye-View Recognition via Perspective Supervisioncited by 302
- 2023RH20T: A Comprehensive Robotic Dataset for Learning Diverse Skills in One-Shotcited by 183
- 2022Time Will Tell: New Outlooks and A Baseline for Temporal Multi-View 3D Object Detectioncited by 178
- 2019Cross-view Semantic Segmentation for Sensing Surroundingscited by 174
- 2022Sparse4D: Multi-view 3D Object Detection with Sparse Spatial-Temporal Fusioncited by 162
- 2022PolarFormer: Multi-camera 3D Object Detection with Polar Transformercited by 147
- 2022Simple-BEV: What Really Matters for Multi-Sensor BEV Perception?cited by 128
- 2021Semi-Supervised Semantic Segmentation with Pixel-Level Contrastive Learning from a Class-wise Memory Bankcited by 125
- 2021Pixel Contrastive-Consistent Semi-Supervised Semantic Segmentationcited by 101
- 2023FB-BEV: BEV Representation from Forward-Backward View Transformationscited by 98
- 2022Learning to Drive by Watching YouTube Videos: Action-Conditioned Contrastive Policy Pretrainingcited by 37
- 2022TiG-BEV: Multi-view BEV 3D Object Detection via Target Inner-Geometry Learningcited by 37
- 2023SA-BEV: Generating Semantic-Aware Bird's-Eye-View Feature for Multi-view 3D Object Detectioncited by 30
- 2020Understanding Bird's-Eye View of Road Semantics using an Onboard Cameracited by 29
- 2024CoViS-Net: A Cooperative Visual Spatial Foundation Model for Multi-Robot Applicationscited by 5
- 2023ICPC: Instance-Conditioned Prompting with Contrastive Learning for Semantic Segmentationcited by 2
- 2022Contrastive Learning for Object Detectioncited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Faster Training, Fewer Labels: Self-Supervised Pretraining for Fine-Grained BEV Segmentationcited by 0
- 2026MapGCLR: Geospatial Contrastive Learning of Representations for Online Vectorized HD Map Constructioncited by 0
- 2026SGR-OCC: Evolving Monocular Priors for Embodied 3D Occupancy Prediction via Soft-Gating Lifting and Semantic-Adaptive Geometric Refinementcited by 0
- 2026SGR-OCC: Evolving Monocular Priors for Embodied 3D Occupancy Prediction via Soft-Gating Lifting and Semantic-Adaptive Geometric Refinement14 Mar 2026
- 2026MapGCLR: Geospatial Contrastive Learning of Representations for Online Vectorized HD Map Construction11 Mar 2026
- 2026Faster Training, Fewer Labels: Self-Supervised Pretraining for Fine-Grained BEV Segmentation20 Feb 2026