SegLocNet: Multimodal Localization Network for Autonomous Driving via Bird's-Eye-View Segmentation
Not on the map. Why?
Abstract (arXiv)
Robust and accurate localization is critical for autonomous driving. Traditional GNSS-based localization methods suffer from signal occlusion and multipath effects in urban environments. Meanwhile, methods relying on high-definition (HD) maps are constrained by the high costs associated with the construction and maintenance of HD maps. Standard-definition (SD) maps-based methods, on the other hand, often exhibit unsatisfactory performance or poor generalization ability due to overfitting. To address these challenges, we propose SegLocNet, a multimodal GNSS-free localization network that achieves precise localization using bird's-eye-view (BEV) semantic segmentation. SegLocNet employs a BEV segmentation network to generate semantic maps from multiple sensor inputs, followed by an exhaustive matching process to estimate the vehicle's ego pose. This approach avoids the limitations of regression-based pose estimation and maintains high interpretability and generalization. By introducing a unified map representation, our method can be applied to both HD and SD maps without any modifications to the network architecture, thereby balancing localization accuracy and area coverage. Extensive experiments on the nuScenes and Argoverse datasets demonstrate that our method outperforms the current state-of-the-art methods, and that our method can accurately estimate the ego pose in urban environments without relying on GNSS, while maintaining strong generalization ability. Our code and pre-trained model will be released publicly.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 35 of its 47 references that are in the map. First posted on arXiv 27 Feb 2025.
Builds on
35 of 47 references.
References · 35
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2022Planning-oriented Autonomous Drivingcited by 1,087
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 988
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 732
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 713
23 more
- 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 572
- 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 559
- 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 552
- 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learningcited by 368
- 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 281
- 2022Cross-view Transformers for real-time Map-view Semantic Segmentationcited by 264
- 2019CenterMask : Real-Time Anchor-Free Instance Segmentationcited by 201
- 2018PointNetVLAD: Deep Point Cloud Based Retrieval for Large-Scale Place Recognitioncited by 198
- 2022PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmarkcited by 140
- 2023OrienterNet: Visual Localization in 2D Public Maps with Neural Matchingcited by 84
- 2021Where is your place, Visual Place Recognition?cited by 82
- 2022OverlapTransformer: An Efficient and Rotation-Invariant Transformer Network for LiDAR-Based Place Recognitioncited by 69
- 2023LiDAR-Based Place Recognition For Autonomous Driving: A Surveycited by 21
- 2019You Are Here: Geolocation by Embedding Maps and Imagescited by 19
- 2024MapLocNet: Coarse-to-Fine Feature Registration for Visual Re-Localization in Navigation Mapscited by 18
- 2023LCPR: A Multi-Scale Attention-Based LiDAR-Camera Fusion Network for Place Recognitioncited by 17
- 2023U-BEV: Height-aware Bird's-Eye-View Segmentation and Neural Map-based Relocalizationcited by 13
- 2022BEV-Locator: An End-to-end Visual Semantic Localization Network Using Multi-View Imagescited by 12
- 2024BLOS-BEV: Navigation Map Enhanced Lane Segmentation Network, Beyond Line of Sightcited by 12
- 2022OpenStreetMap-based LiDAR Global Localization in Urban Environment without a Prior LiDAR Mapcited by 11
- 2023EgoVM: Achieving Precise Ego-Localization using Lightweight Vectorized Mapscited by 11
- 2018Automated Map Reading: Image Based Localisation in 2-D Maps Using Binary Semantic Descriptorscited by 6
- 2024OSMLoc: Single Image-Based Visual Localization in OpenStreetMap with Fused Geometric and Semantic Guidancecited by 5
Built on by
Citing papers per year: 2025: 2; 2026: 4.
6 papers.
- 2025LRFusionPR: A Polar BEV-Based LiDAR-Radar Fusion Network for Place Recognitioncited by 3
- 2025DiffVL: Diffusion-Based Visual Localization on 2D Maps via BEV-Conditioned GPS Denoisingcited by 2
- 2026RHO: Robust Holistic OSM-Based Metric Cross-View Geo-Localizationcited by 1
- 2026HOLO: Homography-Guided Pose Estimator Network for Fine-Grained Visual Localization on SD Mapscited by 0
- 2026Leveraging Semantic Maps for City-Scale Cross-View Localizationcited by 0
- 2026AutoCompass: Accurate Visual Localization on Public Maps by Learning from Weak Labelscited by 0
- 2026AutoCompass: Accurate Visual Localization on Public Maps by Learning from Weak Labels2 Sep 2026
- 2026Leveraging Semantic Maps for City-Scale Cross-View Localization28 Jul 2026
- 2026RHO: Robust Holistic OSM-Based Metric Cross-View Geo-Localization29 Mar 2026
- 2026HOLO: Homography-Guided Pose Estimator Network for Fine-Grained Visual Localization on SD Maps6 Jan 2026
- 2025DiffVL: Diffusion-Based Visual Localization on 2D Maps via BEV-Conditioned GPS Denoising18 Sep 2025
- 2025LRFusionPR: A Polar BEV-Based LiDAR-Radar Fusion Network for Place Recognition27 Apr 2025