mlsanityData to 14 Oct 2026

RING#: PR-by-PE Global Localization with Roto-translation Equivariant Gram Learning

arXiv 2409.00206 ↗First posted 30 Aug 2024cs.CV cs.ROcited by 5

Not on the map. Why?

Abstract (arXiv)

Global localization using onboard perception sensors, such as cameras and LiDARs, is crucial in autonomous driving and robotics applications when GPS signals are unreliable. Most approaches achieve global localization by sequential place recognition (PR) and pose estimation (PE). Some methods train separate models for each task, while others employ a single model with dual heads, trained jointly with separate task-specific losses. However, the accuracy of localization heavily depends on the success of place recognition, which often fails in scenarios with significant changes in viewpoint or environmental appearance. Consequently, this renders the final pose estimation of localization ineffective. To address this, we introduce a new paradigm, PR-by-PE localization, which bypasses the need for separate place recognition by directly deriving it from pose estimation. We propose RING#, an end-to-end PR-by-PE localization network that operates in the bird's-eye-view (BEV) space, compatible with both vision and LiDAR sensors. RING# incorporates a novel design that learns two equivariant representations from BEV features, enabling globally convergent and computationally efficient pose estimation. Comprehensive experiments on the NCLT and Oxford datasets show that RING# outperforms state-of-the-art methods in both vision and LiDAR modalities, validating the effectiveness of the proposed approach. The code will be publicly released.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 56 of its 99 references that are in the map. First posted on arXiv 30 Aug 2024.

Builds on

56 of 99 references.

References · 56

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  6. 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
  7. 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,320
  8. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
  9. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
  10. 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 988
  11. 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
  12. 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 941
38 more
  1. 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 713
  2. 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 658
  3. 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 572
  4. 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 559
  5. 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 552
  6. 2017Fine-tuning CNN Image Retrieval with No Human Annotationcited by 499
  7. 2019General E(2)-Equivariant Steerable CNNscited by 446
  8. 2022BEVFormer v2: Adapting Modern Image Backbones to Bird's-Eye-View Recognition via Perspective Supervisioncited by 302
  9. 2021Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognitioncited by 238
  10. 2018PointNetVLAD: Deep Point Cloud Based Retrieval for Large-Scale Place Recognitioncited by 198
  11. 2021COTR: Correspondence Transformer for Matching Across Imagescited by 183
  12. 2023AnyLoc: Towards Universal Visual Place Recognitioncited by 163
  13. 2023MixVPR: Feature Mixing for Visual Place Recognitioncited by 161
  14. 2019The Oxford Radar RobotCar Dataset: A Radar Extension to the Oxford RobotCar Datasetcited by 134
  15. 2022MatchFormer: Interleaving Attention in Transformers for Feature Matchingcited by 126
  16. 2020MinkLoc3D: Point Cloud Based Large-Scale Place Recognitioncited by 115
  17. 2020Self-supervising Fine-grained Region Similarities for Large-scale Image Localizationcited by 110
  18. 2022TransVPR: Transformer-based place recognition with multi-level attention aggregationcited by 102
  19. 2023R2Former: Unified Retrieval and Reranking Transformer for Place Recognitioncited by 102
  20. 2021Scan Context++: Structural Place Recognition Robust to Rotation and Lateral Variations in Urban Environmentscited by 72
  21. 2022OverlapTransformer: An Efficient and Rotation-Invariant Transformer Network for LiDAR-Based Place Recognitioncited by 69
  22. 2021LCDNet: Deep Loop Closure Detection and Point Cloud Registration for LiDAR SLAMcited by 67
  23. 2022Improving Point Cloud Based Place Recognition with Ranking-based Loss and Large Batch Trainingcited by 45
  24. 2020DH3D: Deep Hierarchical 3D Descriptors for Robust Large-Scale 6DoF Relocalizationcited by 42
  25. 2019LiDAR Iris for Loop-Closure Detectioncited by 39
  26. 2023SNAP: Self-Supervised Neural Maps for Visual Positioning and Semantic Understandingcited by 38
  27. 2020Intensity Scan Context: Coding Intensity and Geometry Relations for Loop Closure Detectioncited by 37
  28. 2018Leveraging Deep Visual Descriptors for Hierarchical Efficient Localizationcited by 29
  29. 2020Deep Keypoint-Based Camera Pose Estimation with Geometric Constraintscited by 29
  30. 2022RING++: Roto-translation Invariant Gram for Global Localization on a Sparse Scan Mapcited by 29
  31. 2020DiSCO: Differentiable Scan Context with Orientationcited by 28
  32. 2021EgoNN: Egocentric Neural Network for Point Cloud Based 6DoF Relocalization at the City Scalecited by 25
  33. 2021SSC: Semantic Scan Context for Large-Scale Place Recognitioncited by 24
  34. 2022Spectral Geometric Verification: Re-Ranking Point Cloud Retrieval for Metric Localizationcited by 21
  35. 2023Are Local Features All You Need for Cross-Domain Visual Place Recognition?cited by 21
  36. 2023Fast and Accurate Deep Loop Closing and Relocalization for Reliable LiDAR SLAMcited by 15
  37. 2020AdaLAM: Revisiting Handcrafted Outlier Detectioncited by 14
  38. 2022BoW3D: Bag of Words for Real-Time Loop Closing in 3D LiDAR SLAMcited by 13

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 3.

5 papers.