Robust Self-Supervised LiDAR Odometry via Representative Structure Discovery and 3D Inherent Error Modeling
Not on the map. Why?
Abstract (arXiv)
The correct ego-motion estimation basically relies on the understanding of correspondences between adjacent LiDAR scans. However, given the complex scenarios and the low-resolution LiDAR, finding reliable structures for identifying correspondences can be challenging. In this paper, we delve into structure reliability for accurate self-supervised ego-motion estimation and aim to alleviate the influence of unreliable structures in training, inference and mapping phases. We improve the self-supervised LiDAR odometry substantially from three aspects: 1) A two-stage odometry estimation network is developed, where we obtain the ego-motion by estimating a set of sub-region transformations and averaging them with a motion voting mechanism, to encourage the network focusing on representative structures. 2) The inherent alignment errors, which cannot be eliminated via ego-motion optimization, are down-weighted in losses based on the 3D point covariance estimations. 3) The discovered representative structures and learned point covariances are incorporated in the mapping module to improve the robustness of map construction. Our two-frame odometry outperforms the previous state of the arts by 16%/12% in terms of translational/rotational errors on the KITTI dataset and performs consistently well on the Apollo-Southbay datasets. We can even rival the fully supervised counterparts with our mapping module and more unlabeled training data.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 16 of its 32 references that are in the map. First posted on arXiv 27 Feb 2022.
Builds on
16 of 32 references.
References · 16
- 2017Attention Is All You Needcited by 59,932
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
- 2017Geometric Loss Functions for Camera Pose Regression with Deep Learningcited by 224
- 2017Submanifold Sparse Convolutional Networkscited by 223
- 2020D3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometrycited by 206
- 2020LIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and Mappingcited by 185
- 2017DeepVO: Towards End-to-End Visual Odometry with Deep Recurrent Convolutional Neural Networkscited by 173
- 2019Depth Completion from Sparse LiDAR Data with Depth-Normal Constraintscited by 108
- 2017UnDeepVO: Monocular Visual Odometry through Unsupervised Deep Learningcited by 95
- 2021Weakly Supervised Learning of Rigid 3D Scene Flowcited by 60
- 2019LO-Net: Deep Real-time Lidar Odometrycited by 59
4 more
- 2021VS-Net: Voting with Segmentation for Visual Localizationcited by 29
- 2019Sequential Adversarial Learning for Self-Supervised Deep Visual Odometrycited by 18
- 2017CNN for IMU Assisted Odometry Estimation using Velodyne LiDARcited by 11
- 2020SelfVoxeLO: Self-supervised LiDAR Odometry with Voxel-based Deep Neural Networkscited by 10
Built on by
Citing papers per year: 2022: 2; 2023: 2; 2024: 0; 2025: 1; 2026: 1.
6 papers.
- 2022Improving Visual Grounding with Visual-Linguistic Verification and Iterative Reasoningcited by 69
- 2022RNNPose: Recurrent 6-DoF Object Pose Refinement with Robust Correspondence Field Estimation and Pose Optimizationcited by 38
- 2023RegFormer: An Efficient Projection-Aware Transformer Network for Large-Scale Point Cloud Registrationcited by 37
- 20234DRVO-Net: Deep 4D Radar-Visual Odometry Using Multi-Modal and Multi-Scale Adaptive Fusioncited by 11
- 2026RegFormer++: An Efficient Large-Scale 3D LiDAR Point Registration Network with Projection-Aware 2D Transformercited by 2
- 2025Efficient Active Training for Deep LiDAR Odometrycited by 0
- 2026RegFormer++: An Efficient Large-Scale 3D LiDAR Point Registration Network with Projection-Aware 2D Transformer15 Mar 2026
- 2025Efficient Active Training for Deep LiDAR Odometry3 Sep 2025
- 20234DRVO-Net: Deep 4D Radar-Visual Odometry Using Multi-Modal and Multi-Scale Adaptive Fusion12 Aug 2023
- 2023RegFormer: An Efficient Projection-Aware Transformer Network for Large-Scale Point Cloud Registration22 Mar 2023
- 2022Improving Visual Grounding with Visual-Linguistic Verification and Iterative Reasoning30 Apr 2022
- 2022RNNPose: Recurrent 6-DoF Object Pose Refinement with Robust Correspondence Field Estimation and Pose Optimization24 Mar 2022