ContrastMotion: Self-supervised Scene Motion Learning for Large-Scale LiDAR Point Clouds
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose a novel self-supervised motion estimator for LiDAR-based autonomous driving via BEV representation. Different from usually adopted self-supervised strategies for data-level structure consistency, we predict scene motion via feature-level consistency between pillars in consecutive frames, which can eliminate the effect caused by noise points and view-changing point clouds in dynamic scenes. Specifically, we propose textitSoft Discriminative Loss that provides the network with more pseudo-supervised signals to learn discriminative and robust features in a contrastive learning manner. We also propose textitGated Multi-frame Fusion block that learns valid compensation between point cloud frames automatically to enhance feature extraction. Finally, textitpillar association is proposed to predict pillar correspondence probabilities based on feature distance, and whereby further predicts scene motion. Extensive experiments show the effectiveness and superiority of our ContrastMotion on both scene flow and motion prediction tasks. The code is available soon.
Key facts. Cited by 3 papers in the map (data through 13 Oct 2026). Builds on 34 of its 43 references that are in the map. First posted on arXiv 25 Apr 2023.
Builds on
34 of 43 references.
References · 34
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,223
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,712
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,231
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,498
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,709
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,215
- 2020Center-based 3D Object Detection and Trackingcited by 1,144
- 2020PointContrast: Unsupervised Pre-training for 3D Point Cloud Understandingcited by 503
- 2018SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraintscited by 297
- 2018FlowNet3D: Learning Scene Flow in 3D Point Cloudscited by 242
- 2020Fast and Furious: Real Time End-to-End 3D Detection, Tracking and Motion Forecasting with a Single Convolutional Netcited by 228
22 more
- 2020Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contextscited by 210
- 2018Unsupervised Learning of Depth and Ego-Motion from Monocular Video Using 3D Geometric Constraintscited by 179
- 2022Vision-Centric BEV Perception: A Surveycited by 126
- 2018TrafficPredict: Trajectory Prediction for Heterogeneous Traffic-Agentscited by 111
- 2019HPLFlowNet: Hierarchical Permutohedral Lattice FlowNet for Scene Flow Estimation on Large-scale Point Cloudscited by 109
- 2020MotionNet: Joint Perception and Motion Prediction for Autonomous Driving Based on Bird's Eye View Mapscited by 100
- 2019Just Go with the Flow: Self-Supervised Scene Flow Estimationcited by 98
- 2021Neural Scene Flow Priorcited by 91
- 2020SSN: Shape Signature Networks for Multi-class Object Detection from Point Cloudscited by 74
- 2020PV-RAFT: Point-Voxel Correlation Fields for Scene Flow Estimation of Point Cloudscited by 74
- 2020FlowStep3D: Model Unrolling for Self-Supervised Scene Flow Estimationcited by 71
- 2021Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR-based Perceptioncited by 57
- 2021Scalable Scene Flow from Point Clouds in the Real Worldcited by 49
- 2021Self-Supervised Pillar Motion Learning for Autonomous Drivingcited by 44
- 2020Self-Supervised Learning of Non-Rigid Residual Flow and Ego-Motioncited by 41
- 2022Point-Level Region Contrast for Object Detection Pre-Trainingcited by 41
- 2021Self-Point-Flow: Self-Supervised Scene Flow Estimation from Point Clouds with Optimal Transport and Random Walkcited by 39
- 2019PointPWC-Net: A Coarse-to-Fine Network for Supervised and Self-Supervised Scene Flow Estimation on 3D Point Cloudscited by 38
- 2022STCrowd: A Multimodal Dataset for Pedestrian Perception in Crowded Scenescited by 35
- 2021Self-Supervised Multi-Frame Monocular Scene Flowcited by 29
- 2021SCTN: Sparse Convolution-Transformer Network for Scene Flow Estimationcited by 23
- 2020PillarFlow: End-to-end Birds-eye-view Flow Estimation for Autonomous Drivingcited by 16
Built on by
Citing papers per year: 2024: 2; 2025: 1.
3 papers.