mlsanityData to 13 Oct 2026

ContrastMotion: Self-supervised Scene Motion Learning for Large-Scale LiDAR Point Clouds

arXiv 2304.12589 ↗First posted 25 Apr 2023cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

In this paper, we propose a novel self-supervised motion estimator for LiDAR-based autonomous driving via BEV representation. Different from usually adopted self-supervised strategies for data-level structure consistency, we predict scene motion via feature-level consistency between pillars in consecutive frames, which can eliminate the effect caused by noise points and view-changing point clouds in dynamic scenes. Specifically, we propose textitSoft Discriminative Loss that provides the network with more pseudo-supervised signals to learn discriminative and robust features in a contrastive learning manner. We also propose textitGated Multi-frame Fusion block that learns valid compensation between point cloud frames automatically to enhance feature extraction. Finally, textitpillar association is proposed to predict pillar correspondence probabilities based on feature distance, and whereby further predicts scene motion. Extensive experiments show the effectiveness and superiority of our ContrastMotion on both scene flow and motion prediction tasks. The code is available soon.

Key facts. Cited by 3 papers in the map (data through 13 Oct 2026). Builds on 34 of its 43 references that are in the map. First posted on arXiv 25 Apr 2023.

Builds on

34 of 43 references.

References · 34

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,223
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,712
  4. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,231
  5. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,498
  6. 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,709
  7. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,215
  8. 2020Center-based 3D Object Detection and Trackingcited by 1,144
  9. 2020PointContrast: Unsupervised Pre-training for 3D Point Cloud Understandingcited by 503
  10. 2018SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraintscited by 297
  11. 2018FlowNet3D: Learning Scene Flow in 3D Point Cloudscited by 242
  12. 2020Fast and Furious: Real Time End-to-End 3D Detection, Tracking and Motion Forecasting with a Single Convolutional Netcited by 228
22 more
  1. 2020Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contextscited by 210
  2. 2018Unsupervised Learning of Depth and Ego-Motion from Monocular Video Using 3D Geometric Constraintscited by 179
  3. 2022Vision-Centric BEV Perception: A Surveycited by 126
  4. 2018TrafficPredict: Trajectory Prediction for Heterogeneous Traffic-Agentscited by 111
  5. 2019HPLFlowNet: Hierarchical Permutohedral Lattice FlowNet for Scene Flow Estimation on Large-scale Point Cloudscited by 109
  6. 2020MotionNet: Joint Perception and Motion Prediction for Autonomous Driving Based on Bird's Eye View Mapscited by 100
  7. 2019Just Go with the Flow: Self-Supervised Scene Flow Estimationcited by 98
  8. 2021Neural Scene Flow Priorcited by 91
  9. 2020SSN: Shape Signature Networks for Multi-class Object Detection from Point Cloudscited by 74
  10. 2020PV-RAFT: Point-Voxel Correlation Fields for Scene Flow Estimation of Point Cloudscited by 74
  11. 2020FlowStep3D: Model Unrolling for Self-Supervised Scene Flow Estimationcited by 71
  12. 2021Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR-based Perceptioncited by 57
  13. 2021Scalable Scene Flow from Point Clouds in the Real Worldcited by 49
  14. 2021Self-Supervised Pillar Motion Learning for Autonomous Drivingcited by 44
  15. 2020Self-Supervised Learning of Non-Rigid Residual Flow and Ego-Motioncited by 41
  16. 2022Point-Level Region Contrast for Object Detection Pre-Trainingcited by 41
  17. 2021Self-Point-Flow: Self-Supervised Scene Flow Estimation from Point Clouds with Optimal Transport and Random Walkcited by 39
  18. 2019PointPWC-Net: A Coarse-to-Fine Network for Supervised and Self-Supervised Scene Flow Estimation on 3D Point Cloudscited by 38
  19. 2022STCrowd: A Multimodal Dataset for Pedestrian Perception in Crowded Scenescited by 35
  20. 2021Self-Supervised Multi-Frame Monocular Scene Flowcited by 29
  21. 2021SCTN: Sparse Convolution-Transformer Network for Scene Flow Estimationcited by 23
  22. 2020PillarFlow: End-to-end Birds-eye-view Flow Estimation for Autonomous Drivingcited by 16

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 1.

3 papers.