Self-Supervised Robust Scene Flow Estimation via the Alignment of Probability Density Functions
Not on the map. Why?
Abstract (arXiv)
In this paper, we present a new self-supervised scene flow estimation approach for a pair of consecutive point clouds. The key idea of our approach is to represent discrete point clouds as continuous probability density functions using Gaussian mixture models. Scene flow estimation is therefore converted into the problem of recovering motion from the alignment of probability density functions, which we achieve using a closed-form expression of the classic Cauchy-Schwarz divergence. Unlike existing nearest-neighbor-based approaches that use hard pairwise correspondences, our proposed approach establishes soft and implicit point correspondences between point clouds and generates more robust and accurate scene flow in the presence of missing correspondences and outliers. Comprehensive experiments show that our method makes noticeable gains over the Chamfer Distance and the Earth Mover's Distance in real-world environments and achieves state-of-the-art performance among self-supervised learning methods on FlyingThings3D and KITTI, even outperforming some supervised methods with ground truth annotations.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 30 of its 60 references that are in the map. First posted on arXiv 23 Mar 2022.
Builds on
30 of 60 references.
References · 30
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
- 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
18 more
- 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 780
- 2019Deep Closest Point: Learning Representations for Point Cloud Registrationcited by 318
- 2018FlowNet3D: Learning Scene Flow in 3D Point Cloudscited by 241
- 2019PointNetLK: Robust & Efficient Point Cloud Registration using PointNetcited by 231
- 2020RPM-Net: Robust Point Matching using Learned Featurescited by 181
- 2020FLOT: Scene Flow on Point Clouds Guided by Optimal Transportcited by 129
- 2020RAFT-3D: Scene Flow using Rigid-Motion Embeddingscited by 121
- 2019HPLFlowNet: Hierarchical Permutohedral Lattice FlowNet for Scene Flow Estimation on Large-scale Point Cloudscited by 108
- 2019Just Go with the Flow: Self-Supervised Scene Flow Estimationcited by 98
- 2020DeepGMR: Learning Latent Gaussian Mixture Models for Registrationcited by 91
- 2020PV-RAFT: Point-Voxel Correlation Fields for Scene Flow Estimation of Point Cloudscited by 74
- 2020FlowStep3D: Model Unrolling for Self-Supervised Scene Flow Estimationcited by 71
- 2021Weakly Supervised Learning of Rigid 3D Scene Flowcited by 60
- 2020Scene Flow from Point Clouds with or without Learningcited by 44
- 2020Self-Supervised Learning of Non-Rigid Residual Flow and Ego-Motioncited by 41
- 2021Self-Point-Flow: Self-Supervised Scene Flow Estimation from Point Clouds with Optimal Transport and Random Walkcited by 39
- 2021Learning Scene Dynamics from Point Cloud Sequencescited by 9
- 2020Adversarial Self-Supervised Scene Flow Estimationcited by 6
Built on by
Citing papers per year: 2022: 2; 2023: 4; 2024: 0; 2025: 1.
7 papers.
- 2022SCOOP: Self-Supervised Correspondence and Optimization-Based Scene Flowcited by 28
- 2023Self-Supervised 3D Scene Flow Estimation Guided by Superpointscited by 24
- 2023The Conditional Cauchy-Schwarz Divergence with Applications to Time-Series Data and Sequential Decision Makingcited by 6
- 2022Learning Canonical Embeddings for Unsupervised Shape Correspondence with Locally Linear Transformationscited by 2
- 2023Self-Supervised 3D Scene Flow Estimation and Motion Prediction using Local Rigidity Priorcited by 2
- 2025Weakly and Self-Supervised Class-Agnostic Motion Prediction for Autonomous Drivingcited by 2
- 2023Active Velocity Estimation using Light Curtains via Self-Supervised Multi-Armed Banditscited by 0
- 2025Weakly and Self-Supervised Class-Agnostic Motion Prediction for Autonomous Driving16 Sep 2025
- 2023Self-Supervised 3D Scene Flow Estimation and Motion Prediction using Local Rigidity Prior17 Oct 2023
- 2023Self-Supervised 3D Scene Flow Estimation Guided by Superpoints4 May 2023
- 2023Active Velocity Estimation using Light Curtains via Self-Supervised Multi-Armed Bandits24 Feb 2023
- 2023The Conditional Cauchy-Schwarz Divergence with Applications to Time-Series Data and Sequential Decision Making21 Jan 2023
- 2022SCOOP: Self-Supervised Correspondence and Optimization-Based Scene Flow25 Nov 2022
- 2022Learning Canonical Embeddings for Unsupervised Shape Correspondence with Locally Linear Transformations5 Sep 2022