Dual-frame Fluid Motion Estimation with Test-time Optimization and Zero-divergence Loss
Not on the map. Why?
Abstract (arXiv)
3D particle tracking velocimetry (PTV) is a key technique for analyzing turbulent flow, one of the most challenging computational problems of our century. At the core of 3D PTV is the dual-frame fluid motion estimation algorithm, which tracks particles across two consecutive frames. Recently, deep learning-based methods have achieved impressive accuracy in dual-frame fluid motion estimation; however, they heavily depend on large volumes of labeled data. In this paper, we introduce a new method that is completely self-supervised and notably outperforms its fully-supervised counterparts while requiring only 1% of the training samples (without labels) used by previous methods. Our method features a novel zero-divergence loss that is specific to the domain of turbulent flow. Inspired by the success of splat operation in high-dimensional filtering and random fields, we propose a splat-based implementation for this loss which is both efficient and effective. The self-supervised nature of our method naturally supports test-time optimization, leading to the development of a tailored Dynamic Velocimetry Enhancer (DVE) module. We demonstrate that strong cross-domain robustness is achieved through test-time optimization on unseen leave-one-out synthetic domains and real physical/biological domains. Code, data and models are available at https://github.com/Forrest-110/FluidMotionNet.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 53 of its 101 references that are in the map. First posted on arXiv 15 Oct 2024.
Builds on
53 of 101 references.
References · 53
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,059
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
- 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 968
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 881
- 2020Do We Really Need to Access the Source Data? Source Hypothesis Transfer for Unsupervised Domain Adaptationcited by 848
- 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 784
- 2023TAPIR: Tracking Any Point with per-frame Initialization and temporal Refinementcited by 287
- 2018FlowNet3D: Learning Scene Flow in 3D Point Cloudscited by 242
38 more
- 2022Test-Time Training with Masked Autoencoderscited by 212
- 2018SPLATNet: Sparse Lattice Networks for Point Cloud Processingcited by 158
- 2018Depth Prediction Without the Sensors: Leveraging Structure for Unsupervised Learning from Monocular Videoscited by 155
- 2018DF-Net: Unsupervised Joint Learning of Depth and Flow using Cross-Task Consistencycited by 148
- 2019Self-supervised Learning with Geometric Constraints in Monocular Video: Connecting Flow, Depth, and Cameracited by 130
- 2020FLOT: Scene Flow on Point Clouds Guided by Optimal Transportcited by 129
- 2020RAFT-3D: Scene Flow using Rigid-Motion Embeddingscited by 122
- 2020f-BRS: Rethinking Backpropagating Refinement for Interactive Segmentationcited by 117
- 2019HPLFlowNet: Hierarchical Permutohedral Lattice FlowNet for Scene Flow Estimation on Large-scale Point Cloudscited by 109
- 2019Just Go with the Flow: Self-Supervised Scene Flow Estimationcited by 98
- 2017Self-supervised Learning of Motion Capturecited by 97
- 2021Neural Scene Flow Priorcited by 91
- 2023Test-Time Training on Nearest Neighbors for Large Language Modelscited by 88
- 2020PV-RAFT: Point-Voxel Correlation Fields for Scene Flow Estimation of Point Cloudscited by 74
- 2020FlowStep3D: Model Unrolling for Self-Supervised Scene Flow Estimationcited by 71
- 2020Tent: Fully Test-time Adaptation by Entropy Minimizationcited by 69
- 2020Self-Supervised Monocular Scene Flow Estimationcited by 64
- 2022Meta-DMoE: Adapting to Domain Shift by Meta-Distillation from Mixture-of-Expertscited by 50
- 2020Scene Flow from Point Clouds with or without Learningcited by 44
- 2021Self-Point-Flow: Self-Supervised Scene Flow Estimation from Point Clouds with Optimal Transport and Random Walkcited by 39
- 2019PointPWC-Net: A Coarse-to-Fine Network for Supervised and Self-Supervised Scene Flow Estimation on 3D Point Cloudscited by 38
- 2022Bi-PointFlowNet: Bidirectional Learning for Point Cloud Based Scene Flow Estimationcited by 38
- 2021HCRF-Flow: Scene Flow from Point Clouds with Continuous High-order CRFs and Position-aware Flow Embeddingcited by 36
- 2024ICP-Flow: LiDAR Scene Flow Estimation with ICPcited by 35
- 2023LODE: Locally Conditioned Eikonal Implicit Scene Completion from Sparse LiDARcited by 31
- 2019Interactive segmentation of medical images through fully convolutional neural networkscited by 29
- 2022SCOOP: Self-Supervised Correspondence and Optimization-Based Scene Flowcited by 28
- 2023Diffusion-TTA: Test-time Adaptation of Discriminative Models via Generative Feedbackcited by 27
- 2021PQ-Transformer: Jointly Parsing 3D Objects and Layouts from Point Cloudscited by 26
- 2023Self-Supervised 3D Scene Flow Estimation Guided by Superpointscited by 24
- 2021SCTN: Sparse Convolution-Transformer Network for Scene Flow Estimationcited by 23
- 2023Point-TTA: Test-Time Adaptation for Point Cloud Registration Using Multitask Meta-Auxiliary Learningcited by 23
- 2022VIBUS: Data-efficient 3D Scene Parsing with VIewpoint Bottleneck and Uncertainty-Spectrum Modelingcited by 21
- 20233D Implicit Transporter for Temporally Consistent Keypoint Discoverycited by 20
- 2023From Semi-supervised to Omni-supervised Room Layout Estimation Using Point Cloudscited by 18
- 2024FastMAC: Stochastic Spectral Sampling of Correspondence Graphcited by 16
- 2022SC-wLS: Towards Interpretable Feed-forward Camera Re-localizationcited by 14
- 2024GDA: Generalized Diffusion for Robust Test-time Adaptationcited by 14
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2025: 1.
1 paper.