U2Flow: Uncertainty-Aware Unsupervised Optical Flow Estimation
Not on the map. Why?
Abstract (arXiv)
Unsupervised optical flow methods typically lack reliable uncertainty estimation, limiting their robustness and interpretability. We propose U2Flow, the first recurrent unsupervised framework that jointly estimates optical flow and per-pixel uncertainty. The core innovation is a decoupled learning strategy that derives uncertainty supervision from augmentation consistency via a Laplace-based maximum likelihood objective, enabling stable training without ground truth. The predicted uncertainty is further integrated into the network to guide adaptive flow refinement and dynamically modulate the regional smoothness loss. Furthermore, we introduce an uncertainty-guided bidirectional flow fusion mechanism that enhances robustness in challenging regions. Extensive experiments on KITTI and Sintel demonstrate that U2Flow achieves state-of-the-art performance among unsupervised methods while producing highly reliable uncertainty maps, validating the effectiveness of our joint estimation paradigm. The code is available at https://github.com/sunzunyi/U2FLOW.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 42 of its 64 references that are in the map. First posted on arXiv 11 Apr 2026.
Builds on
42 of 64 references.
References · 42
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
- 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
- 2021GMFlow: Learning Optical Flow via Global Matchingcited by 324
- 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 273
- 2021Learning to Estimate Hidden Motions with Global Motion Aggregationcited by 223
- 2017UnFlow: Unsupervised Learning of Optical Flow with a Bidirectional Census Losscited by 202
- 2020On the uncertainty of self-supervised monocular depth estimationcited by 182
- 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 170
- 2017Playing for Benchmarkscited by 169
- 2018Uncertainty Estimates and Multi-Hypotheses Networks for Optical Flowcited by 135
30 more
- 2019SelFlow: Self-Supervised Learning of Optical Flowcited by 128
- 2020What Matters in Unsupervised Optical Flowcited by 124
- 2020Learning by Analogy: Reliable Supervision from Transformations for Unsupervised Optical Flow Estimationcited by 120
- 2023FlowFormer++: Masked Cost Volume Autoencoding for Pretraining Optical Flow Estimationcited by 114
- 2021AutoFlow: Learning a Better Training Set for Optical Flowcited by 102
- 2017Occlusion Aware Unsupervised Learning of Optical Flowcited by 101
- 2018Models Matter, So Does Training: An Empirical Study of CNNs for Optical Flow Estimationcited by 94
- 2018Hierarchical Discrete Distribution Decomposition for Match Density Estimationcited by 93
- 2023VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimationcited by 82
- 2021PDC-Net+: Enhanced Probabilistic Dense Correspondence Networkcited by 80
- 2018Lightweight Probabilistic Deep Networkscited by 77
- 2021SMURF: Self-Teaching Multi-Frame Unsupervised RAFT with Full-Image Warpingcited by 74
- 2019DDFlow: Learning Optical Flow with Unlabeled Data Distillationcited by 63
- 2023Dense Optical Tracking: Connecting the Dotscited by 58
- 2021IterMVS: Iterative Probability Estimation for Efficient Multi-View Stereocited by 56
- 2024MemFlow: Optical Flow Estimation and Prediction with Memorycited by 55
- 2020UPFlow: Upsampling Pyramid for Unsupervised Optical Flow Learningcited by 49
- 2020Flow2Stereo: Effective Self-Supervised Learning of Optical Flow and Stereo Matchingcited by 36
- 2022Disentangling Architecture and Training for Optical Flowcited by 32
- 2022OcclusionFusion: Occlusion-aware Motion Estimation for Real-time Dynamic 3D Reconstructioncited by 27
- 2017ProbFlow: Joint Optical Flow and Uncertainty Estimationcited by 24
- 2022Optical Flow Training under Limited Label Budget via Active Learningcited by 14
- 2023Manydepth2: Motion-Aware Self-Supervised Monocular Depth Estimation in Dynamic Scenescited by 12
- 2022Cross-Attention Transformer for Video Interpolationcited by 10
- 2022Self-supervised AutoFlowcited by 10
- 2023Optical Flow for Autonomous Driving: Applications, Challenges and Improvementscited by 9
- 2023SemARFlow: Injecting Semantics into Unsupervised Optical Flow Estimation for Autonomous Drivingcited by 9
- 2024UnSAMFlow: Unsupervised Optical Flow Guided by Segment Anything Modelcited by 8
- 2023Optical Flow boosts Unsupervised Localization and Segmentationcited by 7
- 2024DiffSF: Diffusion Models for Scene Flow Estimationcited by 6
Built on by
Not cited yet.