mlsanityData to 7 Oct 2026

U2Flow: Uncertainty-Aware Unsupervised Optical Flow Estimation

arXiv 2604.10056 ↗First posted 11 Apr 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Unsupervised optical flow methods typically lack reliable uncertainty estimation, limiting their robustness and interpretability. We propose U2Flow, the first recurrent unsupervised framework that jointly estimates optical flow and per-pixel uncertainty. The core innovation is a decoupled learning strategy that derives uncertainty supervision from augmentation consistency via a Laplace-based maximum likelihood objective, enabling stable training without ground truth. The predicted uncertainty is further integrated into the network to guide adaptive flow refinement and dynamically modulate the regional smoothness loss. Furthermore, we introduce an uncertainty-guided bidirectional flow fusion mechanism that enhances robustness in challenging regions. Extensive experiments on KITTI and Sintel demonstrate that U2Flow achieves state-of-the-art performance among unsupervised methods while producing highly reliable uncertainty maps, validating the effectiveness of our joint estimation paradigm. The code is available at https://github.com/sunzunyi/U2FLOW.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 42 of its 64 references that are in the map. First posted on arXiv 11 Apr 2026.

Builds on

42 of 64 references.

References · 42

  1. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  2. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  3. 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
  4. 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
  5. 2021GMFlow: Learning Optical Flow via Global Matchingcited by 324
  6. 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 273
  7. 2021Learning to Estimate Hidden Motions with Global Motion Aggregationcited by 223
  8. 2017UnFlow: Unsupervised Learning of Optical Flow with a Bidirectional Census Losscited by 202
  9. 2020On the uncertainty of self-supervised monocular depth estimationcited by 182
  10. 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 170
  11. 2017Playing for Benchmarkscited by 169
  12. 2018Uncertainty Estimates and Multi-Hypotheses Networks for Optical Flowcited by 135
30 more
  1. 2019SelFlow: Self-Supervised Learning of Optical Flowcited by 128
  2. 2020What Matters in Unsupervised Optical Flowcited by 124
  3. 2020Learning by Analogy: Reliable Supervision from Transformations for Unsupervised Optical Flow Estimationcited by 120
  4. 2023FlowFormer++: Masked Cost Volume Autoencoding for Pretraining Optical Flow Estimationcited by 114
  5. 2021AutoFlow: Learning a Better Training Set for Optical Flowcited by 102
  6. 2017Occlusion Aware Unsupervised Learning of Optical Flowcited by 101
  7. 2018Models Matter, So Does Training: An Empirical Study of CNNs for Optical Flow Estimationcited by 94
  8. 2018Hierarchical Discrete Distribution Decomposition for Match Density Estimationcited by 93
  9. 2023VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimationcited by 82
  10. 2021PDC-Net+: Enhanced Probabilistic Dense Correspondence Networkcited by 80
  11. 2018Lightweight Probabilistic Deep Networkscited by 77
  12. 2021SMURF: Self-Teaching Multi-Frame Unsupervised RAFT with Full-Image Warpingcited by 74
  13. 2019DDFlow: Learning Optical Flow with Unlabeled Data Distillationcited by 63
  14. 2023Dense Optical Tracking: Connecting the Dotscited by 58
  15. 2021IterMVS: Iterative Probability Estimation for Efficient Multi-View Stereocited by 56
  16. 2024MemFlow: Optical Flow Estimation and Prediction with Memorycited by 55
  17. 2020UPFlow: Upsampling Pyramid for Unsupervised Optical Flow Learningcited by 49
  18. 2020Flow2Stereo: Effective Self-Supervised Learning of Optical Flow and Stereo Matchingcited by 36
  19. 2022Disentangling Architecture and Training for Optical Flowcited by 32
  20. 2022OcclusionFusion: Occlusion-aware Motion Estimation for Real-time Dynamic 3D Reconstructioncited by 27
  21. 2017ProbFlow: Joint Optical Flow and Uncertainty Estimationcited by 24
  22. 2022Optical Flow Training under Limited Label Budget via Active Learningcited by 14
  23. 2023Manydepth2: Motion-Aware Self-Supervised Monocular Depth Estimation in Dynamic Scenescited by 12
  24. 2022Cross-Attention Transformer for Video Interpolationcited by 10
  25. 2022Self-supervised AutoFlowcited by 10
  26. 2023Optical Flow for Autonomous Driving: Applications, Challenges and Improvementscited by 9
  27. 2023SemARFlow: Injecting Semantics into Unsupervised Optical Flow Estimation for Autonomous Drivingcited by 9
  28. 2024UnSAMFlow: Unsupervised Optical Flow Guided by Segment Anything Modelcited by 8
  29. 2023Optical Flow boosts Unsupervised Localization and Segmentationcited by 7
  30. 2024DiffSF: Diffusion Models for Scene Flow Estimationcited by 6

Built on by

Not cited yet.