mlsanityData to 14 Oct 2026

GenOpticalFlow: A Generative Approach to Unsupervised Optical Flow Learning

arXiv 2603.22270 ↗First posted 23 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Optical flow estimation is a fundamental problem in computer vision, yet the reliance on expensive ground-truth annotations limits the scalability of supervised approaches. Although unsupervised and semi-supervised methods alleviate this issue, they often suffer from unreliable supervision signals based on brightness constancy and smoothness assumptions, leading to inaccurate motion estimation in complex real-world scenarios. To overcome these limitations, we introduce modelname, a novel framework that synthesizes large-scale, perfectly aligned frame--flow data pairs for supervised optical flow training without human annotations. Specifically, our method leverages a pre-trained depth estimation network to generate pseudo optical flows, which serve as conditioning inputs for a next-frame generation model trained to produce high-fidelity, pixel-aligned subsequent frames. This process enables the creation of abundant, high-quality synthetic data with precise motion correspondence. Furthermore, we propose an textitinconsistent pixel filtering strategy that identifies and removes unreliable pixels in generated frames, effectively enhancing fine-tuning performance on real-world datasets. Extensive experiments on KITTI2012, KITTI2015, and Sintel demonstrate that modelname achieves competitive or superior results compared to existing unsupervised and semi-supervised approaches, highlighting its potential as a scalable and annotation-free solution for optical flow learning. We will release our code upon acceptance.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 49 of its 67 references that are in the map. First posted on arXiv 23 Mar 2026.

Builds on

49 of 67 references.

References · 49

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  5. 2020Denoising Diffusion Implicit Modelscited by 9,781
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  8. 2022Classifier-Free Diffusion Guidancecited by 5,847
  9. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  10. 2024Depth Anything V2cited by 1,422
  11. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  12. 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,059
37 more
  1. 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 968
  2. 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 784
  3. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
  4. 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
  5. 2021GMFlow: Learning Optical Flow via Global Matchingcited by 327
  6. 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 275
  7. 2021Learning to Estimate Hidden Motions with Global Motion Aggregationcited by 224
  8. 20203D Photography using Context-aware Layered Depth Inpaintingcited by 206
  9. 2017UnFlow: Unsupervised Learning of Optical Flow with a Bidirectional Census Losscited by 202
  10. 2017Computer Vision for Autonomous Vehicles: Problems, Datasets and State of the Artcited by 182
  11. 2019Quadratic video interpolationcited by 145
  12. 2022MonoViT: Self-Supervised Monocular Depth Estimation with a Vision Transformercited by 136
  13. 2019SelFlow: Self-Supervised Learning of Optical Flowcited by 128
  14. 2020What Matters in Unsupervised Optical Flowcited by 124
  15. 2023FlowFormer++: Masked Cost Volume Autoencoding for Pretraining Optical Flow Estimationcited by 114
  16. 2017Occlusion Aware Unsupervised Learning of Optical Flowcited by 101
  17. 2017Optical Flow Guided Feature: A Fast and Robust Motion Representation for Video Action Recognitioncited by 82
  18. 2021SMURF: Self-Teaching Multi-Frame Unsupervised RAFT with Full-Image Warpingcited by 74
  19. 2024GenWarp: Single Image to Novel Views with Semantic-Preserving Generative Warpingcited by 73
  20. 2022Global Matching with Overlapping Attention for Optical Flow Estimationcited by 64
  21. 2019DDFlow: Learning Optical Flow with Unlabeled Data Distillationcited by 63
  22. 2022Deformable Sprites for Unsupervised Video Decompositioncited by 61
  23. 2018Representation Flow for Action Recognitioncited by 51
  24. 2020UPFlow: Upsampling Pyramid for Unsupervised Optical Flow Learningcited by 49
  25. 2022RealFlow: EM-based Realistic Optical Flow Dataset Generation from Videoscited by 22
  26. 2020Optical Flow in Dense Foggy Scenes using Semi-Supervised Learningcited by 20
  27. 2018Monocular Depth Estimation using Multi-Scale Continuous CRFs as Sequential Deep Networkscited by 19
  28. 2022Optical Flow Training under Limited Label Budget via Active Learningcited by 14
  29. 2022Self-supervised AutoFlowcited by 10
  30. 2022Semi-Supervised Learning of Optical Flow by Flow Supervisorcited by 9
  31. 2023SemARFlow: Injecting Semantics into Unsupervised Optical Flow Estimation for Autonomous Drivingcited by 9
  32. 2024UnSAMFlow: Unsupervised Optical Flow Guided by Segment Anything Modelcited by 8
  33. 2025Towards Open-World Generation of Stereo Images and Unsupervised Matchingcited by 6
  34. 2022CLIP-FLow: Contrastive Learning by semi-supervised Iterative Pseudo labeling for Optical Flow Estimationcited by 4
  35. 2023StereoFlowGAN: Co-training for Stereo and Flow with Unsupervised Domain Adaptationcited by 4
  36. 2023Unsupervised Learning Optical Flow in Multi-frame Dynamic Environment Using Temporal Dynamic Modelingcited by 2
  37. 2023FlowDA: Unsupervised Domain Adaptive Framework for Optical Flow Estimationcited by 1

Built on by

Not cited yet.