DDFlow: Learning Optical Flow with Unlabeled Data Distillation
Not on the map. Why?
Abstract (arXiv)
We present DDFlow, a data distillation approach to learning optical flow estimation from unlabeled data. The approach distills reliable predictions from a teacher network, and uses these predictions as annotations to guide a student network to learn optical flow. Unlike existing work relying on hand-crafted energy terms to handle occlusion, our approach is data-driven, and learns optical flow for occluded pixels. This enables us to train our model with a much simpler loss function, and achieve a much higher accuracy. We conduct a rigorous evaluation on the challenging Flying Chairs, MPI Sintel, KITTI 2012 and 2015 benchmarks, and show that our approach significantly outperforms all existing unsupervised learning methods, while running at real time.
Key facts. Cited by 63 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 17; 2023: 11; 2024: 9; 2025: 4; 2026: 4.
63 papers.
Sort:
By area:
- 2024CoTracker3: Simpler and Better Point Tracking by Pseudo-Labelling Real Videoscited by 122
- 2024BootsTAP: Bootstrapped Training for Tracking-Any-Pointcited by 115
- 2022IFRNet: Intermediate Feature Refine Network for Efficient Frame Interpolationcited by 107
- 2021PDC-Net+: Enhanced Probabilistic Dense Correspondence Networkcited by 80
- 2021SMURF: Self-Teaching Multi-Frame Unsupervised RAFT with Full-Image Warpingcited by 74
- 2023MC-JEPA: A Joint-Embedding Predictive Architecture for Self-Supervised Learning of Motion and Content Featurescited by 53
- 2021Warp Consistency for Unsupervised Learning of Dense Correspondencescited by 42
- 2022Learning Pixel Trajectories with Multiscale Contrastive Random Walkscited by 36
- 2021Self-Supervised Multi-Frame Monocular Scene Flowcited by 29
- 2021Learning optical flow from still imagescited by 28
- 2022Imposing Consistency for Optical Flow Estimationcited by 24
- 2022RealFlow: EM-based Realistic Optical Flow Dataset Generation from Videoscited by 22
38 more
- 2021Weakly Supervised Instance Segmentation for Videos with Temporal Mask Consistencycited by 19
- 2023Categories of Response-Based, Feature-Based, and Relation-Based Knowledge Distillationcited by 19
- 2021Comparing Correspondences: Video Prediction with Correspondence-wise Lossescited by 16
- 2022Semi-Supervised Learning of Semantic Correspondence with Pseudo-Labelscited by 16
- 2021GyroFlow: Gyroscope-Guided Unsupervised Optical Flow Learningcited by 15
- 2022Spatial-then-Temporal Self-Supervised Learning for Video Correspondencecited by 13
- 2021Occlusion Guided Self-supervised Scene Flow Estimation on 3D Point Cloudscited by 11
- 2021Learning Contrastive Representation for Semantic Correspondencecited by 11
- 2024PooDLe: Pooled and dense self-supervised learning from naturalistic videoscited by 11
- 2022MDFlow: Unsupervised Optical Flow Learning by Reliable Mutual Knowledge Distillationcited by 10
- 2022Self-supervised AutoFlowcited by 10
- 2023GyroFlow+: Gyroscope-Guided Unsupervised Deep Homography and Optical Flow Learningcited by 10
- 2023Self-Supervised Motion Magnification by Backpropagating Through Optical Flowcited by 10
- 2024Self-Supervised Any-Point Tracking by Contrastive Random Walkscited by 10
- 2023SemARFlow: Injecting Semantics into Unsupervised Optical Flow Estimation for Autonomous Drivingcited by 9
- 2023Unsupervised Cumulative Domain Adaptation for Foggy Scene Optical Flowcited by 9
- 2025Flow-Anything: Learning Real-World Optical Flow Estimation from Large-Scale Single-view Imagescited by 9
- 2021ASFlow: Unsupervised Optical Flow Learning with Adaptive Pyramid Samplingcited by 8
- 2022SuperWarp: Supervised Learning and Warping on U-Net for Invariant Subvoxel-Precise Registrationcited by 8
- 2022Learning Depth from Focus in the Wildcited by 8
- 2023DS-Depth: Dynamic and Static Depth Estimation via a Fusion Cost Volumecited by 8
- 2024UnSAMFlow: Unsupervised Optical Flow Guided by Segment Anything Modelcited by 8
- 2021The Augmented Image Prior: Distilling 1000 Classes by Extrapolating from a Single Imagecited by 7
- 2022Unsupervised Learning of 3D Scene Flow from Monocular Cameracited by 7
- 2022GlobalFlowNet: Video Stabilization using Deep Distilled Global Motion Estimatescited by 7
- 2021LIFE: Lighting Invariant Flow Estimationcited by 6
- 2021Learning by Distillation: A Self-Supervised Learning Framework for Optical Flow Estimationcited by 6
- 2024LLM See, LLM Do: Guiding Data Generation to Target Non-Differentiable Objectivescited by 6
- 2025Instance-Level Moving Object Segmentation from a Single Image with Eventscited by 6
- 2025Bridge Frame and Event: Common Spatiotemporal Fusion for High-Dynamic Scene Optical Flowcited by 5
- 2021Sensor-Guided Optical Flowcited by 4
- 2022Box Supervised Video Segmentation Proposal Networkcited by 4
- 2022Learning to Estimate and Refine Fluid Motion with Physical Dynamicscited by 4
- 2024Adverse Weather Optical Flow: Cumulative Homogeneous-Heterogeneous Adaptationcited by 4
- 2021NccFlow: Unsupervised Learning of Optical Flow With Non-occlusion from Geometrycited by 3
- 2023Unsupervised Hierarchical Domain Adaptation for Adverse Weather Optical Flowcited by 3
- 2021Unsupervised Motion Representation Enhanced Network for Action Recognitioncited by 2
- 2023Unsupervised Learning Optical Flow in Multi-frame Dynamic Environment Using Temporal Dynamic Modelingcited by 2
50 most cited of 63 All 63 (JSON)
- 2026Triangular Consistency as a Universal Constraint for Learning Optical Flow18 Jun 2026
- 2026DIMOS: Disentangling Instance-level Moving Object Segmentation11 Jun 2026
- 2026U2Flow: Uncertainty-Aware Unsupervised Optical Flow Estimation11 Apr 2026
- 2026GenOpticalFlow: A Generative Approach to Unsupervised Optical Flow Learning23 Mar 2026
- 2025HKT: A Biologically Inspired Framework for Modular Hereditary Knowledge Transfer in Neural Networks13 Aug 2025
- 2025Flow-Anything: Learning Real-World Optical Flow Estimation from Large-Scale Single-view Images9 Jun 2025
- 2025Bridge Frame and Event: Common Spatiotemporal Fusion for High-Dynamic Scene Optical Flow10 Mar 2025
- 2025Instance-Level Moving Object Segmentation from a Single Image with Events18 Feb 2025
- 2024Breaking The Ice: Video Segmentation for Close-Range Ice-Covered Waters7 Nov 2024
- 2024CoTracker3: Simpler and Better Point Tracking by Pseudo-Labelling Real Videos15 Oct 2024
- 2024Adverse Weather Optical Flow: Cumulative Homogeneous-Heterogeneous Adaptation25 Sep 2024
- 2024Self-Supervised Any-Point Tracking by Contrastive Random Walks24 Sep 2024
38 more
- 2024PooDLe: Pooled and dense self-supervised learning from naturalistic videos20 Aug 2024
- 2024LLM See, LLM Do: Guiding Data Generation to Target Non-Differentiable Objectives1 Jul 2024
- 2024UnSAMFlow: Unsupervised Optical Flow Guided by Segment Anything Model4 May 2024
- 2024BootsTAP: Bootstrapped Training for Tracking-Any-Point1 Feb 2024
- 2024Key-point Guided Deformable Image Manipulation Using Diffusion Model16 Jan 2024
- 2023Self-Supervised Motion Magnification by Backpropagating Through Optical Flow28 Nov 2023
- 2023UFD-PRiME: Unsupervised Joint Learning of Optical Flow and Stereo Depth through Pixel-Level Rigid Motion Estimation7 Oct 2023
- 2023DS-Depth: Dynamic and Static Depth Estimation via a Fusion Cost Volume14 Aug 2023
- 2023MC-JEPA: A Joint-Embedding Predictive Architecture for Self-Supervised Learning of Motion and Content Features24 Jul 2023
- 2023Categories of Response-Based, Feature-Based, and Relation-Based Knowledge Distillation19 Jun 2023
- 2023SSTM: Spatiotemporal Recurrent Transformers for Multi-frame Optical Flow Estimation26 Apr 2023
- 2023Unsupervised Learning Optical Flow in Multi-frame Dynamic Environment Using Temporal Dynamic Modeling14 Apr 2023
- 2023Unsupervised Hierarchical Domain Adaptation for Adverse Weather Optical Flow24 Mar 2023
- 2023Unsupervised Cumulative Domain Adaptation for Foggy Scene Optical Flow14 Mar 2023
- 2023SemARFlow: Injecting Semantics into Unsupervised Optical Flow Estimation for Autonomous Driving10 Mar 2023
- 2023GyroFlow+: Gyroscope-Guided Unsupervised Deep Homography and Optical Flow Learning23 Jan 2023
- 2022Self-supervised AutoFlow4 Dec 2022
- 2022MDFlow: Unsupervised Optical Flow Learning by Reliable Mutual Knowledge Distillation11 Nov 2022
- 2022GlobalFlowNet: Video Stabilization using Deep Distilled Global Motion Estimates25 Oct 2022
- 2022Spatial-then-Temporal Self-Supervised Learning for Video Correspondence16 Sep 2022
- 2022RealFlow: EM-based Realistic Optical Flow Dataset Generation from Videos22 Jul 2022
- 2022Learning Depth from Focus in the Wild20 Jul 2022
- 2022USegScene: Unsupervised Learning of Depth, Optical Flow and Ego-Motion with Semantic Guidance and Coupled Networks15 Jul 2022
- 2022Complementing Brightness Constancy with Deep Networks for Optical Flow Prediction8 Jul 2022
- 2022Learning to Estimate and Refine Fluid Motion with Physical Dynamics21 Jun 2022
- 2022Unsupervised Learning of 3D Scene Flow from Monocular Camera8 Jun 2022
- 2022IFRNet: Intermediate Feature Refine Network for Efficient Frame Interpolation29 May 2022
- 2022SuperWarp: Supervised Learning and Warping on U-Net for Invariant Subvoxel-Precise Registration15 May 2022
- 2022Imposing Consistency for Optical Flow Estimation14 Apr 2022
- 2022Joint Learning of Feature Extraction and Cost Aggregation for Semantic Correspondence5 Apr 2022
- 2022Semi-Supervised Learning of Semantic Correspondence with Pseudo-Labels30 Mar 2022
- 2022Box Supervised Video Segmentation Proposal Network14 Feb 2022
- 2022Learning Pixel Trajectories with Multiscale Contrastive Random Walks20 Jan 2022
- 2021The Augmented Image Prior: Distilling 1000 Classes by Extrapolating from a Single Image1 Dec 2021
- 2021Sensor-Guided Optical Flow30 Sep 2021
- 2021PDC-Net+: Enhanced Probabilistic Dense Correspondence Network28 Sep 2021
- 2021Learning Contrastive Representation for Semantic Correspondence22 Sep 2021
- 2021NccFlow: Unsupervised Learning of Optical Flow With Non-occlusion from Geometry8 Jul 2021
50 newest of 63 All 63 (JSON)
- 2024CoTracker3: Simpler and Better Point Tracking by Pseudo-Labelling Real Videoscited by 122
- 2024BootsTAP: Bootstrapped Training for Tracking-Any-Pointcited by 115
- 2022IFRNet: Intermediate Feature Refine Network for Efficient Frame Interpolationcited by 107
- 2021PDC-Net+: Enhanced Probabilistic Dense Correspondence Networkcited by 80
- 2021SMURF: Self-Teaching Multi-Frame Unsupervised RAFT with Full-Image Warpingcited by 74
- 2023MC-JEPA: A Joint-Embedding Predictive Architecture for Self-Supervised Learning of Motion and Content Featurescited by 53
- 2021Warp Consistency for Unsupervised Learning of Dense Correspondencescited by 42
- 2022Learning Pixel Trajectories with Multiscale Contrastive Random Walkscited by 36
- 2021Self-Supervised Multi-Frame Monocular Scene Flowcited by 29
- 2021Learning optical flow from still imagescited by 28
- 2022Imposing Consistency for Optical Flow Estimationcited by 24
- 2022RealFlow: EM-based Realistic Optical Flow Dataset Generation from Videoscited by 22
12 most cited of 62 All 62 (JSON)
- 2026Triangular Consistency as a Universal Constraint for Learning Optical Flow18 Jun 2026
- 2026DIMOS: Disentangling Instance-level Moving Object Segmentation11 Jun 2026
- 2026U2Flow: Uncertainty-Aware Unsupervised Optical Flow Estimation11 Apr 2026
- 2026GenOpticalFlow: A Generative Approach to Unsupervised Optical Flow Learning23 Mar 2026
- 2025HKT: A Biologically Inspired Framework for Modular Hereditary Knowledge Transfer in Neural Networks13 Aug 2025
- 2025Flow-Anything: Learning Real-World Optical Flow Estimation from Large-Scale Single-view Images9 Jun 2025
- 2025Bridge Frame and Event: Common Spatiotemporal Fusion for High-Dynamic Scene Optical Flow10 Mar 2025
- 2025Instance-Level Moving Object Segmentation from a Single Image with Events18 Feb 2025
- 2024Breaking The Ice: Video Segmentation for Close-Range Ice-Covered Waters7 Nov 2024
- 2024CoTracker3: Simpler and Better Point Tracking by Pseudo-Labelling Real Videos15 Oct 2024
- 2024Adverse Weather Optical Flow: Cumulative Homogeneous-Heterogeneous Adaptation25 Sep 2024
- 2024Self-Supervised Any-Point Tracking by Contrastive Random Walks24 Sep 2024
12 newest of 62 All 62 (JSON)