UPFlow: Upsampling Pyramid for Unsupervised Optical Flow Learning
Not on the map. Why?
Abstract (arXiv)
We present an unsupervised learning approach for optical flow estimation by improving the upsampling and learning of pyramid network. We design a self-guided upsample module to tackle the interpolation blur problem caused by bilinear upsampling between pyramid levels. Moreover, we propose a pyramid distillation loss to add supervision for intermediate levels via distilling the finest flow as pseudo labels. By integrating these two components together, our method achieves the best performance for unsupervised optical flow learning on multiple leading benchmarks, including MPI-SIntel, KITTI 2012 and KITTI 2015. In particular, we achieve EPE=1.4 on KITTI 2012 and F1=9.38% on KITTI 2015, which outperform the previous state-of-the-art methods by 22.2% and 15.7%, respectively.
Key facts. Cited by 49 papers in the map (data through 14 Oct 2026). First posted on arXiv 1 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 11; 2023: 19; 2024: 8; 2025: 6; 2026: 3.
49 papers.
Sort:
By area:
- 2023FlowFormer++: Masked Cost Volume Autoencoding for Pretraining Optical Flow Estimationcited by 114
- 2023MC-JEPA: A Joint-Embedding Predictive Architecture for Self-Supervised Learning of Motion and Content Featurescited by 57
- 2023A Dynamic Multi-Scale Voxel Flow Network for Video Predictioncited by 53
- 2021ADNet: Attention-guided Deformable Convolutional Network for High Dynamic Range Imagingcited by 51
- 2022IFOR: Iterative Flow Minimization for Robotic Object Rearrangementcited by 42
- 2022Learning Pixel Trajectories with Multiscale Contrastive Random Walkscited by 36
- 2023TransFlow: Transformer as Flow Learnercited by 32
- 2023Learning Optical Flow from Event Camera with Rendered Datasetcited by 26
- 2025Event-Based Video Frame Interpolation With Cross-Modal Asymmetric Bidirectional Motion Fieldscited by 25
- 2022RealFlow: EM-based Realistic Optical Flow Dataset Generation from Videoscited by 22
- 2022Splatting-based Synthesis for Video Frame Interpolationcited by 20
- 2023GAFlow: Incorporating Gaussian Attention into Optical Flowcited by 18
37 more
- 2022Boosting Object Representation Learning via Motion and Object Continuitycited by 17
- 2021GyroFlow: Gyroscope-Guided Unsupervised Optical Flow Learningcited by 15
- 2024BiM-VFI: Bidirectional Motion Field-Guided Frame Interpolation for Video with Non-uniform Motionscited by 13
- 2022Solve the Puzzle of Instance Segmentation in Videos: A Weakly Supervised Framework with Spatio-Temporal Collaborationcited by 11
- 2022MDFlow: Unsupervised Optical Flow Learning by Reliable Mutual Knowledge Distillationcited by 10
- 2022Semi-supervised Deep Large-baseline Homography Estimation with Progressive Equivalence Constraintcited by 10
- 2023GyroFlow+: Gyroscope-Guided Unsupervised Deep Homography and Optical Flow Learningcited by 10
- 2022D3FlowSLAM: Self-Supervised Dynamic SLAM with Flow Motion Decomposition and DINO Guidancecited by 9
- 2023SemARFlow: Injecting Semantics into Unsupervised Optical Flow Estimation for Autonomous Drivingcited by 9
- 2023Unsupervised Cumulative Domain Adaptation for Foggy Scene Optical Flowcited by 9
- 2023ADFactory: An Effective Framework for Generalizing Optical Flow with Nerfcited by 9
- 2024UnSAMFlow: Unsupervised Optical Flow Guided by Segment Anything Modelcited by 8
- 2023MPI-Flow: Learning Realistic Optical Flow with Multiplane Imagescited by 7
- 2023Learning to Estimate Single-View Volumetric Flow Motions without 3D Supervisioncited by 5
- 2023Unsupervised Optical Flow Estimation with Dynamic Timing Representation for Spike Cameracited by 5
- 2023StereoFlowGAN: Co-training for Stereo and Flow with Unsupervised Domain Adaptationcited by 4
- 2024Adverse Weather Optical Flow: Cumulative Homogeneous-Heterogeneous Adaptationcited by 4
- 2024FLINT: Learning-based Flow Estimation and Temporal Interpolation for Scientific Ensemble Visualizationcited by 4
- 2022Unsupervised Flow Refinement near Motion Boundariescited by 3
- 2023Unsupervised Hierarchical Domain Adaptation for Adverse Weather Optical Flowcited by 3
- 2023FlowFormer: A Transformer Architecture and Its Masked Cost Volume Autoencoding for Optical Flowcited by 3
- 2024Ada-Tracker: Soft Tissue Tracking via Inter-Frame and Adaptive-Template Matchingcited by 3
- 2024Self-Assessed Generation: Trustworthy Label Generation for Optical Flow and Stereo Matching in Real-worldcited by 3
- 2024Towards Dependable Optical Flow: Benchmarks for Real-World Spatiotemporal Corruptionscited by 3
- 2025VTinker: Guided Flow Upsampling and Texture Mapping for High-Resolution Video Frame Interpolationcited by 3
- 2023Unsupervised Learning Optical Flow in Multi-frame Dynamic Environment Using Temporal Dynamic Modelingcited by 2
- 2025EMoTive: Event-guided Trajectory Modeling for 3D Motion Estimationcited by 2
- 2025Midway Network: Learning Representations for Recognition and Motion from Latent Dynamicscited by 2
- 2023UFD-PRiME: Unsupervised Joint Learning of Optical Flow and Stereo Depth through Pixel-Level Rigid Motion Estimationcited by 1
- 2025An Intra- and Cross-frame Topological Consistency Scheme for Semi-supervised Atherosclerotic Coronary Plaque Segmentationcited by 1
- 2025Rethinking Unsupervised Cross-modal Flow Estimation: Learning from Decoupled Optimization and Consistency Constraintcited by 1
- 2022Fully Convolutional Fractional Scalingcited by 0
- 2023IndGIC: Supervised Action Recognition under Low Illuminationcited by 0
- 2024Rethink Predicting the Optical Flow with the Kinetics Perspectivecited by 0
- 2026Two-Stream Interactive Joint Learning of Scene Parsing and Geometric Vision Taskscited by 0
- 2026GenOpticalFlow: A Generative Approach to Unsupervised Optical Flow Learningcited by 0
- 2026U2Flow: Uncertainty-Aware Unsupervised Optical Flow Estimationcited by 0
- 2026U2Flow: Uncertainty-Aware Unsupervised Optical Flow Estimation11 Apr 2026
- 2026GenOpticalFlow: A Generative Approach to Unsupervised Optical Flow Learning23 Mar 2026
- 2026Two-Stream Interactive Joint Learning of Scene Parsing and Geometric Vision Tasks14 Feb 2026
- 2025VTinker: Guided Flow Upsampling and Texture Mapping for High-Resolution Video Frame Interpolation20 Nov 2025
- 2025Midway Network: Learning Representations for Recognition and Motion from Latent Dynamics7 Oct 2025
- 2025Rethinking Unsupervised Cross-modal Flow Estimation: Learning from Decoupled Optimization and Consistency Constraint29 Sep 2025
- 2025EMoTive: Event-guided Trajectory Modeling for 3D Motion Estimation14 Mar 2025
- 2025Event-Based Video Frame Interpolation With Cross-Modal Asymmetric Bidirectional Motion Fields19 Feb 2025
- 2025An Intra- and Cross-frame Topological Consistency Scheme for Semi-supervised Atherosclerotic Coronary Plaque Segmentation14 Jan 2025
- 2024BiM-VFI: Bidirectional Motion Field-Guided Frame Interpolation for Video with Non-uniform Motions16 Dec 2024
- 2024Towards Dependable Optical Flow: Benchmarks for Real-World Spatiotemporal Corruptions22 Nov 2024
- 2024Self-Assessed Generation: Trustworthy Label Generation for Optical Flow and Stereo Matching in Real-world14 Oct 2024
37 more
- 2024FLINT: Learning-based Flow Estimation and Temporal Interpolation for Scientific Ensemble Visualization27 Sep 2024
- 2024Adverse Weather Optical Flow: Cumulative Homogeneous-Heterogeneous Adaptation25 Sep 2024
- 2024Rethink Predicting the Optical Flow with the Kinetics Perspective21 May 2024
- 2024UnSAMFlow: Unsupervised Optical Flow Guided by Segment Anything Model4 May 2024
- 2024Ada-Tracker: Soft Tissue Tracking via Inter-Frame and Adaptive-Template Matching11 Mar 2024
- 2023ADFactory: An Effective Framework for Generalizing Optical Flow with Nerf7 Nov 2023
- 2023UFD-PRiME: Unsupervised Joint Learning of Optical Flow and Stereo Depth through Pixel-Level Rigid Motion Estimation7 Oct 2023
- 2023GAFlow: Incorporating Gaussian Attention into Optical Flow28 Sep 2023
- 2023MPI-Flow: Learning Realistic Optical Flow with Multiplane Images13 Sep 2023
- 2023StereoFlowGAN: Co-training for Stereo and Flow with Unsupervised Domain Adaptation4 Sep 2023
- 2023IndGIC: Supervised Action Recognition under Low Illumination29 Aug 2023
- 2023MC-JEPA: A Joint-Embedding Predictive Architecture for Self-Supervised Learning of Motion and Content Features24 Jul 2023
- 2023Unsupervised Optical Flow Estimation with Dynamic Timing Representation for Spike Camera12 Jul 2023
- 2023FlowFormer: A Transformer Architecture and Its Masked Cost Volume Autoencoding for Optical Flow8 Jun 2023
- 2023TransFlow: Transformer as Flow Learner23 Apr 2023
- 2023Unsupervised Learning Optical Flow in Multi-frame Dynamic Environment Using Temporal Dynamic Modeling14 Apr 2023
- 2023Unsupervised Hierarchical Domain Adaptation for Adverse Weather Optical Flow24 Mar 2023
- 2023Learning Optical Flow from Event Camera with Rendered Dataset20 Mar 2023
- 2023A Dynamic Multi-Scale Voxel Flow Network for Video Prediction17 Mar 2023
- 2023Unsupervised Cumulative Domain Adaptation for Foggy Scene Optical Flow14 Mar 2023
- 2023SemARFlow: Injecting Semantics into Unsupervised Optical Flow Estimation for Autonomous Driving10 Mar 2023
- 2023FlowFormer++: Masked Cost Volume Autoencoding for Pretraining Optical Flow Estimation2 Mar 2023
- 2023Learning to Estimate Single-View Volumetric Flow Motions without 3D Supervision28 Feb 2023
- 2023GyroFlow+: Gyroscope-Guided Unsupervised Deep Homography and Optical Flow Learning23 Jan 2023
- 2022Solve the Puzzle of Instance Segmentation in Videos: A Weakly Supervised Framework with Spatio-Temporal Collaboration15 Dec 2022
- 2022Semi-supervised Deep Large-baseline Homography Estimation with Progressive Equivalence Constraint6 Dec 2022
- 2022Boosting Object Representation Learning via Motion and Object Continuity16 Nov 2022
- 2022MDFlow: Unsupervised Optical Flow Learning by Reliable Mutual Knowledge Distillation11 Nov 2022
- 2022Unsupervised Flow Refinement near Motion Boundaries3 Aug 2022
- 2022RealFlow: EM-based Realistic Optical Flow Dataset Generation from Videos22 Jul 2022
- 2022D3FlowSLAM: Self-Supervised Dynamic SLAM with Flow Motion Decomposition and DINO Guidance18 Jul 2022
- 2022Fully Convolutional Fractional Scaling20 Mar 2022
- 2022IFOR: Iterative Flow Minimization for Robotic Object Rearrangement1 Feb 2022
- 2022Splatting-based Synthesis for Video Frame Interpolation25 Jan 2022
- 2022Learning Pixel Trajectories with Multiscale Contrastive Random Walks20 Jan 2022
- 2021ADNet: Attention-guided Deformable Convolutional Network for High Dynamic Range Imaging22 May 2021
- 2021GyroFlow: Gyroscope-Guided Unsupervised Optical Flow Learning25 Mar 2021
- 2023FlowFormer++: Masked Cost Volume Autoencoding for Pretraining Optical Flow Estimationcited by 114
- 2023MC-JEPA: A Joint-Embedding Predictive Architecture for Self-Supervised Learning of Motion and Content Featurescited by 57
- 2023A Dynamic Multi-Scale Voxel Flow Network for Video Predictioncited by 53
- 2021ADNet: Attention-guided Deformable Convolutional Network for High Dynamic Range Imagingcited by 51
- 2022IFOR: Iterative Flow Minimization for Robotic Object Rearrangementcited by 42
- 2022Learning Pixel Trajectories with Multiscale Contrastive Random Walkscited by 36
- 2023TransFlow: Transformer as Flow Learnercited by 32
- 2023Learning Optical Flow from Event Camera with Rendered Datasetcited by 26
- 2025Event-Based Video Frame Interpolation With Cross-Modal Asymmetric Bidirectional Motion Fieldscited by 25
- 2022RealFlow: EM-based Realistic Optical Flow Dataset Generation from Videoscited by 22
- 2022Splatting-based Synthesis for Video Frame Interpolationcited by 20
- 2023GAFlow: Incorporating Gaussian Attention into Optical Flowcited by 18
12 most cited of 48 All 48 (JSON)
- 2026U2Flow: Uncertainty-Aware Unsupervised Optical Flow Estimation11 Apr 2026
- 2026GenOpticalFlow: A Generative Approach to Unsupervised Optical Flow Learning23 Mar 2026
- 2026Two-Stream Interactive Joint Learning of Scene Parsing and Geometric Vision Tasks14 Feb 2026
- 2025VTinker: Guided Flow Upsampling and Texture Mapping for High-Resolution Video Frame Interpolation20 Nov 2025
- 2025Midway Network: Learning Representations for Recognition and Motion from Latent Dynamics7 Oct 2025
- 2025Rethinking Unsupervised Cross-modal Flow Estimation: Learning from Decoupled Optimization and Consistency Constraint29 Sep 2025
- 2025EMoTive: Event-guided Trajectory Modeling for 3D Motion Estimation14 Mar 2025
- 2025Event-Based Video Frame Interpolation With Cross-Modal Asymmetric Bidirectional Motion Fields19 Feb 2025
- 2025An Intra- and Cross-frame Topological Consistency Scheme for Semi-supervised Atherosclerotic Coronary Plaque Segmentation14 Jan 2025
- 2024BiM-VFI: Bidirectional Motion Field-Guided Frame Interpolation for Video with Non-uniform Motions16 Dec 2024
- 2024Towards Dependable Optical Flow: Benchmarks for Real-World Spatiotemporal Corruptions22 Nov 2024
- 2024Self-Assessed Generation: Trustworthy Label Generation for Optical Flow and Stereo Matching in Real-world14 Oct 2024
12 newest of 48 All 48 (JSON)