MegaFlow: Zero-Shot Large Displacement Optical Flow
Not on the map. Why?
Abstract (arXiv)
Accurate estimation of large displacement optical flow remains a critical challenge. Existing methods typically rely on iterative local search or/and domain-specific fine-tuning, which severely limits their performance in large displacement and zero-shot generalization scenarios. To overcome this, we introduce MegaFlow, a simple yet powerful model for zero-shot large displacement optical flow. Rather than relying on highly complex, task-specific architectural designs, MegaFlow adapts powerful pre-trained vision priors to produce temporally consistent motion fields. In particular, we formulate flow estimation as a global matching problem by leveraging pre-trained global Vision Transformer features, which naturally capture large displacements. This is followed by a few lightweight iterative refinements to further improve the sub-pixel accuracy. Extensive experiments demonstrate that MegaFlow achieves state-of-the-art zero-shot performance across multiple optical flow benchmarks. Moreover, our model also delivers highly competitive zero-shot performance on long-range point tracking benchmarks, demonstrating its robust transferability and suggesting a unified paradigm for generalizable motion estimation. Our project page is at: https://kristen-z.github.io/projects/megaflow.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 58 of its 75 references that are in the map. First posted on arXiv 26 Mar 2026.
Builds on
58 of 75 references.
References · 58
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2022A ConvNet for the 2020scited by 3,545
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2024Depth Anything V2cited by 1,385
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
- 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
38 more
- 2023CoTracker: It is Better to Track Togethercited by 516
- 2024FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisioncited by 507
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 494
- 2016Optical Flow Estimation using a Spatial Pyramid Networkcited by 421
- 2022Kubric: A scalable dataset generatorcited by 373
- 2021GMFlow: Learning Optical Flow via Global Matchingcited by 324
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 274
- 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 273
- 2022Unifying Flow, Stereo and Depth Estimationcited by 270
- 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 258
- 2021Learning to Estimate Hidden Motions with Global Motion Aggregationcited by 223
- 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 170
- 2017Playing for Benchmarkscited by 169
- 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 169
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
- 2022CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flowcited by 165
- 2019GLU-Net: Global-Local Universal Network for Dense Flow and Correspondencescited by 139
- 2024CoTracker3: Simpler and Better Point Tracking by Pseudo-Labelling Real Videoscited by 122
- 2023The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimationcited by 116
- 2024BootsTAP: Bootstrapped Training for Tracking-Any-Pointcited by 115
- 2023FlowFormer++: Masked Cost Volume Autoencoding for Pretraining Optical Flow Estimationcited by 114
- 2023RoboTAP: Tracking Arbitrary Points for Few-Shot Visual Imitationcited by 88
- 2022CRAFT: Cross-Attentional Flow Transformer for Robust Optical Flowcited by 82
- 2023VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimationcited by 82
- 2024Local All-Pair Correspondence for Point Trackingcited by 77
- 2022Global Matching with Overlapping Attention for Optical Flow Estimationcited by 64
- 2024DELTA: Dense Efficient Long-range 3D Tracking for any videocited by 62
- 2024MemFlow: Optical Flow Estimation and Prediction with Memorycited by 55
- 2025AllTracker: Efficient Dense Point Tracking at High Resolutioncited by 54
- 2022Multiview Stereo with Cascaded Epipolar RAFTcited by 51
- 2022DIP: Deep Inverse Patchmatch for High-Resolution Optical Flowcited by 40
- 2025UFM: A Simple Path towards Unified Dense Correspondence with Flowcited by 35
- 2025WAFT: Warping-Alone Field Transforms for Optical Flowcited by 32
- 2025MoVieS: Motion-Aware 4D Dynamic View Synthesis in One Secondcited by 31
- 2025DPFlow: Adaptive Optical Flow Estimation with a Dual-Pyramid Frameworkcited by 30
- 2025Track-On: Transformer-based Online Point Tracking with Memorycited by 21
- 2023AccFlow: Backward Accumulation for Long-Range Optical Flowcited by 19
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Turning Video Models into Generalist Robot Policiescited by 10
- 2026COMET: Contrastive Motion-Enhanced Temporal Reasoning for Video Multimodal Large Language Modelscited by 1
- 2026TAPVid-MV: A Benchmark for Tracking Any Point in 3D Across Multiple Viewscited by 1
- 2026FlowPainter: Inpainting Optical Flow via Confidence-Guided Completioncited by 0
- 2026On the Real-World Generalisability of Optical Flow Modelscited by 0
- 2026TAPVid-MV: A Benchmark for Tracking Any Point in 3D Across Multiple Views1 Sep 2026
- 2026COMET: Contrastive Motion-Enhanced Temporal Reasoning for Video Multimodal Large Language Models21 Aug 2026
- 2026On the Real-World Generalisability of Optical Flow Models11 Jul 2026
- 2026FlowPainter: Inpainting Optical Flow via Confidence-Guided Completion11 Jul 2026
- 2026Turning Video Models into Generalist Robot Policies27 May 2026