FreeFlow: A Bias-free Hierarchical Transformer for Optical Flow Estimation
Not on the map. Why?
Abstract (arXiv)
Optical flow methods typically rely on task-specific inductive biases, such as correlation volumes, feature warping, and iterative refinement, among others, to reach high accuracy. While effective, such biases constrain the model to predefined heuristics, which can limit its expressivity and lead to more complex pipelines and additional computational cost. We present FreeFlow, a hierarchical transformer built without any flow-specific components, using instead a single feed-forward encoder--decoder. FreeFlow combines three attention variants: window attention for local processing, shifted-window attention for cross-window information exchange, and a global attention operating at a reduced resolution. The resulting architecture scales naturally with model capacity, enabling a consistent accuracy gain from small to large variants. Despite the absence of standard inductive biases, FreeFlow achieves state-of-the-art results on major benchmarks, including Sintel (0.68/1.48 EPE on Clean/Final), KITTI-2015 (3.23 Fl-all), and Spring (3.192 1px), while remaining memory efficient at 1080p inference.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 52 of its 62 references that are in the map. First posted on arXiv 10 Sep 2026.
Builds on
52 of 62 references.
References · 52
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2023Segment Anythingcited by 8,234
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2024Depth Anything V2cited by 1,422
38 more
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,059
- 2021Scaling Vision Transformerscited by 999
- 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 968
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 881
- 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 784
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
- 2021GMFlow: Learning Optical Flow via Global Matchingcited by 327
- 2020BasicVSR: The Search for Essential Components in Video Super-Resolution and Beyondcited by 304
- 2023Hiera: A Hierarchical Vision Transformer without the Bells-and-Whistlescited by 290
- 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 275
- 2022Unifying Flow, Stereo and Depth Estimationcited by 275
- 2021Learning to Estimate Hidden Motions with Global Motion Aggregationcited by 224
- 2020Real-Time Intermediate Flow Estimation for Video Frame Interpolationcited by 213
- 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 189
- 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 174
- 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 172
- 2017Playing for Benchmarkscited by 169
- 2022CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flowcited by 166
- 2022CroCo: Self-Supervised Pre-training for 3D Vision Tasks by Cross-View Completioncited by 160
- 2019Quadratic video interpolationcited by 145
- 2023The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimationcited by 116
- 2023FlowFormer++: Masked Cost Volume Autoencoding for Pretraining Optical Flow Estimationcited by 114
- 2017Optical Flow Guided Feature: A Fast and Robust Motion Representation for Video Action Recognitioncited by 82
- 2023VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimationcited by 82
- 2025Your ViT is Secretly an Image Segmentation Modelcited by 63
- 2024MemFlow: Optical Flow Estimation and Prediction with Memorycited by 55
- 2018Representation Flow for Action Recognitioncited by 51
- 2025WAFT: Warping-Alone Field Transforms for Optical Flowcited by 34
- 2023TransFlow: Transformer as Flow Learnercited by 32
- 2025DPFlow: Adaptive Optical Flow Estimation with a Dual-Pyramid Frameworkcited by 30
- 2017Generic 3D Representation via Pose Estimation and Matchingcited by 17
- 2023Win-Win: Training High-Resolution Vision Transformers from Two Windowscited by 12
- 2023StreamFlow: Streamlined Multi-Frame Optical Flow Estimation for Video Sequencescited by 12
- 2025MEMFOF: High-Resolution Training for Memory-Efficient Multi-Frame Optical Flow Estimationcited by 7
50 most cited of 52 All 52 (JSON)
Built on by
Not cited yet.