mlsanityData to 14 Oct 2026

FreeFlow: A Bias-free Hierarchical Transformer for Optical Flow Estimation

arXiv 2609.11486 ↗First posted 10 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Optical flow methods typically rely on task-specific inductive biases, such as correlation volumes, feature warping, and iterative refinement, among others, to reach high accuracy. While effective, such biases constrain the model to predefined heuristics, which can limit its expressivity and lead to more complex pipelines and additional computational cost. We present FreeFlow, a hierarchical transformer built without any flow-specific components, using instead a single feed-forward encoder--decoder. FreeFlow combines three attention variants: window attention for local processing, shifted-window attention for cross-window information exchange, and a global attention operating at a reduced resolution. The resulting architecture scales naturally with model capacity, enabling a consistent accuracy gain from small to large variants. Despite the absence of standard inductive biases, FreeFlow achieves state-of-the-art results on major benchmarks, including Sintel (0.68/1.48 EPE on Clean/Final), KITTI-2015 (3.23 Fl-all), and Spring (3.192 1px), while remaining memory efficient at 1080p inference.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 52 of its 62 references that are in the map. First posted on arXiv 10 Sep 2026.

Builds on

52 of 62 references.

References · 52

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  3. 2023Segment Anythingcited by 8,234
  4. 2020End-to-End Object Detection with Transformerscited by 7,414
  5. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  6. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  7. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  8. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
  9. 2021Vision Transformers for Dense Predictioncited by 1,803
  10. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  11. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  12. 2024Depth Anything V2cited by 1,422
38 more
  1. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  2. 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,059
  3. 2021Scaling Vision Transformerscited by 999
  4. 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 968
  5. 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 881
  6. 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 784
  7. 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
  8. 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
  9. 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
  10. 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
  11. 2021GMFlow: Learning Optical Flow via Global Matchingcited by 327
  12. 2020BasicVSR: The Search for Essential Components in Video Super-Resolution and Beyondcited by 304
  13. 2023Hiera: A Hierarchical Vision Transformer without the Bells-and-Whistlescited by 290
  14. 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 275
  15. 2022Unifying Flow, Stereo and Depth Estimationcited by 275
  16. 2021Learning to Estimate Hidden Motions with Global Motion Aggregationcited by 224
  17. 2020Real-Time Intermediate Flow Estimation for Video Frame Interpolationcited by 213
  18. 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 189
  19. 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 174
  20. 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 172
  21. 2017Playing for Benchmarkscited by 169
  22. 2022CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flowcited by 166
  23. 2022CroCo: Self-Supervised Pre-training for 3D Vision Tasks by Cross-View Completioncited by 160
  24. 2019Quadratic video interpolationcited by 145
  25. 2023The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimationcited by 116
  26. 2023FlowFormer++: Masked Cost Volume Autoencoding for Pretraining Optical Flow Estimationcited by 114
  27. 2017Optical Flow Guided Feature: A Fast and Robust Motion Representation for Video Action Recognitioncited by 82
  28. 2023VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimationcited by 82
  29. 2025Your ViT is Secretly an Image Segmentation Modelcited by 63
  30. 2024MemFlow: Optical Flow Estimation and Prediction with Memorycited by 55
  31. 2018Representation Flow for Action Recognitioncited by 51
  32. 2025WAFT: Warping-Alone Field Transforms for Optical Flowcited by 34
  33. 2023TransFlow: Transformer as Flow Learnercited by 32
  34. 2025DPFlow: Adaptive Optical Flow Estimation with a Dual-Pyramid Frameworkcited by 30
  35. 2017Generic 3D Representation via Pose Estimation and Matchingcited by 17
  36. 2023Win-Win: Training High-Resolution Vision Transformers from Two Windowscited by 12
  37. 2023StreamFlow: Streamlined Multi-Frame Optical Flow Estimation for Video Sequencescited by 12
  38. 2025MEMFOF: High-Resolution Training for Memory-Efficient Multi-Frame Optical Flow Estimationcited by 7

50 most cited of 52 All 52 (JSON)

Built on by

Not cited yet.