mlsanityData to 14 Oct 2026

FAST: Flow Any Scene Transformer

arXiv 2609.39748 ↗First posted 30 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Scaling has become a primary driver of progress in language and vision foundation models, yet its role in precise correspondence matching remains underexplored. In this work, we present Flow Any Scene Transformer (FAST), a scalable correspondence model driven by two key insights. First, we reveal that the query-key projections inside single-view vision foundation models encode a coarse yet reusable prior for cross-view matching. Second, reusing these pretrained projections in cross-attention form yields a highly effective initialization for a ViT-based matcher built from a single-view encoder. Guided by these insights, we build FAST upon a vanilla single-view foundation model, utilizing a zero-parameter rewiring strategy to convert selected self-attention layers into cross-attention for cross-view interaction. This design allows ViT-based matchers to scale with advances in single-view foundation models, bypassing the need for a dedicated pair-centric pretraining stage. To fully unlock the scaling potential of this formulation, we assemble a 6-million-pair training corpus for general-purpose dense 2D displacement estimation across diverse co-visible image pairs. Extensive experiments demonstrate that FAST achieves state-of-the-art performance across a wide range of benchmarks, while scaling favorably with both backbone size and training data.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 65 of its 78 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

65 of 78 references.

References · 65

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  4. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  5. 2021Vision Transformers for Dense Predictioncited by 1,803
  6. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  7. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  8. 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,059
  9. 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
  10. 2024Grounding Image Matching in 3D with MASt3Rcited by 983
  11. 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 968
  12. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
38 more
  1. 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 881
  2. 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
  3. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
  4. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
  5. 2023LightGlue: Local Feature Matching at Light Speedcited by 590
  6. 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
  7. 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 490
  8. 2018Pyramid Stereo Matching Networkcited by 489
  9. 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 442
  10. 2018YouTube-VOS: A Large-Scale Video Object Segmentation Benchmarkcited by 383
  11. 2022Kubric: A scalable dataset generatorcited by 381
  12. 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 360
  13. 2020Virtual KITTI 2cited by 353
  14. 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 353
  15. 2021GMFlow: Learning Optical Flow via Global Matchingcited by 327
  16. 2023RoMa: Robust Dense Feature Matchingcited by 302
  17. 2019Structured3D: A Large Photo-realistic Dataset for Structured 3D Modelingcited by 286
  18. 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 275
  19. 2019Group-wise Correlation Stereo Networkcited by 235
  20. 2017UnFlow: Unsupervised Learning of Optical Flow with a Bidirectional Census Losscited by 202
  21. 2020AANet: Adaptive Aggregation Network for Efficient Stereo Matchingcited by 202
  22. 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
  23. 2020Revisiting Stereo Depth Estimation From a Sequence-to-Sequence Perspective with Transformerscited by 190
  24. 2023MatrixCity: A Large-scale City Dataset for City-scale Neural Rendering and Beyondcited by 185
  25. 2022DKM: Dense Kernelized Feature Matching for Geometry Estimationcited by 177
  26. 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 174
  27. 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 173
  28. 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 172
  29. 2022CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flowcited by 166
  30. 2022CroCo: Self-Supervised Pre-training for 3D Vision Tasks by Cross-View Completioncited by 160
  31. 2023DynamicStereo: Consistent Dynamic Depth from Stereo Videoscited by 148
  32. 2023Infinite Photorealistic Worlds using Procedural Generationcited by 147
  33. 2022Attention Concatenation Volume for Accurate and Efficient Stereo Matchingcited by 130
  34. 20193D Ken Burns Effect from a Single Imagecited by 128
  35. 2023FlowFormer++: Masked Cost Volume Autoencoding for Pretraining Optical Flow Estimationcited by 114
  36. 2021AutoFlow: Learning a Better Training Set for Optical Flowcited by 102
  37. 2024Selective-Stereo: Adaptive Frequency Information Selection for Stereo Matchingcited by 99
  38. 2018Falling Things: A Synthetic Dataset for 3D Object Detection and Pose Estimationcited by 92

50 most cited of 65 All 65 (JSON)

Built on by

Not cited yet.