FAST: Flow Any Scene Transformer
Not on the map. Why?
Abstract (arXiv)
Scaling has become a primary driver of progress in language and vision foundation models, yet its role in precise correspondence matching remains underexplored. In this work, we present Flow Any Scene Transformer (FAST), a scalable correspondence model driven by two key insights. First, we reveal that the query-key projections inside single-view vision foundation models encode a coarse yet reusable prior for cross-view matching. Second, reusing these pretrained projections in cross-attention form yields a highly effective initialization for a ViT-based matcher built from a single-view encoder. Guided by these insights, we build FAST upon a vanilla single-view foundation model, utilizing a zero-parameter rewiring strategy to convert selected self-attention layers into cross-attention for cross-view interaction. This design allows ViT-based matchers to scale with advances in single-view foundation models, bypassing the need for a dedicated pair-centric pretraining stage. To fully unlock the scaling potential of this formulation, we assemble a 6-million-pair training corpus for general-purpose dense 2D displacement estimation across diverse co-visible image pairs. Extensive experiments demonstrate that FAST achieves state-of-the-art performance across a wide range of benchmarks, while scaling favorably with both backbone size and training data.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 65 of its 78 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
65 of 78 references.
References · 65
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,059
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 968
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
38 more
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 881
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
- 2023LightGlue: Local Feature Matching at Light Speedcited by 590
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
- 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 490
- 2018Pyramid Stereo Matching Networkcited by 489
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 442
- 2018YouTube-VOS: A Large-Scale Video Object Segmentation Benchmarkcited by 383
- 2022Kubric: A scalable dataset generatorcited by 381
- 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 360
- 2020Virtual KITTI 2cited by 353
- 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 353
- 2021GMFlow: Learning Optical Flow via Global Matchingcited by 327
- 2023RoMa: Robust Dense Feature Matchingcited by 302
- 2019Structured3D: A Large Photo-realistic Dataset for Structured 3D Modelingcited by 286
- 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 275
- 2019Group-wise Correlation Stereo Networkcited by 235
- 2017UnFlow: Unsupervised Learning of Optical Flow with a Bidirectional Census Losscited by 202
- 2020AANet: Adaptive Aggregation Network for Efficient Stereo Matchingcited by 202
- 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
- 2020Revisiting Stereo Depth Estimation From a Sequence-to-Sequence Perspective with Transformerscited by 190
- 2023MatrixCity: A Large-scale City Dataset for City-scale Neural Rendering and Beyondcited by 185
- 2022DKM: Dense Kernelized Feature Matching for Geometry Estimationcited by 177
- 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 174
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 173
- 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 172
- 2022CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flowcited by 166
- 2022CroCo: Self-Supervised Pre-training for 3D Vision Tasks by Cross-View Completioncited by 160
- 2023DynamicStereo: Consistent Dynamic Depth from Stereo Videoscited by 148
- 2023Infinite Photorealistic Worlds using Procedural Generationcited by 147
- 2022Attention Concatenation Volume for Accurate and Efficient Stereo Matchingcited by 130
- 20193D Ken Burns Effect from a Single Imagecited by 128
- 2023FlowFormer++: Masked Cost Volume Autoencoding for Pretraining Optical Flow Estimationcited by 114
- 2021AutoFlow: Learning a Better Training Set for Optical Flowcited by 102
- 2024Selective-Stereo: Adaptive Frequency Information Selection for Stereo Matchingcited by 99
- 2018Falling Things: A Synthetic Dataset for 3D Object Detection and Pose Estimationcited by 92
50 most cited of 65 All 65 (JSON)
Built on by
Not cited yet.