Flow3r: Factored Flow Prediction for Scalable Visual Geometry Learning
Not on the map. Why?
Abstract (arXiv)
Current feed-forward 3D/4D reconstruction systems rely on dense geometry and pose supervision -- expensive to obtain at scale and particularly scarce for dynamic real-world scenes. We present Flow3r, a framework that augments visual geometry learning with dense 2D correspondences (`flow') as supervision, enabling scalable training from unlabeled monocular videos. Our key insight is that the flow prediction module should be factored: predicting flow between two images using geometry latents from one and pose latents from the other. This factorization directly guides the learning of both scene geometry and camera motion, and naturally extends to dynamic scenes. In controlled experiments, we show that factored flow prediction outperforms alternative designs and that performance scales consistently with unlabeled data. Integrating factored flow into existing visual geometry architectures and training with ~800K unlabeled videos, Flow3r achieves state-of-the-art results across eight benchmarks spanning static and dynamic scenes, with its largest gains on in-the-wild dynamic videos where labeled data is most scarce.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 39 of its 51 references that are in the map. First posted on arXiv 23 Feb 2026.
Builds on
39 of 51 references.
References · 39
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 789
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
27 more
- 2025Continuous 3D Perception Model with Persistent Statecited by 527
- 2023CoTracker: It is Better to Track Togethercited by 516
- 2016Direct Sparse Odometrycited by 479
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
- 2016Virtual Worlds as Proxy for Multi-Object Tracking Analysiscited by 340
- 2021Neural RGB-D Surface Reconstructioncited by 312
- 2019A Short Note on the Kinetics-700 Human Action Datasetcited by 308
- 2023RoMa: Robust Dense Feature Matchingcited by 296
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 292
- 2023TAPIR: Tracking Any Point with per-frame Initialization and temporal Refinementcited by 281
- 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 274
- 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 258
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 224
- 2022Particle Video Revisited: Tracking Through Occlusions Using Point Trajectoriescited by 215
- 2020Robust Consistent Video Depth Estimationcited by 188
- 2019ReFusion: 3D Reconstruction in Dynamic Environments for RGB-D Cameras Exploiting Residualscited by 180
- 2022DKM: Dense Kernelized Feature Matching for Geometry Estimationcited by 174
- 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 162
- 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 72
- 2025OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modelingcited by 59
- 2024LEAP-VO: Long-term Effective Any Point Tracking for Visual Odometrycited by 54
- 2022A Benchmark and a Baseline for Robust Multi-view Depth Estimationcited by 38
- 2025UFM: A Simple Path towards Unified Dense Correspondence with Flowcited by 35
- 2024Robust Incremental Structure-from-Motion with Hybrid Featurescited by 31
- 2025Zero-Shot Monocular Scene Flow Estimation in the Wildcited by 20
- 2025DiffusionSfM: Predicting Structure and Motion via Ray Origin and Endpoint Diffusioncited by 14
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Lift4D: Harmonizing Single-View 3D Estimation for 4D Reconstruction In-the-Wildcited by 2
- 2026Point4D: Long-range 4D Motion Reconstructioncited by 1
- 2026ComPose: When to Trust Hands for Object Pose Trackingcited by 0
- 2026Reasmory: 3D Reconstruction as Explicit Memory for VLMs Spatial Reasoningcited by 0
- 2026SPARGen: Unifying Spatial Perception and Reasoning through Native Multimodal Generationcited by 0
- 2026Scal3R: Learning Efficient Multi-Relative Pose Query for Scalable Online 3D Reconstructioncited by 0
- 2026Point4D: Long-range 4D Motion Reconstruction8 Sep 2026
- 2026Scal3R: Learning Efficient Multi-Relative Pose Query for Scalable Online 3D Reconstruction3 Sep 2026
- 2026SPARGen: Unifying Spatial Perception and Reasoning through Native Multimodal Generation14 Aug 2026
- 2026Lift4D: Harmonizing Single-View 3D Estimation for 4D Reconstruction In-the-Wild22 Jun 2026
- 2026Reasmory: 3D Reconstruction as Explicit Memory for VLMs Spatial Reasoning31 May 2026
- 2026ComPose: When to Trust Hands for Object Pose Tracking22 May 2026