UFM: A Simple Path towards Unified Dense Correspondence with Flow
Not on the map. Why?
Abstract (arXiv)
Dense image correspondence is central to many applications, such as visual odometry, 3D reconstruction, object association, and re-identification. Historically, dense correspondence has been tackled separately for wide-baseline scenarios and optical flow estimation, despite the common goal of matching content between two images. In this paper, we develop a Unified Flow & Matching model (UFM), which is trained on unified data for pixels that are co-visible in both source and target images. UFM uses a simple, generic transformer architecture that directly regresses the (u,v) flow. It is easier to train and more accurate for large flows compared to the typical coarse-to-fine cost volumes in prior work. UFM is 28% more accurate than state-of-the-art flow methods (Unimatch), while also having 62% less error and 6.7x faster than dense wide-baseline matchers (RoMa). UFM is the first to demonstrate that unified training can outperform specialized approaches across both domains. This result enables fast, general-purpose correspondence and opens new directions for multi-modal, long-range, and real-time correspondence tasks.
Key facts. Cited by 36 papers in the map (data through 14 Oct 2026). Builds on 63 of its 79 references that are in the map. First posted on arXiv 10 Jun 2025.
Builds on
63 of 79 references.
References · 63
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,320
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,059
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 968
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 881
38 more
- 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
- 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 784
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 687
- 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
- 2023LightGlue: Local Feature Matching at Light Speedcited by 590
- 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 559
- 2025Continuous 3D Perception Model with Persistent Statecited by 548
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 511
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
- 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 490
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 490
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
- 2022Kubric: A scalable dataset generatorcited by 381
- 2021GMFlow: Learning Optical Flow via Global Matchingcited by 327
- 2023RoMa: Robust Dense Feature Matchingcited by 302
- 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 275
- 2022Unifying Flow, Stereo and Depth Estimationcited by 275
- 2017A General and Adaptive Robust Loss Functioncited by 236
- 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priorscited by 205
- 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 189
- 2021COTR: Correspondence Transformer for Matching Across Imagescited by 183
- 2022DKM: Dense Kernelized Feature Matching for Geometry Estimationcited by 177
- 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 174
- 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 172
- 2022CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flowcited by 166
- 2023AnyLoc: Towards Universal Visual Place Recognitioncited by 163
- 2024MASt3R-SfM: a Fully-Integrated Solution for Unconstrained Structure-from-Motioncited by 162
- 2019GLU-Net: Global-Local Universal Network for Dense Flow and Correspondencescited by 139
- 2019Iterative Residual Refinement for Joint Optical Flow and Occlusion Estimationcited by 131
- 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 117
- 2021Learning Accurate Dense Correspondences and When to Trust Themcited by 113
- 2022CRAFT: Cross-Attentional Flow Transformer for Robust Optical Flowcited by 82
- 2021PDC-Net+: Enhanced Probabilistic Dense Correspondence Networkcited by 80
- 2025RayZer: A Self-supervised Large View Synthesis Modelcited by 77
- 2024GIM: Learning Generalizable Image Matcher From Internet Videoscited by 75
- 2018DGC-Net: Dense Geometric Correspondence Networkcited by 67
50 most cited of 63 All 63 (JSON)
Built on by
Citing papers per year: 2025: 10; 2026: 26.
36 papers.
Sort:
By area:
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 314
- 2025RoMa v2: Harder Better Faster Denser Feature Matchingcited by 51
- 2025Any4D: Unified Feed-Forward Metric 4D Reconstructioncited by 35
- 2025E-RayZer: Self-supervised 3D Reconstruction as Spatial Visual Pre-trainingcited by 22
- 2025In Pursuit of Pixel Supervision for Visual Pre-trainingcited by 13
- 2026LoMa: Local Feature Matching Revisitedcited by 11
- 2025PhysGM: Large Physical Gaussian Model for Feed-Forward 4D Synthesiscited by 10
- 2026Flow3r: Factored Flow Prediction for Scalable Visual Geometry Learningcited by 9
- 2025MuM: Multi-View Masked Image Modeling for 3D Visioncited by 5
- 2026MegaFlow: Zero-Shot Large Displacement Optical Flowcited by 5
- 2026Cambrian-P: Pose-Grounded Video Understandingcited by 5
- 2025GeCo: Evaluating Geometric Consistency for Video Generation via Motion and Structurecited by 3
24 more
- 2026GGPT: Geometry Grounded Point Transformercited by 3
- 2025RadarGen: Automotive Radar Point Cloud Generation from Camerascited by 2
- 2026Unified 3D Scene Understanding Through Physical World Modelingcited by 2
- 2026VLM3: Vision Language Models Are Native 3D Learnerscited by 2
- 2026Dense Dynamic Scene Reconstruction and Camera Pose Estimation from Multi-View Videoscited by 1
- 2026Who Handles Orientation? Investigating Invariance in Feature Matchingcited by 1
- 2026TurboVGGT: Fast Visual Geometry Reconstruction with Adaptive Alternating Attentioncited by 1
- 2026OrthoTrack: Continuous 6-DoF UAV Trajectory Estimation Anchored in Public Orthophotoscited by 1
- 2026RayTun3R: Online Camera Adaptation in 3D Foundation Modelscited by 1
- 2025CRISP: Contact-Guided Real2Sim from Monocular Video with Planar Scene Primitivescited by 0
- 2026FreeTimeGS++: Secrets of Dynamic Gaussian Splatting and Their Principlescited by 0
- 2026REDI-Match: Rotation-Equivariant Distillation for Efficient and Robust Dense Matchingcited by 0
- 2026Perceptual 3D Simulation With Physical World Modelingcited by 0
- 2026DGSfM: Depth-Guided Scale-Aware Global Structure-from-Motioncited by 0
- 2026MetaView: Monocular Novel View Synthesis with Scale-Aware Implicit Geometry Priorscited by 0
- 2026PixelLoop: Shortcut Topological Navigation with Pixel-Level Loopscited by 0
- 2026LoRetta: A Foundation Model and Extensive Dataset for Global-Scale Remote Sensing Dense Image Matchingcited by 0
- 2026Cross-View Feature Matching: Survey, Benchmarking, and Foundation-Model Perspectivescited by 0
- 2026SPARGen: Unifying Spatial Perception and Reasoning through Native Multimodal Generationcited by 0
- 2026Stable and Scalable Bundle Adjustment of Holistic 3D Structurescited by 0
- 2026RoMa-Omega: What Feed-Forward 3D Models Know About Image Matchingcited by 0
- 2026GAE: Learning a Geometry-Native Latent Space for 3D-Consistent World Generationcited by 0
- 2026FAST: Flow Any Scene Transformercited by 0
- 2026TartanMatch: Towards Universal Dense Correspondence Across Modalitiescited by 0
- 2026TartanMatch: Towards Universal Dense Correspondence Across Modalities10 Oct 2026
- 2026FAST: Flow Any Scene Transformer30 Sep 2026
- 2026GAE: Learning a Geometry-Native Latent Space for 3D-Consistent World Generation21 Sep 2026
- 2026RoMa-Omega: What Feed-Forward 3D Models Know About Image Matching8 Sep 2026
- 2026Stable and Scalable Bundle Adjustment of Holistic 3D Structures3 Sep 2026
- 2026SPARGen: Unifying Spatial Perception and Reasoning through Native Multimodal Generation14 Aug 2026
- 2026Cross-View Feature Matching: Survey, Benchmarking, and Foundation-Model Perspectives11 Aug 2026
- 2026LoRetta: A Foundation Model and Extensive Dataset for Global-Scale Remote Sensing Dense Image Matching4 Aug 2026
- 2026PixelLoop: Shortcut Topological Navigation with Pixel-Level Loops14 Jul 2026
- 2026MetaView: Monocular Novel View Synthesis with Scale-Aware Implicit Geometry Priors13 Jul 2026
- 2026DGSfM: Depth-Guided Scale-Aware Global Structure-from-Motion10 Jul 2026
- 2026RayTun3R: Online Camera Adaptation in 3D Foundation Models2 Jul 2026
24 more
- 2026Perceptual 3D Simulation With Physical World Modeling25 Jun 2026
- 2026OrthoTrack: Continuous 6-DoF UAV Trajectory Estimation Anchored in Public Orthophotos24 Jun 2026
- 2026REDI-Match: Rotation-Equivariant Distillation for Efficient and Robust Dense Matching23 Jun 2026
- 2026VLM3: Vision Language Models Are Native 3D Learners28 May 2026
- 2026Unified 3D Scene Understanding Through Physical World Modeling23 May 2026
- 2026Cambrian-P: Pose-Grounded Video Understanding21 May 2026
- 2026TurboVGGT: Fast Visual Geometry Reconstruction with Adaptive Alternating Attention14 May 2026
- 2026FreeTimeGS++: Secrets of Dynamic Gaussian Splatting and Their Principles5 May 2026
- 2026Who Handles Orientation? Investigating Invariance in Feature Matching13 Apr 2026
- 2026LoMa: Local Feature Matching Revisited6 Apr 2026
- 2026MegaFlow: Zero-Shot Large Displacement Optical Flow26 Mar 2026
- 2026Dense Dynamic Scene Reconstruction and Camera Pose Estimation from Multi-View Videos12 Mar 2026
- 2026GGPT: Geometry Grounded Point Transformer11 Mar 2026
- 2026Flow3r: Factored Flow Prediction for Scalable Visual Geometry Learning23 Feb 2026
- 2025GeCo: Evaluating Geometric Consistency for Video Generation via Motion and Structure25 Dec 2025
- 2025RadarGen: Automotive Radar Point Cloud Generation from Cameras19 Dec 2025
- 2025In Pursuit of Pixel Supervision for Visual Pre-training17 Dec 2025
- 2025CRISP: Contact-Guided Real2Sim from Monocular Video with Planar Scene Primitives16 Dec 2025
- 2025E-RayZer: Self-supervised 3D Reconstruction as Spatial Visual Pre-training11 Dec 2025
- 2025Any4D: Unified Feed-Forward Metric 4D Reconstruction11 Dec 2025
- 2025MuM: Multi-View Masked Image Modeling for 3D Vision21 Nov 2025
- 2025RoMa v2: Harder Better Faster Denser Feature Matching19 Nov 2025
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstruction16 Sep 2025
- 2025PhysGM: Large Physical Gaussian Model for Feed-Forward 4D Synthesis19 Aug 2025
- 2026Perceptual 3D Simulation With Physical World Modeling25 Jun 2026
- 2026Unified 3D Scene Understanding Through Physical World Modeling23 May 2026
- 2026VLM3: Vision Language Models Are Native 3D Learnerscited by 2
- 2026VLM3: Vision Language Models Are Native 3D Learners28 May 2026
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 314
- 2025RoMa v2: Harder Better Faster Denser Feature Matchingcited by 51
- 2025Any4D: Unified Feed-Forward Metric 4D Reconstructioncited by 35
- 2025E-RayZer: Self-supervised 3D Reconstruction as Spatial Visual Pre-trainingcited by 22
- 2025In Pursuit of Pixel Supervision for Visual Pre-trainingcited by 13
- 2026LoMa: Local Feature Matching Revisitedcited by 11
- 2025PhysGM: Large Physical Gaussian Model for Feed-Forward 4D Synthesiscited by 10
- 2026Flow3r: Factored Flow Prediction for Scalable Visual Geometry Learningcited by 9
- 2025MuM: Multi-View Masked Image Modeling for 3D Visioncited by 5
- 2026MegaFlow: Zero-Shot Large Displacement Optical Flowcited by 5
- 2026Cambrian-P: Pose-Grounded Video Understandingcited by 5
- 2025GeCo: Evaluating Geometric Consistency for Video Generation via Motion and Structurecited by 3
12 most cited of 32 All 32 (JSON)
- 2026TartanMatch: Towards Universal Dense Correspondence Across Modalities10 Oct 2026
- 2026FAST: Flow Any Scene Transformer30 Sep 2026
- 2026GAE: Learning a Geometry-Native Latent Space for 3D-Consistent World Generation21 Sep 2026
- 2026RoMa-Omega: What Feed-Forward 3D Models Know About Image Matching8 Sep 2026
- 2026Stable and Scalable Bundle Adjustment of Holistic 3D Structures3 Sep 2026
- 2026SPARGen: Unifying Spatial Perception and Reasoning through Native Multimodal Generation14 Aug 2026
- 2026Cross-View Feature Matching: Survey, Benchmarking, and Foundation-Model Perspectives11 Aug 2026
- 2026LoRetta: A Foundation Model and Extensive Dataset for Global-Scale Remote Sensing Dense Image Matching4 Aug 2026
- 2026PixelLoop: Shortcut Topological Navigation with Pixel-Level Loops14 Jul 2026
- 2026MetaView: Monocular Novel View Synthesis with Scale-Aware Implicit Geometry Priors13 Jul 2026
- 2026DGSfM: Depth-Guided Scale-Aware Global Structure-from-Motion10 Jul 2026
- 2026RayTun3R: Online Camera Adaptation in 3D Foundation Models2 Jul 2026
12 newest of 32 All 32 (JSON)