Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereo
Not on the map. Why?
Abstract (arXiv)
While recent methods for motion and stereo estimation recover an unprecedented amount of details, such highly detailed structures are neither adequately reflected in the data of existing benchmarks nor their evaluation methodology. Hence, we introduce Spring - a large, high-resolution, high-detail, computer-generated benchmark for scene flow, optical flow, and stereo. Based on rendered scenes from the open-source Blender movie "Spring", it provides photo-realistic HD datasets with state-of-the-art visual effects and ground truth training data. Furthermore, we provide a website to upload, analyze and compare results. Using a novel evaluation methodology based on a super-resolved UHD ground truth, our Spring benchmark can assess the quality of fine structures and provides further detailed performance statistics on different image regions. Regarding the number of ground truth frames, Spring is 60× larger than the only scene flow benchmark, KITTI 2015, and 15× larger than the well-established MPI Sintel optical flow benchmark. Initial results for recent methods on our benchmark show that estimating fine details is indeed challenging, as their accuracy leaves significant room for improvement. The Spring benchmark and the corresponding datasets are available at http://spring-benchmark.org.
Key facts. Cited by 170 papers in the map (data through 7 Oct 2026). Builds on 30 of its 52 references that are in the map. First posted on arXiv 3 Mar 2023.
Builds on
30 of 52 references.
References · 30
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
- 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
- 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 780
- 2016Optical Flow Estimation using a Spatial Pyramid Networkcited by 421
- 2022Kubric: A scalable dataset generatorcited by 373
- 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 348
- 2020Virtual KITTI 2cited by 345
- 2016Virtual Worlds as Proxy for Multi-Object Tracking Analysiscited by 340
- 2021GMFlow: Learning Optical Flow via Global Matchingcited by 324
- 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 273
18 more
- 2019GA-Net: Guided Aggregation Net for End-to-end Stereo Matchingcited by 242
- 2021Learning to Estimate Hidden Motions with Global Motion Aggregationcited by 223
- 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
- 2017Playing for Benchmarkscited by 169
- 2020Hierarchical Neural Architecture Search for Deep Stereo Matchingcited by 166
- 2022Attention Concatenation Volume for Accurate and Efficient Stereo Matchingcited by 130
- 2020RAFT-3D: Scene Flow using Rigid-Motion Embeddingscited by 121
- 2021AutoFlow: Learning a Better Training Set for Optical Flowcited by 102
- 2021CamLiFlow: Bidirectional Camera-LiDAR Fusion for Joint Optical Flow and Scene Flow Estimationcited by 56
- 2018Learning Rigidity in Dynamic Scenes with a Moving Camera for 3D Motion Field Estimationcited by 38
- 2019Learning Multi-Human Optical Flowcited by 26
- 2017Optical Flow in Mostly Rigid Scenescited by 20
- 2018Motion-based Object Segmentation based on Dense RGB-D Scene Flowcited by 18
- 2022A Perturbation-Constrained Adversarial Attack for Evaluating the Robustness of Optical Flowcited by 16
- 2022M-FUSE: Multi-frame Fusion for Scene Flow Estimationcited by 14
- 2022High Resolution Multi-Scale RAFT (Robust Vision Challenge 2022)cited by 12
- 2022Semi-Supervised Learning of Optical Flow by Flow Supervisorcited by 9
- 2022Multi-Scale RAFT: Combining Hierarchical Concepts for Learning-based Optical FLow Estimationcited by 9
Built on by
Citing papers per year: 2023: 10; 2024: 25; 2025: 59; 2026: 76.
170 papers.
Sort:
By area:
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 395
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 250
- 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 169
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
- 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generationcited by 161
- 2025Streaming 4D Visual Geometry Transformercited by 147
- 2023Infinite Photorealistic Worlds using Procedural Generationcited by 142
- 2025SpatialTrackerV2: 3D Point Tracking Made Easycited by 84
38 more
- 2025Point3R: Streaming 3D Reconstruction with Explicit Spatial Pointer Memorycited by 82
- 2024Align3R: Aligned Monocular Depth Estimation for Dynamic Videoscited by 79
- 2025Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstructioncited by 66
- 2024MemFlow: Optical Flow Estimation and Prediction with Memorycited by 55
- 2025AllTracker: Efficient Dense Point Tracking at High Resolutioncited by 54
- 2024Feed-Forward Bullet-Time Reconstruction of Dynamic Scenes from Monocular Videoscited by 48
- 2025Dens3R: A Foundation Model for 3D Geometry Predictioncited by 44
- 2026NeoVerse: Enhancing 4D World Model with in-the-wild Monocular Videoscited by 39
- 2025GeometryCrafter: Consistent Geometry Estimation for Open-world Videos with Diffusion Priorscited by 36
- 2025UFM: A Simple Path towards Unified Dense Correspondence with Flowcited by 35
- 2026LoGeR: Long-Context Geometric Reconstruction with Hybrid Memorycited by 33
- 2025WAFT: Warping-Alone Field Transforms for Optical Flowcited by 32
- 2025Any4D: Unified Feed-Forward Metric 4D Reconstructioncited by 32
- 2025MoVieS: Motion-Aware 4D Dynamic View Synthesis in One Secondcited by 31
- 2025DPFlow: Adaptive Optical Flow Estimation with a Dual-Pyramid Frameworkcited by 30
- 2025Dynamic Camera Poses and Where to Find Themcited by 26
- 2026Masked Depth Modeling for Spatial Perceptioncited by 24
- 2024A Survey on Deep Stereo Matching in the Twentiescited by 23
- 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Surveycited by 23
- 2026ZipMap: Linear-Time Stateful 3D Reconstruction via Test-Time Trainingcited by 23
- 2024SharpDepth: Sharpening Metric Depth Predictions Using Diffusion Distillationcited by 21
- 2025Zero-Shot Monocular Scene Flow Estimation in the Wildcited by 20
- 2026LongStream: Long-Sequence Streaming Autoregressive Visual Geometrycited by 17
- 2023Distracting Downpour: Adversarial Weather Attacks for Motion Estimationcited by 15
- 2023SAMFlow: Eliminating Any Fragmentation in Optical Flow with Segment Anything Modelcited by 15
- 2025FlashDepth: Real-time Streaming Video Depth Estimation at 2K Resolutioncited by 14
- 2026VGG-T3: Offline Feed-Forward 3D Reconstruction at Scalecited by 14
- 2024BlinkVision: A Benchmark for Optical Flow, Scene Flow and Point Tracking Estimation using RGB Frames and Eventscited by 13
- 2023Win-Win: Training High-Resolution Vision Transformers from Two Windowscited by 12
- 2023StreamFlow: Streamlined Multi-Frame Optical Flow Estimation for Video Sequencescited by 12
- 2025L4P: Towards Unified Low-Level 4D Vision Perceptioncited by 12
- 2026CoWTracker: Tracking by Warping instead of Correlationcited by 12
- 2023Understanding Physical Dynamics with Counterfactual World Modelingcited by 11
- 2024LayeredFlow: A Real-World Benchmark for Non-Lambertian Multi-Layer Optical Flowcited by 11
- 2024VE-Bench: Subjective-Aligned Benchmark Suite for Text-Driven Video Editing Quality Assessmentcited by 10
- 2025D2USt3R: Enhancing 3D Reconstruction for Dynamic Scenescited by 10
- 2025FlowSeek: Optical Flow Made Easier with Depth Foundation Models and Motion Basescited by 10
- 2026MetricAnything: Scaling Metric Depth Pretraining with Noisy Heterogeneous Sourcescited by 10
50 most cited of 170 All 170 (JSON)
- 2026Less Context, Better Geometry: Masked Geometric Encoder for Robust 3D Foundation Models5 Oct 2026
- 2026FAST: Flow Any Scene Transformer30 Sep 2026
- 2026GeoVerse: World-Consistent Novel View Synthesis in Geometric Latent Space28 Sep 2026
- 20263D Point Tracking with State Space Models27 Sep 2026
- 2026VGGT-Prime: Compute-Adaptive Mixture-of-Heads for Efficient Visual Geometry Transformers20 Sep 2026
- 2026Think Locally, Refine Globally for Memory-Efficient 3D Reconstruction18 Sep 2026
- 2026FreeFlow: A Bias-free Hierarchical Transformer for Optical Flow Estimation10 Sep 2026
- 2026OmniPoint: Universal Monocular Metric Pointcloud from Any Camera8 Sep 2026
- 2026Disparity Has a Sign: Stereo Matching Beyond the Zero-Disparity Plane6 Sep 2026
- 2026BLASt3R: Bundle Adjustment of Any Image Set with Multi-View Matching and Monocular Priors4 Sep 2026
- 2026WiFlow: Estimating Optical Flow using WiFi Channel State Information2 Sep 2026
- 2026TAPVid-MV: A Benchmark for Tracking Any Point in 3D Across Multiple Views1 Sep 2026
38 more
- 2026Monocular Depth Estimation from a Single Image: Progress and Opportunities1 Sep 2026
- 2026Efficient and High-Quality Depth Estimation via Pixel-Space Diffusion with Linear Attention31 Aug 2026
- 2026OptiGeo: Efficient Monocular Geometry for Embodied Perception in Optically Challenging Scenes30 Aug 2026
- 2026NBS: No Bias Stereo28 Aug 2026
- 2026Revisiting Local Context for Long-Horizon Streaming 3D Reconstruction27 Aug 2026
- 2026Unified Video Dense Prediction from Disjoint Data23 Jul 2026
- 2026MoGe-3: Fine-Detail Monocular Geometry Estimation with Self-Guided Sparse Volumetric Refinement20 Jul 2026
- 2026X-Lens: Real-Time Metric Depth Estimation with Heterogeneous Cameras14 Jul 2026
- 2026FoundationGeo: Learning Spatial Pixel-Wise Fields for Monocular Metric Geometry13 Jul 2026
- 2026OmniX: Any-view and Any-time 4D Reconstruction via Feed-forward Trajectory Fields12 Jul 2026
- 2026On the Real-World Generalisability of Optical Flow Models11 Jul 2026
- 2026FlowPainter: Inpainting Optical Flow via Confidence-Guided Completion11 Jul 2026
- 2026SciFlow: Semantic Cross Interference for Self-Supervised Optical Flow Domain Generalization27 Jun 2026
- 2026Independent Samples, Correlated Variance A Learnable Cross-View Cue in Path-Traced Stereo Data24 Jun 2026
- 2026Lite Any Stereo V2: Faster and Stronger Efficient Zero-Shot Stereo Matching23 Jun 2026
- 2026SCOPE: Scale-Consistent One-Pass Estimation of 3D Geometry19 Jun 2026
- 2026StereoFactory: A Unified Merging Framework for Robust Stereo Matching16 Jun 2026
- 2026DepthMaster: Unified Monocular Depth Estimation for Perspective and Panoramic Images10 Jun 2026
- 2026Honey, I Shrunk the Arc de Triomphe!1 Jun 2026
- 2026Learning Global Motion with Compact Gaussians for Feed-Forward 4D Reconstruction29 May 2026
- 2026SurGe: Improved Surface Geometry in Point Maps29 May 2026
- 2026VLM3: Vision Language Models Are Native 3D Learners28 May 2026
- 2026D'ej`a View: Looping Transformers for Multi-View 3D Reconstruction28 May 2026
- 2026Towards Consistent Video Geometry Estimation28 May 2026
- 2026R3: 3D Reconstruction via Relative Regression26 May 2026
- 2026Stabilizing Streaming Video Geometry via Dynamic Feature Normalization25 May 2026
- 2026StereoGenBench: A Synthetic Multi-Camera Benchmark for Stereo Generation under Controlled Baseline Regimes22 May 2026
- 2026Cambrian-P: Pose-Grounded Video Understanding21 May 2026
- 2026UniT: Unified Geometry Learning with Group Autoregressive Transformer20 May 2026
- 2026TurboVGGT: Fast Visual Geometry Reconstruction with Adaptive Alternating Attention14 May 2026
- 2026UniFixer: A Universal Reference-Guided Fixer for Diffusion-Based View Synthesis12 May 2026
- 2026SAMOFT: Robust Multi-Object Tracking via Region and Flow10 May 2026
- 2026Syn4D: A Multiview Synthetic 4D Dataset6 May 2026
- 2026Unlocking the Power of Critical Factors for 3D Visual Geometry Estimation23 Apr 2026
- 2026RAFT-MSF++: Temporal Geometry-Motion Feature Fusion for Self-Supervised Monocular Scene Flow21 Apr 2026
- 2026Flow of Truth: Proactive Temporal Forensics for Image-to-Video Generation16 Apr 2026
- 2026U2Flow: Uncertainty-Aware Unsupervised Optical Flow Estimation11 Apr 2026
- 2026Fast Spatial Memory with Elastic Test-Time Training8 Apr 2026
50 newest of 170 All 170 (JSON)
- 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generationcited by 161
- 2025Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstructioncited by 66
- 2025GeometryCrafter: Consistent Geometry Estimation for Open-world Videos with Diffusion Priorscited by 36
- 2024SharpDepth: Sharpening Metric Depth Predictions Using Diffusion Distillationcited by 21
- 2025High-Fidelity Novel View Synthesis via Splatting-Guided Diffusioncited by 9
- 2025Hierarchical Flow Diffusion for Efficient Frame Interpolationcited by 7
- 2025Diff4Splat: Controllable 4D Scene Generation with Latent Dynamic Reconstruction Modelscited by 7
- 2024FiffDepth: Feed-forward Transformation of Diffusion-Based Generators for Detailed Depth Estimationcited by 5
- 2026DA-Flow: Degradation-Aware Optical Flow Estimation with Diffusion Modelscited by 0
- 2026FlowPainter: Inpainting Optical Flow via Confidence-Guided Completioncited by 0
- 2026FlowPainter: Inpainting Optical Flow via Confidence-Guided Completion11 Jul 2026
- 2026DA-Flow: Degradation-Aware Optical Flow Estimation with Diffusion Models24 Mar 2026
- 2025Diff4Splat: Controllable 4D Scene Generation with Latent Dynamic Reconstruction Models1 Nov 2025
- 2025Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstruction10 Apr 2025
- 2025GeometryCrafter: Consistent Geometry Estimation for Open-world Videos with Diffusion Priors1 Apr 2025
- 2025Hierarchical Flow Diffusion for Efficient Frame Interpolation1 Apr 2025
- 2025High-Fidelity Novel View Synthesis via Splatting-Guided Diffusion18 Feb 2025
- 2024FiffDepth: Feed-forward Transformation of Diffusion-Based Generators for Detailed Depth Estimation1 Dec 2024
- 2024SharpDepth: Sharpening Metric Depth Predictions Using Diffusion Distillation27 Nov 2024
- 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generation31 Jul 2024
- 2026NeoVerse: Enhancing 4D World Model with in-the-wild Monocular Videoscited by 39
- 2023Understanding Physical Dynamics with Counterfactual World Modelingcited by 11
- 2025DynamicVerse: A Physically-Aware Multimodal Framework for 4D World Modelingcited by 5
- 2026OmniX: Any-view and Any-time 4D Reconstruction via Feed-forward Trajectory Fieldscited by 4
- 2026OmniX: Any-view and Any-time 4D Reconstruction via Feed-forward Trajectory Fields12 Jul 2026
- 2026NeoVerse: Enhancing 4D World Model with in-the-wild Monocular Videos1 Jan 2026
- 2025DynamicVerse: A Physically-Aware Multimodal Framework for 4D World Modeling2 Dec 2025
- 2023Understanding Physical Dynamics with Counterfactual World Modeling11 Dec 2023
- 2026VLM3: Vision Language Models Are Native 3D Learnerscited by 2
- 2026VLM3: Vision Language Models Are Native 3D Learners28 May 2026
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 395
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 250
- 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 169
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
- 2025Streaming 4D Visual Geometry Transformercited by 147
- 2023Infinite Photorealistic Worlds using Procedural Generationcited by 142
- 2025SpatialTrackerV2: 3D Point Tracking Made Easycited by 84
- 2025Point3R: Streaming 3D Reconstruction with Explicit Spatial Pointer Memorycited by 82
12 most cited of 152 All 152 (JSON)
- 2026FAST: Flow Any Scene Transformer30 Sep 2026
- 2026GeoVerse: World-Consistent Novel View Synthesis in Geometric Latent Space28 Sep 2026
- 20263D Point Tracking with State Space Models27 Sep 2026
- 2026VGGT-Prime: Compute-Adaptive Mixture-of-Heads for Efficient Visual Geometry Transformers20 Sep 2026
- 2026Think Locally, Refine Globally for Memory-Efficient 3D Reconstruction18 Sep 2026
- 2026FreeFlow: A Bias-free Hierarchical Transformer for Optical Flow Estimation10 Sep 2026
- 2026OmniPoint: Universal Monocular Metric Pointcloud from Any Camera8 Sep 2026
- 2026Disparity Has a Sign: Stereo Matching Beyond the Zero-Disparity Plane6 Sep 2026
- 2026BLASt3R: Bundle Adjustment of Any Image Set with Multi-View Matching and Monocular Priors4 Sep 2026
- 2026WiFlow: Estimating Optical Flow using WiFi Channel State Information2 Sep 2026
- 2026TAPVid-MV: A Benchmark for Tracking Any Point in 3D Across Multiple Views1 Sep 2026
- 2026Monocular Depth Estimation from a Single Image: Progress and Opportunities1 Sep 2026
12 newest of 152 All 152 (JSON)