ReFlow: Self-correction Motion Learning for Dynamic Scene Reconstruction
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
We present ReFlow, a unified framework for monocular dynamic scene reconstruction that learns 3D motion in a novel self-correction manner from raw video. Existing methods often suffer from incomplete scene initialization for dynamic regions, leading to unstable reconstruction and motion estimation, which often resorts to external dense motion guidance such as pre-computed optical flow to further stabilize and constrain the reconstruction of dynamic components. However, this introduces additional complexity and potential error propagation. To address these issues, ReFlow integrates a Complete Canonical Space Construction module for enhanced initialization of both static and dynamic regions, and a Separation-Based Dynamic Scene Modeling module that decouples static and dynamic components for targeted motion supervision. The core of ReFlow is a novel self-correction flow matching mechanism, consisting of Full Flow Matching to align 3D scene flow with time-varying 2D observations, and Camera Flow Matching to enforce multi-view consistency for static objects. Together, these modules enable robust and accurate dynamic scene reconstruction. Extensive experiments across diverse scenarios demonstrate that ReFlow achieves superior reconstruction quality and robustness, establishing a novel self-correction paradigm for monocular 4D reconstruction.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 60 of its 65 references that are in the map. First posted on arXiv 2 Apr 2026.
Builds on
60 of 65 references.
References · 60
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
38 more
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
- 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
- 2023CoTracker: It is Better to Track Togethercited by 516
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
- 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
- 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
- 2019Neural Point-Based Graphicscited by 326
- 2021GMFlow: Learning Optical Flow via Global Matchingcited by 324
- 2023TAPIR: Tracking Any Point with per-frame Initialization and temporal Refinementcited by 281
- 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 273
- 2022Unifying Flow, Stereo and Depth Estimationcited by 270
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
- 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 224
- 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 218
- 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 210
- 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 177
- 2024VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Realitycited by 175
- 2024OmniRe: Omni Urban Scene Reconstructioncited by 159
- 2023Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Renderingcited by 143
- 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 99
- 2023GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesiscited by 95
- 2024Align3R: Aligned Monocular Depth Estimation for Dynamic Videoscited by 79
- 2024Fully Explicit Dynamic Gaussian Splattingcited by 75
- 2024MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian Splattingcited by 62
- 2023A Compact Dynamic 3D Gaussian Representation for Real-Time Dynamic View Synthesiscited by 59
- 2025SceneSplat: Gaussian Splatting-based Scene Understanding with Vision-Language Pretrainingcited by 51
- 2024GFlow: Recovering 4D World from Monocular Videocited by 46
- 20254DGT: Learning a 4D Gaussian Transformer Using Real-World Monocular Videoscited by 46
- 2025Efficiently Reconstructing Dynamic Scenes One D4RT at a Timecited by 46
50 most cited of 60 All 60 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Reconstruct, Inpaint, Test-Time Finetune: Dynamic Novel-view Synthesis from Monocular Videos
- 2026RAFT-MSF++: Temporal Geometry-Motion Feature Fusion for Self-Supervised Monocular Scene Flow
- 2026Reshoot-Anything: A Self-Supervised Model for In-the-Wild Video Reshooting
- 2026Depth Anything V4: Dynamic 4D Scene Reconstruction via Riemannian Flow Matching on 4D Gaussian Splatting
- 2023Consistent4D: Consistent 360deg Dynamic Object Generation from Monocular Video
- 2026Stabilizing Camera-Controlled Novel View Synthesis at Inference Time
- 2023Make-It-4D: Synthesizing a Consistent Long-Term Dynamic Scene Video from a Single Image
- 2025MUT3R: Motion-aware Updating Transformer for Dynamic 3D Reconstruction