mlsanityData to 7 Oct 2026

ReFlow: Self-correction Motion Learning for Dynamic Scene Reconstruction

arXiv 2604.01561 ↗First posted 2 Apr 2026cs.CV cs.AIcited by 0

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

We present ReFlow, a unified framework for monocular dynamic scene reconstruction that learns 3D motion in a novel self-correction manner from raw video. Existing methods often suffer from incomplete scene initialization for dynamic regions, leading to unstable reconstruction and motion estimation, which often resorts to external dense motion guidance such as pre-computed optical flow to further stabilize and constrain the reconstruction of dynamic components. However, this introduces additional complexity and potential error propagation. To address these issues, ReFlow integrates a Complete Canonical Space Construction module for enhanced initialization of both static and dynamic regions, and a Separation-Based Dynamic Scene Modeling module that decouples static and dynamic components for targeted motion supervision. The core of ReFlow is a novel self-correction flow matching mechanism, consisting of Full Flow Matching to align 3D scene flow with time-varying 2D observations, and Camera Flow Matching to enforce multi-view consistency for static objects. Together, these modules enable robust and accurate dynamic scene reconstruction. Extensive experiments across diverse scenarios demonstrate that ReFlow achieves superior reconstruction quality and robustness, establishing a novel self-correction paradigm for monocular 4D reconstruction.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 60 of its 65 references that are in the map. First posted on arXiv 2 Apr 2026.

Builds on

60 of 65 references.

References · 60

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  3. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  4. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  5. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  6. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  7. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  8. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  9. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  10. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
  11. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
  12. 2024Grounding Image Matching in 3D with MASt3Rcited by 960
38 more
  1. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
  2. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
  3. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
  4. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
  5. 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
  6. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
  7. 2023CoTracker: It is Better to Track Togethercited by 516
  8. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  9. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
  10. 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
  11. 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
  12. 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
  13. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
  14. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
  15. 2019Neural Point-Based Graphicscited by 326
  16. 2021GMFlow: Learning Optical Flow via Global Matchingcited by 324
  17. 2023TAPIR: Tracking Any Point with per-frame Initialization and temporal Refinementcited by 281
  18. 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 273
  19. 2022Unifying Flow, Stereo and Depth Estimationcited by 270
  20. 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
  21. 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
  22. 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 224
  23. 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 218
  24. 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 210
  25. 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 177
  26. 2024VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Realitycited by 175
  27. 2024OmniRe: Omni Urban Scene Reconstructioncited by 159
  28. 2023Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Renderingcited by 143
  29. 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 99
  30. 2023GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesiscited by 95
  31. 2024Align3R: Aligned Monocular Depth Estimation for Dynamic Videoscited by 79
  32. 2024Fully Explicit Dynamic Gaussian Splattingcited by 75
  33. 2024MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian Splattingcited by 62
  34. 2023A Compact Dynamic 3D Gaussian Representation for Real-Time Dynamic View Synthesiscited by 59
  35. 2025SceneSplat: Gaussian Splatting-based Scene Understanding with Vision-Language Pretrainingcited by 51
  36. 2024GFlow: Recovering 4D World from Monocular Videocited by 46
  37. 20254DGT: Learning a 4D Gaussian Transformer Using Real-World Monocular Videoscited by 46
  38. 2025Efficiently Reconstructing Dynamic Scenes One D4RT at a Timecited by 46

50 most cited of 60 All 60 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Reconstruct, Inpaint, Test-Time Finetune: Dynamic Novel-view Synthesis from Monocular Videos
  2. 2026RAFT-MSF++: Temporal Geometry-Motion Feature Fusion for Self-Supervised Monocular Scene Flow
  3. 2026Reshoot-Anything: A Self-Supervised Model for In-the-Wild Video Reshooting
  4. 2026Depth Anything V4: Dynamic 4D Scene Reconstruction via Riemannian Flow Matching on 4D Gaussian Splatting
  5. 2023Consistent4D: Consistent 360deg Dynamic Object Generation from Monocular Video
  6. 2026Stabilizing Camera-Controlled Novel View Synthesis at Inference Time
  7. 2023Make-It-4D: Synthesizing a Consistent Long-Term Dynamic Scene Video from a Single Image
  8. 2025MUT3R: Motion-aware Updating Transformer for Dynamic 3D Reconstruction