Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes
Not on the map. Why?
Cited by 20 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We present a method to perform novel view and time synthesis of dynamic scenes, requiring only a monocular video with known camera poses as input. To do this, we introduce Neural Scene Flow Fields, a new representation that models the dynamic scene as a time-variant continuous function of appearance, geometry, and 3D scene motion. Our representation is optimized through a neural network to fit the observed input views. We show that our representation can be used for complex dynamic scenes, including thin structures, view-dependent effects, and natural degrees of motion. We conduct a number of experiments that demonstrate our approach significantly outperforms recent monocular view synthesis methods, and show qualitative results of space-time view synthesis on a variety of real-world videos.
Key facts. Cited by 750 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 78; 2022: 136; 2023: 184; 2024: 172; 2025: 110; 2026: 70.
750 papers.
Sort:
By area:
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
38 more
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 510
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 465
- 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
- 2021Advances in Neural Renderingcited by 365
- 2023Compact 3D Gaussian Representation for Radiance Fieldcited by 365
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
- 2021Neural RGB-D Surface Reconstructioncited by 312
- 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 311
- 2023FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularizationcited by 310
- 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2cited by 300
- 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
- 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
- 2022NeuMan: Neural Human Radiance Field from a Single Videocited by 244
- 2022Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representationcited by 243
- 2022NoPe-NeRF: Optimising Neural Radiance Field with No Pose Priorcited by 235
- 2021DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networkscited by 232
- 2021BungeeNeRF: Progressive Neural Radiance Field for Extreme Multi-scale Scene Renderingcited by 228
- 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 224
- 2023GS-IR: 3D Gaussian Splatting for Inverse Renderingcited by 220
- 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 218
- 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 216
- 2023EmerNeRF: Emergent Spatial-Temporal Scene Decomposition via Self-Supervisioncited by 216
- 2021HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fieldscited by 210
- 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 210
- 2021Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulationcited by 204
- 2023Text-To-4D Dynamic Scene Generationcited by 204
- 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 199
- 2021Neural Articulated Radiance Fieldcited by 196
- 2021GeoNeRF: Generalizing NeRF with Geometry Priorscited by 195
- 2021BANMo: Building Animatable 3D Neural Models from Many Casual Videoscited by 195
50 most cited of 750 All 750 (JSON)
- 2026A Compact Explicit 4D Representation for Dynamic Scenes1 Oct 2026
- 2026Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstruction30 Sep 2026
- 2026Accurate Motion Estimation with B'ezier Control Point for Efficient Frame Interpolation20 Sep 2026
- 2026SplashSplat: Reconstructing Splashing Liquids from Real-World Multi-View Videos17 Sep 2026
- 2026DecoGS: Adaptive Static-Dynamic Decoupling of 3D Gaussians for Free-Viewpoint Video Streaming15 Sep 2026
- 2026Tele360: Real-Time Feed-Forward Human Reconstruction from Sparse Unposed Cameras14 Sep 2026
- 2026SignMimic: Robust High-Quality Sign Language Motion Generation via Human-Shape-Oblivious Pose Transfer Guidance12 Sep 2026
- 2026PASTEL: Panoramic Alignment for Monocular 4D Scene Reconstruction5 Sep 2026
- 2026SMG: Semantic Motion Graph for Monocular Dynamic Gaussian Splatting31 Aug 2026
- 2026LagrangeGS: Non-Conservative Lagrangian System on Dynamic 3D Gaussian Splatting24 Aug 2026
- 2026UniWorld-View: Large-Baseline View Synthesis via Video Diffusion Models5 Aug 2026
- 2026ASTRA: Asynchronous Spatio-Temporal Reconstruction via Trajectory Alignment3 Aug 2026
38 more
- 2026FillGS: Filling Observation Gaps in 4D Gaussian Splatting via Viewpoint-Time Selection and Generative Refinement31 Jul 2026
- 2026GrainGS: Gradient-Decoupled Gaussian Splatting for Efficient Dynamic Novel View Synthesis23 Jul 2026
- 2026Unified Panoramic-Gaussian Representation for Monocular 4D Scene Synthesis2 Jul 2026
- 2026World from Motion: Generative Dynamic Gaussian Reconstruction from Monocular Video1 Jul 2026
- 2026One Video, One World: Turning Monocular Video into Physical 4D Scenes30 Jun 2026
- 2026Learning Efficient 4D Gaussian Representations from Monocular Videos with Flow Splatting29 Jun 2026
- 2026DLGStream: Dynamic Language-embedded Guassian Splatting for Open-vocabulary Enabled Free-viewpoint Video Streaming27 Jun 2026
- 2026Temporally Aware Densification for Dynamic 3D Gaussian Splatting22 Jun 2026
- 20264D Reconstruction from Sparse Dynamic Cameras3 Jun 2026
- 2026SparseStreet: Sparse Gaussian Splatting for Real-Time Street Scene Simulation2 Jun 2026
- 2026WebSpline: Structure-Informed Splines for Real-Time 3D Gaussians from Monocular Videos1 Jun 2026
- 2026Learning Global Motion with Compact Gaussians for Feed-Forward 4D Reconstruction29 May 2026
- 20263D Gaussian Splatting for Efficient Retrospective Dynamic Scene Novel View Synthesis with a Standardized Benchmark12 May 2026
- 2026MoCam: Unified Novel View Synthesis via Structured Denoising Dynamics12 May 2026
- 2026CausalGS: Learning Physical Causality of 3D Dynamic Scenes with Gaussian Representations11 May 2026
- 2026VeloGauss: Learning Physically Consistent Gaussian Velocity Fields from Videos11 May 2026
- 2026DySurface: Consistent 4D Surface Reconstruction via Bridging Explicit Gaussians and Implicit Functions11 May 2026
- 2026Kinematics-Driven Gaussian Shape Deformation for Blurry Monocular Dynamic Scenes9 May 2026
- 2026One World, Dual Timeline: Decoupled Spatio-Temporal Gaussian Scene Graph for 4D Cooperative Driving Reconstruction8 May 2026
- 2026FreeTimeGS++: Secrets of Dynamic Gaussian Splatting and Their Principles5 May 2026
- 2026Color-Encoded Illumination for High-Speed Volumetric Scene Reconstruction29 Apr 2026
- 2026D-Prism: Differentiable Primitives for Structured Dynamic Modeling18 Apr 2026
- 2026CLOTH-HUGS: Cloth Aware Human Gaussian Splatting17 Apr 2026
- 2026Splats in Splats++: Robust and Generalizable 3D Gaussian Splatting Steganography17 Apr 2026
- 2026PartNerFace: Part-based Neural Radiance Fields for Animatable Facial Avatar Reconstruction15 Apr 2026
- 2026ClipGStream: Clip-Stream Gaussian Splatting for Any Length and Any Motion Multi-View Dynamic Scene Reconstruction15 Apr 2026
- 2026ReconPhys: Reconstruct Appearance and Physical Attributes from Single Video9 Apr 2026
- 2026MoRight: Motion Control Done Right8 Apr 2026
- 2026Geo-EVS: Geometry-Conditioned Extrapolative View Synthesis for Autonomous Driving8 Apr 2026
- 2026ReFlow: Self-correction Motion Learning for Dynamic Scene Reconstruction2 Apr 2026
- 2026GRVS: a Generalizable and Recurrent Approach to Monocular Dynamic View Synthesis31 Mar 2026
- 2026MotionScale: Reconstructing Appearance, Geometry, and Motion of Dynamic Scenes with Scalable 4D Gaussian Splatting31 Mar 2026
- 2026RehearsalNeRF: Decoupling Intrinsic Neural Fields of Dynamic Illuminations for Scene Editing30 Mar 2026
- 2026Few TensoRF: Enhance the Few-shot on Tensorial Radiance Fields26 Mar 2026
- 2026DRoPS: Dynamic 3D Reconstruction of Pre-Scanned Objects25 Mar 2026
- 20264DGS360: 360deg Gaussian Reconstruction of Dynamic Objects from a Single Video23 Mar 2026
- 2026Fast and Robust Deformable 3D Gaussian Splatting21 Mar 2026
- 2026Generalizable NGP-SR: Generalizable Neural Radiance Fields Super-Resolution via Neural Graph Primitives20 Mar 2026
50 newest of 750 All 750 (JSON)
- 2022RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generationcited by 162
- 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Modelscited by 160
- 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 120
- 2024STAG4D: Spatial-Temporal Anchored Generative 4D Gaussianscited by 102
- 2025Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstructioncited by 66
- 20244Real: Towards Photorealistic 4D Scene Generation via Video Diffusion Modelscited by 64
- 2024StereoCrafter: Diffusion-based Generation of Long and High-fidelity Stereoscopic 3D from Monocular Videoscited by 36
- 2024Diffusion Priors for Dynamic View Synthesis from Monocular Videoscited by 18
- 2023DynVideo-E: Harnessing Dynamic NeRF for Large-Scale Motion- and View-Change Human-Centric Video Editingcited by 17
- 20244Dynamic: Text-to-4D Generation with Hybrid Priorscited by 15
- 2025Reconstruct, Inpaint, Test-Time Finetune: Dynamic Novel-view Synthesis from Monocular Videoscited by 13
- 2024ExtraNeRF: Visibility-Aware View Extrapolation of Neural Radiance Fields with Diffusion Modelscited by 12
12 most cited of 20 All 20 (JSON)
- 2026UniWorld-View: Large-Baseline View Synthesis via Video Diffusion Models5 Aug 2026
- 2026ReFlow: Self-correction Motion Learning for Dynamic Scene Reconstruction2 Apr 2026
- 2025SpaceTimePilot: Generative Rendering of Dynamic Scenes Across Space and Time31 Dec 2025
- 2025Yesnt: Are Diffusion Relighting Models Ready for Capture Stage Compositing? A Hybrid Alternative to Bridge the Gap27 Oct 2025
- 2025Reconstruct, Inpaint, Test-Time Finetune: Dynamic Novel-view Synthesis from Monocular Videos16 Jul 2025
- 2025EscherNet++: Simultaneous Amodal Completion and Scalable View Synthesis through Masked Fine-Tuning and Enhanced Feed-Forward 3D Reconstruction10 Jul 2025
- 2025ViDAR: Video Diffusion-Aware 4D Reconstruction From Monocular Inputs23 Jun 2025
- 2025Dynamic View Synthesis as an Inverse Problem9 Jun 2025
- 2025Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstruction10 Apr 2025
- 2025Hierarchical Flow Diffusion for Efficient Frame Interpolation1 Apr 2025
- 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Models7 Mar 2025
- 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Models27 Nov 2024
12 newest of 20 All 20 (JSON)
- 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 218
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 185
- 2024OmniRe: Omni Urban Scene Reconstructioncited by 159
- 2024DriveDreamer4D: World Models Are Effective Data Machines for 4D Driving Scene Representationcited by 123
- 2024ReconDreamer: Crafting World Models for Driving Scene Reconstruction via Online Restorationcited by 89
- 2025ReconDreamer++: Harmonizing Generative and Reconstructive Models for Driving Scene Representationcited by 36
- 2024Dynamic 3D Gaussian Fields for Urban Areascited by 35
- 2025ReconDreamer++: Harmonizing Generative and Reconstructive Models for Driving Scene Representation24 Mar 2025
- 2024ReconDreamer: Crafting World Models for Driving Scene Reconstruction via Online Restoration29 Nov 2024
- 2024DriveDreamer4D: World Models Are Effective Data Machines for 4D Driving Scene Representation17 Oct 2024
- 2024OmniRe: Omni Urban Scene Reconstruction29 Aug 2024
- 2024Dynamic 3D Gaussian Fields for Urban Areas5 Jun 2024
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generation19 Apr 2024
- 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splatting2 Jan 2024
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
12 most cited of 719 All 719 (JSON)
- 2026A Compact Explicit 4D Representation for Dynamic Scenes1 Oct 2026
- 2026Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstruction30 Sep 2026
- 2026Accurate Motion Estimation with B'ezier Control Point for Efficient Frame Interpolation20 Sep 2026
- 2026SplashSplat: Reconstructing Splashing Liquids from Real-World Multi-View Videos17 Sep 2026
- 2026DecoGS: Adaptive Static-Dynamic Decoupling of 3D Gaussians for Free-Viewpoint Video Streaming15 Sep 2026
- 2026Tele360: Real-Time Feed-Forward Human Reconstruction from Sparse Unposed Cameras14 Sep 2026
- 2026SignMimic: Robust High-Quality Sign Language Motion Generation via Human-Shape-Oblivious Pose Transfer Guidance12 Sep 2026
- 2026PASTEL: Panoramic Alignment for Monocular 4D Scene Reconstruction5 Sep 2026
- 2026SMG: Semantic Motion Graph for Monocular Dynamic Gaussian Splatting31 Aug 2026
- 2026LagrangeGS: Non-Conservative Lagrangian System on Dynamic 3D Gaussian Splatting24 Aug 2026
- 2026ASTRA: Asynchronous Spatio-Temporal Reconstruction via Trajectory Alignment3 Aug 2026
- 2026FillGS: Filling Observation Gaps in 4D Gaussian Splatting via Viewpoint-Time Selection and Generative Refinement31 Jul 2026
12 newest of 719 All 719 (JSON)