Neural Radiance Flow for 4D View Synthesis and Video Processing
Not on the map. Why?
Abstract (arXiv)
We present a method, Neural Radiance Flow (NeRFlow),to learn a 4D spatial-temporal representation of a dynamic scene from a set of RGB images. Key to our approach is the use of a neural implicit representation that learns to capture the 3D occupancy, radiance, and dynamics of the scene. By enforcing consistency across different modalities, our representation enables multi-view rendering in diverse dynamic scenes, including water pouring, robotic interaction, and real images, outperforming state-of-the-art methods for spatial-temporal view synthesis. Our approach works even when inputs images are captured with only one camera. We further demonstrate that the learned representation can serve as an implicit scene prior, enabling video processing tasks such as image super-resolution and de-noising without any additional supervision.
Key facts. Cited by 270 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 22; 2022: 45; 2023: 69; 2024: 69; 2025: 42; 2026: 23.
270 papers.
Sort:
By area:
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2021Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughscited by 396
- 2021Advances in Neural Renderingcited by 365
- 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
- 2023FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularizationcited by 310
- 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
38 more
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
- 2022Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representationcited by 243
- 2021DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networkscited by 232
- 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
- 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
- 2021Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulationcited by 204
- 2023Text-To-4D Dynamic Scene Generationcited by 204
- 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 199
- 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 191
- 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 185
- 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 177
- 2021NEAT: Neural Attention Fields for End-to-End Autonomous Drivingcited by 174
- 2022Fourier PlenOctrees for Dynamic Radiance Field Rendering in Real-timecited by 164
- 2022Instant Volumetric Head Avatarscited by 157
- 2022NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fieldscited by 151
- 2023SUDS: Scalable Urban Dynamic Scenescited by 151
- 2024WildGaussians: 3D Gaussian Splatting in the Wildcited by 150
- 2022D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Videocited by 136
- 2022Mixed Neural Voxels for Fast Multi-view Video Synthesiscited by 126
- 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 116
- 2021HDR-NeRF: High Dynamic Range Neural Radiance Fieldscited by 113
- 2021NeRF-VAE: A Geometry Aware 3D Scene Generative Modelcited by 111
- 20213D Neural Scene Representations for Visuomotor Controlcited by 110
- 2021Light Field Neural Renderingcited by 108
- 2024FreGS: 3D Gaussian Splatting with Progressive Frequency Regularizationcited by 103
- 2024STAG4D: Spatial-Temporal Anchored Generative 4D Gaussianscited by 102
- 2023RobustNeRF: Ignoring Distractors with Robust Lossescited by 101
- 2024Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstructioncited by 100
- 2021GANcraft: Unsupervised 3D Neural Rendering of Minecraft Worldscited by 98
- 2021Neural Scene Flow Priorcited by 91
- 2024NeRF On-the-go: Exploiting Uncertainty for Distractor-free NeRFs in the Wildcited by 85
- 2023Neural Residual Radiance Fields for Streamably Free-Viewpoint Videoscited by 77
- 2021Learning to Stylize Novel Viewscited by 76
- 2023Learning Neural Volumetric Representations of Dynamic Humans in Minutescited by 70
- 2021SIMONe: View-Invariant, Temporally-Abstracted Object Representations via Unsupervised Video Decompositioncited by 69
- 2022AdaNeRF: Adaptive Sampling for Real-time Rendering of Neural Radiance Fieldscited by 68
- 2024ReCapture: Generative Video Camera Controls for User-Provided Videos using Masked Video Fine-Tuningcited by 68
- 2023Forward Flow for Novel View Synthesis of Dynamic Scenescited by 67
50 most cited of 270 All 270 (JSON)
- 2026Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstruction30 Sep 2026
- 2026SMG: Semantic Motion Graph for Monocular Dynamic Gaussian Splatting31 Aug 2026
- 2026ATGS: Anchored Temporal Gaussian Splatting for Long Volumetric Video Representation31 Aug 2026
- 2026ERF-GS: Reconstructing Fast Motion from Disjoint Event-RGB Viewpoints9 Aug 2026
- 2026Hallo4D: Multi-Modal Hallucination Mitigation for Consistent Spatio-Temporal Generation14 Jul 2026
- 2026Learning Efficient 4D Gaussian Representations from Monocular Videos with Flow Splatting29 Jun 2026
- 2026DLGStream: Dynamic Language-embedded Guassian Splatting for Open-vocabulary Enabled Free-viewpoint Video Streaming27 Jun 2026
- 2026Learning Global Motion with Compact Gaussians for Feed-Forward 4D Reconstruction29 May 2026
- 2026RiGS: Rigid-aware 4D Gaussian Splatting from a Single Monocular Video22 May 2026
- 2026DySurface: Consistent 4D Surface Reconstruction via Bridging Explicit Gaussians and Implicit Functions11 May 2026
- 2026Kinematics-Driven Gaussian Shape Deformation for Blurry Monocular Dynamic Scenes9 May 2026
- 2026GeoRect4D: Geometry-Compatible Generative Rectification for Dynamic Sparse-View 3D Reconstruction22 Apr 2026
38 more
- 2026D-Prism: Differentiable Primitives for Structured Dynamic Modeling18 Apr 2026
- 2026PartNerFace: Part-based Neural Radiance Fields for Animatable Facial Avatar Reconstruction15 Apr 2026
- 2026GP-4DGS: Probabilistic 4D Gaussian Splatting from Monocular Video via Variational Gaussian Processes3 Apr 2026
- 2026DiffWind: Physics-Informed Differentiable Modeling of Wind-Driven Object Dynamics10 Mar 2026
- 2026Time-Archival Camera Virtualization for Sports and Visual Performances16 Feb 2026
- 2026MotionCrafter: Dense Geometry and Motion Reconstruction with a 4D VAE9 Feb 2026
- 2026Grow with the Flow: 4D Reconstruction of Growing Plants with Gaussian Flow Fields9 Feb 2026
- 2026Constrained Dynamic Gaussian Splatting3 Feb 2026
- 2026Revisiting 3D Reconstruction Kernels as Low-Pass Filters25 Jan 2026
- 2026MOSAIC-GS: Monocular Scene Reconstruction via Advanced Initialization for Complex Dynamic Environments8 Jan 2026
- 2026Mesh4D: 4D Mesh Reconstruction and Tracking from Monocular Video8 Jan 2026
- 2025Prior-Enhanced Gaussian Splatting for Dynamic Scene Reconstruction from Casual Video12 Dec 2025
- 2025Gaussians on Fire: High-Frequency Reconstruction of Flames27 Nov 2025
- 2025Dynamic Avatar-Scene Rendering from Human-centric Context13 Nov 2025
- 2025Physics-Informed Deformable Gaussian Splatting: Towards Unified Constitutive Laws for Time-Evolving Material Field9 Nov 2025
- 2025StreamSTGS: Streaming Spatial and Temporal Gaussian Grids for Real-Time Free-Viewpoint Video8 Nov 2025
- 2025See4D: Pose-Free 4D Generation via Auto-Regressive Video Inpainting30 Oct 2025
- 2025Advances in 4D Representation: Geometry, Motion, and Interaction22 Oct 2025
- 2025DEGS: Deformable Event-based 3D Gaussian Splatting from RGB and Event Stream9 Oct 2025
- 20254D-MoDe: Towards Editable and Scalable Volumetric Streaming via Motion-Decoupled 4D Gaussian Compression22 Sep 2025
- 2025Maps for Autonomous Driving: Full-process Survey and Frontiers16 Sep 2025
- 2025TRACE: Learning 3D Gaussian Physical Dynamics from Multi-view Videos13 Aug 2025
- 2025Laplacian Analysis Meets Dynamics Modelling: Gaussian Splatting for 4D Reconstruction7 Aug 2025
- 2025Affine-Equivariant Kernel Space Encoding for NeRF Editing4 Aug 2025
- 2025Enhanced Velocity Field Modeling for Gaussian Video Reconstruction31 Jul 2025
- 2025Reconstructing 4D Spatial Intelligence: A Survey28 Jul 2025
- 2025DASH: 4D Hash Encoding with Self-Supervised Decomposition for Real-Time Dynamic Scene Rendering25 Jul 2025
- 2025DBMovi-GS: Dynamic View Synthesis from Blurry Monocular Video via Sparse-Controlled Gaussian Splatting26 Jun 2025
- 2025Metropolis-Hastings Sampling for 3D Gaussian Reconstruction15 Jun 2025
- 2025DGS-LRM: Real-Time Deformable 3D Gaussian Reconstruction From Monocular Videos11 Jun 2025
- 2025SpeeDe3DGS: Speedy Deformable 3D Gaussian Splatting with Temporal Pruning and Motion Grouping9 Jun 2025
- 2025Layered Motion Fusion: Lifting Motion Segmentation to 3D in Egocentric Videos5 Jun 2025
- 2025ODE-GS: Latent ODEs for Dynamic Scene Extrapolation with 3D Gaussian Splatting5 Jun 2025
- 2025PhysGaia: A Physics-Aware Benchmark with Multi-Body Interactions for Dynamic Novel View Synthesis3 Jun 2025
- 2025Hi-Dyna Graph: Hierarchical Dynamic Scene Graph for Robotic Autonomy in Human-Centric Environments30 May 2025
- 2025PhyMAGIC: Physical Motion-Aware Generative Inference with Confidence-guided LLM22 May 2025
- 2025Advances in Radiance Field for Dynamic Scene: From Neural Field to Gaussian Field15 May 2025
- 2025TUGS: Physics-based Compact Representation of Underwater Scenes by Tensorized Gaussian12 May 2025
50 newest of 270 All 270 (JSON)
- 2024STAG4D: Spatial-Temporal Anchored Generative 4D Gaussianscited by 102
- 20244Real: Towards Photorealistic 4D Scene Generation via Video Diffusion Modelscited by 64
- 20244Dynamic: Text-to-4D Generation with Hybrid Priorscited by 15
- 2025PhyMAGIC: Physical Motion-Aware Generative Inference with Confidence-guided LLMcited by 3
- 2025PhyMAGIC: Physical Motion-Aware Generative Inference with Confidence-guided LLM22 May 2025
- 20244Dynamic: Text-to-4D Generation with Hybrid Priors17 Jul 2024
- 20244Real: Towards Photorealistic 4D Scene Generation via Video Diffusion Models11 Jun 2024
- 2024STAG4D: Spatial-Temporal Anchored Generative 4D Gaussians22 Mar 2024
- 20233D Concept Learning and Reasoning from Multi-View Imagescited by 60
- 20233D Concept Learning and Reasoning from Multi-View Images20 Mar 2023
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2021Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughscited by 396
- 2021Advances in Neural Renderingcited by 365
- 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
- 2023FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularizationcited by 310
- 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
12 most cited of 263 All 263 (JSON)
- 2026Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstruction30 Sep 2026
- 2026SMG: Semantic Motion Graph for Monocular Dynamic Gaussian Splatting31 Aug 2026
- 2026ATGS: Anchored Temporal Gaussian Splatting for Long Volumetric Video Representation31 Aug 2026
- 2026ERF-GS: Reconstructing Fast Motion from Disjoint Event-RGB Viewpoints9 Aug 2026
- 2026Hallo4D: Multi-Modal Hallucination Mitigation for Consistent Spatio-Temporal Generation14 Jul 2026
- 2026Learning Efficient 4D Gaussian Representations from Monocular Videos with Flow Splatting29 Jun 2026
- 2026DLGStream: Dynamic Language-embedded Guassian Splatting for Open-vocabulary Enabled Free-viewpoint Video Streaming27 Jun 2026
- 2026Learning Global Motion with Compact Gaussians for Feed-Forward 4D Reconstruction29 May 2026
- 2026RiGS: Rigid-aware 4D Gaussian Splatting from a Single Monocular Video22 May 2026
- 2026DySurface: Consistent 4D Surface Reconstruction via Bridging Explicit Gaussians and Implicit Functions11 May 2026
- 2026Kinematics-Driven Gaussian Shape Deformation for Blurry Monocular Dynamic Scenes9 May 2026
- 2026GeoRect4D: Geometry-Compatible Generative Rectification for Dynamic Sparse-View 3D Reconstruction22 Apr 2026
12 newest of 263 All 263 (JSON)