D-NeRF: Neural Radiance Fields for Dynamic Scenes
Not on the map. Why?
Cited by 68 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Neural rendering techniques combining machine learning with geometric reasoning have arisen as one of the most promising approaches for synthesizing novel views of a scene from a sparse set of images. Among these, stands out the Neural radiance fields (NeRF), which trains a deep network to map 5D input coordinates (representing spatial location and viewing direction) into a volume density and view-dependent emitted radiance. However, despite achieving an unprecedented level of photorealism on the generated images, NeRF is only applicable to static scenes, where the same spatial location can be queried from different images. In this paper we introduce D-NeRF, a method that extends neural radiance fields to a dynamic domain, allowing to reconstruct and render novel images of objects under rigid and non-rigid motions from a single camera moving around the scene. For this purpose we consider time as an additional input to the system, and split the learning process in two main stages: one that encodes the scene into a canonical space and another that maps this canonical representation into the deformed scene at a particular time. Both mappings are simultaneously learned using fully-connected networks. Once the networks are trained, D-NeRF can render novel images, controlling both the camera view and the time variable, and thus, the object movement. We demonstrate the effectiveness of our approach on scenes with objects under rigid, articulated and non-rigid motions. Code, model weights and the dynamic scenes dataset will be released.
Key facts. Cited by 1,459 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 98; 2022: 200; 2023: 326; 2024: 366; 2025: 278; 2026: 191.
1,459 papers.
Sort:
By area:
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
38 more
- 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 596
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 510
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
- 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
- 2023LangSplat: 3D Language Gaussian Splattingcited by 410
- 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 369
- 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 368
- 2021Advances in Neural Renderingcited by 365
- 2023Compact 3D Gaussian Representation for Radiance Fieldcited by 365
- 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 363
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 359
- 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
- 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
- 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 311
- 2023FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularizationcited by 310
- 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2cited by 300
- 2023Text-to-3D using Gaussian Splattingcited by 299
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 283
- 20223D Neural Field Generation using Triplane Diffusioncited by 274
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 256
- 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
- 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 246
- 2022Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representationcited by 243
- 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
- 2021DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networkscited by 232
- 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 230
- 2021BungeeNeRF: Progressive Neural Radiance Field for Extreme Multi-scale Scene Renderingcited by 228
- 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
- 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
- 2024A Survey on 3D Gaussian Splattingcited by 221
- 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
50 most cited of 1,459 All 1,459 (JSON)
- 2026Dyna3: VLM-Guided Training-Free 4D Reconstruction via Depth Foundation Models1 Oct 2026
- 2026A Compact Explicit 4D Representation for Dynamic Scenes1 Oct 2026
- 2026Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstruction30 Sep 2026
- 2026PartiCam: Camera Controlled Video Generation with Reward Guidance30 Sep 2026
- 2026Eulerian Motion Reconstruction for Water Scenery29 Sep 2026
- 2026DispFlow-GS: Displacement Flow Supervision with Motion Disentangling for Monocular Deformable 3D Gaussian Splatting29 Sep 2026
- 2026ProDyGS: Dynamic Gaussian Splatting from a Single Static Monocular Camera26 Sep 2026
- 2026GaussPDE: Graph-Based Partial Differential Equation-Driven Rendering for 3D Gaussian Splatting23 Sep 2026
- 2026GARO: Geometry-Aware Redundancy Optimization for Real-Time and High-Fidelity Dynamic Gaussian Splatting20 Sep 2026
- 2026Can 4D Foundation Models Remember?17 Sep 2026
- 2026SplashSplat: Reconstructing Splashing Liquids from Real-World Multi-View Videos17 Sep 2026
- 2026DecoGS: Adaptive Static-Dynamic Decoupling of 3D Gaussians for Free-Viewpoint Video Streaming15 Sep 2026
38 more
- 2026Racing in Volume with Flow Ensembles14 Sep 2026
- 2026What Makes a 3D Scene Editable? A Factorized Benchmark of Fidelity, Locality, Consistency, and Preservation14 Sep 2026
- 2026VideoTok4D: A 4D-Aware Video Tokenizer for Compact World Representation11 Sep 2026
- 2026Is Gaussian Splatting Becoming Neural Again? A Taxonomy and Controlled Study of Learned Parameterization11 Sep 2026
- 2026RouteBridge: Reliability-Routed Bidirectional Distillation Between Neural Radiance Fields and 3D Gaussian Splatting9 Sep 2026
- 2026EdMCGS: Event-Driven Markov Chain Gaussian Splatting for Extreme-Low-Frame-Rate Dynamic Scene Reconstruction8 Sep 2026
- 2026PASTEL: Panoramic Alignment for Monocular 4D Scene Reconstruction5 Sep 2026
- 2026UniFusion: Sparse-View 4D Reconstruction via Unified Spatio-temporal Depth Alignment5 Sep 2026
- 2026CC-4DGS: Computational Deformation and Point-Cloud Compression for Storage-Efficient Dynamic Gaussian Splatting2 Sep 2026
- 2026ToCo-Mesh: Topology-Consistent Dynamic Mesh Reconstruction via Adaptive Tessellation and Surface-Aligned 2DGS1 Sep 2026
- 2026SMG: Semantic Motion Graph for Monocular Dynamic Gaussian Splatting31 Aug 2026
- 2026ATGS: Anchored Temporal Gaussian Splatting for Long Volumetric Video Representation31 Aug 2026
- 2026FractureFields: Contact-Aware Binary Multi-Field Transfer for Fractured 3D Gaussian Simulation29 Aug 2026
- 2026Stochastic Liquid Deformation Fields: An SDE Generalisation of Closed-Form Continuous-Time Cells for Dynamic 3D Gaussian Splatting27 Aug 2026
- 2026Code as Worlds: Agentic Discovery of Executable World Representations for Physical Reasoning27 Aug 2026
- 20264DGS-JEPA: Temporally Compositional Joint-Embedding Prediction for Dynamic Gaussian Splatting24 Aug 2026
- 2026LagrangeGS: Non-Conservative Lagrangian System on Dynamic 3D Gaussian Splatting24 Aug 2026
- 2026Seeing the Unseen: Semantic-in-Gaussian for Sparse-View 3D Generalization24 Aug 2026
- 2026Towards Alias-Free 4D Gaussian Representations with Motion-Aware Filtering22 Aug 2026
- 2026Sparse Light Field Sampling Improves Casual 3D and 4D Reconstruction20 Aug 2026
- 2026SemanticSlider3D: Training-Free Continuous Semantic Editing for 3D Objects19 Aug 2026
- 2026DyG2T: Modeling Object Dynamics with 3D Gaussian Temporal-Spatial Particle Graph Transformer19 Aug 2026
- 2026QuARC-GS: Quantized Anchored Residual Coding for Compact Dynamic Scene Streaming with Gaussian Splatting18 Aug 2026
- 2026NGS-Marker: Robust Native Watermarking for 3D Gaussian Splatting18 Aug 2026
- 2026LaGSplat: Inferring Physics-Governed Interactive Simulation from Monocular Video Using Latent Lagrangian Gaussian Splatting17 Aug 2026
- 2026DSAR: Dual-Stream Autoregressive Modeling of Temporal Cloth Dynamics for Photorealistic Animatable Avatars11 Aug 2026
- 2026ERF-GS: Reconstructing Fast Motion from Disjoint Event-RGB Viewpoints9 Aug 2026
- 2026BendTwin: Robust Dense-to-Sparse Physical Reconstruction with Bending-Aware Differentiable Spring-Mass Models6 Aug 2026
- 2026UniWorld-View: Large-Baseline View Synthesis via Video Diffusion Models5 Aug 2026
- 2026D'ej`a Cue: Localizing States in Object Histories via Vocabulary-Relative Coordinates3 Aug 2026
- 2026ASTRA: Asynchronous Spatio-Temporal Reconstruction via Trajectory Alignment3 Aug 2026
- 2026FillGS: Filling Observation Gaps in 4D Gaussian Splatting via Viewpoint-Time Selection and Generative Refinement31 Jul 2026
- 2026Endo-NeRF++: Uncertainty-Aware Neural Rendering with Multi-Resolution Hash Encoding for Dynamic Surgical Scene Reconstruction30 Jul 2026
- 20264DHumanDiff: Direct Text-to-4DGS Generation for Consistent 360-Degree Dynamic Humans30 Jul 2026
- 20263DGBGS: 3D Granular Ball Gaussian Splatting for Compact Novel View Synthesis29 Jul 2026
- 2026Future Rendering neq Future Surface: A Benchmark and Dataset for Dynamic Surface Reconstruction Beyond the Observed Window23 Jul 2026
- 2026GrainGS: Gradient-Decoupled Gaussian Splatting for Efficient Dynamic Novel View Synthesis23 Jul 2026
- 2026PhysCoRe: Physics-Corrected Residual World Models for Material-Aware Deformable Dynamics22 Jul 2026
50 newest of 1,459 All 1,459 (JSON)
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 283
- 20223D Neural Field Generation using Triplane Diffusioncited by 274
- 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
- 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Modelscited by 160
- 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
- 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 143
- 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 120
- 2023A Unified Approach for Text- and Image-guided 4D Scene Generationcited by 82
- 2024NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizercited by 79
- 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondencecited by 69
- 2025Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstructioncited by 66
- 20244Real: Towards Photorealistic 4D Scene Generation via Video Diffusion Modelscited by 64
12 most cited of 68 All 68 (JSON)
- 2026PartiCam: Camera Controlled Video Generation with Reward Guidance30 Sep 2026
- 2026UniWorld-View: Large-Baseline View Synthesis via Video Diffusion Models5 Aug 2026
- 2026Ocean4D: Generative Underwater 4D Reconstruction via Medium-Aware Video Diffusion22 Jun 2026
- 2026Flex4DHuman: Flexible Multi-view Video Diffusion for 4D Human Reconstruction11 Jun 2026
- 2026PointAction: 3D Points as Universal Action Representations for Robot Control2 Jun 2026
- 2026R-DMesh: Video-Guided 3D Animation via Rectified Dynamic Mesh Flow13 May 2026
- 2026ViPS: Video-informed Pose Spaces for Auto-Rigged Meshes19 Apr 2026
- 2026ReFlow: Self-correction Motion Learning for Dynamic Scene Reconstruction2 Apr 2026
- 2026Intrinsic Geometry-Appearance Consistency Optimization for Sparse-View Gaussian Splatting3 Mar 2026
- 2025Instant Expressive Gaussian Head Avatars at Over 100 FPS18 Dec 2025
- 2025Splatent: Splatting Diffusion Latents for Novel View Synthesis10 Dec 2025
- 2025Dynamic-eDiTor: Training-Free Text-Driven 4D Scene Editing with Multimodal Diffusion Transformer30 Nov 2025
12 newest of 68 All 68 (JSON)
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 185
- 2024OmniRe: Omni Urban Scene Reconstructioncited by 159
- 2024textitS3Gaussian: Self-Supervised Street Gaussians for Autonomous Drivingcited by 105
- 2024DeSiRe-GS: 4D Street Gaussians for Static-Dynamic Decomposition and Surface Reconstruction for Urban Driving Scenescited by 45
- 2024Dynamic 3D Gaussian Fields for Urban Areascited by 35
- 2024DreamDrive: Generative 4D Scene Modeling from Street View Imagescited by 35
- 2023UniWorld: Autonomous Driving Pre-training via World Modelscited by 32
- 2024VDG: Vision-Only Dynamic Gaussian for Driving Simulationcited by 16
- 2026Flow Equivariant World Models: Memory for Partially Observed Dynamic Environmentscited by 6
- 2025From 2D to 3D Cognition: A Brief Survey of General World Modelscited by 4
- 2025Visionary: The World Model Carrier Built on WebGPU-Powered Gaussian Splatting Platformcited by 1
- 2026PhysCoRe: Physics-Corrected Residual World Models for Material-Aware Deformable Dynamicscited by 1
12 most cited of 13 All 13 (JSON)
- 2026PhysCoRe: Physics-Corrected Residual World Models for Material-Aware Deformable Dynamics22 Jul 2026
- 2026Flow Equivariant World Models: Memory for Partially Observed Dynamic Environments3 Jan 2026
- 2025Visionary: The World Model Carrier Built on WebGPU-Powered Gaussian Splatting Platform9 Dec 2025
- 2025Generalized Dynamics Generation towards Scannable Physical World Model16 Oct 2025
- 2025From 2D to 3D Cognition: A Brief Survey of General World Models25 Jun 2025
- 2024DreamDrive: Generative 4D Scene Modeling from Street View Images31 Dec 2024
- 2024DeSiRe-GS: 4D Street Gaussians for Static-Dynamic Decomposition and Surface Reconstruction for Urban Driving Scenes18 Nov 2024
- 2024OmniRe: Omni Urban Scene Reconstruction29 Aug 2024
- 2024VDG: Vision-Only Dynamic Gaussian for Driving Simulation26 Jun 2024
- 2024Dynamic 3D Gaussian Fields for Urban Areas5 Jun 2024
- 2024textitS3Gaussian: Self-Supervised Street Gaussians for Autonomous Driving30 May 2024
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generation19 Apr 2024
12 newest of 13 All 13 (JSON)
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
12 most cited of 1,371 All 1,371 (JSON)
- 2026Dyna3: VLM-Guided Training-Free 4D Reconstruction via Depth Foundation Models1 Oct 2026
- 2026A Compact Explicit 4D Representation for Dynamic Scenes1 Oct 2026
- 2026Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstruction30 Sep 2026
- 2026Eulerian Motion Reconstruction for Water Scenery29 Sep 2026
- 2026DispFlow-GS: Displacement Flow Supervision with Motion Disentangling for Monocular Deformable 3D Gaussian Splatting29 Sep 2026
- 2026ProDyGS: Dynamic Gaussian Splatting from a Single Static Monocular Camera26 Sep 2026
- 2026GaussPDE: Graph-Based Partial Differential Equation-Driven Rendering for 3D Gaussian Splatting23 Sep 2026
- 2026GARO: Geometry-Aware Redundancy Optimization for Real-Time and High-Fidelity Dynamic Gaussian Splatting20 Sep 2026
- 2026Can 4D Foundation Models Remember?17 Sep 2026
- 2026SplashSplat: Reconstructing Splashing Liquids from Real-World Multi-View Videos17 Sep 2026
- 2026DecoGS: Adaptive Static-Dynamic Decoupling of 3D Gaussians for Free-Viewpoint Video Streaming15 Sep 2026
- 2026Racing in Volume with Flow Ensembles14 Sep 2026
12 newest of 1,371 All 1,371 (JSON)